A Software Development Engineer II in the Data Platform team will be working on implementing large scale data solutions for Hotstar’s data-driven initiatives, enabling us to provide personalized, seamless, and delightful experiences to millions of users worldwide.The engineer will be working closely with the tech leads of the team to ensure we build data products that solve a variety of use-cases for the organization.

ABOUT THE TEAM:

The Data Platform team builds and maintains the tools that power our data-driven insights. This includes our petabyte-scale data ingestion system, Kafka infrastructure, query engines (Hive, Presto, Spark, Flink), real-time monitoring, and Airflow for orchestration. The Data Platform team empowers Disney+ Hotstar's product and engineering teams with critical data insights at massive scale.

Key Responsibilities

• Responsible for implementing scalable, robust, and high-performance data processing pipelines and services to build data products for a variety of product teams
• Develop and maintain data-centric applications and tools to support data ingestion, storage, transformation, and analysis
• Collaborate with product managers, data scientists and analysts to understand requirements and translate them into technical solutions
• Optimize data workflows and algorithms for performance, reliability, and scalability
• Participate in Agile development processes, including sprint planning, daily stand-ups, and retrospectives
• Ability to support hyper growth systems across multiple geographies and regions

Skills & Attributes for success

• Prior experience working with product teams to build Data Products at scale.
• In-depth understanding and experience in working with high scale Data lakehouse systems like Databricks.
• Hands-on experience in Data technologies like Apache Spark, SQL, Airflow, Kafka and Kafka connects.
• Strong understanding of Data storage formats like Parquet, Hudi, Delta etc.
• Strong programming skills in 1 or more of the following languages: Python, Scala, Go, Java.
• Excellent teamwork and communication skills, with the ability to work effectively in a fast-paced, agile environment.