A Software Development Engineer II in the Ads Data team will be working on implementing large scale data solutions for Hotstar’s data-driven initiatives, enabling us to provide personalised, seamless, and delightful experiences to millions of users worldwide.The engineer will be working closely with the tech leads of the team to ensure we build data products that solve a variety of use-cases for the organization.

ABOUT THE TEAM: The Ads Data Platform builds and maintains the tools that power our data-driven insights. This includes our petabyte-scale data ingestion system, Kafka infrastructure, query engines (Hive, Presto, Spark, Flink), real-time monitoring, and Airflow for orchestration. The Ads Data team empowers Disney+ Hotstar’s reporting for internal and external parties.

REPORTING TO: Engineering Manager

KEY RESPONSIBILITIES

• • Build the simplest possible solution that fulfils data world need as well as meets functional, compliance and quality requirements, making sure to deliver solutions on time and identify and eliminate potential waste
  • Develop and maintain data-centric applications and tools to support data ingestion, storage, transformation, and analysis
  • Collaborate with product managers, data scientists and analysts to understand requirements and translate them into technical solutions
  • Optimise data workflows and algorithms for performance, reliability, and scalability
  • Participate in Agile development processes, including sprint planning, daily stand-ups, and retrospectives
  • Ability to support hyper growth systems across multiple geographies and regions

SKILLS & ATTRIBUTES FOR SUCCESS

•  

  Preferred Additional Skills:

  • Prior experience working with product teams to build Data Products at scale
  • In-depth understanding and experience in working with high scale Data lake house systems like Databricks
  • Hands-on experience in Data technologies like Apache Spark, SQL, Airflow and Kafka connects
  • Strong understanding of Data storage formats like Parquet, Hudi, Delta etc.
  • Strong programming skills in 1 or more of the following languages: Python, Scala, Go, Java
  • Excellent teamwork and communication skills, with the ability to work effectively in a fast-paced, agile environment
  • Experience with streaming data processing technologies such as Apache Kafka, Elastic search, Spark Streaming
  • Experience with platform and cloud infrastructure technologies such as AWS S3
  • Experience with Terraform for spawning infrastructure