We are seeking a highly skilled and motivated Data Engineer with expertise in Databricks to join our team. The Data Engineer will be responsible for designing, developing, and maintaining our data infrastructure and systems using Databricks. This role will involve working closely with cross-functional teams to ensure the availability, reliability, and scalability of our data pipelines and analytics platforms

Your Responsibilities

•    Design, build, and maintain scalable data pipelines and ETL processes using Databricks to collect, transform, and load data from various sources into our data warehouse.
•    Collaborate with data scientists, analysts, and other stakeholders to understand their data requirements and implement solutions to meet their needs using Databricks.
•    Prepare data for the advanced analysis e.g. ML modeling
•    Optimize and tune data pipelines and ETL processes in Databricks for performance and efficiency.
•    Develop and maintain data models, schemas, and data dictionaries in Databricks.
•    Implement data quality checks and monitoring in Databricks to ensure data accuracy and integrity.
•    Troubleshoot and resolve data-related issues and incidents in Databricks.
•    Stay up-to-date with the latest trends and technologies in data engineering, specifically related to Databricks, and recommend improvements to our data infrastructure and systems
 

Who we are looking for

•    Bachelor's degree in Computer Science, Engineering, or a related field.
•    Proven experience as a Data Engineer or similar role, with expertise in Databricks.
•    Technical expertise with data models, data mining, and segmentation techniques
•    Strong programming skills in languages such as Python.
•    Experience with big data technologies such as Hadoop, Spark, or Kafka.
•    Proficiency in SQL and database technologies (e.g., MySQL, PostgreSQL, or Oracle).
•    Familiarity with cloud platforms (e.g., AWS, Azure, or GCP) and their data services.
•    Knowledge of data warehousing concepts and dimensional modeling.
•    Excellent problem-solving and analytical skills.
•    Strong communication and collaboration skills.
•    Data engineering certification (Databricks Data Engineer Associate) is a plus
 

Your preferred qualifications

What we offer

At Magna, you can expect an engaging and dynamic environment where you can help to develop industry-leading automotive technologies. We invest in our employees, providing them with the support and resources they need to succeed. As a member of our global team, you can expect exciting, varied responsibilities as well as a wide range of development prospects. Because we believe that your career path should be as unique as you are.