Senior Lead Azure Data Engineer - Data Factory / Synapse / Databricks
What you will be doing
- Provide technical leadership and guidance to a team of data engineers, fostering a culture of excellence, collaboration, and accountability.
- Stay hands-on in development, performing reviews and validations to ensure quality, scalability, and performance across all deliverables.
- Design, develop, and maintain data pipelines and ETL processes using Azure Data Factory and Databricks (PySpark).
- Build and optimize data lake and data warehouse solutions using Delta Lake and Synapse Analytics (serverless).
- Define and enforce engineering standards, code reviews, and best practices across the team.
- Collaborate closely with architects and stakeholders to define and evolve data architecture and solution design.
- Ensure data quality, performance tuning, and cost optimization across Azure components.
- Automate data ingestion, transformation, and orchestration processes to improve reliability and operational efficiency.
- Partner with data scientists, analysts, and business teams to translate complex data requirements into robust, scalable solutions.
- Stay current with emerging technologies and innovations within the Azure and Databricks ecosystems.
- Stay hands-on in development, performing reviews and validations to ensure quality, scalability, and performance across all deliverables.
- Design, develop, and maintain data pipelines and ETL processes using Azure Data Factory and Databricks (PySpark).
- Build and optimize data lake and data warehouse solutions using Delta Lake and Synapse Analytics (serverless).
- Define and enforce engineering standards, code reviews, and best practices across the team.
- Collaborate closely with architects and stakeholders to define and evolve data architecture and solution design.
- Ensure data quality, performance tuning, and cost optimization across Azure components.
- Automate data ingestion, transformation, and orchestration processes to improve reliability and operational efficiency.
- Partner with data scientists, analysts, and business teams to translate complex data requirements into robust, scalable solutions.
- Stay current with emerging technologies and innovations within the Azure and Databricks ecosystems.