We are looking for a highly skilled and experienced Azure Data Engineer with strong expertise in Azure Databricks, Azure Data Factory, PySpark, and Azure Synapse Analytics. The ideal candidate will be responsible for designing and building scalable data solutions, performing advanced data transformation and integration tasks, and contributing to the overall data architecture and strategy.

Key Responsibilities

Design and develop scalable and optimized data pipelines using Azure Data Factory and Azure Databricks
Write efficient and reusable PySpark code for data transformations
Build and maintain data integration workflows to support various business needs
Implement and manage Azure Synapse for data warehousing and advanced analytics
Optimize data processing workflows for performance and cost efficiency
Collaborate with data scientists, analysts, and other engineers to ensure data quality and integrity
Develop and maintain technical documentation and best practices

Must-Have Skills

Azure Databricks – strong experience in building and orchestrating notebooks, clusters, and workflows
Azure Data Factory (ADF) – expertise in creating and managing pipelines and data flows
PySpark – strong programming skills for big data processing
Azure Synapse Analytics – solid understanding of data warehousing concepts and analytics