Azure Data Factory (ADF) Developer (RARR Job 6239)

Role Overview
We are seeking a skilled Azure Data Factory (ADF) Developer to design, develop, and maintain scalable data integration and orchestration solutions on the Azure platform. The ideal candidate will have strong experience in data engineering, ETL/ELT processes, and cloud-based data pipelines.

Key Responsibilities

• Design, develop, and maintain data pipelines using Azure Data Factory
• Build and manage ETL/ELT workflows to ingest, transform, and load data from multiple sources
• Integrate data from various sources such as: 
  • Azure SQL Database / Synapse
  • Blob Storage / Data Lake
  • REST APIs and external systems
• Implement data orchestration and scheduling mechanisms
• Monitor, troubleshoot, and optimize pipeline performance
• Develop reusable components and parameterized pipelines
• Implement logging, monitoring, and error-handling frameworks
• Work with stakeholders to gather data requirements and translate them into technical solutions
• Ensure data quality, governance, and security best practices
• Collaborate with cross-functional teams (Data Engineers, Analysts, Architects)
• Support production deployments, releases, and maintenance

Required Skills & Qualifications
Technical Skills

• Strong experience in Azure Data Factory (ADF)
• Hands-on experience with: 
  • Azure Data Lake / Blob Storage
  • Azure SQL / Synapse Analytics
• Good knowledge of ETL/ELT concepts
• Proficiency in SQL and data transformation techniques
• Experience with: 
  • REST APIs integration
  • JSON, Parquet, CSV data formats
• Understanding of data partitioning, performance tuning, and optimization

Cloud & DevOps

• Familiarity with Azure services: 
  • Azure Functions
  • Logic Apps
• Event Grid (optional, good to have)
• Experience with CI/CD pipelines (Azure DevOps, Git)
• Knowledge of version control and branching strategies

Microsoft Excel Skills

• Proficiency in Microsoft Excel for data analysis and validation
• Experience with: 
  • Pivot Tables, Charts, and Dashboards
  • Advanced formulas (VLOOKUP, XLOOKUP, INDEX-MATCH, etc.)
  • Data cleansing and transformation techniques

Good to Have Skills

• Experience with Databricks / Spark / PySpark
• Experience in data migration and large-scale data processing
• Understanding of data security and