Data Ingestion Engineer (RARR Job 6408)

We are looking for a Data Ingestion Engineer to design and build scalable data ingestion pipelines for extracting, transforming, and loading XML and PDF data into Microsoft Fabric EDW. The ideal candidate will have expertise in Microsoft Fabric, PySpark, data transformation, and Lakehouse architecture.

Key Responsibilities

• Build and maintain data ingestion pipelines using Microsoft Fabric.
• Extract, parse, and transform XML and PDF data.
• Load data into Bronze, Silver, and Gold Lakehouse layers.
• Develop reusable ingestion frameworks and automate workflows.
• Implement incremental loads, error handling, and data validation.
• Optimize Spark/PySpark processing and Delta Lake performance.
• Collaborate with architects, BI teams, and business stakeholders.
• Maintain data mappings, documentation, and governance standards.