AWS Glue Data Engineer(RARR Job 5208)

We are looking for a skilled Data Engineer with strong experience in AWS Glue, AWS Lambda, PySpark, Python, and SQL to design, build, and maintain robust data pipelines and ETL processes. The ideal candidate will have a deep understanding of cloud-based data engineering and hands-on experience in working with large-scale data processing frameworks.

Key Responsibilities:

• Develop and maintain scalable and secure ETL pipelines using AWS Glue and PySpark.

• Create and manage Lambda functions for event-driven data processing.

• Write optimized SQL queries for data extraction, transformation, and loading.

• Collaborate with Data Scientists, Analysts, and cross-functional teams to support data needs.

• Design, implement, and monitor data quality and data validation processes.

• Optimize the performance of data processing workflows.

• Ensure best practices in code quality, testing, and documentation.

Mandatory Skills:

• AWS Glue – Experience in developing and orchestrating ETL jobs

• AWS Lambda – Hands-on with serverless data processing

• PySpark – Strong understanding of Spark with Python for big data transformation

• Python – Proficient in scripting and data manipulation

• SQL – Advanced query writing and data handling