Data Engineer - SPARK, SCALA AND AWS(Job No 969)

Big Data Engineer - AWS

Job Summary:

We are seeking a talented Big Data Engineer with expertise in AWS to join our team. The ideal candidate will be responsible for designing, developing, and maintaining big data solutions on AWS. This role requires a deep understanding of big data technologies, cloud architecture, and best practices in data engineering.

Responsibilities:

• Design, develop, and maintain big data solutions using AWS services.

• Implement data processing architectures, including data ingestion, storage, processing, and analysis.

• Collaborate with cross-functional teams to define data requirements and deliver solutions.

• Ensure scalability, security, and cost-effectiveness of data solutions.

• Develop and maintain ETL pipelines to process large volumes of data.

• Monitor and optimize data workflows for performance and reliability.

• Troubleshoot and resolve data-related issues in a timely manner.

• Create and maintain documentation for data solutions and processes.

Qualifications:

• Bachelor’s degree in Computer Science, Information Technology, or a related field.

• 3+ years of experience in big data engineering.

• Proven experience with AWS services such as EMR, S3, Redshift, Lambda, and Glue.

• Strong understanding of big data technologies like Hadoop, Spark, and Kafka.

• Experience with data modeling, ETL processes, and data warehousing.

• Proficiency in programming languages such as Python, Java, or Scala.

• Excellent problem-solving skills and attention to detail.

• Ability to work independently as well as part of a team.

Skills:

✔ Proficiency in AWS big data services (EMR, S3, Redshift, Lambda, Glue)
✔ Strong knowledge of big data technologies (Hadoop, Spark, Kafka)
✔ Experience with ETL tools and processes
✔ Familiarity with data modeling and data warehousing concepts
✔ Excellent communication and collaboration skills
✔ Ability to manage multiple tasks and projects simultaneously