Hadoop Developer(RARR Job 4844)

We are seeking a skilled Hadoop Developer with SQL to join our dynamic team. The ideal candidate will have experience in big data technologies and a strong background in SQL development. The role involves designing, developing, and maintaining data pipelines, ensuring efficient data processing and storage within a Hadoop ecosystem.

Key Responsibilities:

• Develop, implement, and optimize Hadoop-based data pipelines.

• Design and maintain scalable data processing solutions using HDFS, Hive, Spark, and MapReduce.

• Write and optimize complex SQL queries for data extraction, transformation, and loading (ETL).

• Work with Apache Hive, HBase, Sqoop, Flume, and other Hadoop ecosystem components.

• Monitor and troubleshoot Hadoop jobs to ensure high availability and performance.

• Collaborate with data analysts, data engineers, and business stakeholders to meet data requirements.

• Ensure data security and governance practices are followed.

• Develop and maintain technical documentation for data workflows and processes.

Required Skills & Qualifications:

• 3+ years of experience working with Hadoop ecosystem tools (HDFS, Hive, Spark, MapReduce, etc.).

• Strong expertise in SQL development and optimization.

• Hands-on experience with Apache Hive, HBase, Sqoop, Flume, and other Hadoop technologies.

• Proficiency in Java, Scala, or Python for data processing.

• Experience with ETL processes and data pipeline development.

• Familiarity with cloud platforms like AWS, Azure, or GCP is a plus.

• Strong analytical and problem-solving skills.

• Excellent communication and teamwork abilities.