Cloudera Data Engineer (NCS/Job/ 2574)

Cloudera Data Engineer/Developer

• Develop, optimize, and manage data pipelines on the Cloudera CDP/CDH platform.
• Work with HDFS, Hive, Impala, HBase, Oozie, and other ecosystem tools.
• Configure and maintain Cloudera Manager, including services, clusters, and security settings.
• Perform cluster upgrades, patches, and capacity planning.

Data Engineering

• Build scalable ETL/ELT processes using Spark (Scala/Python), Hive, Kafka, NiFi, etc.
• Optimize Spark jobs for performance, memory usage, and reliability.
• Create reusable data ingestion frameworks and data standardization layers.
• Perform data modeling for structured and unstructured datasets.

Performance, Monitoring & Troubleshooting

• Monitor cluster health, performance metrics, and resource utilization.
• Debug and resolve issues across the Hadoop ecosystem (jobs, queues, nodes, services).
• Conduct root cause analysis and implement best practices for stability