Sr. Big Data Support Engineer (NCS/Job/ 2494)

Shift:

Weekdays :  Shift one : 7.30 AM to 5.30 PM

Shift two : 11.00 AM to 8:00 PM

Job Description:
We are seeking an experienced Senior Big Data Support Engineer to provide production and application support for large-scale Big Data platforms. The candidate should have strong expertise in Hadoop ecosystem, SQL, Unix, and scripting, along with a solid understanding of data pipelines, ETL workflows, and cluster performance tuning.

Key Responsibilities:

• Provide L2/L3 production support for Big Data applications and data pipelines.

• Monitor, troubleshoot, and resolve issues in Hadoop and Spark ecosystems.

• Perform root cause analysis (RCA) for recurring incidents and ensure permanent fixes.

• Manage and support data ingestion, ETL jobs, and batch/real-time processes.

• Optimize and tune Hadoop/Spark jobs for better performance.

• Develop and maintain Unix/Shell/Python scripts for automation and operational efficiency.

• Coordinate with development, DevOps, and infrastructure teams for deployments and configuration management.

• Maintain incident and change logs, prepare dashboards, and participate in post-mortem reviews.

Required Skills:

• Strong hands-on experience in Big Data ecosystems – Hadoop, HDFS, Hive, Spark, Oozie, Sqoop, Kafka, or HBase.

• Proficiency in SQL and data analysis for issue diagnosis and validation.

• Experience with Unix/Linux systems and Shell scripting.

• Working knowledge of Python or PowerShell for automation.

• Familiarity with monitoring tools (Grafana, Splunk, Cloudera Manager, Ambari, or Datadog).

• Exposure to incident, problem, and change management processes.

• Strong analytical, troubleshooting, and communication skills.

Nice to Have:

• Experience in cloud-based Big Data platforms (AWS EMR, Azure HDInsight, GCP Dataproc).

• Understanding of CI/CD, Git, Jenkins, or Ansible.

• Knowledge of data governance, security, or data lake implementations.

• Experience leading a small support or operations team.