Jr. Big Data Support Engineer (NCS/Job/ 2493)

Shift:

Weekdays :  Shift one : 7.30 AM to 5.30 PM

Shift two : 11.00 AM to 20.00 PM

Job Description:
We are looking for a Junior Big Data Support Engineer to provide production and application support for big data platforms. The ideal candidate should have a strong understanding of Hadoop ecosystem components, SQL, Unix, and scripting, along with a keen interest in troubleshooting and data pipeline monitoring.

Key Responsibilities:

• Provide L1/L2 support for big data applications and pipelines.

• Monitor data ingestion, transformation, and job executions in Hadoop/Spark environments.

• Perform root cause analysis for data and job failures.

• Write and execute SQL queries to validate data and troubleshoot issues.

• Use Unix/Linux commands and shell scripts for operational tasks and automation.

• Coordinate with development and infrastructure teams for incident resolution and enhancements.

• Document recurring issues, workarounds, and standard operating procedures (SOPs).

• Support batch job scheduling and monitoring tools (e.g., Control-M, Autosys, Airflow).

Required Skills:

• Basic understanding of Big Data technologies – Hadoop, HDFS, Hive, Spark.

• Proficiency in SQL for data validation and troubleshooting.

• Hands-on experience with Unix/Linux and shell scripting.

• Familiarity with monitoring tools and job schedulers.

• Good analytical and problem-solving skills.

• Willingness to work in rotational/night shifts.

Nice to Have:

• Exposure to Python or PowerShell scripting.

• Basic knowledge of cloud platforms (AWS EMR, Azure HDInsight, GCP Dataproc).

• Understanding of data pipelines, ETL workflows, and streaming tools (Kafka, NiFi).

• Experience in incident management and ticketing tools (ServiceNow, Jira).