Data Engineer (NCS/Job/ 2191)
Job Skills
Job Description
Data Engineer (5-7 years exp)
Engineer with strong expertise in PySpark/Spark, along with solid knowledge of data warehouse fundamentals and Databricks.
The role involves building and optimizing scalable data pipelines, implementing data models, and managing large datasets across cloud environments.
Python is good to have, while PySpark/Spark is a must.
Key Responsibilities:
Design, build, and maintain scalable ETL/ELT pipelines on Databricks platform.
Apply strong data warehouse fundamentals in schema design, dimensional modeling, and optimization.
Develop and optimize distributed data processing workflows using PySpark/Spark.
Collaborate with analysts, data scientists, and business teams to deliver reliable datasets.
Qualifications & Skills:
5–7 years of experience in data engineering.
PySpark/Spark expertise (must-have).
Experience with Databricks and cloud data platforms (AWS, Azure).
Strong knowledge of Data Warehouse fundamentals (star/snowflake schema, partitioning).
Proficiency in SQL; Python is a good-to-have.
Thorough knowledge of orchestration tools (Airflow, ADF, etc.) and CI/CD practices.
