Data Engineer(Hea Job/ 138)

Hands-on Data Engineers to build and maintain scalable data solutions  and services .

The role includes :

1. Maintain , develop data engineering pipelines to ensure  seamless data flow for BI applications
2. Create data models  to  ensure  seamless  query system
3. Develop  or onboard opensource tools to make the data platform up to date
4. Optimize queries and scripts over large-scale datasets (TBs) with a focus on performance and cost-efficiency ·
5. Implement data governance and security best practices in kubernetes environments
6. Collaborate across teams to translate business requirements into robust technical solutions

Mandatory skill sets:

a .  2 + years experience in bigdata technologies like pyspark , hadoop , trino , druid

b.   Strong experience on query optimisation in trino /pyspark

c.   Strong hands on in  Airflow / scheduler

d.   Expertise in python