Python/Scala/PySpark Data Engineer(Ign Job/ 36)

For Offers Technology Consulting And Digital Solutions Globally.

4 - 8 Years

Full Time

Up to 30 Days

Up to 20 LPA

2 Position(s)

Bangalore / Bengaluru

4 - 8 Years

Full Time

Up to 30 Days

Up to 20 LPA

2 Position(s)

Bangalore / Bengaluru

Job Skills

4+ years of experience in Data Warehouse project / ETL / Data Engineering
Clear concept of dimensional data modelling(Logical), SCDs, Normalisation and denormalizations.
Thoroughly translating the logical models to physical and data flows per the business requirements.
Update and optimise the local and metadata models.
Could evaluate the implemented data system for the variances, discrepancies and efficiencies
Troubleshoot and optimise the existing data flows, models and processing jobs by modularising.
Explore ways to enhance the data quality and reliability.
Strong in writing UDF
Previous knowledge of implementing the DQ framework on Spark would be an added advantage.
Good in writing programming using Python/Scala/PySpark is a must.
Strong knowledge of spark framework.