Python snowflake developer (NCS/Job/ 2058)

JD:
Job Summary:

Skilled Data Engineer with over 5 years of experience in ETL development, data pipeline design, and automation. Candidate to have strong proficiency in Python and Snowflake SQL, with a deep understanding of data modelling, governance, and cloud-based orchestration.

 

Key Responsibilities:

•            Design, implement, and maintain ETL workflows using Python and Snowflake SQL.

•            Develop Python scripts leveraging the snowflake-connector-python library for automation and orchestration.

•            Write efficient SQL queries to transform and manage data within Snowflake.

•            Ensure data quality, consistency, and performance across ETL processes.

•            Monitor and optimize Snowflake warehouse usage and query performance.

•            Implement robust logging, error handling, and alerting mechanisms for ETL jobs.

•            Collaborate with data analysts, engineers, and business stakeholders to gather and understand data requirements.

•            Write clean, maintainable code and documentation for ETL processes and data flows.

•            Utilize job orchestration tools such as Airflow for scheduling and automation.

•            Apply CI/CD practices for deployment and version control of data pipelines.

•            Work with AWS cloud services and manage secrets securely.

•            Knowledge of Credit Card domain and SAS platform will be added advantage.