Snowflake Developer & Lead (NCS/Job/ 2775)

Snowflake Lead

Exp: 5-10Yrs

Responsibilities:

• Design, build, and manage scalable and efficient ETL/ELT pipelines using DBT and Python to ingest data from diverse sources into Snowflake.
• Optimize data transformation processes in DBT by implementing modular, reusable, and testable SQL models.
• Develop and maintain data models (star/snowflake schemas) in Snowflake for analytics and reporting.
• Implement data partitioning, clustering, and performance tuning techniques to improve query performance in Snowflake.
• Leverage AWS services such as S3, Glue, Lambda, EMR, EC2, and CloudWatch to orchestrate and monitor data workflows.
• Ensure secure and reliable data storage and access by configuring IAM roles, data encryption, and data governance policies on AWS.
• Good to have knowledge on Fivetran, Hightouch tools.
• Implement data quality checks, validations, and anomaly detection logic using DBT tests and Python-based scripts.
• Monitor data integrity and build alerts for failed pipelines or data issues using tools like Airflow, Control-M,Dagster, or AWS Step Functions.
• Automate recurring data engineering tasks and data reconciliation processes using Python scripts and libraries (e.g., Pandas, PySpark, Boto3).
• Develop utilities and frameworks for data ingestion, cleansing, and transformation.
• Work closely with data analysts, data scientists, and business stakeholders to understand data requirements and translate them into scalable engineering solutions.
• Document data flows, architecture, and business logic to support knowledge sharing and audit requirements.
• Optimize Snowflake usage by managing warehouse sizing, query performance tuning, and cost monitoring practices.
• Apply best practices for AWS resource utilization to reduce compute/storage costs.
• Ensure compliance with data privacy laws and organizational policies by implementing appropriate data masking, logging, and access control mechanisms.
• Participate in audits and maintain documentation for data lineage and governance.