GCP Big Data Engineer(RARR Job 5282)

We are looking for a skilled and proactive GCP Big Data Engineer with hands-on experience in building and maintaining scalable data pipelines using Google Cloud Platform (GCP) services. The ideal candidate must have a strong foundation in BigQuery, Python, and data engineering best practices. You will work closely with data analysts, architects, and business stakeholders to design efficient data solutions that drive business value.

Key Responsibilities:

• Design, develop, and maintain scalable ETL/ELT data pipelines on GCP.

• Work with BigQuery, Cloud Storage, Cloud Composer, and other GCP tools to ingest, transform, and load data.

• Write efficient, reusable, and modular Python scripts for data processing and automation.

• Optimize data workflows for performance and cost efficiency.

• Ensure data quality, validation, and governance across pipelines.

• Collaborate with data scientists and analysts to understand business requirements and translate them into technical solutions.

• Monitor and troubleshoot data pipeline issues in production environments.

• Implement CI/CD practices for data engineering workflows.

Required Skills:

• 5+ years of experience in data engineering with at least 4+ years on GCP.

• Strong expertise in BigQuery and SQL performance tuning.

• Proficiency in Python for data manipulation, automation, and orchestration.

• Experience with Cloud Composer (Apache Airflow) for workflow management.

• Familiarity with data modeling, partitioning, clustering, and query optimization.

• Strong understanding of data warehouse concepts and best practices.

• Experience with version control (Git) and DevOps tools.

• Excellent problem-solving, communication, and collaboration skills.

Preferred Qualifications:

• GCP Professional Data Engineer certification.

• Experience with other GCP services like Pub/Sub, Dataflow, and Dataproc.

• Exposure to data security and compliance practices.

• Knowledge of additional programming languages such as Java or Scala is a plus.

Education:

• Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or related field.