ETL + Bigdata Tester(Job No 689)

Mandatory Skill

• ETL Testing
• Big Data testing
• programming in languages like Python

Job Description:

• Hands-on experience with advanced ETL automation frameworks, beyond basic query validation.
  • Candidate should have hands-on experience with advanced ETL automation frameworks, not only basic query validation. 
  • Familiarity with tools and methodologies beyond simple data validation to address complex data pipelines and automation processes. So solid background in test automation, particularly for ETL processes includes that tests are properly executed and that results are accurately reported.
  • End-to-end validation of the automated testing framework, including integration with the overall data pipeline. 
• Hands-on Experience with Big Data:
  • Solid understanding of Big Data systems and the integration between testing, automation, and infrastructure is must.
  • Should be capable of handling large-scale data environments and understanding how to leverage automation in the context of Big Data architecture.
• Knowledge of CI/CD tools (e.g., Jenkins, Airflow) integrated with ETL processes.
  • Knowledge of CICD tools like Jenkins and Airflow is essential.
  • The candidate must understand how these tools integrate with ETL processes and help automate the continuous integration and deployment of data pipelines, ensuring seamless and efficient delivery.  
  • However, Client is agree to easing requirements around particularly in areas like CICD tool or infrastructure side 
• Deeper understanding of integration and infrastructure, particularly around ETL and Big Data environments.
  • The candidate should possess a deeper understanding of integration and infrastructure, particularly in relation to ETL processes and Big Data environments. This involves knowledge of how data flows through various systems, how it's processed, and how different infrastructure components work together to support scalable data operations.
• Programming and Coding Skills (Big Data & Python):
  • Expectation of hands-on experience with programming in languages like Python
• Strong Communication Skills & Culturally Fit :
  • Since the role requires interacting with different teams and stakeholders, the candidate must have excellent communication skills.
  • Effective communication is crucial for explaining technical concepts, coordinating      between teams, and ensuring that testing and automation practices are aligned with business goals.