Data Analyst (Engineer)(Job No 872)

We are seeking a highly motivated and experienced Data Engineer to join NAB?s CIB Data Engineering team. The successful candidate will be responsible for designing, developing, and maintaining data pipelines and infrastructure to support the analytical needs of the CIB division. This role requires a strong understanding of data warehousing principles, proficiency in Python and SQL, and a working knowledge of data visualization techniques. 

• Experience with PySpark/Databricks and a basic understanding of business analysis principles are highly advantageous. Responsibilities: 
• Design, develop, and implement robust and scalable data pipelines using Python and SQL to ingest, process, and transform large datasets from various sources (e.g., databases, flat files, APIs). 
• Build and maintain data warehouses and data lakes, ensuring data quality, consistency, and security. 
• Develop and maintain ETL (Extract, Transform, Load) processes for various CIB data sources, including transactional data, market data, and client information. 
• Optimize data pipelines for performance and efficiency, identifying and resolving bottlenecks. 
• Collaborate with business stakeholders (within CIB) to understand their data needs and translate those needs into technical solutions. 
• Develop and maintain comprehensive documentation for data pipelines and processes.
• Monitor data pipeline performance and troubleshoot issues as they arise. 
• Participate in agile development processes, contributing to sprint planning, daily stand-ups, and sprint retrospectives. 
• Contribute to the design and implementation of data governance policies and procedures. 
• Contribute to the ongoing improvement and modernization of the data infrastructure within CIB. 
• Proactively identify opportunities to improve data quality, efficiency, and accessibility. 
• Assist in the development of data-driven insights and reports to support business decision-making (requiring the application of basic business analysis skills). 

Qualifications: 

• Bachelor's degree in Computer Science, Data Science, or a related field. 
• 3+ years of experience as a Data Engineer, with a proven track record of designing and implementing data pipelines.
• Strong proficiency in Python, PySpark and SQL. Experience working with relational databases (e.g., Oracle, PostgreSQL, MySQL). 
• Experience with data warehousing concepts and technologies. 
• Experience with data modelling and design. 
• Excellent problem-solving and analytical skills.