MLops Eng (NCS/Job/ 3597)

Key Responsibilities

• Design, implement, and manage scalable machine learning (ML) pipelines using Azure ML, Databricks, and PySpark.
• Build and maintain automated CI/CD pipelines with Github and Github Action, incorporating SonarQube to ensure code quality and security standards.
• Utilize Azure Kubernetes Service (AKS) to containerize and deploy machine learning models, ensuring high availability and scalability.
• Have understanding of over all architecture and can work on scalable solutions
• Develop reusable templates for various ML use cases to streamline the model deployment process and enhance operational efficiency.
• Design and manage APIs to facilitate seamless interaction between ML models and other applications, ensuring robust, secure, and scalable API interfaces.
• Perform model optimization, monitor data drift, data refresh checks, and ensure the ML pipelines are cost-efficient.
• Implement cost monitoring and management strategies to ensure efficient use of resources, particularly for model training and deployment phases.
• Work closely with data scientists, DevOps, and IT teams to deploy and manage machine learning models across environments.
• Provide thorough documentation for ML workflows, pipeline templates, and optimization strategies to support cross-team collaboration.