AI Quality Engineer (RARR Job 6401)

We are hiring an AI Quality Engineer to ensure the quality and reliability of AI-powered products. The role requires strong expertise in QA, development, and process automation, covering manual testing, automated testing, and AI model evaluation. Roles and Responsibilities:

• Design & execute manual test cases (functional, API, edge cases)
• Build and maintain automation frameworks (UI, API, data layers)
• Develop scripts/tools for process automation and test efficiency
• Evaluate AI/LLM outputs (accuracy, hallucination, drift, latency, cost)
• Run regression testing and ensure release readiness
• Log, track, and independently verify defects
• Support UAT and collaborate with product & engineering teams

Required Skills & Qualifications:

• 5+ years in QA / SDET / Automation roles
• 1+ years of experience working with AI/LLM-based products is mandatory
• Strong development experience (Python or TypeScript preferred)
• Hands-on experience in test automation (UI, API, data validation)
• Experience in process automation/scripting/workflow optimization
• Strong SQL skills
• Experience with CI/CD pipelines
• Exposure to AI evaluation, datasets, and model testing

Good to Have:

• Experience in retail/e-commerce domain
• Exposure to RAG, vector databases, or AI pipelines
• Performance or security testing experience