Senior QA Engineer - Ai/ML New

Our client, a leading digital innovation company, is seeking a Senior QA Engineer to lead quality assurance for AI-powered solutions, with a focus on Generative AI and complex platform applications. This is an exciting opportunity to define testing strategies for cutting-edge AI systems in a collaborative, agile environment.

What You’ll Do:

• Design and implement comprehensive testing frameworks for Generative AI applications, LLM-based systems, and AI agent workflows
• Develop automated testing strategies for AI model outputs, including accuracy, relevance, bias detection, and safety validation
• Execute manual and automated testing of platform UI, conversational AI, and multi-system integrations
• Create and maintain API test suites for REST/GraphQL endpoints and AI service integrations
• Build and maintain CI/CD testing pipelines with automated regression testing for platform features and AI model behavior
• Establish quality metrics, guardrails, and ethical AI compliance protocols
• Perform load and performance testing for AI inference, model serving, and real-time applications
• Collaborate with engineering teams to integrate QA into development workflows and enforce quality standards

Tech Stack:

• Automation & Testing: Selenium, Playwright, Postman, REST Assured, custom frameworks
• Programming: Python, JavaScript/TypeScript
• Cloud & AI: AWS, AI/ML services and infrastructure
• Performance Testing: JMeter, Locust, Artillery
• Methodologies: Agile, CI/CD, exploratory & usability testing, cross-platform validation

Requirements:

• 5+ years QA experience, with 2+ years focused on AI/ML or complex platforms
• Strong automated testing and CI/CD experience
• Experience testing APIs, UI, and AI-driven systems
• Knowledge of Generative AI applications, LLMs, AI agents, and prompt-based systems
• Understanding of AI/ML evaluation metrics and testing methodologies for non-deterministic outputs
• Bachelor’s degree in Computer Science, Engineering, or related field

#LI-JM2