AI Test Engineer (SC Cleared)

Salary: £? - ? per year

Requirements:

• Strong experience delivering quality assurance for AI/ML solutions across the full lifecycle
• Hands-on expertise with Microsoft-based environments, including Azure testing tools and AI platforms
• Proficiency in one or more of the following: Python, Java, JavaScript, SQL, or R
• Proven experience in AI and Generative AI testing
• Proven experience in RAG solution validation, including RAGAS framework
• Proven experience with CI/CD, DevOps, and cloud-based test integration
• Ability to define and implement AI testing strategies and model validation frameworks
• Strong understanding of functional and non-functional testing
• Strong understanding of accessibility, security, and performance testing
• Experience working in regulated or enterprise environments
• Active SC Clearance (mandatory)

Responsibilities:

• Lead the design and execution of end-to-end test strategies across AI and digital programmes
• Ensure quality across AI models, data pipelines, APIs, and cloud-based services
• Embed test-driven development and behaviour-driven development practices within engineering teams
• Drive improvements in automation frameworks and testing tools
• Provide expert oversight on AI model validation, including Generative AI and RAG solutions
• Identify risks early and implement mitigation strategies
• Mentor and coach engineers to build strong testing capability across teams
• Define and deliver testing strategies aligned to organisational standards
• Lead AI testing, validation, and evaluation frameworks
• Integrate testing within CI/CD and DevOps pipelines
• Champion modern testing approaches, including AI-led and predictive testing techniques
• Collaborate with cross-functional teams including engineering, data science, product, and leadership
• Oversee defect management, quality metrics, and release assurance
• Ensure compliance with accessibility, security, and performance standards

Technologies:

• AI
• Azure
• CI/CD
• Cloud
• DevOps
• Java
• JavaScript
• Python
• RAG
• SQL
• Security
• TDD

More:

We are seeking an experienced Senior Test Engineer (AI) to play a key role in delivering high-quality, reliable artificial intelligence and data-driven solutions within a complex, enterprise-scale environment. This is an exciting 6-month initial contract based in London on a hybrid working pattern, inside IR35 and requiring use of an umbrella company. We offer the opportunity to lead testing strategy across cutting-edge AI systems, with a focus on robust validation, strong governance, and continuous quality improvement across digital platforms.

last updated 32 week of 2026