Senior Software Engineer in Test, Python

Salary: £60,000 - 100,000 per year

Requirements:

• 5+ years of hands-on experience with test architecture and automation systems design
• 8+ years of programming experience across multiple languages, including Python
• AI expertise for testing, including the ability to design, implement, and optimize solutions using LLMs, agentic AI systems, and predictive analytics for quality assurance
• Experience with autonomous testing agents that can independently discover, execute, and adapt test strategies
• Proven track record driving test transformation and improving test effectiveness while reducing production issues
• Knowledge of continuous integration tools such as Jenkins, GitLab, TeamCity, or AWS, and their optimization for quality gates
• Advanced test analysis skills, including test flakiness analysis, failure pattern recognition, and automated root cause identification
• Excellent verbal and written communication skills with the ability to influence senior leadership and cross-functional teams on quality initiatives
• Some working knowledge of C++
• Leadership experience mentoring engineers and driving organizational change in testing practices
• Certifications or training in AI/ML or AI testing, such as Coursera AI for Everyone, Google AI Engineer, or ISTQB AI Testing Foundation

Responsibilities:

• Design and implement intelligent test analysis systems that identify quality gaps, predict failure patterns, and optimize test effectiveness
• Build systems that collect, analyze, and act on testing data to continuously improve quality processes
• Apply systematic regression tracking and implement processes to prevent regression recurrence
• Establish new methodologies for measuring and improving test quality beyond simple pass/fail metrics, with a focus on regression prevention and production reliability
• Leverage AI-powered tools for automated failure analysis, root cause identification, and test flakiness scoring
• Define and implement architectural patterns that make testing more effective, maintainable, and aligned with business impact
• Support both Software Engineers and QA Engineers by using specialist knowledge to improve quality and streamline workflows
• Suggest improvements that enhance quality and help us exceed customer expectations

Technologies:

• Agentic AI
• AI
• AWS
• GitLab
• ISTQB
• Support
• Jenkins
• Python
• Roku
• Teamcity
• Cloud
• AI Agents
• Architect
• Claude Code
• Cursor
• LESS
• MCP

More:

We are Roku, the #1 TV streaming platform in the U.S., Canada, and Mexico, and we are working to power every television in the world. We pioneered streaming to the TV and connect consumers to the content they love, content publishers to large audiences, and advertisers to unique engagement opportunities. You will join our Roku OS QA Team, where we rigorously test every product and feature to deliver the most reliable streaming media platform in the industry. We offer a fast-paced, collaborative environment where everyone contributes from day one, along with a hybrid working model that is generally in the office Monday through Thursday and flexible on Fridays for many roles. Our benefits package includes global mental health and financial wellness support, and local benefits may include healthcare, life, accident, disability, commuter, and retirement options, depending on location. We are looking for curious, adaptable builders who can work with AI tools and automation to move faster, raise the bar, and scale impact.

last updated 34 week of 2026