AI Language Engineer II, Alexa for Shopping Lang-Tech

Salary: £60,000 - 110,000 per year

Requirements:

• Experience with Unix tools
• Strong analytical skills, attention to detail, and effective communication abilities
• Experience in a fast paced, dynamic organization
• Experience prioritizing and handling multiple assignments at any given time while maintaining commitment to deadlines
• Masters Degree in Applied Linguistics, Computational Linguistics, Natural Language Processing (NLP), or related field
• Experience with Large Language Models, NLP, or Machine Learning
• Experience with Python libraries for data analysis such as pandas and scikit-learn
• Familiarity with AI coding assistants
• PhD in Applied Linguistics, Computational Linguistics, Natural Language Processing (NLP), or related technical field
• Experience with SQL and Git
• Experience building RAG or agentic systems
• Experience conducting quantitative analysis
• Experience building data pipelines
• Experience with AWS services (Bedrock, S3, EC2, etc.)
• Knowledge of user experience concepts and methods
• Familiarity with online retail (e-commerce)

Responsibilities:

• Develop LLM-as-a-judge systems to support human-in-the-loop evaluations
• Automate operations and perform data analysis using scripting languages such as Python
• Author, optimize, and manage system prompts for customer-facing LLM systems
• Integrate API calls into Retrieval Augmented Generation (RAG) systems
• Evaluate model performance and annotation quality to produce reports for stakeholders
• Produce, process, and manipulate different types of language data
• Contribute to defining platform requirements for internal tooling by developing prototypes
• Raise the quality bar on editorial workflows and SOPs through standardization, documentation, and periodic audits and investigations
• Support processes and mechanisms to onboard and upskill Editors and AI Tutors on an ongoing basis
• Design, implement, and refine control mechanisms, metrics, and methodologies to ensure editorial and annotation quality
• Collaborate with editors, applied scientists, engineers, and product managers to deliver an optimal customer experience by defining metrics, guidelines, and workflows
• Deliver across parallel workstreams, balancing timelines, impact, and stakeholder requirements

Technologies:

• AI
• API
• AWS
• EC2
• Git
• Support
• LLM
• Machine Learning
• Python
• RAG
• SQL
• Unix
• pandas
• Cloud
• Mobile
• Security
• UX UI Design
• Web

More:

We are the Conversational Shopping team, a high-performing org behind Alexa for Shopping, and we are focused on making it easy for customers to find and discover the best products for their unique needs through recommendations, comparisons, product Q&A, and more. This role sits within the AI Shopping org and the CMX-Lang-Tech team, a technical sub-team of the AI Shopping Content team, responsible for AI response quality through evaluation and prompting of our AI models. We value a collaborative, cross-functional environment and work closely with global product, design, science, engineering, editorial, and research partners to deliver quality, speed, and consistency. Amazon is an equal opportunities employer with an inclusive culture and a commitment to privacy and workplace accommodations.

last updated 36 week of 2026