Staff Software Engineer Inference

Salary: £57,000 - 73,000 per year

Requirements:

• We require proficiency in Python or Rust.
• We require software engineering experience building and operating distributed systems in production.
• We require working knowledge of containerized infrastructure such as Kubernetes and at least one major cloud platform, including AWS, GCP, or Azure.
• We look for a results-oriented mindset with a bias toward flexibility and impact.
• We value willingness to pick up slack even when it goes beyond your job description.
• We want candidates with a desire to learn more about machine learning systems and infrastructure.
• We look for people who thrive in environments where technical excellence directly drives business results and research breakthroughs.
• We care that you are thoughtful about the societal impacts of your work.
• A bachelors degree or an equivalent combination of education, training, and/or experience is required.
• A field relevant to the role, demonstrated through coursework, training, or professional experience, is required.

Responsibilities:

• We design, build, and maintain the distributed systems that serve Claude to millions of users worldwide.
• We develop resilient, flexible systems that adapt in real time to real-world events.
• We develop intelligent request routing, load balancing, and traffic management systems across thousands of accelerators.
• We maximize compute efficiency across the fleet by autoscaling and orchestrating production, research, and experimental workloads.
• We build and operate production-grade deployment pipelines for releasing new models to users.
• We provide high-performance inference infrastructure that enables researchers to develop next-generation models.
• We integrate new AI accelerator platforms and support inference for new model architectures.

Technologies:

• AI
• AWS
• Azure
• Cloud
• GCP
• Support
• Kubernetes
• Load Balancing
• Machine Learning
• Python
• Rust
• Slack
• Hardware
• LLM

More:

We are Anthropic, a public benefit corporation headquartered in San Francisco, focused on creating reliable, interpretable, and steerable AI systems that are safe and beneficial for our users and society. Our team is a rapidly growing group of researchers, engineers, policy experts, and business leaders working together on high-impact AI research and infrastructure. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a collaborative office environment. We operate a location-based hybrid policy, with staff expected to be in one of our offices at least 25% of the time, and we sponsor visas on a case-by-case basis. We value collaboration, communication, and diverse perspectives, and we encourage candidates to apply even if they do not meet every qualification.

last updated 34 week of 2026