ML/AI Engineer

Salary: £44,000 - 76,000 per year

Requirements:

• Strong Python skills for automation, tooling, and service development.
• Deep expertise in Kubernetes, Docker, Helm, operators, node-pool management, and autoscaling.
• Hands-on CI/CD experience with Harness or a similar tool, including multi-stage pipelines; experience with GitOps, artefact repositories, and environment promotion.
• Practical experience with CUDA, TensorRT, Triton, TorchServe, and GPU scheduling and optimisation.
• Proficiency with Prometheus, Grafana, and Dynatrace, including defining SLIs, SLOs, and alert thresholds for ML systems.
• Experience operating MLflow or an equivalent for experiment tracking, model bundling, and deployments.
• Expert use of Git, branching models, protected merges, and code-review workflows.
• Ideally, experience with GCP services such as GKE, Cloud Run, Pub/Sub, and BigQuery, and with Vertex AI.
• Ideally, experience with prompt and version management, offline and online evaluation, and human-in-the-loop workflows such as RLHF.
• Ideally, familiarity with Model Context Protocol (MCP), Google ADK, LangGraph or LangChain, and agent orchestration or multi-agent patterns.
• Ideally, experience with Ray, Kubeflow, or similar frameworks.
• Ideally, experience embedding controls, audit evidence, and governance in regulated environments.
• Ideally, experience with GPU efficiency, autoscaling strategies, and workload right-sizing.

Responsibilities:

• Build and operate production-grade Kubernetes clusters for high-volume model inference and scheduled training jobs.
• Configure autoscaling, resource quotas, GPU and CPU node pools, service mesh, Helm charts, and custom operators to meet reliability and efficiency targets.
• Implement GitOps workflows for environment configuration and application releases.
• Build CI/CD pipelines to automate build, test, model packaging, and deployment across development, pre-production, and production environments.
• Enable progressive delivery and rollback strategies, integrating quality gates, tests, and model-evaluation checks.
• Standardise continuous training and continuous monitoring pipelines to keep production models fresh and safe.
• Deploy and tune GPU-backed inference services, optimise CUDA environments, and use TensorRT where appropriate.
• Operate scalable serving frameworks such as NVIDIA Triton and TorchServe, with attention to latency, efficiency, resilience, and cost.
• Implement end-to-end observability for models and pipelines, covering drift, data quality, fairness signals, latency, GPU utilisation, error budgets, and SLOs and SLIs.
• Establish actionable alerting and on-call runbooks, lead incident reviews, and drive reliability improvements.
• Operate a model registry such as MLflow for experiment tracking, versioning, lineage, and environment-specific artefacts.
• Maintain audit readiness through model cards, reproducible builds, provenance, and controlled promotion between stages.

Technologies:

• AI
• BigQuery
• CI/CD
• Cloud
• CUDA
• Docker
• Dynatrace
• GCP
• Git
• GitOps
• Grafana
• Helm
• Kubeflow
• Kubernetes
• MCP
• MLflow
• Prometheus
• Python
• NodeJS
• Support
• Machine Learning

More:

Were hiring a full-time ML/AI Engineer for our Data & AI Engineering team in Manchester, with a salary of £72,702–£80,000 per annum and a 35-hour working week. Our hybrid work style requires at least two days per week, or 40% of working time, in our Manchester office; flexible working options include hybrid working and job share. Youll join us as we advance our transformation and help shape the future of AI, embedding fairness, transparency, and accountability in our work. At Lloyds Banking Group, our purpose is to help Britain prosper, and our colleagues work to make a difference for customers, businesses, and communities while shaping the future of financial services. We offer a pension contribution of up to 15%, an annual bonus subject to Group performance, share schemes including free shares, adaptable lifestyle benefits such as discounted shopping, 30 days holiday plus bank holidays, wellbeing initiatives, and generous parental leave policies. Were committed to an inclusive, values-led workplace that reflects the diversity of the communities we serve, and we welcome applications from under-represented groups.

last updated 40 week of 2026