Senior Data Platform Engineer

Salary: £25,000 - 65,000 per year

Requirements:

• Proven experience designing and implementing enterprise-grade federated identity, token exchange, permission propagation, SCIM provisioning, and access lifecycle management.
• Strong hands-on experience with Infrastructure-as-Code, especially Terraform, and production CI/CD pipelines, including environment promotion, rollback, and release controls.
• Experience hardening API gateway patterns, including authentication, routing, rate limiting, and access policy enforcement.
• Technical comfort working across Azure, AWS, or Databricks platform ecosystems.
• Highly autonomous and pragmatic, with the ability to translate architectural specifications into practical code and communicate trade-offs clearly in plain English.
• Experience with AI gateways, LLM proxies, or model-routing patterns.
• Exposure to AI observability tools, vector databases, RAG pipelines, or non-deterministic system monitoring.
• Hands-on experience implementing policy-as-code, action logging, or AI kill switches.
• Direct experience with Okta, ZScaler, Entra ID, Unity Catalog, or M365 migration environments.
• Background in regulated or high-governance industries such as Financial Services, Energy, Infrastructure Investment, Fintech, or Enterprise SaaS.
• Familiarity with FinOps practices such as token budgeting, usage tracking, and cost attribution.

Responsibilities:

• Build and maintain Infrastructure-as-Code using Terraform across development, test, and production environments.
• Strengthen CI/CD practices in GitHub Actions, establishing repeatable deployment patterns, environment promotions, automated rollbacks, and release controls.
• Support architecture decisions by converting designs into maintainable, well-documented engineering patterns.
• Design and implement federated identity architecture across Okta, Entra ID, and ZScaler.
• Build identity, token exchange, and permission propagation models that work for both human users and non-human AI agents.
• Implement SCIM provisioning and deprovisioning, with single-revoke capability and full auditability.
• Harden existing AI gateway and agent orchestration layers into secure, production-ready capabilities.
• Implement API gateway controls including authentication, routing, rate limiting, token budgets, policy-as-code, and action logging.
• Build platform-, tool-, and agent-level kill switches, alongside dry-run and safe-testing modes for agent workflows.
• Implement AI system observability, including prompt logging, output monitoring, quality scoring, and drift detection.
• Establish operational monitoring for gateway usage, latency, error rates, and model routing logic.
• Enforce token budgets, cost alerts, and usage/cost attribution by team and use case.
• Deploy vector database and retrieval infrastructure to support Document AI and RAG use cases.
• Align platform controls with Databricks and Unity Catalog governance patterns.
• Provide clear documentation, reusable patterns, and self-service onboarding guidance so delivery squads can deploy tools without bespoke manual intervention.

Technologies:

• AI
• AI Agents
• API
• AWS
• Azure
• CI/CD
• Databricks
• GitHub
• Support
• LLM
• RAG
• Terraform
• Unity
• Cloud
• GameDev
• DevOps
• LESS
• MCP

More:

We are Octopus Energy Generation, part of Octopus Energy Group, based in London and working in a full-time hybrid setup. We are on a mission to drive the global renewable energy revolution, and we manage a global portfolio of over 8 billion in renewable energy assets. Our culture is fast-moving, autonomous, and collaborative, with a strong focus on learning, decision-making, and building quickly alongside a wide range of co-owners. We offer flexibility on salary, aim to match pay to experience, and are proud of being named the UKs top company to work for and ranking in the top ten in the Sunday Times Best Places to Work 2024. We care about inclusion, equal opportunities, and making reasonable accommodations so people can do their best work.

last updated 36 week of 2026