Senior Data Engineer (AI/Tooling)

Salary: £48,000 - 68,000 per year

Requirements:

• Strong hands-on Python development experience for building tools and automation
• Experience integrating GenAI/LLM capabilities into applications, workflows, or tooling
• Hands-on experience designing, testing, and optimizing prompts for LLM-based tools
• Hands-on experience with AWS Bedrock for building GenAI-powered applications
• Practical experience using and/or integrating GitHub Copilot into development workflows
• Experience designing and building automation frameworks/tooling from scratch
• Strong experience with test automation and validation frameworks to ensure conversion accuracy
• Experience parsing, interpreting, and transforming Matillion job definitions in JSON format
• Experience in the financial domain is desirable
• English proficiency at C2 level

Responsibilities:

• Design and build an agentic AI framework to automate and accelerate migration workflows
• Develop and maintain a library of reusable migration patterns and templates for common conversion scenarios
• Build pipelines that automatically convert and transform code and configurations as part of the migration process
• Integrate GitHub Copilot into the migration workflow to accelerate code generation and conversion tasks
• Provide technical support, tooling, and troubleshooting to migration factory pods executing migrations at scale

Technologies:

• Agentic AI
• AI
• AWS
• AWS Glue
• Architect
• Copilot
• ETL
• GitHub
• Support
• JSON
• LLM
• Python
• Cloud
• VR

More:

We are delivering a strategic data engineering engagement with our client to architect and plan the migration of their entire data processing and ETL estate from Matillion to AWS Glue. During the mobilisation phase, we will work closely with the clients engineering teams to reverse-engineer the existing landscape, design the target-state architecture across infrastructure, data processing, workflows, dependencies, and operating model, and build the detailed delivery blueprint for the full-scale migration. The work is highly collaborative and technically rich, involving job inventory review, reusable migration pattern design, validation and reconciliation framework development, proof-of-concept testing, and navigation through rigorous internal governance. This is a senior engagement based in London, United Kingdom, within a Tier 1 financial services environment, where our recommendations will shape a multi-phase, multi-million-pound programme.

last updated 36 week of 2026