Lead Data Engineer

Salary: £60,000 - 90,000 per year

Requirements:

• Experience leading the design and delivery of enterprise-scale data engineering solutions within Google Cloud Platform (GCP)
• Strong experience developing and maintaining scalable ETL/ELT pipelines, data models, and integration frameworks
• Hands-on experience with Infrastructure as Code (IaC), particularly Terraform
• Experience building and supporting automated deployment processes using GitLab CI/CD pipelines
• Strong experience designing, optimising, and maintaining BigQuery datasets, schemas, and analytical workloads
• Experience with Cloud Storage, Cloud SQL, and Cloud Composer
• Proficiency in Python for ETL applications, automation tools, and data services
• Experience implementing real-time data integration and Change Data Capture (CDC) solutions using Striim
• Experience developing and supporting ETL workflows and reusable components using Ab Initio
• Strong understanding of data quality, governance, security, and compliance standards
• Experience mentoring engineers, leading code reviews, and establishing engineering best practices
• Experience collaborating with cross-functional teams on secure, reliable, and scalable data solutions

Responsibilities:

• Lead the design and delivery of enterprise-scale data engineering solutions within Google Cloud Platform (GCP)
• Develop and maintain scalable ETL/ELT pipelines, data models, and integration frameworks
• Design and manage Infrastructure as Code (IaC) solutions using Terraform
• Build and support automated deployment processes through GitLab CI/CD pipelines
• Design, optimise, and maintain BigQuery datasets, schemas, and analytical workloads
• Develop and manage Cloud Storage, Cloud SQL, and Cloud Composer solutions
• Develop Python-based ETL applications, automation tools, and data services
• Implement real-time data integration and Change Data Capture (CDC) solutions using Striim
• Develop and support ETL workflows and reusable components using Ab Initio
• Ensure data quality, governance, security, and compliance standards are maintained
• Monitor platform performance, reliability, and operational efficiency across cloud environments
• Lead code reviews, mentor engineers, and establish engineering best practices
• Collaborate with cross-functional teams to deliver secure, reliable, and scalable data solutions
• Support architecture design, technical planning, estimation, and continuous improvement initiatives

Technologies:

• Ab Initio
• BigQuery
• CI/CD
• Cloud
• Composer
• ETL
• GCP
• GitLab
• Support
• Python
• SQL
• Security
• Terraform

More:

We are offering a 12-month contract for a Lead Data Engineer role based in London or Reading on a hybrid working arrangement, with a competitive day rate outside IR35. You will join a leading organisation delivering a major cloud transformation and data modernisation programme, building enterprise-scale data solutions across a complex technology landscape. Working closely with architects, stakeholders, analysts, and engineering teams, you will help drive best practice across data engineering, infrastructure automation, CI/CD, and cloud technologies while mentoring and leading other engineers within the delivery team.

last updated 37 week of 2026