Data Engineering Technical Lead

Salary: £61,000 - 101,000 per year

Requirements:

• Deep expertise designing and building scalable data pipelines and data products in cloud environments
• Strong hands-on experience with Databricks, Spark, SQL, and Python
• Experience developing and optimizing batch and real-time data processing solutions
• Strong understanding of modern data architecture patterns, including Kimball, Data Vault, dimensional modelling, and data product design principles
• Experience implementing Infrastructure as Code using tools such as Terraform or CloudFormation
• Experience leading technical delivery teams and mentoring data engineers
• Strong stakeholder management skills with the ability to translate business requirements into scalable technical solutions
• Experience implementing data governance, data quality, security, and operational controls within enterprise platforms
• Strong understanding of software engineering best practices including version control, CI/CD, automated testing, and code review processes
• Experience working in Agile product delivery environments and collaborating across cross-functional teams
• Demonstrated ability to drive technical decision-making and influence architecture direction
• Proficiency using AI-assisted development tools such as Claude Code, Codex, GitHub Copilot, or equivalent tools to improve engineering productivity and quality
• Experience in data analytics, programming, database administration, or data management
• Experience delivering Financial Services, Wealth Management, Asset Management, or Investment platform data solutions
• Experience working with AWS-native data services and event-driven architectures
• Experience building data products that support analytics, reporting, machine learning, or AI use cases
• Knowledge of MLOps, AI Engineering, Agentic AI, or Generative AI implementation patterns
• Experience leading distributed engineering teams
• Experience establishing engineering standards, reusable frameworks, and community-of-practice initiatives
• Knowledge of data mesh, domain-driven design, and product-centric operating models

Responsibilities:

• Lead the technical design, development, and evolution of data products that support business decision-making across Financial Advice Services, Marketing, Operations, Risk, and other key business functions
• Lead a team of data engineers while partnering closely with Product Managers, Data Analysts, Architects, and business stakeholders
• Write ETL processes, design database systems, and develop tools for real-time and offline analytic processing
• Troubleshoot software and processes for data consistency and integrity
• Integrate complex, large-scale data from a variety of sources for business partners to generate insight and make decisions
• Translate business specifications into design specifications and code
• Write complex programs, ad hoc queries, and reports
• Ensure that all code is well structured, includes sufficient documentation, and is easy to maintain and reuse
• Partner with internal clients to gain an expert understanding of business functions and informational needs
• Work closely with other technical and data analytics experts across the business to implement data solutions
• Lead all phases of solution development
• Explain technical considerations in meetings, including those with internal clients and less experienced team members
• Assess data quality and test code thoroughly for accuracy of intended purpose
• Provide data analysis guidance and serve as a technical consultant for the client
• Educate and develop junior data engineers while applying quality control to their work
• Develop data engineering standards and contribute expertise to other data expert teams across Vanguard
• Test and implement new software releases through regression testing
• Identify issues and engage with vendors to resolve and elevate software into production

Technologies:

• Agentic AI
• AI
• AWS
• CI/CD
• Claude Code
• Cloud
• Copilot
• Data Vault
• Databricks
• ETL
• GitHub
• Support
• LESS
• Machine Learning
• Marketing
• MLOps
• Python
• SQL
• Security
• Spark
• Terraform

More:

hackajob is partnering directly with Vanguard to hire for this Data Engineering Technical Lead role within the Chief Data & Analytics Office. We are shaping and delivering Vanguard Europes data and analytics capabilities in a modern cloud-based environment leveraging Databricks, AWS, and Infrastructure as Code. This is a hybrid position requiring office attendance 3 days per week (Tuesday, Wednesday, and Thursday). We are not offering visa sponsorship for this position. We are a different kind of investment company, founded in 1975 on a simple idea: that an investment company should manage its funds solely in the interests of its clients. Our philosophy is to provide value to investors through low-cost, uncomplicated investments. We are committed to diversity and inclusion, and we believe building diverse, inclusive, and highly effective teams helps us better serve our clients, crew, and communities. Our hybrid working model supports flexibility, in-person learning, collaboration, and connection while helping us deliver on our mission to take a stand for all investors, treat them fairly, and give them the best chance for investment success.

last updated 39 week of 2026