Lead Data Engineer, Technology Consulting

Salary: £60,000 - 100,000 per year

Requirements:

• Demonstrated ability to lead multiple complex areas of data engineering delivery to time, cost and quality with minimal direction.
• Experience managing teams inclusively, delivering agreed scope and acting as an escalation point for decisions affecting your work.
• Experience building data pipelines using Spark, Python or SQL.
• Experience with AWS and its data and AI/ML services, such as SageMaker.
• Experience with big data and lakehouse platforms on AWS, such as EMR, Databricks or Snowflake.
• Experience building data platforms, including Data Lakes, Lakehouses or Data Meshes, to support analytics and AI workloads.
• Understanding of data security, data governance and responsible AI principles.
• Ability to partner with and influence senior stakeholders and build trust across stakeholder groups.
• Track record of anticipating project risks and bringing multidisciplinary subject matter experts together to analyse and resolve issues.
• Recognised subject matter expertise, with the ability to drive innovation and bring experience from multiple clients and industries.
• Commitment to self-improvement and learning, including learning new programming languages.
• Pragmatic problem-solving skills and the ability to create clarity and structure in ambiguous situations.
• Experience productionising and operating data and AI/ML solutions, including Generative AI or LLM-based applications.
• Experience coaching and mentoring engineers and creating structured development opportunities for junior team members and client counterparts.
• Active SC clearance is required.
• Desirable: Experience building automated data quality checks and metrics.
• Desirable: Experience creating or maintaining production software delivery pipelines using CI/CD tools such as GitHub Actions, Azure DevOps, Jenkins or CircleCI.
• Desirable: Experience building LLM or foundation-model applications using frameworks such as LangChain, vector databases or agentic AI approaches.
• Desirable: Experience with MLOps and Infrastructure as Code, such as Terraform or CloudFormation, for data, analytics and AI services.
• Desirable: Experience with data reporting and visualisation tools such as Power BI, Tableau or Qlik.
• Desirable: Experience applying AI or agentic techniques in your work using GitHub Copilot, Claude Code or equivalent.

Responsibilities:

• Lead delivery of complex data engineering work across multiple areas, ensuring delivery to agreed time, cost and quality.
• Build modern, AI-enabled data platforms on AWS, including distributed workloads, batch and streaming pipelines, and data foundations for machine learning, Generative AI and LLM solutions.
• Work with architects, technology consultants and public sector client stakeholders to help customers make use of their data.
• Manage teams delivering agreed scope and serve as a key escalation point for decisions affecting your areas of work.
• Partner with and influence senior stakeholders to build trust and drive delivery outcomes.
• Anticipate project risks and coordinate multidisciplinary teams of subject matter experts to analyse and resolve issues.
• Drive innovation and market-leading practices across client work.
• Coach and mentor engineers, creating development opportunities for junior team members and client counterparts.

Technologies:

• Agentic AI
• AI
• AWS
• Azure
• Big Data
• CI/CD
• Claude Code
• Copilot
• Databricks
• DevOps
• GitHub
• Support
• Jenkins
• LLM
• Machine Learning
• MLOps
• Power BI
• Python
• Qlik
• SQL
• Security
• Snowflake
• Spark
• Tableau
• Terraform
• Cloud
• Data Warehouse
• Matrix

More:

We are Credera, a global consulting firm combining transformational consulting, industry knowledge, and AI and technology expertise to deliver customer experiences and growth. We provide tailored solutions that can scale globally and work with clients from strategy through execution. This permanent Lead Engineer role is within our Data Function, based from any of our UK offices in London, Manchester, Leeds or Newcastle. We use a flexible hybrid model requiring three days per week onsite, at a client site as needed or in a local Credera office. The role includes varied client projects as well as internal projects, training and development. We offer a salary of £84,000–£100,000, a comprehensive benefits plan, personalised development opportunities, experienced colleagues around the globe and opportunities for career progression. We value collaboration, inclusion, learning and making a positive impact on our clients, people and community.

last updated 40 week of 2026