Lead Data Engineer

Salary: £50,000 - 50,000 per year

Requirements:

• We need experience communicating with non-technical stakeholders to gather requirements and explain complex data engineering concepts in clear, accessible language.
• We need the ability to understand complex datasets and source system design, and to describe them using techniques such as data modelling.
• We need experience designing, building, testing, and supporting moderate to complex data pipelines within a collaborative DevOps team.
• We need a strong understanding of the development lifecycle, including working to process and managing stakeholder expectations for delivery.
• We need the ability to apply industry best practices, with awareness of emerging technologies and experience with the technologies described.
• We need relevant experience with Databricks, Azure Data Factory, Azure DevOps, Power BI, ThoughtSpot, Unity Catalog, and Microsoft Purview.

Responsibilities:

• We design, build, and support data pipelines within our Data as a Service platform.
• We deliver our Data as a Service roadmap by improving trust in data, building data products, and strengthening our enterprise data platform.
• We operate scalable data pipelines from operational systems into our Data as a Service platform using a DevOps-aligned engineering approach.
• We work closely with stakeholders across the organisation to translate analytical and reporting needs into robust data products.
• We develop clear user stories that support analytics and decision-making use cases.
• We enable data consumers through Databricks workspaces, Power BI, and ThoughtSpot.
• We embed data governance, quality, and assurance across the full data lifecycle.
• We ensure compliance with organisational policy, responsible use of AI, strong metadata management, and high data quality standards.
• We define, embed, and champion data engineering best practices and standards.
• We drive adoption and effective use of enterprise data capabilities across the organisation.

Technologies:

• AI
• Azure
• Databricks
• DevOps
• Support
• Power BI
• Unity
• Cloud
• GameDev
• Network
• Office 365

More:

We are National Highways, and we manage and improve Englands motorways and major A roads to help our customers have safer, smoother, and more reliable journeys. Our Digital Services Directorate is reshaping how we operate by delivering digital, data, and technology services across frontline and back office functions in a modern and efficient way. This is a hybrid role based at any National Highways office location, requiring two days per week in the office. We offer a total reward package that includes a performance-related bonus, contributory pension with employer contribution of up to 10%, annual leave starting at 26 days plus Bank Holidays, flexible hours, hybrid working, life assurance, health and wellbeing support, career development investment, family-friendly leave, financial wellbeing support, and volunteering leave. We are committed to creating a diverse environment and welcome applicants from all backgrounds.

last updated 31 week of 2026