Databricks Lead Engineer

Salary: £37,000 - 68,500 per year

Requirements:

• We require 2 years of recent, hands-on Databricks experience delivering production solutions.
• We require an active/current Databricks certification, such as Data Engineer, Machine Learning, or Generative AI.
• We require strong experience designing and implementing Databricks Lakehouse architectures.
• We require hands-on implementation of Medallion Architecture, including Bronze, Silver, and Gold layers.
• We require experience with Unity Catalog, including governance, access control, lineage, and secure data sharing.
• We require strong experience building Declarative Pipelines / DLT, including Expectations, data quality, failure handling, and observability.
• We require experience with Databricks-native ingestion approaches such as AutoLoader and/or Lakeflow Connect.
• We require strong PySpark and SQL skills.
• We require Delta Lake experience, including MERGE, schema evolution, optimisation, and performance tuning.
• We require experience with Databricks Workflows and production pipeline orchestration.
• We require a strong understanding of CI/CD, testing, monitoring, alerting, incident triage, and operational best practice.
• We require the ability to mentor engineers and act as the technical escalation point within the delivery team.

Responsibilities:

• We will have you join a major data transformation programme as an experienced, hands-on Databricks Lead Engineer.
• We will have you lead engineering delivery and design solutions, rather than simply work from an existing blueprint.
• We will have you take ownership of engineering delivery and help shape a modern enterprise data platform.

Technologies:

• AI
• CI/CD
• Databricks
• Machine Learning
• PySpark
• SQL
• Unity
• GameDev
• Model Serving
• RAG
• Security

More:

We are offering a new contract role for a Databricks Lead Engineer in London, working three days per week on-site. This is an inside IR35 contract with a rate of up to £575 per day, initially for 6 months with potential extension, and an ASAP start. We are looking for a technically strong Databricks specialist to join our major data transformation programme and help shape a modern enterprise data platform.

last updated 35 week of 2026