Databricks Data Engineer

Salary: £41,000 - 81,000 per year

Requirements:

• Proven experience in data engineering and pipeline development on Databricks and cloud-native platforms.
• Strong consulting values with the ability to collaborate effectively in client-facing environments.
• Hands-on expertise across the data lifecycle: ingestion, transformation, modelling, governance, and consumption.
• Strong problem-solving, analytical, and communication skills.
• Experience leading or mentoring teams of engineers to deliver high-quality, scalable data solutions.
• Deep expertise with the Databricks platform, including Spark/PySpark/Scala, Delta Lake, Unity Catalog, and MLflow.
• Proficiency in ETL/ELT tools such as DBT, Matillion, Talend, or equivalent.
• Strong SQL and Python, or equivalent language, skills for data manipulation and automation.
• Hands-on experience with cloud platforms such as AWS, Azure, or GCP.
• Familiarity with Databricks Workflows and other orchestration tools.
• Knowledge of data modelling methodologies such as star schemas, Data Vault, Kimball, and Inmon.
• Familiarity with medallion architectures, data lakehouse principles, and distributed data processing.
• Experience with version control tools such as GitHub or Bitbucket, and CI/CD pipelines.
• Understanding of data governance, security, and compliance frameworks.
• Exposure to AI/ML workloads is desirable.
• Minimum 5–8 years in data engineering, data warehousing, or data architecture roles, with at least 3+ years working with Databricks.
• University degree required.
• Preferred BSc/MSc in Computer Science, Data Engineering, or a related field.
• Databricks certifications, especially Data Engineer Professional, are highly desirable.

Responsibilities:

• We engage with clients and deliver data solutions in a collaborative, client-facing environment.
• We design and implement robust ETL/ELT workflows.
• We build batch and streaming data pipelines.
• We integrate real-time and batch data sources.
• We design and optimize Databricks and Lakehouse architectures.
• We develop and optimize data models, including Delta Lake and Medallion architecture patterns.
• We ensure secure, well-governed data products and pipelines.
• We collaborate with solution architects, data engineers, developers, ML engineers, analysts, and client stakeholders.
• We apply quality, governance, and security best practices.
• We lead or mentor engineers to deliver scalable data solutions.
• We contribute reusable assets, accelerators, and technical leadership to grow the practice.
• We drive innovation and improve data engineering practices.

Technologies:

• AI
• AWS
• Azure
• BitBucket
• CI/CD
• Cloud
• Data Vault
• Databricks
• ETL
• GCP
• GitHub
• MLflow
• Python
• PySpark
• SQL
• Scala
• Security
• Spark
• Talend
• Unity
• dbt
• GameDev
• Architect

More:

We are NTT DATA, a $30+ billion business and technology services leader serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. We are one of the worlds leading AI and digital infrastructure providers, with capabilities across enterprise-scale AI, cloud, security, connectivity, data centers, and application services. Our consulting and industry solutions help organizations move confidently and sustainably into the digital future. We have experts in more than 70 countries and offer access to a robust ecosystem of innovation centers and established and start-up partners. This role is based in London, United Kingdom, and is a full-time position. We are building a pipeline of exceptional Databricks Data Engineer talent across the UK for future opportunities, and we embrace diversity, inclusion, and equal opportunity across our global team.

last updated 36 week of 2026