Data Engineer

Salary: £55,000 - 65,000 per year

Requirements:

• Strong experience with Python and PySpark
• Experience working in a modern Databricks, Spark, or Python engineering environment
• Experience building production-grade data solutions through code
• Strong understanding of distributed processing
• Experience with Microsoft Fabric is beneficial, though not essential
• Experience with Azure Databricks is particularly relevant
• Experience with SQL, Git/source control, CI/CD, testing, monitoring, and data quality is relevant

Responsibilities:

• Develop pipelines, transformations, and data products on top of our new data platform
• Work in a code-led engineering environment using Python, PySpark, and notebook-based development
• Build and improve lakehouse solutions using Microsoft Fabric and Azure technologies
• Work with Spark, Delta tables, and medallion architecture patterns across Bronze, Silver, and Gold layers
• Contribute to testing, monitoring, and data quality practices
• Help shape how our organisation uses data, including data products, automation, AI, and Generative AI
• Solve engineering problems and build robust solutions through code

Technologies:

• AI
• Azure
• CI/CD
• Databricks
• Fabric
• Git
• Python
• PySpark
• SQL
• Spark
• Cloud
• Data Warehouse
• UX UI Design

More:

We are an organisation that has heavily invested in modernising our legacy data estate and are now building on the foundations of a modern Microsoft Fabric/Azure data environment. Our team is growing and focused on developing the next stage of our data capability, with an emphasis on code-led engineering rather than traditional drag-and-drop development. The role offers a salary of £55,000 to £65,000 plus benefits, with a hybrid setup of 1-2 days per week in St Helens. We are open to candidates with commercial Databricks, Spark, or Python experience who want to move deeper into PySpark, distributed processing, and Fabric.

last updated 37 week of 2026