Data Engineer (Databricks)

Salary: £40,000 - 65,000 per year

Requirements:

• Hands on experience developing data or analytic applications in Python using Streamlit, Dash or a similar framework
• Experience designing, testing and maintaining user-facing applications, including the use of version control
• Strong SQL skills and experience analysing and integrating data sets from multiple sources
• Experience with Databricks or a similar modern data platform
• Working experience with notebooks and Python data libraries and processing frameworks such as Pandas and PySpark
• Understanding of deployment, CI/CD, orchestration and application support practices
• Nice to have: experience building dashboards and visualisations using Databricks SQL, Power BI, Tableau or a similar tool
• Nice to have: familiarity with data quality frameworks and automated testing approaches
• Nice to have: understanding of data engineering concepts such as pipelines, orchestration and version control
• Nice to have: exposure to working in a product-oriented or data platform environment

Responsibilities:

• Design, build, test, deploy and maintain lightweight analytics applications, primarily using Python and Streamlit, to support training and onboarding
• Translate business and user requirements into intuitive application workflows, well-structured data models and transparent metrics
• Work closely with data engineers to ensure data pipelines and reusable data sets meet application and analytical needs
• Maintain application code in version control and contribute to testing, technical documentation and development best practices
• Develop and maintain reusable datasets, semantic layer, data quality checks, monitoring and reporting for the data used by the applications
• Gather user feedback and iteratively improve application usability, accessibility and adoption
• Build dashboards and visualisations where they are the most appropriate way to communicate onboarding, adoption and business metrics
• Support onboarding of new users to the data platform, improving accessibility and usability

Technologies:

• CI/CD
• Databricks
• Support
• Power BI
• Python
• PySpark
• SQL
• Tableau
• pandas

More:

Whitehall Resources currently require an experienced Data Engineer (Databricks) to work with a key client. This role falls inside IR35.

last updated 34 week of 2026