Data Engineer (AWS)

Salary: £49,400 - 49,400 per year

Requirements:

• Experience delivering production data pipelines end-to-end, including design, implementation, and operational maintenance, in a cloud environment.
• An undergraduate degree in a quantitative subject or equivalent experience working in data engineering, data science, or development in the cloud.
• Experience writing production-quality Python code to work with complex or messy datasets.
• Understanding of core data engineering best practices, such as data-modelling, transformation, validation, testing, and reproducibility.
• Experience working collaboratively within multidisciplinary teams, including analysts, data scientists, or other engineers.
• Strong communication skills, with the ability to present work in a straightforward and engaging way, including to non-technical audiences.

Responsibilities:

• Join our multidisciplinary team of data engineers and data scientists working on data processing and analytical capabilities.
• Spend most of our time on hands-on technical work with support for learning and professional development.
• Design, build, and maintain scalable data pipelines to ingest, transform, and process large and complex data sources, including automated web scraping and bulk data acquisition workflows.
• Implement data transformation, validation, and quality controls to ensure datasets are reliable, reproducible, and analysis ready.
• Build and maintain containerised data and analytics applications such as dashboards and data tools that run scalable workloads.
• Implement and manage data workflow orchestration and scheduling to ensure observable and maintainable execution of data pipelines and jobs.
• Apply Infrastructure as Code where necessary to support data pipelines and processing workflows on our AWS-based infrastructure.
• Design and maintain systems for data version control and reproducible machine learning workflows.
• Work with analysts, data scientists, and engineers to translate analytical and operational requirements into data solutions.

Technologies:

• AWS
• Cloud
• Support
• Machine Learning
• Python
• Web
• MLOps

More:

We are recruiting a Data Engineer to join our government client on a 12-month fixed term contract in Canary Wharf, London. This is an exciting opportunity to apply your data engineering skills for the public good within our Data, Technology and Insights (DTI) unit, a multidisciplinary team of data engineers, data scientists, technologists, behavioural scientists, and digital forensics experts. We are offering a salary of £49,400 per annum plus an excellent pension, and we are committed to diversity, equality, and inclusion as a Disability Confident Employer.

last updated 30 week of 2026