Consortia
Data Engineer
Job Description
Salary: £62,000 - 102,000 per year
Requirements:- 3+ years of experience in data engineering
- Strong proficiency in Python and Rust
- Hands-on experience with AWS cloud, Linux, and Docker
- Expertise in distributed computing frameworks such as Ray, Dask, or Apache Arrow
- Strong analytical skills with the ability to handle large-scale, high-frequency data
- Solid understanding of ETL pipelines, data modelling, and database optimisation
- Experience working with real-time streaming technologies
- Build and maintain high-performance data pipelines that process complex and large-scale datasets
- Work closely with analysts and researchers to understand their data requirements
- Optimise real-time data ingestion by integrating external APIs and alternative data sources
- Enhance data architecture to improve accessibility, efficiency, and security
- Automate ETL workflows to streamline data modelling and analysis
- Support event-driven systems by implementing technologies like Kafka and Protobuf
- Ensure seamless data streaming and processing
- Implement rigorous quality assurance measures to ensure data integrity and consistency across inputs and outputs
- Collaborate with teams to support machine learning applications and facilitate data preparation for model training and deployment
- AWS
- Cloud
- Docker
- ETL
- Support
- Kafka
- Linux
- Machine Learning
- Model Training
- Python
- Rust
- Security
- Flow
More:
We are hiring for a Data Engineer role in London on a hybrid, full-time basis. We offer the opportunity to work in a fast-moving, data-driven environment using cutting-edge tools and technologies, alongside top-tier professionals. You will contribute to the efficiency and innovation of our growing data team and have a real impact on advanced analytics and quantitative research.
last updated 35 week of 2026
Interested in this role?
Submit your application now
How to Apply
About Consortia
Consortia
London
IT
Skills & Technologies
Inferred from job description
Salary Insight
£82,000
This role
£60,000
UK median
This salary is 37% above the UK median for Software Engineers (£60,000/yr).
Based on 2024–2025 UK technology sector benchmarks