Principal Data Engineer - AWS

Salary: £65,000 - 105,000 per year

Requirements:

• Strong proficiency in Python, Scala, or Java.
• Hands-on experience with Big Data technologies including Spark, Hadoop, or similar distributed processing frameworks.
• Experience building real-time event streaming solutions using technologies such as Kafka, Spark Streaming, or Amazon Kinesis within AWS environments.
• Proven expertise designing modern data architectures including Data Lakehouse and Data Warehousing solutions.
• Experience with CI/CD, DevOps practices, and data governance including GDPR.
• A collaborative engineering mindset with experience delivering scalable cloud solutions and using AI-enabled tools responsibly to improve engineering productivity while maintaining appropriate human oversight and quality assurance.
• Excellent stakeholder communication skills with the ability to translate business requirements into practical, high-quality technical solutions.

Responsibilities:

• Design and build end-to-end data pipelines using AWS-native services and modern cloud data architectures, ensuring scalable, secure, and resilient solutions.
• Partner with clients and cross-functional teams to understand business requirements, define technical solutions, and deliver production-grade data platforms.
• Apply AWS Well-Architected Principles, engineering best practices, CI/CD, and AI-enabled development approaches to improve quality, efficiency, and operational excellence.
• Lead the development of robust, tested, fault-tolerant data engineering solutions while promoting responsible engineering standards and governance.
• Mentor engineers, share technical expertise, and encourage the effective and responsible use of approved AI tools and automation to enhance collaboration and delivery.

Technologies:

• AI
• AWS
• Big Data
• CI/CD
• Cloud
• DevOps
• Hadoop
• Support
• Java
• Kafka
• Python
• Scala
• Spark
• Databricks
• Hive

More:

We are Capco, a collaborative, flat, and entrepreneurial consulting firm delivering high-impact technology solutions for Tier 1 financial institutions. We work on greenfield initiatives and enterprise-scale programmes across digital financial services and energy, helping shape the future of transformation in the financial services industry. We offer a competitive, people-first benefits package that includes bonus, pension, health and life insurance, mental health support, family-friendly leave, backup care, flexible holiday options, annual learning hours, certifications, coaching, and a range of additional perks. We are committed to accessibility and inclusion, and our #BeYourselfAtWork culture values individuality, collaboration, and responsible innovation.

last updated 34 week of 2026