Senior Data Pipeline Engineer

Salary: £70,000 - 80,000 per year

Requirements:

• We need at least 5 years of hands-on experience designing, building and operating telemetry or observability data pipelines in enterprise environments.
• We need senior data pipeline engineering experience with a demonstrable track record at enterprise scale.
• We need hands-on experience designing, deploying and operating observability platforms across cloud, hybrid and on-premises environments.
• We need strong practical experience with data transformation, including parsing, routing, filtering, enrichment and normalisation of log, metric and trace data.
• We need hands-on experience with one or more industry-standard observability platforms and their architecture, deployment and data-pipelining functionality.
• We need the ability to mentor junior engineers and plan and allocate tasks within an engagement team.
• We prefer consulting experience, though it is not essential.
• We need strong working knowledge of the OpenTelemetry Collector and OTLP.
• We need scripting and automation skills in Python and Bash.
• We need familiarity with JSON, regex, syslog and common log, metric and trace formats.
• We need cloud platform knowledge across AWS, Azure and/or GCP.
• We need experience with Kubernetes, Docker and OpenShift.
• We need familiarity with delivery and project tooling such as JIRA, Confluence and ServiceNow.
• We prefer certification in one or more relevant observability platforms or tools, such as Dynatrace, OpenTelemetry, Cribl, Elastic or Splunk.
• We need the right to work in the United Kingdom.
• We need willingness to work from our Brighton or London office and travel to UK client sites as required.

Responsibilities:

• We design, build and operate telemetry pipelines that collect, route, transform, enrich, reduce and mask logs, metrics and traces at enterprise scale.
• We develop and maintain data transformation logic, including parsing, restructuring, filtering and normalising telemetry across formats and schemas.
• We optimise pipelines for data quality, cost control and performance.
• We onboard complex applications and data sources onto observability platforms.
• We build, test and document reusable pipeline configurations, processors and templates.
• We monitor pipeline health and throughput, and troubleshoot ingestion, routing and delivery issues.
• We architect observability platform deployments to meet enterprise client requirements, including topology, sizing, high availability, resilience and scaling.
• We deploy, configure and operate observability platforms and collection/agent fleets across cloud, hybrid and on-premises environments.
• We define deployment patterns and infrastructure as code for repeatable, automated platform rollouts.
• We integrate observability platforms with client infrastructure, data sources and downstream destinations.
• We own platform health, upgrades and capacity planning, and keep architecture and deployment documentation current.
• We deliver observability platform and pipeline engagements directly with enterprise clients.
• We own delivery outcomes for the platform and pipeline workstreams on assigned engagements.
• We act as the senior technical authority and escalation point for platform architecture, deployment and data pipeline issues.
• We lead troubleshooting and root-cause analysis across enterprise observability platforms and telemetry pipelines.
• We support pre-sales with technical scoping and solution design for platform and pipeline work.
• We translate client requirements into platform and pipeline designs that balance coverage, cost and compliance.
• We provide technical leadership on engagements, setting direction and quality standards for the workstream.
• We plan the workstream, scope the work, sequence tasks and allocate them across the delivery team where required.
• We mentor and coach junior engineers and consultants working alongside us.
• We coordinate with the wider engagement team and report progress on the workstream.
• We work hands-on across the observability tool landscape and contribute to our methodology, toolkits and reusable assets.

Technologies:

• AWS
• Architect
• Azure
• Bash
• Cloud
• Confluence
• Docker
• Dynatrace
• GCP
• Support
• JIRA
• JSON
• Kubernetes
• OpenTelemetry
• OpenShift
• Python
• ServiceNow
• Splunk

More:

We are NETbuilder, a leading provider of digital solutions, software, consulting and managed services, with specialist expertise across financial services, government and commercial markets. Since 1999, we have delivered end-to-end solutions across Digital Delivery, Development and Technology as a digital transformation consultancy with onsite, onshore and offshore capability. You will join our world-class team of experienced consultants as we build a new Observability Practice, working as a senior technical specialist on enterprise client engagements. This is a full-time, permanent role based in Brighton or London, office-based with travel to UK client sites, offering a competitive salary of £70,000 to £80,000, company pension, and ongoing investment in professional development and certification in a close-knit, high-performance culture.

last updated 30 week of 2026