CUDA Engineer

Salary: £63,000 - 103,000 per year

Requirements:

• 4+ years writing production CUDA code, with a track record of shipping performance-critical kernels
• Deep understanding of GPU microarchitecture, warps, occupancy, register pressure, and memory hierarchy
• Strong CUDA C++ skills, including streams and asynchronous execution
• Hands-on experience profiling to diagnose compute-bound vs. memory-bound bottlenecks
• Experience with kernel fusion, memory coalescing, and avoiding warp divergence
• Experience writing quantised and mixed-precision kernels
• Solid grasp of parallel algorithm design and numerical precision tradeoffs
• Nice to have: experience with transformer/attention-style kernels or autoregressive decoding
• Nice to have: experience building high-performance GPU libraries from scratch
• Nice to have: background in HPC or other latency-critical performance engineering
• Nice to have: exposure to multi-GPU or multi-node kernel-level optimisation
• Nice to have: comfortable reading PTX/SASS to validate kernel efficiency

Responsibilities:

• Write and optimise custom CUDA kernels for core transformer inference operations
• Profile kernels to identify and eliminate bottlenecks in occupancy, memory throughput, and warp divergence
• Apply kernel fusion to reduce memory round-trips and launch overhead across inference pipelines
• Optimise memory access patterns and manage the memory hierarchy for maximum bandwidth utilisation
• Implement quantisation-aware kernels and mixed-precision arithmetic to reduce latency and memory footprint
• Build and tune caching mechanisms for efficient autoregressive decoding
• Tune kernel launch configurations for target GPU architectures
• Benchmark kernels against existing baselines and drive measurable throughput and latency improvements
• Write tests for CUDA code to catch performance and correctness regressions
• Maintain internal CUDA libraries and contribute to our team coding standards and documentation

Technologies:

• AI
• CUDA
• SASS
• NodeJS

More:

We are Fuse Energy, a forward-thinking renewable energy startup on a mission to deliver a terawatt of renewable energy fast. We combine first-principles thinking with cutting-edge technology to build a radically better energy system. Backed by $210M from top-tier investors including Multicoin, Balderton, Lakestar, Accel, Creandum, Lowercarbon, Ribbit, Box Group and strategic angels, we are expanding into high-performance compute infrastructure at the intersection of energy and AI. We focus on optimising how power-dense GPU workloads are scheduled, cooled, and balanced against grid conditions in real time. This is a full-time role with competitive salary, an equity sign-on bonus, a biannual bonus scheme, fully expensed tech to match your needs, and a breakfast and dinner allowance for office-based employees.

last updated 35 week of 2026