P

Perplexity

London

Member of Technical Staff (Index Engineer, Search Crawler)

Full Time昨天
Search

职位描述

AI answers are only as trustworthy as the information behind them. Perplexity grounds its answers in fresh, real-world sources, and the index is what makes that possible. We're looking for an engineer to work on the indexing and data processing layer of Perplexity's Search Crawler. You'll build systems that ingest, process, and organize large volumes of crawled content into efficient, queryable structures, working primarily on offline and nearline pipelines that keep data fresh, complete, and accessible to downstream retrieval. Throughput, scalability, and correctness are critical across datasets that change continuously.

Responsibilities

  • Design, implement, and operate large-scale indexing systems and data pipelines at the core of Perplexity's search infrastructure.

  • Develop and optimize indexing strategies that balance performance, freshness, and resource efficiency.

  • Work on storage formats, compaction, and update mechanisms that keep data accessible and current.

  • Keep pipelines reliable and predictable under high-throughput conditions.

  • Build well-tested components with clear responsibilities and interface contracts that stay flexible as the system evolves.

  • Define and implement observability across offline and near line pipelines, including structured logs, metrics, and data quality signals.

  • Monitor throughput, resource usage, and cost, and drive optimisations as business needs change.

  • Partner with retrieval, ranking, and ML teams to make sure indexing outputs meet their requirements.

  • Enable safe experimentation on indexing strategies and processing logic through controlled rollouts and clearly defined quality signals.

Qualifications

  • 5+ years of experience building production backend or data infrastructure systems.

  • Strong programming experience in Go, C++, or Rust.

  • Experience with high-throughput data processing systems and very large datasets.

  • Experience building or operating databases, storage systems, data planes, or indexing pipelines.

  • Strong understanding of distributed systems, fault tolerance, consistency, and scalability.

  • Experience running production systems and handling operational incidents.

  • A systems-thinking mindset and the ability to reason about end-to-end data flows.

Find Jobs in United Kingdom on Arbeitnow

Applying for Member of Technical Staff (Index Engineer, Search Crawler)?

Build a resume tailored to this role at Perplexity in minutes — free, and formatted to pass applicant tracking systems.

如何申请

准备好申请了吗?你需要准备:

  • 一份突出相关经验的最新简历
  • A compelling cover letter (if required)
  • Portfolio or work samples (for relevant positions)

关于 Perplexity

P

Perplexity

London

常见问题

Where is the Member of Technical Staff (Index Engineer, Search Crawler) position at Perplexity located?

The Member of Technical Staff (Index Engineer, Search Crawler) role at Perplexity is based in London.

What type of employment is the Member of Technical Staff (Index Engineer, Search Crawler) role at Perplexity?

This Member of Technical Staff (Index Engineer, Search Crawler) position is offered as Full Time.

What skills are needed for the Member of Technical Staff (Index Engineer, Search Crawler) role at Perplexity?

Key skills and focus areas for this role include Search.

How do I apply for the Member of Technical Staff (Index Engineer, Search Crawler) position at Perplexity?

You can apply for the Member of Technical Staff (Index Engineer, Search Crawler) role at Perplexity directly from this page. Create a professional, ATS-ready resume with Clever CV to strengthen your application before you apply.

探索更多机会

来自知名企业的数千个职位正在等你