Member of Technical Staff (Index Engineer, Search Crawler)
De onde veio esta listagem
Esta vaga foi obtida de uma publicação pública. Perplexity ainda não reivindicou a listagem, então ninguém de lá se comprometeu a entrevistar pelo VoxJobs ainda — você é entrevistado por nós, a empresa é procurada com os candidatos, e você é avisado no momento em que ela entrar.
Sobre a vaga
AI answers are only as trustworthy as the information behind them. Perplexity grounds its answers in fresh, real-world sources, and the index is what makes that possible. We're looking for an engineer to work on the indexing and data processing layer of Perplexity's Search Crawler. You'll build systems that ingest, process, and organize large volumes of crawled content into efficient, queryable structures, working primarily on offline and nearline pipelines that keep data fresh, complete, and accessible to downstream retrieval. Throughput, scalability, and correctness are critical across datasets that change continuously.
Responsibilities
- Design, implement, and operate large-scale indexing systems and data pipelines at the core of Perplexity's search infrastructure.
- Develop and optimize indexing strategies that balance performance, freshness, and resource efficiency.
- Work on storage formats, compaction, and update mechanisms that keep data accessible and current.
- Keep pipelines reliable and predictable under high-throughput conditions.