About the job
Join Perplexity, a pioneering firm serving millions of users daily by providing reliable and high-quality answers through an innovative LLM-first search engine combined with specialized data sources. Our Answer Quality team plays a crucial role in refining prompts, tools, searches, and specialized datasets, ensuring that our evaluations are fast, accurate, and actionable. In this exciting role, you will be instrumental in building the data flywheel that supports various teams across Perplexity.
Responsibilities
Develop and maintain systems and pipelines that empower Search, Product, and other teams to independently access reliable evaluation verdicts without delays.
Take charge of the "evals-to-product" loop, autonomously transforming raw signals into robust datasets that drive decision-making throughout the organization.
Construct a sophisticated simulator pipeline capable of replaying user interactions with the product in formats comprehensible to LLMs and VLMs, reflecting real-time product updates.
Ensure data integrity by implementing monitoring, lineage tracking, and quality checks, providing downstream consumers with reliable results.
Collaborate within a small, impactful team where your contributions will directly influence how Perplexity measures and enhances Answer Quality.

