About the job
Join Perplexity as a Search Quality Analyst and help us enhance our advanced search technologies. We are seeking a skilled data analyst who will leverage user behavior insights to optimize our A/B testing processes and improve our product offerings. This role involves identifying critical signals in user interactions and transforming data into actionable insights.
Key Responsibilities
Create data-driven insights from user interactions to guide our product strategy and boost user engagement.
Develop and test hypotheses through the design, execution, and analysis of A/B tests.
Define key performance metrics and visualizations for ongoing tracking and present them through interactive dashboards.
Innovate new data pipelines to enhance search ranking quality, including discovering new signals, generating metrics, and creating data labeling frameworks that incorporate both human and LLM feedback.
Required Qualifications
Minimum of 4 years of experience in data analysis or a related field.
Proven experience with search-related products, focusing on online metrics and A/B testing analysis.
Strong proficiency in Python, with the capability to produce production-grade code.
Expertise in SQL for data manipulation and analysis.
Familiarity with Business Intelligence (BI) tools for data visualization.
Solid understanding of statistical concepts and methodologies.
Preferred Qualifications
Experience with Apache Spark for big data processing.
Familiarity with Databricks for collaborative data science.
Experience in developing LLM-as-a-judge systems to enhance analytics.

