About the job
About Our Team
Join the dynamic Support Automation team at OpenAI, where we utilize cutting-edge AI technologies to tackle real-world challenges and automate processes across our organization. Our mission is to enhance productivity from customer operations to engineering by building a suite of automation tools that empower our team members. We are dedicated to creating innovative products that prioritize quality and reliability through rapid prototyping and reusable solutions applicable across various sectors within OpenAI.
In summary, our team harnesses OpenAI's technology to improve our internal processes, and you will have the unique opportunity to access both public and pre-released technologies to achieve this goal.
About the Role
We are seeking a talented Backend Software Engineer with substantial experience in machine learning and large language models to help us design and implement an evaluation infrastructure that measures the effectiveness of OpenAI's support automation efforts. This role is highly technical and collaborative, requiring you to build resilient systems and backend services that underpin knowledge creation, access, and application throughout OpenAI. You will work closely with Data Science and Research teams to scale evaluations effectively.
Key Responsibilities:
Design and implement evaluation pipelines that are dependable, reproducible, and scalable.
Develop infrastructure for continuous evaluation monitoring, including regression and drift monitoring, and establish robust feedback loops to enhance support automation.
Create, maintain, and support backend services and APIs that facilitate intelligent automation and knowledge systems.
Integrate and organize data across internal platforms, optimizing it for downstream systems and AI workflows.
Collaborate closely with data, research, and engineering teams to effectively integrate OpenAI models into impactful workflows.
Oversee the full development lifecycle of new backend systems and internal platform features.
Design with scalability and maintainability in mind while iterating rapidly on innovative ideas.
Ideal Candidate Profile:
4+ years of experience in backend engineering within product-focused companies (excluding internships).
Proficient in designing and building reliable backend systems, with a strong understanding of machine learning principles.
Experience collaborating across teams to drive project success and impact.

