companyOpenAI logo

Backend Software Engineer (Evals)

OpenAISan Francisco
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Experience

Qualifications

4+ years of backend engineering experience in product-driven environments; proficiency in designing and building reliable backend solutions; strong understanding of machine learning concepts; excellent collaboration skills across multidisciplinary teams.

About the job

About Our Team

Join the dynamic Support Automation team at OpenAI, where we utilize cutting-edge AI technologies to tackle real-world challenges and automate processes across our organization. Our mission is to enhance productivity from customer operations to engineering by building a suite of automation tools that empower our team members. We are dedicated to creating innovative products that prioritize quality and reliability through rapid prototyping and reusable solutions applicable across various sectors within OpenAI.

In summary, our team harnesses OpenAI's technology to improve our internal processes, and you will have the unique opportunity to access both public and pre-released technologies to achieve this goal.

About the Role

We are seeking a talented Backend Software Engineer with substantial experience in machine learning and large language models to help us design and implement an evaluation infrastructure that measures the effectiveness of OpenAI's support automation efforts. This role is highly technical and collaborative, requiring you to build resilient systems and backend services that underpin knowledge creation, access, and application throughout OpenAI. You will work closely with Data Science and Research teams to scale evaluations effectively.

Key Responsibilities:

  • Design and implement evaluation pipelines that are dependable, reproducible, and scalable.

  • Develop infrastructure for continuous evaluation monitoring, including regression and drift monitoring, and establish robust feedback loops to enhance support automation.

  • Create, maintain, and support backend services and APIs that facilitate intelligent automation and knowledge systems.

  • Integrate and organize data across internal platforms, optimizing it for downstream systems and AI workflows.

  • Collaborate closely with data, research, and engineering teams to effectively integrate OpenAI models into impactful workflows.

  • Oversee the full development lifecycle of new backend systems and internal platform features.

  • Design with scalability and maintainability in mind while iterating rapidly on innovative ideas.

Ideal Candidate Profile:

  • 4+ years of experience in backend engineering within product-focused companies (excluding internships).

  • Proficient in designing and building reliable backend systems, with a strong understanding of machine learning principles.

  • Experience collaborating across teams to drive project success and impact.

About OpenAI

OpenAI is at the forefront of artificial intelligence research and application, dedicated to developing advanced AI models that address real-world challenges. Our Support Automation team is passionate about crafting innovative automation tools that enhance productivity and serve our colleagues effectively. We prioritize quality, reliability, and a collaborative work environment to drive impactful solutions.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.