companyOpenAI logo

Tokens-as-a-Service (TaaS) Software Engineer

OpenAISan FranciscoNew
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Experience

Qualifications

Required QualificationsSolid software engineering background with hands-on experience in building systems, tooling, automation, or infrastructure platforms. Experience in compute infrastructure, distributed systems, performance engineering, or operational production environments. Strong analytical skills to assess token throughput, utilization, benchmarking, infrastructure efficiency, and workload performance. Proficient in integrating external systems or partner environments into internal infrastructure stacks. Excellent debugging and analytical skills across hardware, networking, software, and operational domains. Preferred QualificationsExperience with cloud platforms and services. Familiarity with machine learning frameworks and token management systems.

About the job

OpenAI is hiring a Tokens-as-a-Service (TaaS) Software Engineer in San Francisco. This position focuses on building and maintaining systems that transform large-scale infrastructure capacity into reliable, measurable token throughput for demanding workloads. The work combines hands-on engineering with a strong focus on operational reliability and performance.

The engineer will work on performance benchmarking, tokenomics, model porting, infrastructure integration, systems tooling, and operational monitoring. The role bridges partner and in-house compute environments with OpenAI’s infrastructure, supporting onboarding, measurement, monitoring, and optimization of GPU resources for real-world workloads.

What you will do

  • Design and develop systems and tools to measure, monitor, and improve token throughput across a range of compute environments.
  • Support benchmarking, tokenomics analysis, and model porting for different infrastructure setups.
  • Create integration tools to connect external or partner infrastructure with OpenAI’s compute, observability, and workload management systems.
  • Set up and track operational metrics such as billing, usage, SLAs, utilization, reliability, and throughput.
  • Identify and resolve bottlenecks in hardware, networking, software, or workload enablement that impact token generation.
  • Work closely with compute, infrastructure, networking, finance, and operations teams to turn raw capacity into usable workload-serving power.
  • Build dashboards, automation, and reporting tools that provide clear visibility into TaaS capacity, efficiency, and business results.

Requirements

  • Strong background in software engineering, with direct experience building systems, tools, automation, or infrastructure platforms.
  • Experience working with compute infrastructure, distributed systems, performance engineering, or operational production environments.
  • Analytical skills for assessing token throughput, utilization, benchmarking, infrastructure efficiency, and workload performance.
  • Ability to integrate external systems or partner environments into internal infrastructure stacks.
  • Excellent debugging and analytical abilities across hardware, networking, software, and operational areas.

Preferred qualifications

  • Experience with cloud platforms and services.
  • Knowledge of machine learning frameworks and token management systems.

About OpenAI

OpenAI is committed to advancing digital intelligence in a way that is safe and beneficial for humanity. We harness the power of machine learning and AI to develop innovative solutions that address real-world challenges.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.