companyOpenAI logo

Threat Modeler - Preparedness

OpenAISan Francisco
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Entry Level

Qualifications

Successful candidates will have a strong background in risk assessment and modeling, with experience in AI systems and their potential impacts. You should possess excellent analytical skills, the ability to work collaboratively across disciplines, and a proactive approach to identifying and mitigating risks.

About the job

About the Team

The Preparedness team plays a crucial role within the Safety Systems organization at OpenAI, adhering to our Preparedness Framework.

While frontier AI models promise to bring significant benefits to humanity, they also introduce substantial risks. The Preparedness team is dedicated to ensuring that the development of advanced AI models fosters positive outcomes. Our mission includes identifying, monitoring, and preparing for catastrophic risks associated with these technologies.

Key Mission Objectives:

  1. Monitor and predict the evolving capabilities of frontier AI systems to identify misuse risks that could significantly impact society.
  2. Establish concrete procedures, infrastructure, and partnerships to mitigate these risks and ensure the safe development of powerful AI systems.

This fast-paced and impactful role connects capability assessment, evaluations, internal red teaming, and mitigations for frontier models, facilitating coordination on AGI preparedness.

About the Role

As a Threat Modeler, you will spearhead OpenAI's comprehensive approach to identifying, modeling, and forecasting risks from frontier AI systems. Your work will ensure that our evaluation frameworks, safeguards, and classifications are robust, comprehensive, and future-focused. You will help articulate the rationale behind our most stringent risk-prevention strategies, influencing prioritization and mitigation across various domains. This position acts as a central hub, integrating technical, governance, and policy considerations regarding our approach to frontier AI risks.

Key Responsibilities

  • Develop and maintain comprehensive threat models across various misuse areas (biological, cyber, attack planning, etc.).
  • Create plausible threat models addressing loss of control, self-improvement, and other potential risks associated with alignment from frontier AI systems.
  • Forecast risks by merging technical foresight, adversarial simulation, and current trends.
  • Collaborate closely with technical partners on capability evaluations and risk assessments.

About OpenAI

OpenAI is at the forefront of artificial intelligence research and development, committed to ensuring that AI benefits all of humanity. Our teams are dedicated to pushing the boundaries of technology while prioritizing safety and ethical considerations.

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.