Content Integrity Analyst

Join Our Dynamic TeamAt OpenAI, our Trust, Safety & Risk Operations teams are dedicated to protecting our innovative products, users, and the organization from various threats, including abuse, fraud, scams, and regulatory challenges. We operate at the nexus of operations, compliance, user trust, and safety, collaborating closely with Legal, Policy, Engineering, Product, Go-To-Market, and external partners to ensure our platforms are secure, compliant, and reliable for a diverse, global audience.Our team supports users across ChatGPT, our API, enterprise solutions, and developer tools. We handle sensitive inbound inquiries, develop detection and enforcement systems, and scale operational workflows to address the demands of a fast-paced, high-stakes environment.Your Role and ResponsibilitiesWe are looking for seasoned analysts with expertise in one or more of the following domains:Content Integrity & Scaled Enforcement – Proactively identify, review, and respond to policy violations, harmful content, and emerging abuse trends on a large scale.Emerging Risk Operations – Detect, assess, and mitigate new and intricate safety, policy, or integrity challenges in the rapidly changing AI landscape.In this role, you will manage high-sensitivity workflows, serve as the incident manager for complex cases, and develop scalable operational systems, including tools, automation, and vendor processes that uphold user safety and trust while fulfilling our legal, ethical, and product commitments.Our work culture embraces a hybrid model of three days in the San Francisco office each week, and we provide relocation assistance for new hires.Please be advised that this role may involve exposure to sensitive content, including material that may be sexual, violent, or otherwise unsettling.Your Key Responsibilities Include:Manage and resolve high-priority cases within your area of expertise (content enforcement, fraud/scams, compliance, or emerging risks).Conduct thorough risk assessments and investigations utilizing internal tools, product signals, and external data sources.Act as the incident manager for escalated cases necessitating intricate policy, legal, or regulatory analysis.Collaborate with cross-functional teams to design and implement top-tier operational workflows, decision trees, and automation strategies.Establish feedback loops and continuous improvement initiatives to enhance operational effectiveness.

About Our TeamAt OpenAI, our User Safety & Risk Operations team is dedicated to protecting our platform and users from various forms of abuse, fraud, and emerging threats. We operate at the crucial intersection of product risk, operational scale, and real-time safety response, supporting a diverse range of users from individuals to global enterprises, as well as advertisers and creators.The Ads Trust & Safety Operations team is committed to ensuring the safety of our users, advertisers, and creators across all monetized surfaces. As OpenAI rolls out new revenue-generating formats and partnerships, this team guarantees that these experiences are safe, compliant, of high quality, and aligned with our overarching safety standards. We work closely with Product, Engineering, Policy, and Legal teams to identify potential risks, develop and enhance enforcement systems, and ensure scalable, high-integrity operations.About the RoleWe are seeking a seasoned operator to help expand and enhance the Ads Trust & Safety Operations at OpenAI. In this pivotal role, you will oversee critical Ads T&S workstreams from inception to execution, collaborating closely with Product, Policy, Engineering, Legal, and Operations teams to design scalable enforcement processes, strengthen detection mechanisms, and ensure safe support for Ads and monetization at scale.You will navigate the intersection of strategy and execution—translating ambiguity into structured programs, identifying operational risks, and driving measurable improvements across systems and workflows.This position requires an individual who is highly operational, excels at execution, and is comfortable providing clarity in uncertain situations. You should be enthusiastic about building scalable systems and processes from the ground up and working in tandem with policy and product teams as we rapidly iterate on advertising strategies and features.Key Responsibilities:Oversee complex, high-impact Ads Trust & Safety problem areas from strategy through execution.Design and scale operational workflows for Ads Trust & Safety, encompassing enforcement models, review processes, escalation paths, and quality frameworks.Work closely with Product, Policy, and Engineering teams to translate risk and policy requirements into scalable systems, tools, and automation.Drive operational readiness for new Ads and monetization launches, features, and markets, identifying risks early and ensuring appropriate mitigations are in place.Leverage data to identify trends, gaps, and emerging risks across Ads surfaces; develop proposals for enhancements.

About Our TeamAt OpenAI, our Trust, Safety & Risk Operations teams play a crucial role in protecting our innovative products, valued users, and the integrity of our organization from various threats such as abuse, fraud, scams, and regulatory non-compliance. We work collaboratively across operations, compliance, and user safety, partnering closely with Legal, Policy, Engineering, Product, Go-To-Market teams, and external stakeholders to ensure our platforms are secure, compliant, and trusted by a diverse, global audience.The Global Safety Response Operations team provides round-the-clock support for user safety, risk management, and regulatory escalations pertaining to OpenAI’s suite of products. We address high-priority cases that necessitate human judgment and swift action. Acting as the core escalation management and delivery unit of OpenAI’s safety operations, we strive to ensure our products are safe and aligned with our policies while delivering timely, empathetic, and consistent support to our users.About the RoleWe are seeking experienced Trust, Safety, and Risk Operations analysts with expertise in areas such as policy enforcement, content moderation, fraud prevention, developer risk, or privacy and regulatory matters. As a key player in safety escalation management, you will triage and resolve urgent and sensitive cases while collaborating across various subject matter areas, systems, and processes to ensure operational excellence, drive process enhancements, and extract valuable insights and trends.This role operates within a 24/7 global framework, necessitating flexibility to work rotating shifts, including nights, weekends, and holidays as part of an on-call support model.Our hybrid work model offers three days in-office weekly, alongside relocation assistance for new hires.Please be advised that this position may involve exposure to sensitive content, which may be sexual, violent, or otherwise disturbing.Your Responsibilities:Manage and resolve high-priority cases related to all harm and risk areas, ensuring prompt and appropriate resolutions in accordance with policy and legal standards.Utilize multiple systems and tools to oversee user reports, internal escalations, and other critical investigations.Serve as an incident manager for escalations that require nuanced interpretation of policies, legal stipulations, or regulatory guidelines.Identify and implement process enhancements and automation initiatives to boost efficiency, accuracy, and coverage.Collaborate with cross-functional teams to drive continuous improvement and optimize operational workflows.

Join Lyft as a Manager of Trust & Safety Policy, where you will play a crucial role in shaping and implementing policies that ensure the safety and trust of our community. Your leadership will guide strategic initiatives, engage with stakeholders, and drive data-informed decisions to foster a secure environment for our riders and drivers.

As the Trust and Safety Strategy Lead at Faire, you will play a pivotal role in shaping our approach to ensuring the security and trust within our marketplace. You will be responsible for developing and executing strategic initiatives that promote a safe environment for our users, driving policy development, and collaborating with various teams to implement safety measures and risk management protocols.This position is ideal for a strategic thinker with a strong background in trust and safety, who thrives in a fast-paced, innovative environment.

Chime is hiring a Product Manager focused on Trust & Safety in San Francisco. This role centers on protecting the platform and its users by driving initiatives that strengthen safety and reduce fraud. Role overview The Product Manager will work with teams across the company to design and launch strategies that address user safety concerns. Efforts will target the identification and prevention of fraudulent activities, ensuring that Chime remains a secure place for members. Key responsibilities Develop and implement product strategies to enhance trust and safety Collaborate with engineering, operations, and other teams to address risks and improve user security Shape product direction with a focus on maintaining a trustworthy platform Impact Your work will directly influence how Chime protects its community, helping to build a safer experience for all users.

Discord, a platform frequented by over 200 million users monthly, thrives on its vibrant gaming community, where more than 90% of users engage in gaming activities. With a staggering 1.5 billion hours spent playing diverse titles each month, Discord is pivotal in shaping the gaming landscape. Our mission is to enhance social interactions for gamers before, during, and after gameplay.We are seeking an outstanding Trust & Safety Counsel to join our dynamic legal team. This influential role offers the opportunity to contribute significantly at one of the most exciting companies in the tech industry! As our second Trust & Safety Counsel, you will be integral in supporting our Trust & Safety organization, addressing law enforcement data requests, identifying and removing harmful content and actors, and ensuring compliance with international laws and regulations.

Join suno as an Engineering Manager in our Trust & Safety team, where you will lead the development and implementation of innovative solutions to enhance user safety and trust on our platform. You will work closely with cross-functional teams to ensure the integrity of our systems and the protection of our users. Your leadership will be vital in driving engineering excellence and fostering a culture of safety and accountability.

Role overview The Senior Manager, Trust & Safety Policy at Lyft leads the team that shapes and updates policies to protect riders and drivers. This position ensures Lyft’s standards align with legal requirements and promote a secure experience on the platform. The role involves both policy development and hands-on implementation. Key responsibilities Guide a team dedicated to creating and carrying out trust and safety policies Draft and update policies that keep users safe while meeting legal and regulatory standards Collaborate with colleagues from multiple departments to design solutions that work in practice Share policy changes and decisions clearly throughout the company What Lyft looks for Ability to think strategically and solve complex problems Strong communication skills Experience working with teams across different functions Background in trust and safety, policy, or a related area is helpful Location San Francisco, CA

Join Quizlet as a Senior Software Engineer specializing in Trust & Safety, where you will play a crucial role in enhancing the security and integrity of our platform. You will collaborate with cross-functional teams to develop robust software solutions that protect our community and ensure a safe learning environment.

Join Databricks, where we are dedicated to creating the most advanced and secure platform for data and AI. Our commitment to innovation drives us to develop cutting-edge solutions in security, compliance, and governance.As a vital member of the Trust and Safety Data Science team, you will engage in projects that are essential for maintaining the security and regulatory compliance of the Databricks Platform. Our clients rely on Databricks to safeguard their data while managing millions of virtual machines across three clouds in numerous regions worldwide.Our engineering teams design highly sophisticated products that address significant real-world challenges. We continuously strive to push the limits of data and AI technology, all while ensuring the security and scalability that are crucial for our customers' success on our platform. We cater to a diverse array of companies with different security and compliance needs. Understanding how our customers utilize our existing features is imperative, involving comprehensive, data-driven analysis of all facets of Databricks' security programs.Customers entrust us with their most critical data, and our mission is to establish the most reliable data analytics and machine learning platform globally. We are expanding our Trust and Safety Data Science team and seek talented individuals to join our group of “full stack” data scientists. Collaborating closely with engineering and security teams, you will focus on strategic initiatives that enhance the security and safety of Databricks for our clients. Our team employs advanced statistical and machine learning techniques to detect fraud and abuse across our platforms, utilizing state-of-the-art methodologies. For insights into our initiatives, check out our blog post. Engaging in fraud and abuse detection is dynamic and crucial, offering you a chance to significantly impact the security and efficiency of business operations.For further information, please visit https://www.databricks.com/trust.

About the TeamThe Trust & Safety, Integrity, and Fraud Product team at DoorDash is committed to creating a secure and reliable experience for all users on our platform, including Consumers, Merchants, and Dashers. We address intricate challenges such as fraud prevention, account takeover prevention, authenticity verification, and regulatory compliance, all while ensuring a seamless user experience. Our collaborative efforts with cross-functional teams—including Engineering, Data Science, Compliance, and Risk Operations—drive strategic initiatives that safeguard our business while promoting growth.About the RoleAs DoorDash expands beyond restaurants into a broader marketplace, our commitment to safety and trust remains paramount. We are seeking a Senior Product Manager to spearhead cross-functional teams tackling complex challenges that affect Consumers, Dashers, and Merchants. Your role will encompass various aspects of our business—from new user onboarding and in-app experiences to innovative products and services that are unparalleled in the market. Depending on your expertise, you will either lead a vertical fraud team focused on protecting Consumers or a horizontal fraud platform team dedicated to enhancing our Risk Engine, Data Signals Intelligence, and Automation/Anomaly Detection capabilities. This is an exceptional opportunity to shape the future of DoorDash during a period of rapid growth and significant impact.You’re excited about this opportunity because you will…Establish the vision and long-term product strategy for a vertical or horizontal fraud team.Develop and implement a customer-centric product roadmap in close collaboration with senior leadership, Operations, Data Science, Analytics, Design, and Engineering teams.

The Minor Safety Analyst is essential in protecting vulnerable users by thoroughly reviewing and processing reports related to safety and abusive incidents that could endanger minors. This role requires the execution of detailed open-source and in-platform investigations to identify harmful behaviors, recognize threat actors, and evaluate potential risks. The analyst is responsible for managing high-volume analytical workflows, ensuring that all findings are documented accurately while adhering to tight deadlines. They produce clear and concise written summaries and investigative reports for both internal teams and client stakeholders. Furthermore, analysts collaborate with cross-functional teams to ensure that safety requests are processed effectively and in accordance with established protocols.This role requires availability from Tuesday to Saturday, 9:00 AM to 5:00 PM local time.Review and process reports of abuse and safety incidents, particularly those that may involve potential harm to minors, while adhering to established operational procedures.Conduct open-source and in-platform investigations into behavioral abuse and threat actors to identify techniques, context, and impact.Support analytical workflows by documenting findings clearly, meeting deadlines, and maintaining a high level of accuracy and consistency.Generate concise written summaries, briefings, and investigative reports for internal and client stakeholders.Work collaboratively with team members, cross-functional partners, and vendor teams to ensure requests are processed efficiently and accurately.Contribute to the continuous improvement of investigative workflows and knowledge resources.Engage in team training sessions, shadowing, and peer reviews to enhance professional expertise and investigative capabilities.

As a Senior Analyst for Minor Safety at Control Risks, you will be instrumental in assisting a leading global technology firm in safeguarding and fortifying its online platform. This role focuses on the critical task of reviewing and addressing safety and abuse incidents involving minors, conducting in-depth investigations of behavioral abuse and potential threat actors, and delivering high-quality analytical insights in a dynamic environment. Become part of a dedicated, mission-oriented team that collaborates across various disciplines to protect vulnerable populations, allowing the client to operate securely and responsibly in a constantly shifting risk landscape.Work Schedule: Tuesday to Saturday, 9:00 AM - 5:00 PM local time.Thoroughly review incident reports related to safety and abuse targeting minors, taking decisive action in accordance with operational policies and ensuring consistent follow-through on every report.Conduct investigations into behavioral abuse and threat actors on the client’s platform to analyze techniques, impacts, and attribution accurately.Engage in a fast-paced analytic workflow, meeting tight deadlines while maintaining a high standard of analytic excellence, ensuring that reporting deliverables are aligned with best practice intelligence assessments.Prepare detailed written reports, presentations, and strategic insights for senior leadership and the broader organization.Lead improvement initiatives by offering guidance on policy development and executing projects that enhance existing workflows.Review and provide constructive feedback on team members’ work, and design and deliver training programs.Identify emerging issues and trends, escalating them as necessary.Contribute to enhancing support resources and content.Act as a consultative partner with our vendor team, providing expertise in processing all types of requests with exceptional quality and efficiency.Serve as a role model and mentor to colleagues, demonstrating flexibility and outstanding teamwork to prioritize competing demands effectively.

About Scribd:At Scribd Inc. (pronounced “scribbed”), we are dedicated to igniting human curiosity and enriching lives through a diverse tapestry of stories and knowledge. Join us in our mission to democratize the sharing of ideas and information while empowering collective expertise through our innovative products: Everand, Scribd, Slideshare, and Fable.We foster a work culture where authenticity and boldness thrive; a place where we engage in meaningful discussions and embrace the unexpected as we prioritize our customers' needs.Our flexible work arrangement, Scribd Flex, allows employees to collaborate with their managers to establish a daily work style that meets their individual preferences. This initiative highlights our commitment to in-person interactions that build teamwork and community, requiring occasional attendance for all Scribd employees, regardless of location.What do we seek in our new team members? We value “GRIT” — the fusion of passion and perseverance towards achieving long-term goals. At Scribd, we encourage everyone to embody a GRIT-ty mindset in their work. This means setting and achieving Goals, delivering Results, generating Innovative ideas, and fostering positive Team dynamics through collaboration and attitude.

Airbnb started in 2007 when two hosts welcomed three guests into their San Francisco home. Since then, the platform has grown to over 5 million hosts and more than 2 billion guests worldwide. Hosts offer unique stays and experiences that connect travelers with local communities. Trust Engineering at Airbnb Trust sits at the heart of Airbnb’s platform. The Trust Engineering team builds technology to keep the community safe and uphold high standards for hosts, guests, homes, and experiences. Their work addresses both online risks, such as account compromise, fake listings, and financial loss, and offline concerns like theft, property damage, and personal safety. The team’s responsibilities include user onboarding, screening, identity, and reputation systems. Trust Engineering leads the technical vision for these systems and integrates them throughout Airbnb’s platform. Role overview The Senior Staff Software Engineer, Trust, is a senior individual contributor role. This engineer partners with technical leaders across Airbnb to shape, plan, and deliver a broad roadmap of Trust engineering projects. The position involves extensive collaboration with teams throughout the company. While highly senior, this is still a hands-on engineering role, every Airbnb software engineer, regardless of level, contributes code and development work. What you will do Define and drive the long-term vision and strategy for the Trust Platform, setting architectural direction for core systems that support scalable, high-quality fraud detection, safety, and trust decisions across Airbnb. Work deeply within Trust Platform components, developing system and performance tools, and identifying ways to improve technical quality, operational excellence, and developer experience. Promote an AI-first engineering approach, using LLM-powered agents to generate and refine code, so you can focus on problem-solving, system design, and quality oversight. Location This position is remote and based in the United States.

Join our innovative team at Intrinsic Safety, where we leverage cutting-edge technologies to tackle some of the most challenging issues of the digital era using safe and effective AI. Your role will be pivotal in enabling Trust & Safety teams to minimize time spent on tedious manual reviews and investigations, empowering them to focus on what truly matters. By transforming the methods these teams use to protect their communities from various threats, including spam, scams, misinformation, hate speech, and physical security issues, you will significantly impact the lives of many individuals. We are experiencing rapid growth, serving major social media and online service platforms.We are seeking our inaugural Business Development Representative (BDR) to spearhead pipeline growth and assist in scaling our sales efforts. In this role, you will be responsible for outbound prospecting, qualifying leads, and scheduling meetings with decision-makers across online marketplaces and digital platforms. Collaborating closely with the go-to-market (GTM) team, you will refine messaging, optimize outreach strategies, and cultivate relationships with potential customers. This is a high-impact position that offers the chance to shape our sales approach and advance your career as we grow.This position requires in-person attendance at our San Francisco office.Key Responsibilities:Generate and qualify leads through strategic outbound prospecting, focusing on trust & safety, legal, and compliance leaders.Implement multi-channel outreach strategies via email, phone, and LinkedIn to engage key decision-makers and secure discovery meetings.Conduct initial conversations to assess prospect needs, evaluate fit, and ensure seamless transitions to the GTM team.Accurately track outreach activities, interactions, and pipeline progress in our CRM system.Provide insights from customer interactions to refine our sales messaging, ideal customer profile, and go-to-market strategy.

Join Sofi as a Senior Insider Trust & Fraud Investigator, where you will play a pivotal role in safeguarding our customers and ensuring their trust. You will leverage your expertise to investigate and mitigate insider threats and fraudulent activities, contributing to a secure financial environment.

Zūm is transforming mass mobility with its Connected Mobility Experience (Zūm CMX) system, which synchronizes people, vehicles, and operations in real time. In the student mobility sector, Zūm CMX aims to deliver reliable, transparent, and efficient transportation for students and their families. More than 4,500 schools rely on Zūm CMX. The company has received recognition from Fast Company’s World’s Most Innovative Companies, CNBC’s Disruptor 50, and the Financial Times’ Fastest Growing Companies. Backing comes from investors such as Sequoia Capital, GIC, TPG, and Softbank. Role overview The Safety Manager will oversee safety operations for Zūm in San Francisco. This position covers the full safety lifecycle: developing programs, delivering training, managing incidents, and ensuring compliance with regulatory standards. The role leads the safety department and works to build a strong culture of behavioral safety, aiming to protect employees, students, and the community. The Safety Manager is responsible for upholding safety as a core value, making sure everyone returns home safely each day. What you will do Develop and implement safety programs and standards Deliver safety training and promote behavioral change Manage incident response and investigate accidents Ensure compliance with all regulatory safety requirements Lead the safety department and foster a culture of shared responsibility What makes a candidate successful Strong commitment to safety and achieving zero incidents Ability to balance proactive prevention and responsive incident management Experience designing and delivering engaging safety training Skill in analyzing incident data and conducting field observations Confidence presenting safety metrics to administrators and investigating accident scenes Clear communication and the ability to interpret safety regulations