Senior Software Engineer - AI Growth

Join Sanity, where we are pioneering the future of AI-driven Content Operations. Our innovative AI Content Operating System empowers teams to model, create, and automate content in alignment with their unique business processes, enhancing digital development and dramatically improving content operation efficiency. Industry leaders such as Linear, Figma, Riot Games, Anthropic, Spotify, Arc’teryx, and Morningbrew trust Sanity to automate their content workflows.As a Senior Software Engineer focused on AI Growth, you will be pivotal in developing the complete vertical for AI-native applications at Sanity. This includes advancing our Model Context Protocol (MCP) server and delivering agentic systems that can scaffold Sanity applications, Studios, and comprehensive front-end solutions. In collaboration with designers, product managers, and fellow engineers, you will engage in rapid experimentation, transforming the latest AI capabilities into tangible products. If you thrive on innovation, enjoy late-night tinkering with new model releases, and envision possibilities beyond conventional boundaries, this role is perfect for you.Recent achievements include:Sanity MCP Server – our remote MCP server, now generally available and recognized as one of eight official MCP servers in Vercel's v0.Sanity Agent Toolkit – agent rules exposed via MCP, including a Claude Code plugin featuring skills and slash commands.Auto-configured MCP in the CLI – the Sanity CLI now automatically detects code editors and configures the MCP server seamlessly.Your ResponsibilitiesEnhance our MCP server – introduce new functionalities, tools, and integrations that enable AI agents to interact more effectively with Sanity's content platform.Develop agentic developer tools – create systems that can autonomously generate Sanity applications and studios, along with frontend code with minimal human intervention.Design and execute evaluations – construct evaluation suites utilizing Braintrust to identify regressions, assess improvements, and make data-informed decisions regarding prompt and model modifications.

Employee Applicant Privacy NoticeAbout Us:Join us in reshaping the financial landscape. At SoFi, we are revolutionizing how individuals engage with personal finance, empowering our members with innovative, mobile-centric solutions. As a pioneering financial services firm and national bank, we leverage cutting-edge technology to help our millions of members achieve their financial aspirations. In an era of unprecedented industry transformation, we take pride in our daily contributions that significantly enrich lives, guided by our core values. Invest in your future, your career, and the financial realm with us.The Position:We are looking for a Senior Staff Software Engineer, AI to join our Member Growth team, focused on delivering AI-driven value to SoFi Members. This position is crucial in enhancing our members' financial journeys through advanced personalization and AI solutions. You will spearhead the development of internal frameworks, tools, and applications that elevate our marketing, communication, and measurement capabilities.Our mission is to guide members towards financial independence by equipping them with the precise tools, resources, and insights they need to thrive. We aspire to be a reliable ally in their financial endeavors, providing timely and personalized insights that cultivate lasting confidence. Achieving this demands a thoughtful, highly customized approach tailored to each member's unique financial circumstances.The ideal candidate will have extensive expertise in Artificial Intelligence (AI) and Machine Learning (ML) systems, coupled with a fervor for developing next-generation products. At SoFi, we value seamless collaboration between Product, Design, and Engineering; hence, you will engage throughout the entire product lifecycle—from initial concept to deployment and continuous enhancement. We champion a culture of continuous learning and expect you to be equally committed to your professional development and mentoring colleagues.Your Responsibilities:Lead technical architecture and design decisions, facilitating cross-functional discussions for AI and ML solutions.Ensure the delivery of highly available and scalable services in a production environment.

About the Role: The Tubi team is dedicated to creating and refining exceptional user interfaces and experiences across our web and OTT applications. Our primary focus is on implementing features that aid in user acquisition and growth, such as user registration, onboarding, SEO optimization, and account management. As a member of this dynamic team, you will collaborate closely with Product and Design teams to innovate and develop cutting-edge, experiment-driven features that significantly enhance the user experience. Your responsibilities will encompass both front-end development and building robust technical architecture to ensure optimal performance and scalability, while continuously exploring engineering-driven features and experiments that can propel user growth. You will leverage technologies such as React, Node.js, GitHub Actions, Terraform, and CDN infrastructure to create and deploy high-performance applications that serve millions of users. This position is hybrid, based in our San Francisco office, and requires you to be present in the office three days a week.

At Sanity.io, we are at the forefront of revolutionizing AI-driven Content Operations. Our state-of-the-art AI Content Operating System empowers teams to model, craft, and automate content tailored to their unique business processes, significantly enhancing digital development and optimizing content operational efficiency. Renowned companies such as Linear, Figma, Riot Games, Anthropic, Spotify, Arc’teryx, and Morningbrew leverage Sanity to power and automate their content workflows.The landscape of application development is undergoing a seismic shift thanks to AI. Tools that enhance coding experiences are witnessing a surge in user adoption, with professional developers now integrating AI capabilities into their workflows as a standard practice. In this role, you will harness this momentum by developing native integrations with the most rapidly evolving developer tools, enhancing our MCP server (including MCP Apps with UIs), and creating intuitive builders that allow users to set up Sanity through natural language interfaces. You will blend a growth-oriented, experimental culture with in-depth technical work focused on improving the AI developer experience. This represents a pivotal growth opportunity for Sanity, and your team will be responsible for driving it from inception to realization.Recently, the team has achieved notable milestones, including:Sanity MCP Server – our remote MCP server, now generally available and recognized as one of eight official MCP servers in Vercel's v0.Sanity Agent Toolkit – featuring agent rules made accessible via MCP, along with a Claude Code plugin equipped with skills and slash commands.Auto-configured MCP in the CLI – the Sanity CLI now automatically identifies code editors and configures the MCP server accordingly.Key Responsibilities:Lead a team of engineers – guide them in prioritizing impactful projects, support their professional growth, and enable them to produce their best work.Own strategy, roadmap, and execution – collaborate closely with product and design teams to determine development priorities and ensure successful product launches....

About Retell AIAt Retell AI, we are pioneering the future of call centers through innovative voice AI technology. Our cutting-edge solutions are transforming how companies engage with customers.In just 18 months since our inception, we've empowered thousands of businesses with our AI voice agents that efficiently manage sales, support, and logistics calls, significantly reducing the need for large teams of human agents. Supported by industry-leading investors including Y Combinator and Alt Capital, we've grown our annual recurring revenue from $5M to an impressive $36M while expanding our team from 5 to 20 talented individuals since 2025.Our ambitious vision for 2026 is to develop a state-of-the-art customer experience platform where entire contact centers are driven by AI. Unlike basic automation requiring constant human oversight, we’re engineering intelligent AI “workers” capable of serving as frontline agents, quality assurance analysts, and managerial roles, all while optimizing customer interactions continuously.We are rapidly expanding and seeking driven builders who thrive on solving complex technical challenges, act decisively, and wish to make a tangible impact in one of the fastest-growing voice AI startups.Join us in shaping the future!Recognized as a top 50 AI application in the a16z list: https://tinyurl.com/5853dt2xRanked #4 in Brex's Fast-Growing Software Vendors of 2025: https://www.brex.com/journal/brex-benchmark-december-2025Featured among the top startups on: https://leanaileaderboard.com/

Responsibilities:Develop Our Product. Take ownership of software features that enhance our AI platform, empowering private market investors to analyze deals swiftly and accurately. This role requires you to actively engage in coding and delivering essential platform components from the ground up.Ensure Quality and Excellence. Establish and maintain coding standards, architectural guidelines, and review procedures; mentor fellow engineers. Co-cultivate a culture centered on practical, reliable, and test-driven development that swiftly meets business requirements.Scale for Growth. Assist in monitoring and scaling the architecture of our platform and its infrastructure.Collaborate Across Functions. Engage closely with product, security, and go-to-market teams to translate our strategic roadmap into actionable features and deliverables.

At Lassie, we are revolutionizing healthcare by creating the AI that powers every health practice.Over a million health practices are spending upwards of $100 billion annually on administrative staff, yet they struggle to recruit enough personnel. The ongoing impacts of COVID-19 have left many offices understaffed, resulting in patients experiencing unanswered calls and confusing bills daily.We envision a future where AI manages the operations of a doctor's office, streamlining administration and facilitating patient interactions.Founded by Steijn Pelle, who played a pivotal role in scaling Robinhood and Coinbase to hundreds of millions in revenue, and Frédéric Renken, a former engineer and the first product hire at Superhuman, we are infusing consumer product excellence into healthcare and transforming the interaction dynamic between doctors and their patients.About the RoleWe are seeking a Software Engineer to take charge of the systems that enhance the entire customer experience: from discovering our services to onboarding and going live.Independent health practices are often overburdened and require better tools. Your role will be crucial in helping them discover Lassie and achieve success swiftly. Collaborating closely with sales and product teams, you will develop infrastructure that ensures smooth deal closures and enables new customers to thrive from day one.This position is perfect for someone who enjoys experimentation, thrives in a fast-paced environment, and desires to see a direct correlation between their efforts and revenue impact.You Will Be a Great Fit If You...Are enthusiastic about experimentation, learning from mistakes, and employing first principles thinking.Develop tools and systems that amplify the effectiveness of sales and engineering teams.Work closely with sales to transform chaotic workflows into streamlined processes.Help shape our marketing strategies, branding, and distribution methods.Engage with technologies such as Python, TypeScript, various databases, serverless environments, and Salesforce, even if some are new to you.Some Things We've BuiltA specialized growth and onboarding infrastructure that has reduced the demo-to-close timeframe from weeks to mere hours.Data pipelines capable of processing over $1 billion in insurance claims.A synchronization engine supported by encrypted SQLite.

The Trade Desk is a leading global technology company dedicated to fostering a better, more open internet for everyone through principled, intelligent advertising. With the capability to handle over 1 trillion queries daily, our platform operates at an unparalleled scale. We pride ourselves on our award-winning culture, built on the foundations of trust, ownership, empathy, and collaboration. We appreciate the unique experiences and perspectives that every individual brings to The Trade Desk, and we are committed to creating inclusive spaces where everyone can express their authentic selves at work. If you are passionate about solving complex problems at scale and are eager to join a dynamic, globally-connected team where your contributions will significantly impact the media ecosystem, we invite you to explore why Fortune magazine consistently ranks The Trade Desk among the top small to medium-sized workplaces worldwide. As a Senior Software Engineer, you will have end-to-end ownership, allowing you to engage in various facets of designing, building, and delivering data-centric products for our stakeholders. At The Trade Desk, we focus on constructing the back-end infrastructure of our platform with an unwavering commitment to quality at scale. Whether developing components for our client-facing applications, crafting internal custom solutions for our teams, or building model pipelines for bidding optimizations, we ensure that the infrastructure, development processes, and tools empower us to execute efficiently. Our systems operate continuously, serving global traffic, and we collaborate in a highly cooperative environment while leveraging a diverse array of technologies. Our back-end developers tackle algorithmic, optimization, and scalability challenges across all our initiatives.

fractional-ai is looking for a Senior or Staff Software Engineer to join the San Francisco office. This position centers on building advanced AI solutions with a team that values both technical depth and collaboration. Role overview This role focuses on designing and developing AI-driven systems. The work involves solving technical challenges and contributing to projects that push the boundaries of what AI can achieve. Collaboration with other engineers and stakeholders is a key part of daily responsibilities. Who will thrive Experienced engineers with a strong background in software development Those who enjoy working on complex technical problems Individuals who value teamwork and open communication Location This position is based in the San Francisco office.

About BlockitAt Blockit, we recognize that time is the most precious resource, yet the process of scheduling remains antiquated. We are innovating with AI technology to create an autonomous scheduling agent that seamlessly manages complex coordination, including time zones, group scheduling, and in-person logistics—essentially an executive assistant that operates around the clock.Unlike traditional LLM applications, Blockit pioneers the realm of multiplayer, stateful AI agents—enabling coordinated interactions among multiple users while retaining context and executing real-world actions. As more people connect their calendars, the strength of our network increases exponentially.This is the cornerstone of our platform of AI agents designed to optimize time management. Backed by Sequoia, we are a compact, agile team dedicated to rapid development and maintaining high standards. If you are passionate about contributing to groundbreaking advancements, we would love to connect.Learn more about our team and culture on our teams page.The RoleAs a Software Engineer focused on Product & Growth, you will enhance Blockit's functionalities and expand its presence in users' daily routines.This role transcends traditional growth engineering; it involves developing new capabilities for our agents, integrating with various platforms (Slack, mobile, desktop, etc.), and identifying new workflows for Blockit to support. You will oversee the complete feature development process: engaging with users, prototyping, implementing, and analyzing results. Your work will encompass frontend, backend, and agent engineering.Your ResponsibilitiesDevelop new features from concept to completion across backend, frontend, and agent integrations.Introduce new tools and functionalities to our agents to accommodate emerging workflows.Enhance and build integrations with external services including Slack, email, and calendar providers.Collaborate with design and go-to-market teams to identify user needs and pain points.Rapidly prototype, deploy, and iterate based on user feedback.Engage with a diverse codebase, interacting with a variety of systems.QualificationsA minimum of 2 years of experience in delivering production software.Versatility to navigate across the technology stack as required.Strong product sensibility: a commitment to user experience, accuracy, and clarity beyond just meeting technical specifications.Proficiency in programming languages relevant to our stack.Excellent communication skills and a collaborative mindset.

Biotechnology is transforming the world around us—impacting the medicines we use, the crops we cultivate, the fabrics we wear, and the essential products we depend on daily. To keep pace with the rapid advancements in science, we need cutting-edge technology.At Benchling, our mission is to harness the potential of biotechnology. The most innovative biotech firms leverage Benchling’s R&D Cloud to facilitate the development of revolutionary products, shortening the time to key milestones and market entry.Join us in revolutionizing science through modern software solutions.ROLE OVERVIEWWe are a dedicated team focused on developing AI tools for scientists, including agents that automate repetitive tasks and models that enhance molecular design. Our aim is to democratize AI accessibility, empowering every scientist to utilize these advancements. As a member of our engineering team, you will create product experiences that promote AI adoption among the vast community of scientists using Benchling. You will combine robust technical expertise with a keen product sense, optimizing onboarding processes, creating viral engagement strategies, and guiding scientists in effectively integrating AI into their daily activities. Given that we are at the forefront of scientific AI, both at Benchling and in the broader industry, we will iterate quickly based on customer feedback and adapt our strategies to discover the best pathways for development and market engagement. Our success hinges on our curiosity and commitment to our customers.

Join the Revolution at Retell AIRetell AI is pioneering the future of call centers through innovative voice AI, driven by first principles thinking.In just 18 months since our inception, we have empowered thousands of businesses with our AI voice agents, transforming how sales, support, and logistics calls are managed—previously requiring extensive human teams. Supported by prestigious investors such as Y Combinator and Alt Capital, we've rapidly scaled from $5M ARR to an impressive $36M ARR with a compact yet dynamic team of 20.Our ambition for 2026 is to create a revolutionary customer experience platform, where entire contact centers are powered by AI. Moving beyond basic automation, we aim to develop intelligent AI “workers” that serve as frontline agents, QA analysts, and managers, continuously enhancing customer interactions without the need for constant human oversight.As we expand, we are seeking passionate engineers who are eager to solve challenging technical problems, act swiftly, and make a significant impact in one of the fastest-growing voice AI startups. Let’s shape the future together.

About Us:At LangChain, we are on a mission to revolutionize the presence of intelligent agents in everyday applications. We provide robust solutions for agent engineering, enabling developers to transform their prototypes into production-ready AI agents that organizations can depend on. Originating as widely embraced open-source tools, we have expanded to also deliver a comprehensive platform for building, evaluating, deploying, and managing agents on a large scale.Our tools, including LangChain, LangGraph, LangSmith, and Agent Builder, are trusted by teams developing real AI products across various sectors, from startups to large enterprises. We are proud that millions of developers utilize LangChain to support AI initiatives at prominent companies such as Replit, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, and 35% of the Fortune 500.Having raised $125M in Series B funding from leading investors like IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we are at an exciting juncture, continuously innovating and expanding our product offerings. Each team member has the opportunity to make a significant impact on our growth and collaborative culture. At LangChain, your contributions can redefine how technology interacts with the real world.About the Role:We are looking for a Senior Fullstack Engineer to join our newly established team focused on developing foundational product features and integrations that enhance user acquisition, foster rapid experimentation, and enable self-service expansion. This pivotal role involves building growth systems from the ground up, working closely with cross-functional teams including product, design, GTM, and analytics to streamline user activation, optimize product offerings, and create a seamless growth narrative for both developers and enterprise clients. This position requires on-site presence five days a week in New York City, San Francisco, or Boston.Your Responsibilities:Engage across our technology stack (React, TypeScript, Python, Go) to develop full-stack product features that enhance growth and user retention.Create adaptable experimentation systems and processes that target a variety of growth metrics.Engage in data-driven, rapid growth experiments throughout the user journey, from onboarding to monetization.Design and implement new onboarding features and enhancements that quicken the user’s time to value.Develop growth mechanisms, including usage-based guardrails, intelligent upgrade prompts, and contextual calls-to-action.Collaborate closely with product, design, GTM, and analytics teams to identify, prioritize, and execute impactful growth initiatives.

About Our TeamJoin the innovative ChatGPT team at OpenAI, where we blend research, engineering, product development, and design to introduce cutting-edge AI technologies to the global audience.Our mission is to learn from deployment and ensure the responsible and safe use of AI, maximizing its benefits for all. We are dedicated to making our tools universally available, breaking down barriers related to geography, economy, and platform. Our commitment is to enhance lives through AI while gaining deep insights into user interactions with our products.About the PositionWe are seeking a skilled Backend Software Engineer to join our dynamic ChatGPT Growth team. This role will be pivotal in driving high-impact projects aimed at expanding the ChatGPT user base and Plus Subscribers. Responsibilities will include enhancing account accessibility, optimizing notifications, improving SEO, and promoting user engagement and virality. As we embark on our growth journey, your insights will be crucial in identifying strategic opportunities that can lead to substantial results. We value engineers who are driven by impact, exhibit autonomy, possess strong analytical skills, and can effectively eliminate barriers to utilizing the full potential of ChatGPT.Your ResponsibilitiesLead initiatives to drive long-term growth for ChatGPT through data analysis, product ideation, and experimental design to enhance user experiences.Collaborate with iOS, Android, and fullstack engineers to design and implement backend systems that support these product experiences.Work closely with research, product, design, data science, and other teams to ensure impactful execution on project goals.Foster an inclusive culture that encourages open communication and challenges conventional thinking.Ideal Candidate ProfileDemonstrated experience in delivering features that optimize user journeys, including landing pages, product pages, and purchase flows.Strong analytical mindset with a track record of designing and executing A/B tests, employing a scientific approach to data-driven experiments. Proficient in tracking business metrics and KPIs, and skilled at deriving actionable insights from data.Possess a strong desire to learn and develop new skills, showcasing a commitment to personal and professional growth.

Role overview retell-ai seeks a Senior Software Engineer in the San Francisco Bay Area to focus on Go-To-Market (GTM) projects. This engineer will help shape how new products are created and introduced to customers, directly influencing the company’s approach to launching and scaling offerings. What you will do Collaborate with teams across the organization to translate business needs into software that advances GTM objectives. Develop and improve products to ensure they fit seamlessly into the market. Uphold high standards for code quality and system performance as products grow and change. Collaboration This position works closely with product, business, and engineering partners to deliver solutions that address both technical and market demands.

Supported by key investors from Silicon Valley, Peregrine Technologies empowers public safety organizations, state and local governments, federal agencies, and private-sector institutions to address societal challenges with remarkable speed and precision. Our AI-driven platform transforms disconnected data into actionable insights—instantly delivering vital information that enables quicker, more informed decisions, resulting in improved outcomes across various touchpoints. Currently, Peregrine serves hundreds of clients in over 30 states and two countries, impacting more than 125 million people. We are poised for further growth as we expand into enterprise solutions and international markets.TeamAt Peregrine, our engineering team prioritizes empathy, believing it enhances our solutions. Observing how users interact with our product is essential as we navigate towards effective answers. Engineers will have the chance to collaborate onsite with our team, gaining insights into the diverse use cases we address.We cherish both ownership and teamwork—taking full responsibility for significant features while closely collaborating with fellow engineers to bring them to fruition. Humility and empathy are fundamental to developing optimal solutions, as we work directly with our deployment team and users to refine our offerings. Tenacity and creativity are vital in realizing our vision.RoleAs a pivotal member of our new AI team, you’ll play a key role in delivering unique value to our customers. This team is tasked with designing powerful, user-friendly experiences powered by generative AI. You will explore innovative methods for users to engage with our platform—whether through natural language commands or by enabling AI agents to manage complex tasks on their behalf. Your contributions will shape secure, impactful AI-driven features that assist clients in solving real-world issues more efficiently.Your responsibilities will encompass a variety of complex challenges, from scaling our platform to process terabytes of data from multiple sources to efficiently querying and alerting users in real-time, as well as optimizing search algorithms for quick results.Our tech stack is continuously evolving but is rooted in a backend framework of Python, Django, Celery, Airflow, and Kafka; a frontend constructed with React, Redux, and Mapbox; data storage solutions including PostgreSQL and Elasticsearch; machine learning models hosted in Bedrock and SageMaker; along with AWS, Pulumi, Terraform, and Kubernetes as our infrastructure.

Join Our Innovative Team at Retell AIRetell AI is at the forefront of revolutionizing the call center industry through advanced voice AI technology. In just 18 months since our inception, we have empowered thousands of businesses to optimize their sales, support, and logistics calls, which previously relied on large teams of human agents. Supported by prominent investors including Y Combinator and Alt Capital, we've achieved remarkable growth, scaling from $5 million to $36 million in annual recurring revenue (ARR) while expanding our talented team to 20 members.Our ambitious vision for 2026 is to develop a state-of-the-art customer experience platform, transforming entire contact centers with AI. Unlike traditional automation that requires ongoing human oversight, we are building intelligent AI "workers" capable of functioning as frontline agents, quality assurance analysts, and managers, constantly enhancing customer interactions.If you are a passionate innovator eager to solve complex technical challenges and make a tangible impact at one of the fastest-growing voice AI startups, we invite you to join us in shaping the future.Ranked among the top 50 AI applications by a16z: a16z List4th on Brex's Fast-Growing Software Vendors of 2025: Brex BenchmarkFeatured as a leading startup on: Leanaileaderboard

Join Us at Retell AIRetell AI is revolutionizing the call center industry by leveraging innovative voice AI technology based on first principles.In just 18 months since our inception, we have attracted thousands of companies that rely on Retell's AI voice agents to efficiently manage sales, support, and logistics calls, previously handled by large teams of human agents. Supported by renowned investors such as Y Combinator and Alt Capital, we have rapidly grown from $5M to $36M in Annual Recurring Revenue (ARR) with a dedicated team of 20.Looking ahead to 2026, our ambition is to establish a state-of-the-art customer experience platform entirely powered by AI. We aim to create intelligent AI “workers” capable of serving as frontline agents, quality assurance analysts, and managers, continuously optimizing customer interactions without the need for constant human oversight.We are on an exciting growth trajectory and are seeking driven individuals who are eager to solve complex technical challenges, accelerate progress, and make a significant impact at one of the fastest-growing voice AI startups.Let’s innovate the future together!Ranked as a top 50 AI app by a16z: https://tinyurl.com/5853dt2x#4 on Brex's Fast-Growing Software Vendors of 2025: https://www.brex.com/journal/brex-benchmark-december-2025One of the top startups on: https://leanaileaderboard.com/

midihealth seeks a Senior Software Engineer specializing in AI to join the team in a hybrid role based in the San Francisco Bay Area. This position centers on building and enhancing the company’s healthcare technology platform. Role overview This engineer will apply AI knowledge to develop new features and refine existing ones. The work involves collaborating with colleagues to design solutions that address real healthcare needs. Location This is a hybrid role. Candidates should be located in or able to commute to the San Francisco Bay Area.

About SentryAt Sentry, we are committed to transforming the way developers build software. With a mission to eradicate poor software experiences, we empower developers to create better applications more efficiently, ensuring a seamless encounter with technology.Backed by over $217 million in funding and trusted by more than 100,000 organizations, including industry giants like Disney, Microsoft, and Atlassian, we are at the forefront of performance monitoring and error tracking solutions. Our innovative tools enable companies to focus on product development rather than bug fixes.We embrace a hybrid work environment across our global offices, designating Mondays, Tuesdays, and Thursdays as in-office collaboration days to foster meaningful team interactions. If you are passionate about creating solutions that enhance the digital experience, join us in developing the next wave of software monitoring tools.About the RoleAs a Senior Software Engineer on Sentry’s AI/ML team, you will play a pivotal role in constructing the evaluation infrastructure that assesses the accuracy, reliability, and performance of our AI systems in real-world scenarios. This position is essential for ensuring that our debugging agents and AI-driven features operate correctly, safely, and predictably as they scale. You will design datasets, benchmarks, and test harnesses that convert vague AI behavior into quantifiable metrics, enabling the team to deploy AI solutions with confidence.In This Role You WillDevelop and implement robust evaluation frameworks to assess accuracy, reliability, regressions, and edge cases within AI systems.Generate and manage high-quality datasets, golden test cases, and benchmarks based on real production data.Create automated test harnesses and metrics pipelines to continuously evaluate models, prompts, and workflows.Collaborate closely with applied AI engineers and product leaders to establish clear definitions of success and translate them into measurable criteria.Oversee the evaluation lifecycle for significant AI projects, from initial experimentation to ongoing production monitoring.You'll Love This Job If YouHave a strong commitment to accuracy, rigor, and measurement in AI systems.Enjoy transforming ambiguous product objectives and model behaviors into precise tests and metrics.Take pleasure in building foundational infrastructure that facilitates rapid iteration and boosts team confidence.Thrive in collaborative environments and relish the opportunity to influence model design through effective evaluation.