Evaluations Engineer, Applied AI

Artificial Intelligence (AI) is increasingly essential across various sectors of society. At Scale AI, we are dedicated to accelerating the evolution of AI applications. For over eight years, we have been a premier AI data foundry, driving groundbreaking advancements in areas such as generative AI, defense technologies, and autonomous vehicles. Following our recent Series F funding round, we are enhancing the deployment of frontier data and models by developing sophisticated agents for enterprises globally through our Scale Generative Platform (SGP). Our SGP ML team stands at the forefront of the AI revolution. We collaborate directly with clients to create innovative products utilizing our extensive proprietary research and resources. As a Staff Applied AI Engineer, you will engage with clients to develop machine learning solutions that address their specific business challenges. Your projects will encompass a range of applications, from constructing next-generation AI cybersecurity firewalls to transforming journalism through AI experiences, as well as employing foundational genomic models to predict vital drug proteins. Through daily data-driven experiments, you will uncover critical insights regarding model performance, which you will leverage to enhance our products. If you are passionate about influencing the future of AI, we invite you to apply!

Join Our Innovative Team at ArcadeAt Arcade, we are revolutionizing the way physical products are created with our cutting-edge AI platform. We empower individuals to turn their creative ideas into tangible products seamlessly, utilizing natural language and generative AI. Our mission is to democratize product design, making it as effortless as sharing a post online.Backed by a remarkable $42M in funding from industry-leading investors including Reid Hoffman and Ashton Kutcher, our company is a rising star in the tech landscape. Guided by our founder Mariam Naficy and a team steeped in AI and design expertise, we are at the forefront of a new frontier that merges AI, personal expression, and on-demand manufacturing.Your Role as an Applied AI EngineerWe are on the lookout for an Applied AI Engineer to enhance our generative AI capabilities. This position combines hands-on model development with the integration of advanced AI techniques into our production systems. You will collaborate with diverse teams to conduct research, experiment with models, and implement AI-driven products.

Join the Innovative Team at CodeRabbit!At CodeRabbit, we are at the forefront of research and development, dedicated to creating cutting-edge human-machine collaboration systems. Our mission is to revolutionize code review processes through a next-generation partnership between skilled engineers and sophisticated AI algorithms. By harnessing the power of generative AI, we aim to enhance software development efficiency and quality, achieving results that far exceed individual capabilities.Role OverviewAs an Applied Generative AI Engineer, you will be instrumental in designing, building, and deploying state-of-the-art generative AI systems that drive our code review and developer productivity tools. Your work will center around integrating cutting-edge methodologies such as Retrieval-Augmented Generation (RAG), Reinforcement Learning from Human Feedback (RLHF), and multi-step agentic reasoning into impactful product workflows.Collaboration will be key! You will work closely with engineers, product managers, and technical leads to build intelligent systems that deliver tangible value, transforming how developers write, review, and ship code.Key ResponsibilitiesDesign and enhance LLM-based systems for contextually rich and high-quality code reviews.Create and optimize agentic workflows that reason across various steps and contexts.Develop and manage knowledge base and retrieval pipelines, including chunking, embeddings, and semantic search.Deploy generative AI models into production and monitor their performance.Collaborate with cross-functional teams to ensure AI outputs meet user needs and align with product objectives.Analyze user feedback and usage data to iteratively refine system performance.Implement RLHF, ranking, and reward modeling techniques to enhance response quality over time.Stay updated on the latest advancements in generative AI and apply them to emerging use cases.QualificationsEducation: Bachelor’s degree in Computer Science, Engineering, Artificial Intelligence, or a related field, or equivalent practical experience.Experience: Minimum of 3 years of experience working with machine learning or LLM-based systems in production environments, with at least 2 years dedicated to generative AI.Technical Skills: Proficiency in programming languages and frameworks relevant to AI development.

Artificial Intelligence (AI) is rapidly transforming every aspect of our society, and at Scale, our vision is to lead this evolution by accelerating AI application development. For over eight years, we have been at the forefront of AI data innovation, propelling remarkable advancements in diverse fields such as generative AI, defense technologies, and autonomous vehicles. Following our recent Series F funding, we are enhancing the use of cutting-edge data and models to create sophisticated AI agents for enterprises globally via our Scale Generative Platform (SGP).The SGP Machine Learning team plays a crucial role in this AI revolution. We collaborate directly with clients to design and deliver state-of-the-art products, leveraging exclusive research and resources developed at Scale. As an Applied AI Engineer, you will partner with clients to devise machine learning solutions tailored to their specific business challenges. Your projects will encompass a wide range, from developing next-generation AI cybersecurity firewalls to pioneering AI-driven experiences in journalism and utilizing foundational genomic models to predict life-saving drug proteins. You will conduct daily data-driven experiments to glean insights on model performance, identifying strengths and areas for improvement to elevate product quality. If you are passionate about influencing the future of AI, we would be excited to connect with you!

Ironclad is the premier AI contracting platform that revolutionizes the way agreements are treated as valuable assets. Contracts are processed more swiftly, insights emerge instantaneously, and workflows are seamlessly advanced—all while maintaining your control. Whether you are engaged in buying or selling, Ironclad streamlines the complete process on a single intelligent platform, granting leaders the visibility necessary to stay ahead of the curve. This is why the most innovative organizations in the world, such as OpenAI, the World Health Organization, and the Associated Press, trust Ironclad to expedite their operations.Consistently recognized as an industry leader, Ironclad has been named a Leader in the Forrester Wave and the Gartner Magic Quadrant for Contract Lifecycle Management. We have also been acknowledged as a Great Place to Work by Fortune and one of Fast Company’s Most Innovative Workplaces. With backing from top investors including Accel, Y Combinator, Sequoia, BOND, and Franklin Templeton, we are poised for continued growth. For more details, visit www.ironcladapp.com or follow us on LinkedIn.AI Engineering at IroncladAt Ironclad, we are accelerating our AI initiatives to transform how contracts are created, managed, and executed throughout organizations. We are in search of a Generative AI Application Developer to swiftly develop and implement high-impact legal AI product features.In this role, you will be the go-to expert for AI feature development, leveraging our existing AI platform. You will establish a Prompt Strategy, utilizing established Retrieval-Augmented Generation (RAG) services and Large Language Model (LLM) APIs to create intelligent product capabilities such as summarization and redlining.Collaboration with product managers and designers will be key as you translate user requirements into production-ready LLM application logic. Your success will be determined by your ability to design optimal context inputs and craft effective prompts that maximize the accuracy, relevance, latency, and reliability of user-facing features.

Join Our Team as a Staff Software Engineer, Full-Stack - Enterprise Generative AI At Scale AI, we are revolutionizing enterprise workflows through our Scale Generative AI Platform (Scale GP), an advanced AI solution that provides APIs for knowledge retrieval, inference, evaluation, and much more. We are seeking a talented full-stack engineer, with a strong front-end focus, to develop innovative AI-powered applications that transform how businesses operate. In this dynamic role, you will collaborate on diverse projects, ranging from cutting-edge customer-facing applications to internal SaaS products. Be part of our engineering team that powers initiatives such as TIME’s Person of the Year AI experience (see it in action), showcasing how our technology impacts the media landscape. Additionally, you will enhance Scale’s GenAI Platform (SGP), a robust system enabling businesses to create and manage AI agents at scale. Whether developing interactive AI assistants or refining our core SaaS platform, your contributions will shape the future of AI in real-world applications.

About UsAt Applied Compute, we are pioneering the development of Specific Intelligence for enterprises, creating agents that continuously learn from a company’s processes, data, expertise, and objectives. Our mission is to bridge the gap between isolated AI capabilities and their effective application within real business environments. Traditional AI systems often fall short as they lack the ability to adapt based on feedback. Our innovative continual learning layer captures context, memory, and decision-making processes across the enterprise, enabling specialized agents to engage in meaningful work.What Excites Us: We operate at the exciting intersection of product development and cutting-edge research. Our product team designs the platform that empowers a new generation of digital coworkers, while our research team drives advancements in post-training and reinforcement learning to enhance user experiences. As an applied research engineer, you will work directly with clients to implement models in production, combining robust product development with deep research insights to facilitate AI integration in enterprises.Meet Our Team: Our diverse team consists of engineers, researchers, and operators, many of whom are former founders. We have previously built reinforcement learning infrastructure at OpenAI, established data foundations at Scale AI, and contributed to significant systems at companies like Together, Two Sigma, and Watershed. We collaborate with Fortune 50 clients, including DoorDash, Mercor, and Cognition, and are proud to be backed by reputable investors such as Benchmark, Sequoia, and Lux.Who Thrives Here: We seek individuals who are passionate about applying innovative research and complex systems to solve real-world challenges. You should feel comfortable navigating new environments rapidly—be it a fresh codebase, a client’s data architecture, or an unfamiliar problem domain. A genuine enjoyment for customer interaction, empathy, and a deep understanding of their operational workflows are essential. Candidates with entrepreneurial backgrounds, extensive side projects, or a proven track record of end-to-end ownership typically excel in our environment.

Technical Staff Member in Applied AIAbout the OpportunityWe are seeking a highly skilled Technical Staff Member specializing in generative modeling to bridge the gap between our advanced models and the clients who rely on them. You will collaborate with a diverse team of machine learning experts, protein engineers, and biologists to revolutionize biological control and disease treatment. Your role will involve gaining a comprehensive understanding of our proprietary generative models and leveraging that expertise to deploy, adapt, and optimize these models in client environments, particularly within the pharmaceutical and biotech industries.This hybrid position requires a research-oriented mindset to deeply understand our models, paired with the communication skills necessary to translate that knowledge into production systems that yield scientific value for our collaborators.About UsAt Latent Labs, we are pioneering frontier models that decode the fundamentals of biology. Our ambitious goals are driven by curiosity and a commitment to scientific excellence. Prior to founding Latent Labs, our team co-developed DeepMind's Nobel Prize-winning AlphaFold, innovated latent diffusion, and created groundbreaking lab data management systems along with high-throughput protein screening platforms. Here, you will work alongside some of the brightest minds in generative AI and biology.We value interdisciplinary collaboration, continuous learning, and teamwork. Our team offsites foster a culture of trust and connection between our London and San Francisco offices. We are looking for innovators who are passionate about solving complex problems and making a positive global impact. Join us on our ambitious mission.Your QualificationsExpertise in Machine Learning: You are a proficient ML researcher with a strong background in generative modeling, evidenced by your contributions to notable open-source projects, impactful product launches, or significant publications in leading venues such as NeurIPS, ICML, ICLR, or Nature. You possess a deep understanding of generative model architectures, training dynamics, and inference behavior.Proficient ML Developer: You produce robust, tested, and maintainable ML code. Your experience includes using version control and code review systems. You are adept at rapid prototyping while also being able to write elegant production code. Additionally, you have experience in building systems that deploy large models via APIs and executing inference tasks in production environments.

Join Reka as a Member of the Technical Staff in Applied AI!Leverage cutting-edge AI models to tackle intricate real-world challenges.Engage in close collaboration with researchers and fellow team members to explore the latest developments in AI and ML.Partner with our customers to seamlessly integrate our innovative models into their existing technology frameworks.Drive business success with a strong sense of product ownership and accountability.Be part of a pioneering team in a rapidly growing environment, taking on diverse roles.

Quizlet Inc. is looking for an Applied AI Engineer to create AI-driven features that support student learning. This position centers on developing and deploying machine learning solutions aimed at making study experiences more effective and engaging for a global user base. What you will do Design and implement machine learning models to enhance Quizlet’s educational tools Work on features that help students study more efficiently and enjoyably Locations Denver, CO New York, NY San Francisco, CA Seattle, WA

About Us:At LangChain, we strive to revolutionize the accessibility of intelligent agents. Our goal is to provide a robust framework for agent engineering that empowers developers to transition from initial prototypes to production-ready AI agents that can be trusted by teams. What started as a suite of widely embraced open-source tools has evolved into a comprehensive platform designed for the building, assessment, deployment, and management of agents at scale.Currently, our tools, including LangChain, LangGraph, LangSmith, and Agent Builder, are utilized by various teams delivering tangible AI solutions across both startups and large corporations. Millions of developers depend on LangChain to empower AI initiatives at prestigious companies like Replit, Clay, Coinbase, Workday, Lyft, Cloudflare, Harvey, Rippling, Vanta, and 35% of the Fortune 500.With $125M raised in our Series B round from IVP, Sequoia, Benchmark, CapitalG, and Sapphire Ventures, we are in a phase of rapid growth, continuously innovating new products while ensuring every team member has a significant impact on our development and collaborative processes. LangChain is a place where your contributions can influence the real-world application of this transformative technology.About the Role:We are seeking talented Applied AI Engineers to assist in creating AI agents that enhance various aspects of LangChain, from Marketing and Go-To-Market strategies to Recruiting, Support, Internal Tools, and our Core Product.In this position, you will take ownership of specific problem areas, collaborating closely with relevant teams to design, construct, and deploy production-grade agents, workflows, and applications that revolutionize our operational processes. Your contributions will directly support LangChain’s vision of making intelligent, autonomous software a reality for both our internal teams and our clients. Some projects may be open source, contributing to the LangChain and LangGraph ecosystems while establishing new benchmarks for AI development practices.If you are a full-stack software engineer eager to implement AI agents in practical use cases and witness their impact on business outcomes, we invite you to apply.

Overview: Join Listen Labs as we respond to a surge in market demand with an ambitious 6-month product roadmap. We are expanding our engineering team and are on the lookout for a highly skilled technical expert (our current team includes three IOI medalists) who is eager to build a transformative product that reshapes decision-making for businesses. If you have a passion for solving intricate problems from start to finish, we want to connect with you.About Listen LabsListen Labs is an AI-driven research platform designed to help teams quickly extract insights from customer interviews in a matter of hours rather than months. We empower our clients by enabling them to analyze conversations, identify key themes, and make faster, more informed product decisions.Why Work with Us?Exceptional Team: Founded by seasoned entrepreneurs with a successful AI exit, along with talent from renowned companies such as Jane Street, Twitter, Stripe, Affirm, Bain, and Goldman Sachs, our team boasts impressive credentials including IOI and ICPC backgrounds.Rapid Growth: As a 40-person team backed by Sequoia Capital, we have achieved a remarkable growth trajectory, scaling from $0 to a $14 million run-rate in less than a year. We prioritize craftsmanship and thrive on collaboration with individuals who take ownership.Impressive Traction: We are experiencing rapid growth across various sectors, securing enterprise clients such as Google, Microsoft, Nestlé, and Procter & Gamble.Proven Performance: We maintain an industry-leading win rate driven by our uniquely differentiated product.Market Validation: We consistently attract customers from diverse segments, achieving six-figure contracts that facilitate quick expansions.Viral Product: Our interviews reach tens of thousands of viewers, promoting product-led growth, organic expansion, and daily interest from Fortune 500 companies.Technical Challenges Await:Research Agent Development:Unlike traditional software purchases, hiring McKinsey offers valuable opinions, expertise, and execution. We aim to provide users with an AI agent that possesses complete knowledge about our platform and best research practices, assisting them in project setup, interview conduction, and response analysis.Human Database Creation:One of our core offerings is the ability to identify target users effectively (e.g., "power users of ChatGPT and Excel"). We are in the process of building a comprehensive database that connects users with the insights they need.

Join Checkr as a Staff Applied AI Engineer, where your expertise will drive innovative AI solutions that enhance our processes and services. You will work collaboratively with a dynamic team of engineers and data scientists, contributing to impactful projects that improve the user experience and operational efficiency.

Join the Visionaries at Automat!At Automat, we are a collective of innovative technologists hailing from prestigious backgrounds at Google Creative Lab and Samsung’s innovation Think Tank. Our mission is to transform the future of business through intelligent agents that enhance operational efficiency and eventually manage enterprises autonomously. We are leaders in redefining Enterprise AI Agents and Intelligent Document Processing, creating cutting-edge tools and infrastructure to seamlessly integrate AI advancements into practical applications.We cherish curiosity, teamwork, and impactful contributions over strict credentials. If you are passionate about AI and automation, excel in dynamic and creative settings, and yearn to engage in groundbreaking projects, we invite you to apply!While this is a senior role, we believe that unique talents and perspectives can surpass traditional experience metrics. We seek an individual who can make an immediate impact from day one and contribute to our team’s learning journey.Your RoleAs an Applied AI Engineer, you will operate at the crossroads of product development, engineering, and research. You will work hand-in-hand with skilled engineers and end users to create innovative tools for our internal teams and external clientele. Your contributions will help shape technical solutions, guide strategic initiatives, and enrich our company culture.Key Responsibilities:Collaborate with product and engineering teams to gain insights into customer challengesResearch and implement real-world applications of advanced AI modelsDesign and execute impactful solutions for both internal tools and customer-facing productsInfluence engineering practices, guide product development, and foster a collaborative cultureWhat Motivates You:A passion for curiosity, creativity, and quick adaptationCreating full-stack applications that bring AI to lifeKeeping abreast of the latest trends in AI and LLM prompting techniquesChallenging the limits of what is achievable with AI agentsThriving in fast-paced, collaborative environments

About WorkOS WorkOS is revolutionizing the developer landscape by creating cutting-edge tools and APIs that empower businesses to achieve Enterprise Ready status. Our platform is the backbone for authentication, identity management, authorization, and other essential infrastructures, enabling developers to securely scale their products for large enterprises.Having recently secured a $100M Series C funding round, valuing the company at $2B, we are supported by leading investors such as Meritech, Sapphire, Greenoaks, Craft, Abstract, and Audacious. WorkOS is proud to serve many of the fastest-growing AI companies, including OpenAI, Cursor, Perplexity, Vercel, and Plaid.As AI technology evolves, WorkOS stands at the forefront of Human and Agent Authentication, Identity, and Access Control, helping businesses navigate crucial questions about agent identity and permissions. Our rapidly expanding customer base features hundreds of innovative software companies developing the next generation of enterprise-ready solutions.About the RoleWe are assembling an Applied AI team dedicated to significantly enhancing productivity across Engineering, Sales, Support, and Operations while also developing AI functionalities for our clients.As an Applied AI Engineer, you will design and deploy transformative AI systems that redefine how WorkOS develops, markets, and supports its software. You will focus on creating robust tools and workflows that are essential for daily operations, while also exploring novel AI capabilities for our users.Join a small, high-ownership team that:Identifies challenges based on measurable impact.Rapidly transitions from idea to prototype to production in days or weeks.Quickly adapts to evolving models, tools, and best practices.This role offers substantial visibility across the organization.What You’ll DoCollaborate closely with Engineering, Sales, Support, and Operations to identify high-impact internal challenges where AI can enhance efficiency or facilitate new workflows.Design and construct tools that integrate seamlessly into daily operations—agents, automations, and workflows that are reliable, observable, and easy to maintain.Leverage LLMs, embeddings, retrieval systems, and tool-calling to connect with documents, Slack, GitHub, CRM systems, analytics, support frameworks, and internal services.Transform repetitive, multi-step manual tasks into streamlined, AI-driven processes that span various applications and data sources.Stay informed about emerging models and tools, conduct focused experiments, and assist the team in continuous improvement.

Join Our Team as an Applied AI EngineerAt Rowspace, we're at the forefront of AI research and engineering, and we are looking for an Applied AI Engineer to help revolutionize how our platform uncovers vital financial insights. Your week may involve developing and deploying AI agents based on client feedback, creating evaluation frameworks for AI performance, and designing sophisticated retrieval systems to optimize AI within financial workflows.Your ResponsibilitiesIntegrate groundbreaking AI research to develop systems that comprehend financial contexts and business concepts.Construct retrieval pipelines that intelligently extract and synthesize insights from unstructured data sources such as PDFs, emails, and presentations.Develop workflows that empower AI systems to analyze financial relationships, conduct benchmarking, and perform comparative analyses.Design and maintain knowledge graphs that represent intricate financial relationships, entity connections, and market dynamics.Create evaluation frameworks to assess and enhance AI performance in investment research, due diligence, and portfolio monitoring.Implement systems ensuring traceability from AI outputs to primary data sources.Experiment with innovative LLM orchestration patterns and context management techniques tailored for financial applications.Guide the technical direction and establish best practices for AI application development at Rowspace.Engage in rapid iteration with direct customer feedback to continuously enhance AI systems based on real-world usage.Oversee the deployment and operation of production systems end-to-end, ensuring reliability, performance, and maintainability across the technology stack.

About Komodo Health We Bring Data to Life Komodo Health’s mission is to alleviate the global burden of disease. The company’s Healthcare Map integrates de-identified patient data with advanced algorithms and clinical expertise, creating a detailed view of the U.S. healthcare system. This foundation supports a suite of software applications that help partners address complex healthcare challenges, monitor patient behaviors, spot treatment trends, and identify care gaps. Komodo Health values excellence, growth, results, and enjoying the journey. The team brings together professionals from varied backgrounds who share a commitment to improving health outcomes. Role Overview: Applied AI Engineer Healthcare in the U.S. is intricate, and Komodo Health tackles these challenges through data-driven solutions. By mapping the patient journey nationwide, the company helps pharmaceutical firms, payers, and healthcare systems make decisions that improve patient care. Labs@Komodo builds AI-native platforms and systems that turn data into actionable insights. The team developed Marmot, Komodo’s AI-native product, which embeds AI into both the user interface and development workflow. By combining Komodo’s healthcare data with modern large language models (LLMs), Marmot delivers real-world insights for healthcare stakeholders. What You Will Do Design and implement end-to-end AI solutions for real products and internal tools. Work at the intersection of applied research, engineering, and product development. Integrate modern AI techniques into scalable, production-ready systems. Collaborate with product, platform, and data teams to build AI capabilities that advance healthcare data use. Location San Francisco, CA

About the Role sfcompute is hiring an Applied AI Engineer in San Francisco, CA. This position focuses on building and deploying AI models that support real business needs. The work involves using advanced technologies to create practical solutions that improve how teams operate. What You Will Do Develop and implement AI models tailored to business goals Work closely with teams across the company to understand their challenges Deliver solutions that boost productivity and efficiency

Join Our Mission at Abby CareAt Abby Care, we are dedicated to transforming the landscape of family caregiving, addressing one of the most significant challenges of our time. Our goal is to empower over 50 million unpaid family caregivers across the United States by providing them with the training and support they need to get compensated for the invaluable care they provide at home.We are developing a cutting-edge, tech-driven family-first care platform designed to enhance care delivery, improve health outcomes, and ensure a superior experience for families nationwide. As we expand our impact, we are seeking passionate individuals to join our team. With partnerships alongside leading insurance providers, healthcare organizations, and community groups, we are backed by top-tier, mission-driven venture capitalists who share our vision of supporting families throughout the country.Our team comprises high-caliber professionals with backgrounds at renowned companies such as Uber, Scale AI, DoorDash, Dropbox, and Meta. Together, we are reimagining family caregiving.Your Role as an Applied AI EngineerWe are on the lookout for a skilled and motivated Applied AI Engineer to join our dynamic team. Reporting to the VP, Head of Engineering, this full-time position is based in San Francisco, CA, with an in-person presence required four days a week.In this role, you will play a crucial part in designing and building AI-driven products that serve as intelligent copilots for families and healthcare providers. You will create AI systems that facilitate family caregiving, enhance clinician support in care delivery, and explore innovative home-based care models. Your work will involve hands-on engagement with AI models and real-world clinical and operational data, contributing to the evolution of AI-assisted caregiving and shaping the future of care as a key early engineer.