Software Engineer, Simulator Evaluation

Waymo is at the forefront of autonomous driving technology, aspiring to become the world's most reliable driver. Originating as the Google Self-Driving Car Project in 2009, we are dedicated to developing the Waymo Driver—The World’s Most Experienced Driver™—to enhance mobility access while significantly reducing traffic-related fatalities. With over ten million rider-only trips facilitated by our technology, the Waymo Driver has autonomously navigated more than 100 million miles on public roads and tens of billions in simulation across more than 15 states in the U.S.Our Release Evaluation organization is committed to ensuring each iteration of the Waymo Driver is safe for public deployment. We construct automated pipelines to identify rare and exceptional scenarios in autonomous driving, effectively searching for critical insights under limited time and resource constraints. Within Release Evaluation, the Sampling and Efficiency team employs advanced importance sampling techniques combined with machine learning to maximize the statistical efficiency of our discovery pipelines.

Join Waymo, a pioneer in autonomous driving technology, dedicated to becoming the world's most trusted driver. Originating from the Google Self-Driving Car Project in 2009, our mission is to enhance mobility access and eliminate traffic-related fatalities. The Waymo Driver has already facilitated over ten million rides, showcasing its capability after autonomously navigating over 100 million miles on public roads and trillions in simulations across more than 15 U.S. states.As part of the Release Evaluation team, you will play a key role in ensuring the safety of each Waymo Driver version prior to deployment. We develop automated systems to address rare and exceptional scenarios in autonomous driving, effectively identifying critical signals under constraints of time and resources. The Sampling and Efficiency team utilizes advanced importance sampling techniques and machine learning to enhance the statistical efficiency of our evaluation pipelines.

Waymo is leading the way in autonomous driving technology with a mission to be the world's most trusted driver. Originating from the Google Self-Driving Car Project in 2009, Waymo is dedicated to developing the Waymo Driver—The World’s Most Experienced Driver™—to enhance accessibility to transportation while preventing countless lives lost in traffic accidents. Our innovative Waymo Driver underpins our fully autonomous ride-hailing service and is adaptable to various vehicle platforms and applications. With over ten million rider-only trips facilitated by our technology, we have driven more than 100 million miles on public roads and logged tens of billions of miles in simulation across more than 15 U.S. states.The Perception Evaluation team at Waymo is pioneering advancements in autonomous driving, prioritizing the safety and reliability of our self-driving systems. Our team leverages state-of-the-art tools and methodologies to rigorously evaluate the performance of our perception systems, which are essential for the safe and effective operation of autonomous vehicles. We are currently seeking a Software Engineer to be instrumental in shaping the future of transportation and enhancing the quality and reliability of Waymo's autonomous vehicles.In this hybrid role, you will report directly to an Engineering Manager.

Waymo is at the forefront of autonomous driving technology, committed to becoming the world's most trusted driver. Originating from the Google Self-Driving Car Project in 2009, Waymo has dedicated itself to developing the Waymo Driver—The World’s Most Experienced Driver™—to enhance mobility access while significantly reducing traffic-related fatalities. Our Waymo Driver powers a fully autonomous ride-hailing service and is adaptable to a diverse array of vehicle platforms and applications. With over ten million rider-only trips and experience from more than 100 million miles driven autonomously on public roads, Waymo is shaping the future of transportation.Our simulation environment is among the most sophisticated ever created, utilizing deterministic logic, physical dynamics, and cutting-edge Generative AI to establish a training ground for the Waymo Driver. The Simulator Evaluation team tackles the challenging question: How can we mathematically validate that a virtual world is perceptibly 'real'?We are on the lookout for a Staff Software Engineer who will take on the role of Technical Architect in this field. You will operate at the intersection of software engineering and AI, ensuring our simulated environments—whether governed by explicit rules or foundational models—accurately reflect reality.In this Staff-level position, you will report directly to a Senior Staff Software Engineering Manager and function as a Technical Lead, connecting intricate technical metrics with overarching product strategies.Your Responsibilities Will Include:Architecting Evaluation Standards: Define the 'Definition of Done' for simulation realism, anticipating product objectives (e.g., operational capabilities in snow or highway driving) and designing the evaluation roadmap to ensure our simulation fidelity evolves in alignment with onboard requirements.Acting as the System Critic: Create comprehensive mathematical frameworks to validate our hybrid virtual world, determining the balance between diverse evaluation needs—from verifying logical rules and dynamics to assessing the distribution quality of generative AI models.Building at Scale: Lead the development of large-scale, extensible evaluation platforms (in C++/Python), ensuring our metric pipelines are robust distributed systems capable of delivering clear, reproducible insights on petabytes of data.Providing Strategic, Cross-Functional Leadership: Serve as the technical liaison across various organizations, closely collaborating with AI research and other simulation teams. The evaluation workflows you design will facilitate rapid innovation and inform research trajectories.

Waymo is at the forefront of autonomous driving technology, dedicated to becoming the world’s most trusted driver. Originating from the Google Self-Driving Car Project in 2009, Waymo has been committed to developing the Waymo Driver—The World’s Most Experienced Driver™—to enhance mobility access and save lives lost to traffic accidents. The Waymo Driver not only powers our fully autonomous ride-hailing service but can also be adapted to various vehicle platforms and applications. With over ten million rider-only trips under its belt, the Waymo Driver has driven autonomously over 100 million miles on public roads and completed tens of billions of miles in simulation across more than 15 U.S. states.The Planner Evaluation team tackles one of the primary challenges in autonomous driving: assessing and elevating the quality of the software steering the car. We seek data-driven software engineers and data scientists who are passionate about autonomous vehicles and adept at utilizing complex data to inform decision-making. If this excites you, we encourage you to apply!This position follows a hybrid work model and reports to an Engineering Manager.

Waymo is at the forefront of autonomous driving technology, striving to become the world's most trusted driver. Originating from the Google Self-Driving Car Project in 2009, Waymo has dedicated itself to creating the Waymo Driver—the world's most experienced driver™—with the aim of enhancing mobility access while preventing the countless lives lost in traffic accidents. The Waymo Driver powers our fully autonomous ride-hailing service and is adaptable across various vehicle platforms and use cases. With over ten million rider-only trips under its belt and extensive experience driving more than 100 million miles on public roads, complemented by extensive simulations across 15+ U.S. states, Waymo is leading the charge in safe and efficient transportation solutions.The Planner Evaluation team addresses a pivotal challenge in autonomous driving: enhancing and quantifying the software that drives our vehicles. We seek seasoned data-driven software engineers and data scientists passionate about autonomous vehicles and utilizing complex data to drive informed decisions. This is the perfect opportunity for someone eager to make a significant impact in the field!In this hybrid role, you will report directly to an Engineering Manager.You will:Develop performance metrics and driving quality signals for the Waymo driver utilizing various techniques, including statistics, mathematics, physics, algorithms, and machine learning.Innovatively use simulations and analyze real-world driving logs to assess driving performance.Design and implement robust methods to strengthen the correlation between changes in onboard software and simulated results.Advocate for code quality and best practices within a large and intricate code base.Analyze data and provide insights for enhancing metric quality and interpretability.Collaborate effectively with engineers, data scientists, statisticians, and leadership to deliver evaluation products and facilitate data-driven decisions.Rapidly validate the effectiveness of additional coverage, ensuring solutions are robust for customer teams to manage their own evaluations.

Waymo is at the forefront of autonomous driving technology, driven by the mission to become the world’s most trusted driver. Born from the Google Self-Driving Car Project in 2009, Waymo has dedicated itself to developing the Waymo Driver—The World’s Most Experienced Driver™—to enhance mobility and save lives that are often lost in traffic accidents. The Waymo Driver powers our fully autonomous ride-hailing service, which can be adapted for various vehicle platforms and use cases. With over ten million rider-only trips completed and experience accumulated from driving over 100 million miles on public roads, alongside tens of billions of miles in simulation across more than 15 U.S. states, Waymo is redefining transportation.The Perception team is integral to the Waymo Driver's success, crafting cutting-edge technology that enables our autonomous systems to accurately understand their environment, make informed decisions in real-time, and transport passengers safely to their destinations. We engage in research to tackle real-world challenges and collaborate with other innovative teams at Alphabet. Our access to extensive driving data collected through diverse sensors empowers software engineers like you to create and scale multi-modal models and techniques.Our objective is to establish a robust foundation for a high-level Perception pipeline, which is a fundamental component of the self-driving system. We serve as the essential link between Waymo's hardware teams and the broader engineering organization focused on self-driving technology, defining sensor specifications, providing vital feedback, and simplifying system complexities.In this hybrid role, you will report directly to a Technical Lead Manager.

Waymo is at the forefront of autonomous driving technology, striving to become the world's most trusted driver. Originating from the Google Self-Driving Car Project in 2009, Waymo has been dedicated to developing the Waymo Driver—The World’s Most Experienced Driver™—with the goal of enhancing mobility access while aiming to reduce the tragic loss of lives due to traffic accidents. The Waymo Driver not only fuels our fully autonomous ride-hailing service but is also adaptable across various vehicle platforms and applications. With over ten million trips solely for riders and extensive experience from autonomously navigating over 100 million miles on public roads, alongside tens of billions of miles in simulation across more than 15 U.S. states, we are leading the charge in this transformative technology.The Large Model Evaluation team plays a pivotal role in advancing Waymo's AI vision. As we integrate cutting-edge Large Language Models (LLMs) and Vision-Language Models (VLMs), our aim is to construct sophisticated AI systems capable of addressing the multifaceted challenges of real-world driving. Central to our achievements is the ability to accurately measure our progress. In a landscape where robust evaluation serves as a critical barrier to deploying large models, the intricacies of this task at Waymo are particularly complex and safety-sensitive. We seek quantitatively driven engineers to innovate and propose novel methodologies for evaluating the ML models utilized in the Waymo Driver.

Waymo is a pioneering force in autonomous driving technology, dedicated to becoming the world's most trusted driver. Originating from the Google Self-Driving Car Project in 2009, Waymo focuses on developing the Waymo Driver—The World's Most Experienced Driver™—to enhance mobility access and significantly reduce traffic-related fatalities. The Waymo Driver powers our fully autonomous ride-hailing service and is adaptable across various vehicle platforms and applications. With over ten million rider-only trips completed and extensive experience from driving more than 100 million miles on public roads, complemented by simulations totaling tens of billions of miles across over 15 U.S. states, we are at the forefront of our industry.The Large Model Evaluation team plays a crucial role in advancing Waymo's AI ambition. As we leverage advancements in Large Language Models (LLMs) and Vision-Language Models (VLMs), our goal is to create cutting-edge AI systems that navigate the complexities of real-world driving scenarios. Our progress hinges on our ability to measure performance effectively. With robust evaluation being essential for deploying large models, the challenges we face are particularly intricate and safety-critical. We are seeking engineers with a quantitative mindset to explore and establish innovative methods for assessing the machine learning models utilized in the Waymo Driver.

Waymo is at the forefront of autonomous driving technology, striving to become the world’s most reliable driver. Originating from the Google Self-Driving Car Project in 2009, Waymo has dedicated itself to developing the Waymo Driver—The World’s Most Experienced Driver™—to enhance mobility access and prevent countless lives lost to traffic accidents. Our cutting-edge Waymo Driver is the backbone of our fully autonomous ride-hailing service and can be implemented across various vehicle platforms and applications. Having completed over ten million rider-only trips, our technology has accumulated experience from autonomously driving over 100 million miles on public roads and tens of billions of miles in simulations across more than 15 U.S. states.The Large Model Evaluation team is pivotal to Waymo's AI mission. As advancements in Large Language Models (LLMs) and Vision-Language Models (VLMs) continue, we are constructing state-of-the-art AI systems capable of addressing the full spectrum of real-world driving complexities. Central to our success is our capacity to measure progress effectively. Robust evaluation is crucial for deploying any large model, and at Waymo, the challenge is particularly intricate and safety-critical. We seek quantitatively-minded engineers to innovate and propose new methods for assessing the machine learning models integrated into the Waymo Driver.

Be a Part of the Future of Home RoboticsAt sunday, we are pioneering the development of personal robots designed to liberate individuals from the burden of repetitive tasks. Our mission is to democratize access to generalized robotics, allowing families to reclaim precious time spent on mundane activities.After investing 18 months in assembling an exceptional team, securing investment, and validating our technology, we are on the lookout for passionate professionals eager to join us during this exciting phase of growth. If you are ready to channel your expertise into cutting-edge robotics innovation, we want to hear from you.Your RoleAs a Full Stack Engineer focused on ML Data & Evals, you will serve as the vital link between raw data and robotic intelligence. You’ll create the foundational infrastructure for our ML team to evaluate and deploy models effectively. Your contributions will expedite the research-to-production cycle, facilitating on-robot evaluations and visualizing model performance in intricate, real-world settings.Key ResponsibilitiesDesign Interactive Data Systems: Develop interfaces and engines that integrate robot and Skill Capture Gloves™ data, enabling efficient human-in-the-loop workflows, from episode annotation to seamless transitions between autonomous operation and manual teleoperation.Conduct Evaluations & Benchmarking: Create high-performance tools to compare model-driven motions with human-captured ground truths, aiding in the assessment of model advancements across various tasks.Data Processing & Orchestration: Design processing services that convert raw captures and sensor data into formats suitable for machine learning, ensuring a smooth transition from our global data collection systems to the models that power our robots.Adaptability in a Startup Environment: While your primary focus will be the ML Platform, our Full Stack Engineers should be versatile, readily adjusting to shifting priorities and contributing across different areas of the stack as we grow.

Waymo, an innovative leader in autonomous driving technology, aims to become the world's most trusted driver. Established in 2009 from the Google Self-Driving Car Project, Waymo focuses on developing the Waymo Driver—The World’s Most Experienced Driver™—to enhance mobility access and prevent traffic-related fatalities. The Waymo Driver facilitates our fully autonomous ride-hail service and is adaptable to a variety of vehicle platforms and use cases. With over ten million rider-only trips completed and more than 100 million miles driven autonomously on public roads, along with extensive simulation across 15+ U.S. states, Waymo is redefining transportation.The Planner Evaluation team is at the forefront of addressing one of the critical challenges in autonomous driving: assessing and enhancing the quality of the software that operates the vehicles. We are in search of skilled data-centric software engineers and data scientists who are eager to improve our methodologies for characterizing and evaluating modifications to the onboard software stack. If you're enthusiastic about autonomous vehicles and utilizing complex data to inform decision-making, this is the ideal opportunity for you!This hybrid role will report to an Engineering Manager.Your responsibilities will include:Developing metrics to evaluate the performance and driving characteristics of the Waymo Driver using various techniques such as statistics, mathematics, physics, algorithms, and machine learning.Utilizing simulations creatively while analyzing real-world driving logs to assess driving performance.Designing and implementing methods to establish a robust connection between onboard software modifications and simulated results.Promoting code health and adherence to best practices within a large and intricate codebase.Analyzing data to provide actionable insights on enhancing metric quality and interpretability.Collaborating with fellow engineers, data scientists, statisticians, and leadership to produce evaluation tools and support data-driven decisions.

About NuroNuro is a pioneering self-driving technology company dedicated to making autonomy accessible to everyone. Established in 2016, we are developing the most scalable autonomous vehicle system, integrating advanced AI with automotive-grade hardware. Nuro licenses its core technology, the Nuro Driver™, to facilitate a diverse array of applications, including robotaxis, commercial fleets, and personal vehicles. With years of proven self-driving deployments, our technology provides automakers and mobility platforms with a clear path to commercial-scale autonomous vehicles, fostering a safer, more connected future.Position OverviewWe are seeking an experienced engineering leader to assume the role of Director for our Evaluation Platform team. This critical platform supports the simulation, evaluation, and validation processes that are essential for the development of autonomous technologies and ensuring readiness for driverless deployment.The successful candidate will establish the technical vision, execution strategy, and organizational framework for a multidisciplinary team focused on simulation, evaluation infrastructure, and software-driven operational workflows.The evaluation platform integrates data, simulation, metrics, and analysis workflows, empowering teams to:Rapidly iterate to enhance autonomy performanceAssess autonomy performance and risk with credibility and rigorMake informed, data-driven decisions regarding driverless deploymentKey ResponsibilitiesDevelop and oversee the technical vision and roadmap for the Evaluation Platform, encompassing simulation, evaluation infrastructure, and software quality operations.Lead, mentor, and nurture a multi-team organization (including managers and senior individual contributors), promoting a culture of technical excellence, ownership, and continuous improvement.Build and scale simulation and evaluation capabilities that cater to both rapid autonomy iteration and rigorous validation scenarios.Take ownership of the autonomy evaluation and validation platform, collaborating closely with Autonomy and Systems leadership to ensure reliability, scalability, and trust from engineering and validation teams.Represent the Evaluation Platform at the executive level, effectively communicating tradeoffs, progress, risks, and readiness.

Waymo, a pioneering leader in autonomous driving technology, aims to be the world’s most trusted driver. Originating from the Google Self-Driving Car Project in 2009, our mission centers on developing the Waymo Driver—The World’s Most Experienced Driver™—to enhance mobility access while significantly reducing traffic-related fatalities. The Waymo Driver is the backbone of our fully autonomous ride-hailing service and is versatile across various vehicle platforms and applications. To date, it has successfully facilitated over ten million rider-only trips, driven autonomously over 100 million miles on public roads, and conducted tens of billions of miles in simulation across more than 15 U.S. states.In Waymo’s Perception Evaluation team, we focus on delivering rapid, actionable, and seamless development cycles and releases for all aspects of Perception. Our team is responsible for designing, building, and refining vital evaluation workflows, ensuring high-quality and efficient evaluation processes. Collaborating closely with teams in Machine Learning, Simulation, Data Science, and Infrastructure, we empower Perception teams to enhance model performance and software quality, leading to successful and secure launches.In this hybrid role, you will report to an Engineering Manager.

Waymo is at the forefront of autonomous driving technology, dedicated to becoming the most trusted driver in the world. Originating from the Google Self-Driving Car Project in 2009, our mission has been to enhance mobility access while significantly reducing traffic-related fatalities. The Waymo Driver, our cutting-edge autonomous technology, powers a fully autonomous ride-hail service and is adaptable across various vehicle platforms and applications. With over ten million rider-only trips completed and more than 100 million miles driven autonomously on public roads, our system has been tested extensively, further driving our commitment to safety and innovation.The Driver Understanding and Evaluation (DUE) Machine Learning team is tasked with developing and managing scalable machine learning and data systems, enhancing our simulation workflows and analytical tools, and refining the evaluation processes for developer onboarding. This team merges expert human insights with advanced machine learning techniques to provide robust training and evaluation data for the myriad metrics and components that define the Waymo Driver. We seek talented researchers and software engineers who are enthusiastic about pioneering machine learning approaches for our evaluation systems, driving continuous improvements in our technology stack.Key Responsibilities:Develop a comprehensive strategy for next-generation, machine learning-based evaluation metrics while ensuring scientific and statistical rigor across our AI applications.Design and implement scalable systems for training and fine-tuning large-scale generative models to simulate realistic driving behaviors.Lead efforts in creating, implementing, and iterating innovative reinforcement learning (RL) algorithms and reward functions tailored to generate high-fidelity driving behaviors.Oversee the development of advanced Deep Learning models and Generative AI solutions to enhance triaging processes, automate high-volume workflows, and perform nuanced analyses of self-driving behaviors to identify critical anomalies.Stay informed on best practices within Alphabet and the broader industry to develop a state-of-the-art Reinforcement Learning from Human Preference (RLHF) based data collection and evaluation system.Provide mentorship, guidance, and thought leadership to engineers within the team and across collaborative groups.Coordinate and align multiple teams—including Driver Understanding, Simulation, System Engineering, Research, and Onboard Software—to ensure cohesive evaluation methodologies.

Waymo is at the forefront of autonomous driving technology, dedicated to becoming the world's most trusted driver. Originating from the Google Self-Driving Car Project in 2009, our focus has been on developing the Waymo Driver—The World’s Most Experienced Driver™—to enhance mobility access and save countless lives lost to traffic accidents. The Waymo Driver underpins our fully autonomous ride-hail service, with applications across various vehicle platforms and use cases. With over ten million rider-only trips facilitated, our technology has autonomously navigated over 100 million miles on public roads and tens of billions of miles in simulation across more than 15 U.S. states.The Safety Evaluation team acts as the guardians of safety, integrating data analysis expertise and thorough validation into our autonomous driving systems. We work in close collaboration with engineering teams to ground the evaluation of machine learning-intensive systems in safety principles. Our deep knowledge permeates every aspect of our safety-critical systems, ensuring that every decision made by our vehicles is supported by rigorous analysis and sound reasoning. Our mission extends beyond mere assessment to innovation, as we develop advanced ML techniques specifically designed for the intricacies of collision evaluation. Ultimately, we are paving the way for safer roads and a future in which Waymo vehicles navigate the complexities of the real world with confidence.As a Senior Data Scientist specializing in Safety Evaluation at Waymo, you will be pivotal in ensuring the safety and reliability of our autonomous vehicles. Your role will encompass a wide range of data analysis, model development, and evaluation tasks. While no two days are the same at Waymo, your core responsibilities will include:Creating safety evaluation frameworks essential for enhancing ML models.Designing and executing comprehensive data analysis pipelines and validation frameworks.Utilizing statistical methods and ML models to analyze historical/simulation data and evaluate safety performance.Collaborating with cross-functional teams such as Simulation and Planning to guarantee thorough safety evaluations across the autonomous driving system.

At Intrinsic Robotics, a pioneering venture backed by Alphabet, we are on a mission to revolutionize industrial robotics. Our team is driven by the belief that breakthroughs in artificial intelligence, perception, and simulation will transform the landscape of industrial robotics, with software and data at the heart of this evolution. Our goal is to create intelligent, accessible, and user-friendly industrial robotics solutions for an expansive range of businesses, entrepreneurs, and developers. We pride ourselves on being a vibrant team of engineers, roboticists, designers, and technologists dedicated to unlocking the creative and economic potential of robotics.We invite you to apply if you're interested in software engineering positions but don't find a suitable match in our current listings. Our recruitment team will evaluate applications and connect with you if a relevant opportunity arises.Please note, if you apply to this posting, you may not receive a response.We particularly want to hear from you if:You believe in making robotics more accessible for the manufacturing sector.You are skilled in modern software development and have delivered a substantial volume of high-quality software.You thrive on tackling challenging problems in interactive full-stack software, AI, and robotics.You have experience (or a desire) in developing tools and user-friendly interfaces for robotic functionalities. Robot functionalities include, but are not limited to, APIs for creating, editing, and simulating robot workcells, scalable computing infrastructure for microservices, vision algorithms, multi-step task planning, motion and grasp planning, machine learning for complex tasks, and representations for Industry 4.0.

Nuro develops self-driving technology, aiming to make autonomous vehicles accessible for everyone. Since 2016, the team has blended advanced AI with automotive-grade hardware, licensing the Nuro Driver™ to support robotaxis, commercial fleets, and personal vehicles. Partnerships with automakers and mobility platforms help bring these autonomous solutions to commercial scale. The Senior Software Engineer - Software Update Infrastructure role is part of the Fleet Connectivity team based in Mountain View, California. This position focuses on building and maintaining systems that support release infrastructure and over-the-air (OTA) updates for Nuro’s autonomous vehicles. The work covers both cloud and robotics stacks, ensuring reliable network connectivity, telemetry, and software updates that are vital to Nuro’s mission. What you will do Design, build, test, deploy, and maintain software for release infrastructure and OTA updates. Manage project priorities, deadlines, and deliverables within the team and when working with other groups. Write high-quality, testable code that meets strict code quality standards. Monitor release system performance by defining and tracking KPIs, and implement optimizations to improve build costs, times, and storage usage. Create testing and validation programs to ensure system architecture and data flows are reliable. Contribute to documentation and participate in on-call rotations during business hours. Requirements 5+ years of experience working with large-scale distributed systems. Proficiency in C++ or Go. Comfortable working in Unix/Linux environments and with Bash scripting. Ability to translate broad requirements into detailed system designs. Strong knowledge of data structures, algorithms, and distributed system software design. Bachelor’s degree in Computer Science, Electrical Engineering, or a closely related field. Bonus points Experience with SQL. Familiarity with Google Cloud Platform (GCP). UI development experience. Background in OTA updates execution and management.

Role overview Nuro is looking for a Senior Middleware Software Engineer to help build and support the software that powers its autonomous delivery platform. This role focuses on developing and maintaining middleware systems that connect different parts of the technology stack. The work directly impacts the reliability and efficiency of Nuro’s services.