Software Engineer - Perception Data Infrastructure

About the RoleJoin our dynamic team of experts where machine learning and systems engineering intersect to enhance the performance of autonomous systems. As a Senior Software Engineer specializing in Perception Machine Learning Data, you will play a crucial role in integrating machine learning advancements with autonomy infrastructure, ensuring that our models are trained using the most pertinent, diverse, and high-quality datasets. Your contributions will significantly influence how autonomous systems recognize uncommon scenarios, adapt to various geographical contexts, and operate safely at scale.Key Responsibilities Include:Utilizing Vision Language Models (VLMs) to compile diverse datasets that reflect real-world driving patterns across different regions.Creating high-fidelity synthetic data frameworks across multiple sensor modalities.Enhancing machine learning-powered validation processes for data quality and model preparedness.Your Impact:High-Output Generalist: Collaborate across various domains including autonomy, infrastructure, databases, simulation, and machine learning development, while expanding your expertise in Robotics and ML.Robotics Specialist: Develop cutting-edge solutions for data discovery, automated labeling, and synthetic data generation in close cooperation with the Infrastructure and Autonomy teams.About the WorkTackle the most demanding data challenges in autonomy by applying machine learning and rigorous systems engineering principles:Design hybrid systems that combine deep learning with traditional algorithms for scalable data curation and annotation.Create frameworks to evaluate the real-world authenticity of synthetic data and enhance the quality of synthetic data rendering.Develop tools to automatically identify data gaps that affect the performance of perception models.Collaborate with autonomy engineers to transform raw sensor data into prioritized training objectives, addressing critical gaps that hinder perception and autonomy performance.About YouBachelor’s degree in Computer Science, Robotics, Statistics, Physics, Mathematics, or a related quantitative field.Experience:4+ years of professional software engineering experience, proficient in Python and familiar with C/C++. Demonstrated ability to lead cross-functional technical projects from conception to execution.You have hands-on experience in implementing machine learning solutions and enjoy embedding them into practical systems. Your focus is on delivering impactful, integrated solutions rather than solely theoretical ML projects.Bonus PointsExperience working with synthetic or autonomous driving data.Background in building machine learning systems for robotic applications.

Waymo is a leader in autonomous driving technology dedicated to becoming the most trusted driver in the world. Originating from the Google Self-Driving Car Project in 2009, our focus has been on creating the Waymo Driver—an exceptional driver that enhances mobility access while significantly reducing traffic-related fatalities. The Waymo Driver not only supports our fully autonomous ride-hailing service but can also be adapted to various vehicle platforms and applications. With over ten million rider-only trips completed, our technology has safely navigated more than 100 million miles on public roads and processed tens of billions of miles in simulation across over 15 U.S. states.The Perception Data team at Waymo plays a critical role in shaping the strategy and technical direction for all data utilized in training and evaluating the Waymo Driver's perception capabilities. We manage the complete data lifecycle, developing automated systems and 'infrastructure-as-product' solutions that convert vast amounts of driving sensor data into high-quality training datasets. Our team tackles complex challenges, including active learning loops and open-vocabulary modeling, bridging raw data with advanced machine learning techniques.By integrating data ingestion, curation, and evaluation into a unified ecosystem, we facilitate the swift development of foundational models and next-generation perception systems. We work closely with Machine Learning, Infrastructure, and Evaluation teams to address intricate data challenges, ensuring our models can effectively interpret the long-tail of rare events. Ultimately, our contributions lay the groundwork for the Waymo Driver to operate safely in diverse environments.

Waymo, an innovative leader in autonomous driving technology, is on a mission to redefine mobility by creating the world's most trusted driver. Originating as the Google Self-Driving Car Project in 2009, Waymo has been dedicated to developing the Waymo Driver—The World's Most Experienced Driver™—aimed at enhancing mobility access and preventing traffic-related fatalities. Our autonomous ride-hail service, powered by the Waymo Driver, has completed over ten million trips, with an impressive track record of driving more than 100 million miles on public roads and tens of billions in simulations across 15+ U.S. states.The Perception team plays a crucial role in this journey by constructing systems that learn and interpret the spatial-temporal representations and semantic meanings of the environments surrounding our self-driving vehicles. We collaborate closely with other teams to optimize and integrate these systems into the Waymo Driver, while also conducting cutting-edge research to tackle real-world challenges. Our engineers leverage vast datasets from diverse sensors, allowing them to (1) devise methods for continuously learning from large-scale real-world data, (2) create scalable models and training processes, (3) analyze real-world behaviors to navigate complex interactions, and (4) optimize models for both onboard and offboard hardware.In this hybrid role, you will report to a Technical Lead Manager within the Semantics subgroup of our Perception organization.

Waymo is at the forefront of autonomous driving technology, dedicated to becoming the world’s most trusted driver. Originating as the Google Self-Driving Car Project in 2009, Waymo has tirelessly developed the Waymo Driver—The World’s Most Experienced Driver™—to enhance mobility access and save lives lost to traffic accidents. The Waymo Driver powers our fully autonomous ride-hailing service, and its technology can be adapted to a variety of vehicle platforms and applications. With over ten million rider-only trips and extensive experience driving over 100 million miles on public roads, alongside tens of billions of miles in simulation across more than 15 U.S. states, our capabilities are unparalleled.The Perception team is integral to Waymo, developing the advanced technology that enables the Waymo Driver to accurately perceive its surroundings, make timely decisions, and ensure safe transportation for passengers. We are engaged in cutting-edge research that addresses tangible challenges and fosters collaboration with research teams at Alphabet. With access to vast amounts of driving data from diverse sensors, we empower machine learning practitioners to create multi-modal models and techniques on a grand scale.In this hybrid role, you will report directly to the Director of Engineering.

Aeva, Inc. is seeking a Machine Learning Engineer with a focus on Perception to join the team in Mountain View, CA. This role centers on developing algorithms that help autonomous systems interpret and respond to their environment. The work draws on both machine learning and computer vision to improve how autonomous vehicles perceive the world around them. Key responsibilities Design and build perception algorithms for autonomous platforms Use machine learning and computer vision on real-world datasets Support progress in autonomous vehicle technology through technical contributions Work closely with engineers and researchers to expand product capabilities Location This position is based in Mountain View, CA.

Waymo, an innovator in autonomous driving technology, is dedicated to becoming the world's most reliable driver. Originating as the Google Self-Driving Car Project in 2009, our focus has been on creating the Waymo Driver—The World’s Most Experienced Driver™—to enhance mobility access and prevent traffic-related fatalities. The Waymo Driver supports our fully autonomous ride-hail service and can be integrated into various vehicle platforms for diverse applications. With over ten million rides provided and experience from driving more than 100 million miles on public roads combined with billions of miles in simulation across 15+ U.S. states, we’re at the forefront of a transportation revolution.The Perception team is responsible for developing systems that learn spatial-temporal representations and their semantic meanings within the autonomous vehicle's environment. Collaborating closely with other teams for optimization and integration into the Waymo Driver, we engage in research to tackle practical challenges and work with Alphabet's research teams. With access to millions of miles of diverse driving data, our engineers can (1) create methods for efficient and continuous learning from large-scale real-world data, (2) build and train models at scale, (3) analyze real-world behavior to manage complex interactions, and (4) optimize models for our onboard and offboard hardware.In this hybrid role, you will report directly to a Technical Lead Manager.

Join Nuro as a Senior Software Engineer specializing in Perception Data Infrastructure. In this pivotal role, you will be responsible for developing and optimizing systems that process perception data, enabling our autonomous vehicles to navigate safely and efficiently. You will collaborate with cross-functional teams to enhance our data infrastructure, ensuring reliability and scalability.

Who We Are Nuro is a pioneering self-driving technology company dedicated to making autonomy accessible to everyone. Established in 2016, Nuro is revolutionizing transportation with the most scalable autonomous driver, integrating advanced AI with automotive-grade hardware. Our flagship technology, the Nuro Driver™, is licensed to cater to various applications, including robotaxis, commercial fleets, and personal vehicles. With years of proven self-driving deployments, Nuro provides automakers and mobility platforms a clear pathway to commercial-scale autonomous vehicles, fostering a safer, more connected future. About the Role We are in search of a Senior/Staff Software Engineer to take on a pivotal technical leadership role in Nuro’s Machine Learning (ML) Data engine. You will be positioned at the crucial intersection of Autonomy, Machine Learning, and Infrastructure, serving as an architect for the systems that power our autonomy AI models. In this role, you’ll collaborate with the Autonomy team to implement the technical strategy to convert vast amounts of autonomy data into high-value training signals for decision-making. Your responsibilities will include designing and constructing data products for autonomy researchers, developing queries for rare 'needle-in-a-haystack' scenarios, and automating labeling and data ingestion workflows. You will work closely with Autonomy ML researchers to grasp their data needs, cooperate with infrastructure teams to establish the appropriate data interfaces and APIs, and develop robust tools for data selection, simulation, and introspection, all capable of handling data at scale. If you thrive on solving complex problems with practical solutions that impact the real world, we invite you to join us. About the Work Data Pipeline Architecture: Design and implement scalable data ingestion and processing pipelines that transform data streams into targeted training datasets. Lead efforts to enhance data quality, identify anomalies, and manage out-of-distribution examples to ensure effective model training and deployment. Cross-Functional Leadership: Collaborate with autonomy teams and data infrastructure teams to create effective ML data pipelines and products for ML engineers. ML Tooling & Introspection: Build infrastructure and visualization tools that enable ML researchers to easily introspect data, identify model failure modes, request new data samples, and comprehend shifts in data distribution. Labeling Operations Integration: Work closely with the data operations team to establish quality standards for labeling operations.

Waymo is at the forefront of autonomous driving technology, dedicated to becoming the world's most trusted driver. Originating from the Google Self-Driving Car Project in 2009, Waymo has tirelessly worked on developing the Waymo Driver—The World's Most Experienced Driver™—to enhance mobility access and save lives lost to traffic accidents. The Waymo Driver fuels our fully autonomous ride-hailing service and can adapt to various vehicle platforms and applications. With over ten million rider-only trips completed, Waymo has amassed more than 100 million miles driven autonomously on public roads, supplemented by tens of billions of simulated miles across 15+ U.S. states.The Perception team at Waymo is instrumental in crafting the technology that empowers the Waymo Driver. Our advanced models enable the Waymo Driver to interpret its surroundings, make informed decisions, and ensure safe passage for passengers. Engaging in research to tackle real-world challenges, we collaborate closely with Alphabet's research teams. Our access to extensive driving data from diverse sensors allows machine learning practitioners to develop scalable multi-modal models and techniques.You will report directly to our Director of Engineering within the Perception Organization.

About UsNuro is at the forefront of self-driving technology, dedicated to making autonomy available to everyone. Established in 2016, we are developing the world's most scalable driver by merging innovative AI with robust automotive hardware. Our flagship technology, the Nuro Driver™, is licensed to facilitate a variety of applications, from robotaxis to commercial fleets and personal vehicles. With years of successful self-driving deployments, Nuro is paving the way for automakers and mobility platforms to achieve commercial-scale autonomy, enabling a safer, more interconnected future.Role OverviewOur Sensor Data and Calibration team is expanding, and we are seeking a Senior Software Engineer with a strong background in robotics and machine learning. You will be responsible for designing both online and offline unstructured (targetless) sensor calibration algorithms. The ideal candidate will have extensive hands-on experience in the research, development, and application of machine learning methods utilizing various sensor data types (IMU, camera, lidar, radar, etc.). Familiarity with classical state estimation techniques, such as non-linear least-squares optimization and Lie algebra, is a plus.Key ResponsibilitiesDevelop cutting-edge state estimation and calibration algorithms leveraging both traditional robotics and modern machine learning techniques.Evaluate and characterize the accuracy and performance metrics of state estimation and calibration algorithms.Integrate calibration pipelines into the autonomy system while monitoring onboard performance and resource usage.Collaborate with cross-functional teams to enhance ML model training and overall performance assessment.Address critical inquiries regarding sensor data and overall autonomy effectiveness.

As a Senior Software Engineer specializing in Perception Verification at Waymo, you will play a crucial role in enhancing the safety and performance of autonomous driving technology. Your expertise will guide the development of innovative algorithms and systems that validate perception capabilities, ensuring our vehicles can navigate the complexities of real-world environments.This position offers an exciting opportunity to work at the forefront of technology, collaborating with a talented team of engineers and researchers dedicated to revolutionizing transportation.

About Us Nuro is a pioneering self-driving technology company committed to making autonomy accessible for everyone. Established in 2016, we are developing the world’s most scalable autonomous vehicle, integrating advanced AI with automotive-grade hardware. Our flagship technology, the Nuro Driver™, is licensed to enable a variety of applications, including robotaxis, commercial fleets, and personal vehicles. With a proven track record in self-driving deployments, Nuro provides automakers and mobility platforms a clear pathway to large-scale autonomous vehicles, paving the way for a safer, more connected future. Position OverviewOur robotics division is expanding, and we are on the lookout for an experienced Software Engineer to join our Sensor Data and Calibration team. We seek a candidate with a strong background in robotics and machine learning to create synthetic sensor simulation models and algorithms. The ideal applicant will possess hands-on experience with research, development, and implementation of machine learning techniques (such as NeRF or Gaussian splatting) aimed at generating synthetic sensor data, including photorealistic images and realistic lidar and/or radar outputs. Your Responsibilities Research, develop, and implement cutting-edge synthetic sensor simulation methodologies. Evaluate and characterize the authenticity and utility of synthetic sensor data. Address critical inquiries regarding sensor data and the performance of autonomous systems. Collaborate with cross-functional teams to establish mapping needs and specifications. Candidate Profile One of the following qualifications: PhD in machine learning, computer science, electrical engineering, robotics, or a related discipline with at least 3 years of industry experience. Master's degree with a minimum of 4 years of industry experience. 5+ years of relevant industry experience. In-depth understanding of machine learning principles, with practical experience in training and evaluating modern ML models. Proficient in Python, with familiarity in deep learning frameworks like PyTorch, TensorFlow, or Jax. Desired Skills Comprehensive knowledge of 3D geometry and state estimation concepts. Strong programming skills in systems coding. Experience in simulating/modeling real sensors (camera, lidar, radar, IMU, etc.), including noise modeling. Familiarity with contemporary ML graphics techniques, such as NeRF, Gaussian Splatting, and/or generative models.

About Us Nuro is a pioneering self-driving technology firm focused on democratizing autonomy for everyone. Established in 2016, we are on a mission to create the world's most scalable autonomous driver. Our innovative approach blends advanced AI with automotive-grade hardware, allowing us to license our core technology, the Nuro Driver™, across diverse applications including robotaxis, commercial fleets, and personal vehicles. Our proven technology, tested through numerous self-driving deployments, provides automakers and mobility platforms with a clear path to commercial-scale autonomous vehicles, fostering a safer, more connected future. Position OverviewWe are excited to expand our robotics team and are seeking a talented Senior Software Engineer to join our Sensor Data and Calibration unit. The ideal candidate will possess a strong background in robotics and machine learning, with a focus on developing sophisticated synthetic sensor simulation models and algorithms. Experience in research, development, and application of machine learning techniques (such as NeRF or Gaussian splatting) for generating synthetic sensor data, including photorealistic images and realistic LiDAR or radar outputs, is essential. Key Responsibilities Research and create cutting-edge synthetic sensor simulation methodologies. Evaluate and characterize the realism and effectiveness of synthetic sensor data. Address essential inquiries regarding sensor data and autonomous performance. Collaborate with various teams across autonomy, infrastructure, and systems to define mapping requirements. Qualifications One of the following: PhD in machine learning, computer science, electrical engineering, robotics, or a related field, with 3+ years of industry experience. Master's degree with 4+ years of industry experience. 5+ years of industry experience. In-depth knowledge of machine learning fundamentals with practical experience in training and assessing contemporary ML models. Proficient in Python, with experience in deep learning frameworks such as PyTorch, TensorFlow, or JAX. Preferred Qualifications Strong grasp of 3D geometry and state estimation principles. Experience in systems-level coding. Familiarity with simulating and modeling real sensors (camera, LiDAR, radar, IMU, etc.), including noise modeling. Expertise in modern ML graphics techniques, such as NeRF, Gaussian Splatting, and/or generative models.

Who We AreAt Ema, we are pioneering cutting-edge AI technologies designed to enhance the creativity and productivity of employees across enterprises. Our unique technology enables organizations to entrust Ema, the AI employee, with repetitive tasks, freeing up human talent for more strategic initiatives. Founded by a team of former executives from tech giants such as Google, Coinbase, and Okta, and backed by prestigious investors including Accel Partners and Naspers, we are on the forefront of the AI revolution.Our diverse team, composed of top engineers from leading tech firms like Microsoft Research and Facebook, brings a wealth of knowledge and experience, primarily from renowned institutions such as Stanford and MIT. Operating out of Silicon Valley and Bangalore, India, we embrace a hybrid work model, requiring employees to be in our Mountain View, CA office three days a week.Who You AreWe seek passionate and innovative Machine Learning Engineers who thrive on tackling complex challenges and enjoy working with vast datasets. You have a talent for translating theoretical concepts into practical, scalable solutions, and you are a collaborative team player who excels in autonomous settings. Your enthusiasm for employing machine learning techniques, particularly in Natural Language Processing and Information Retrieval, is matched only by your desire to contribute to a mission-driven, high-growth startup making a significant impact.Your ResponsibilitiesDesign, develop, and deploy machine learning models that drive our NLP, retrieval, ranking, reasoning, dialog, and code-generation systems.Implement state-of-the-art machine learning algorithms, including Transformer-based models and reinforcement learning, to enhance AI system performance.Analyze and process large, complex datasets (structured, semi-structured, and unstructured) to inform model development.Engage throughout the entire machine learning model lifecycle, from problem identification and data exploration to feature engineering and model evaluation.

Waymo is a pioneering company in the autonomous driving sector, dedicated to becoming the world’s most trusted driver. Originating from the Google Self-Driving Car Project in 2009, Waymo has been committed to developing the Waymo Driver—The World’s Most Experienced Driver™—to enhance mobility access and prevent traffic-related fatalities. With over ten million rider-only trips and more than 100 million miles driven autonomously across various U.S. states, Waymo continues to push the boundaries of what is possible in vehicular automation. Our DUE Machine Learning team is tasked with constructing and managing scalable machine learning and data systems, simulation workflows, and insight tools, all aimed at optimizing the evaluation and onboarding processes for developers. This team integrates human expertise with cutting-edge machine learning models to produce training and evaluation data across a multitude of metrics, enhancing the performance of the Waymo Driver. We seek passionate researchers and software engineers excited about advancing machine learning methodologies for our autonomous vehicle evaluation systems, dedicated to enhancing our technology stack's efficacy.

Join our dynamic team at LinkedIn as a Distinguished Software Engineer in Machine Learning. In this pivotal role, you will lead innovative projects that enhance our growth strategies through cutting-edge machine learning techniques. You will collaborate with cross-functional teams to implement advanced algorithms that drive our product offerings and influence key decisions.

Waymo is at the forefront of autonomous driving technology, striving to become the world’s most reliable driver. Originating from the Google Self-Driving Car Project in 2009, our mission has been to develop the Waymo Driver—the world's most experienced driver—to enhance mobility access and save countless lives lost to traffic accidents. The Waymo Driver powers our fully autonomous ride-hail service and can be adapted to various vehicle platforms and product applications. With over ten million rider-only trips and more than 100 million miles driven autonomously on public roads, along with tens of billions of miles simulated across more than 15 U.S. states, we are redefining transportation.The Perception team is dedicated to building systems that learn the spatial-temporal representations and semantic meanings of the environment around the autonomous driving vehicle (ADV). We collaborate closely with downstream teams to optimize and integrate these systems into the Waymo Driver. Our research tackles real-world challenges and involves collaboration with Alphabet’s research teams. With access to millions of miles of diverse driving data from various sensors, our engineers develop methods for efficient and continuous learning from large-scale real-world data, model training at scale, real-world behavior analysis, and optimizing models for both onboard and offboard hardware.In this hybrid role, you will report to a Technical Lead Manager.

Waymo is a pioneering autonomous driving technology company with a vision to become the most trusted driver in the world. Originating from the Google Self-Driving Car Project in 2009, we have dedicated ourselves to developing the Waymo Driver—The World’s Most Experienced Driver™—to enhance mobility access while preventing countless lives lost in traffic accidents. The Waymo Driver is the backbone of our fully autonomous ride-hailing service and can be adapted to various vehicle platforms and product use cases. To date, the Waymo Driver has successfully completed over ten million rider-only trips, backed by its extensive experience of autonomously navigating over 100 million miles on public roads and tens of billions of miles in simulation across more than 15 U.S. states.The Perception team is responsible for creating the systems that interpret spatial-temporal representations and their semantic meanings of the environment surrounding the self-driving car. We collaborate closely with downstream teams to optimize and integrate these systems into the Waymo Driver. Our team conducts innovative research to solve real-world challenges and partners with research teams at Alphabet, leveraging millions of miles of driving data from a diverse range of sensors. This enables our engineers to (1) devise methods for continuous learning from large-scale real-world data, (2) design and scale model training, (3) analyze real-world behavior and develop systems for managing real-world complexities, and (4) optimize models for our onboard and offboard hardware.In this hybrid role, you will report to a Senior Staff Technical Lead Manager.

Join Our TeamAt Unity, we are creating an exceptional ad-tech ecosystem that connects billions of users with the games and experiences they cherish. The Advertiser Growth team plays a pivotal role in this mission, managing the online ads delivery stack, which includes auction, pacing, and bidding systems. As a Senior Machine Learning Engineer, you will significantly contribute to modernizing our core infrastructure and developing backend systems for next-generation AI agents that transform the campaign experience. This position provides an exciting opportunity to tackle complex system challenges at a massive scale while directly impacting Unity’s revenue growth.