Senior Machine Learning Engineer - Perception Mapping

Join Zoox as a Machine Learning Engineer Intern in Perception and gain invaluable hands-on experience with cutting-edge technology while working alongside industry-leading experts. Our internship program is designed for outstanding students who exhibit exceptional academic performance, extracurricular involvement, and a genuine passion for our mission at Zoox. As part of the Perception team, you will contribute to the development of systems that empower our autonomous vehicles to understand their surroundings. You will have the opportunity to work in one of several dynamic teams, focusing on multimodal models, scene understanding, vehicle recognition, and hazard detection, all while utilizing state-of-the-art machine learning techniques and real-world data.

Join Zoox as a Senior Machine Learning Engineer specializing in Perception, where you will play a pivotal role in crafting and deploying state-of-the-art detection models that leverage integrated sensor data. This position focuses on pioneering projects tailored for the next generation of driving software, which includes developing joint detection and tracking models and innovating methods to transmit enriched embeddings to downstream models to enhance semantic understanding and uncertainty management.This unique opportunity allows you to significantly contribute to Zoox's venture into new horizons. By engineering more robust and adaptable models, you will aid in navigating complex and diverse scenarios, propelling our mission to achieve safe and dependable autonomous mobility. We seek an enthusiastic and driven individual who is eager to push the limits of perception technology in autonomous vehicles.

Join the visionary Perception team at Zoox, where we are revolutionizing autonomous vehicle technology by creating an intricate understanding of our surroundings for self-driving robots. Our mission is to facilitate safe and efficient navigation within complex environments through advanced detection, classification, and tracking systems.As a pivotal software engineer on the perception mapping team, you will drive the development of Zoox's online mapping initiative. Your responsibilities will include designing, training, validating, and seamlessly integrating machine learning models that identify semantic map elements in real-world settings. You will engage in all facets of machine learning development, from data collection and annotation to training, validation, and onboard integration. Your contributions will be instrumental in achieving key milestones that enhance our scaling and autonomy capabilities, playing a crucial role in Zoox's success.

Join the innovative Perception team at Zoox, where we harness the power of Generative AI to produce synthetic data that revolutionizes the training and evaluation of our autonomous systems. As a Machine Learning Engineer specializing in Generative AI, you will be at the cutting edge of developing and training advanced models for sensor-level scenario generation. By utilizing world models and radiance field techniques alongside our extensive proprietary datasets, your work will have a direct impact on enhancing the productivity, safety, and capabilities of Zoox's autonomous systems through real-world algorithm validation.

Join Zoox as a Machine Learning Engineer specializing in 3D vision perception! In this role, you will be at the forefront of developing cutting-edge technologies that empower autonomous vehicles to perceive and understand their environment in three dimensions. Utilize your expertise in machine learning and computer vision to create innovative solutions that enhance the safety and efficiency of our self-driving systems.

Onsite in Foster City, CA | at least 3 days onsiteThe Perception team seeks a talented Machine Learning Engineer to innovate advanced Computer Vision modules, significantly enhancing the onboard perception capabilities of our robotic fleet. This position will directly influence safety and operational efficiency. The ideal candidate will engage in the complete design and development process, encompassing data collection, dataset creation, and the design and implementation of machine learning models. Key Responsibilities:Architect and develop in-cabin Computer Vision ML modules for critical safety and monitoring applications.Implement advanced Perception model architectures and sophisticated training methodologies.Create high-quality datasets utilizing inputs from our sensor stack and large-scale data.Validate and optimize solutions through real-world driving scenarios, directly enhancing the safety and reliability of our autonomous systems. Essential Qualifications:Bachelor's Degree in Computer Science or Computer Engineering with a minimum of 4 years of relevant experience.Proficient in modern Computer Vision and Machine Learning, especially in areas like 3D reconstruction, detection, classification, and semantic segmentation.Experience in training and deploying Deep Learning models.Strong programming skills in C++ and/or Python.Exceptional communication abilities. Preferred Qualifications:Familiarity with any of the following:Experience in the self-driving industry.Expertise in integrating ML models within latency-sensitive systems.Proficiency in CUDA programming. Employee Benefits:Comprehensive Health Care Plan (Medical, Dental, and Vision).Life Insurance (Basic and Voluntary, including AD&D).Generous Paid Time Off (Vacation, Sick Leave, and Public Holidays).Opportunities for Training and Development.Retirement Plan options (401k, IRA).

Join Zoox's innovative Perception Object Detection and Tracking team, where we focus on the sophisticated perception of dynamic objects and individuals. In this pivotal role, you will collaborate directly with machine learning model teams to integrate state-of-the-art models into our vehicle technology stack.You will have unparalleled access to premier sensor data and a robust infrastructure designed for rigorous testing and validation of your algorithms. We are pioneering new algorithms for segmentation, tracking, classification, and high-level scene comprehension, and you will have the opportunity to contribute to any (or all!) of these critical components.

Join the innovative Offline Driving Intelligence (ODIN) team at Zoox, where we harness the power of advanced AI to develop sophisticated algorithms that interpret the world around us. Our cutting-edge models are first tested offline, paving the way for impactful integration into our self-driving robots, which are designed for safe and efficient navigation through complex environments.As a Machine Learning Engineer on the ODIN team, you will be at the forefront of developing advanced multimodal large language models to enhance environmental cognition. Your expertise will focus on refining these models for off-vehicle analysis, collaborating closely with the onboard team to ensure our robotaxi platform can swiftly identify hazards and navigate driving constraints with remarkable precision. You will work alongside a team of world-class engineers and researchers, leveraging high-quality sensor data and state-of-the-art infrastructure to validate your algorithms in real-world scenarios, significantly influencing the productivity, safety, and overall capabilities of Zoox's autonomous systems.

Join Zoox as a Machine Learning Engineer Intern in Simulation and gain invaluable hands-on experience with cutting-edge technology. Our internship program not only offers mentorship from some of the brightest minds in the industry but also invites you to contribute to our innovative mission. We seek candidates who exhibit exceptional academic performance, extracurricular involvement, intellectual curiosity, and a genuine passion for advancing Zoox's groundbreaking work.The Simulation team at Zoox is responsible for generating high-fidelity synthetic data essential for the training and evaluation of our autonomous vehicle AI systems, as well as providing real-time sensor data for hardware-in-the-loop simulations. With Zoox vehicles operating in various cities across the United States, our Simulation team ensures that we are always prepared for success.As a Machine Learning Engineer Intern focused on Simulation, you will have the opportunity to join one of several teams:On the 3D World Simulation team, your role will involve enhancing our simulation pipeline to accurately replicate dynamic actors. You will conduct research on various reconstruction algorithms and integrate the most effective solutions into our simulation framework.Within the Agent Simulation team, your focus will be on developing and refining models that authentically simulate the behaviors of road agents, including pedestrians and vehicles. Your expertise in software engineering and machine learning will be crucial in ensuring these agents exhibit a diverse range of plausible human behaviors, vital for validating the safety and efficacy of Zoox's autonomous driving technology.In the 3D Sensor Simulation team, you will assist in generating high-fidelity synthetic data to train and test autonomous vehicle AI, as well as provide real-time sensor data for hardware-in-the-loop simulations. You will develop 3D machine learning models and training datasets while collaborating closely with the Sensors, Perception, and Validation teams to enhance the fidelity of our sensor simulations.On the Scenario Authoring team, you'll work to create intelligent AI systems capable of generating novel scenarios that validate the safety and performance of Zoox's autonomous driving technology. Utilizing your software engineering and machine learning skills, you will gather data, refine existing diffusion models, enhance our LLM agent, and assess outcomes against customer requirements.Lastly, as part of the Scenario Automation team, you will build tools for scenario generation and analysis to evaluate robotic behavior through simulation. Your skills in software engineering and machine learning will be essential in recreating complex scenarios to assess performance.

Join the innovative Offline Driving Intelligence (ODIN) team at Zoox, where we harness the power of cutting-edge AI to develop sophisticated algorithms that perceive and interpret the world around us. Our mission is to create algorithms that first operate in offline settings, ultimately paving the way for safe and efficient navigation of our self-driving robot in complex environments.As a key engineer in the ODIN team, you will be at the forefront of developing advanced multimodal large language models that significantly enhance environmental comprehension. Your role will involve fine-tuning these models for off-vehicle analysis, collaborating with our onboard team to ensure our robotaxi platform can swiftly identify hazards and interpret driving restrictions with minimal latency. You will work alongside a team of world-class engineers and researchers, utilizing premium sensor data and state-of-the-art infrastructure to validate your algorithms in real-world scenarios, directly contributing to the productivity, safety, and capabilities of Zoox’s autonomous systems.

About the Internship Zoox is seeking a Software Engineering Intern focused on Perception Data at our Foster City, CA location. This role supports the development of software that improves how our autonomous vehicles understand and interpret their surroundings. What You'll Work On Collaborate with engineers to build and refine perception systems for autonomous vehicles Contribute to software projects that help vehicles navigate safely and efficiently Work alongside experienced professionals committed to advancing autonomous technology

Join Visa Inc. as a Staff Machine Learning Engineer and be at the forefront of innovation in the financial technology landscape. In this role, you will leverage advanced machine learning techniques to create cutting-edge solutions that enhance our services and customer experience. You will collaborate with cross-functional teams to drive impactful projects and contribute to the growth of our machine learning capabilities.

Join our innovative Prediction & Behavior ML team at Zoox, where we are at the forefront of developing cutting-edge machine learning algorithms that analyze and predict driving behaviors from complex data sets. Our algorithms are pivotal in enhancing both on-vehicle driving decision-making and off-vehicle simulation and validation processes. By closely collaborating with the Planner team, we ensure a seamless integration of behavior forecasting and motion planning, driving the advancement of our autonomous vehicle technology. Furthermore, our partnerships with the Perception, Simulation, and Systems Engineering teams enable us to rigorously validate and refine our driving performance.As a Learned Trajectory Machine Learning Engineer, you will be instrumental in designing and implementing advanced deep learning models that generate accurate trajectories for our vehicles. Your work will directly impact the integration of behavior prediction with motion planning, and you will collaborate extensively with Planner and Perception teams to elevate our vehicle's overall functionality and performance.

Join Zoox as a Senior Engineering Manager for our Machine Learning Platform. In this pivotal role, you will lead a talented engineering team, driving innovation and excellence in our machine learning initiatives. You'll be responsible for overseeing the architecture and development of ML systems that enhance our autonomous vehicle technology. Your leadership will empower engineers to explore cutting-edge solutions and collaborate across disciplines.At Zoox, we are committed to redefining mobility through advanced robotics and AI, aiming to create a seamless transportation experience that is safe, efficient, and sustainable.

As a Staff Machine Learning Engineer at Zoox, you will play a crucial role in shaping the future of autonomous mobility. You will work with a talented team to design and implement cutting-edge algorithms that enable the mapping and understanding of the world around our vehicles. This position is ideal for innovative thinkers who thrive in a dynamic environment and are passionate about machine learning and artificial intelligence.

Join the dynamic 3D Simulation team at Zoox, where we blend advanced Machine Learning and cutting-edge 3D graphics to create realistic simulations of sensors such as cameras, lidar, and radar. In this pivotal role, you will utilize world-class sensor data and a robust testing infrastructure to develop and refine algorithms that enhance the accuracy of sensor simulations. Collaborate closely with teams across Sensor Simulation, Perception, and Verification & Validation to continuously elevate the fidelity of our synthetic data, which is crucial for training and testing autonomous vehicle AI, as well as for real-time simulations involving hardware-in-the-loop.

Join Zoox as a Senior Machine Learning Engineer specializing in Scene Understanding. In this role, you'll leverage your expertise to develop advanced algorithms and models that enhance the understanding of complex scenes for autonomous vehicles. You will be part of a dynamic team that is committed to innovation and excellence in the field of machine learning.

Join the innovative 3D Simulation team at Zoox, where we are at the forefront of merging cutting-edge machine learning with advanced 3D vision technology. We are seeking passionate machine learning engineers to help enhance the realism in simulations and promote diversity within virtual environments. You will leverage unparalleled access to world-class sensor data and a robust infrastructure designed for rigorous testing and validation of your algorithms. Our ML team is dedicated to generating intricate and diverse 3D environments, including lifelike representations of humans and varying environmental conditions. Your contributions will be instrumental in shaping the future of automated driving technology.

Join Zoox as a Senior/Staff Software Engineer specializing in Perception & Sensing, where you'll work alongside a talented team of engineers from various domains including AI, robotics, and computer vision. This role offers the opportunity to innovate and implement cutting-edge technologies, contribute to research initiatives, and enhance key systems that drive our vision forward. Your expertise will play a pivotal role in the development of algorithms, software, and solutions that enhance our autonomous vehicle technology.