Machine Learning Engineer Intern, Perception

High-definition maps are essential for ensuring safe and scalable autonomous driving. We are on the lookout for driven engineers who are enthusiastic about tackling intricate, real-world challenges while developing cutting-edge mapping systems.This position involves collaborating with a diverse and cross-functional team to design and implement extensive HD mapping algorithms, workflows, and data pipelines. Your contributions will significantly enhance our capability to efficiently map new urban areas and continuously update existing maps on a large scale, playing a pivotal role in expediting our autonomous vehicle deployment.

The Perception team at Zoox plays a pivotal role in advancing our autonomous vehicle technology by creating a sophisticated understanding of the world for our self-driving robots. Our expertise enables safe and efficient navigation through complex environments by leveraging advanced detection, classification, and tracking systems.As a Senior Software Engineer within the perception mapping team, you will be an integral player in Zoox’s online mapping initiatives. Your responsibilities will encompass designing, training, validating, and integrating machine learning models that accurately detect semantic elements within our environment. This role will engage you in all phases of ML development, including data collection, labeling, training, validation, and onboard integration. Your contributions will be crucial in achieving significant milestones in scaling and enhancing our autonomy capabilities, ultimately driving the success of Zoox.

Zoox’s Perception and Mapping Data team develops the systems behind high-definition maps for autonomous vehicles. These maps are essential for safe operation and expansion into new cities, as well as for keeping current routes accurate and up to date. Role overview This Software Engineer position centers on building and improving mapping systems that support Zoox’s autonomous driving technology. The work involves both creating new maps for additional locations and maintaining the quality of existing ones. What you will do Design and implement large-scale algorithms and workflows for HD mapping Build and maintain data pipelines to process mapping data efficiently Collaborate with cross-functional teams to address real-world challenges in autonomous driving Improve the speed and efficiency of mapping new areas and updating current maps Requirements Interest in solving challenging technical problems related to autonomous vehicles Experience with mapping systems, large data pipelines, or similar technical domains is valuable Location This role is based in Foster City, CA.

Join the visionary Perception team at Zoox, where we are revolutionizing autonomous vehicle technology by creating an intricate understanding of our surroundings for self-driving robots. Our mission is to facilitate safe and efficient navigation within complex environments through advanced detection, classification, and tracking systems.As a pivotal software engineer on the perception mapping team, you will drive the development of Zoox's online mapping initiative. Your responsibilities will include designing, training, validating, and seamlessly integrating machine learning models that identify semantic map elements in real-world settings. You will engage in all facets of machine learning development, from data collection and annotation to training, validation, and onboard integration. Your contributions will be instrumental in achieving key milestones that enhance our scaling and autonomy capabilities, playing a crucial role in Zoox's success.

About the Internship Zoox is seeking a Software Engineering Intern focused on Perception Data at our Foster City, CA location. This role supports the development of software that improves how our autonomous vehicles understand and interpret their surroundings. What You'll Work On Collaborate with engineers to build and refine perception systems for autonomous vehicles Contribute to software projects that help vehicles navigate safely and efficiently Work alongside experienced professionals committed to advancing autonomous technology

Join Zoox as a Senior/Staff Software Engineer specializing in Perception & Sensing, where you'll work alongside a talented team of engineers from various domains including AI, robotics, and computer vision. This role offers the opportunity to innovate and implement cutting-edge technologies, contribute to research initiatives, and enhance key systems that drive our vision forward. Your expertise will play a pivotal role in the development of algorithms, software, and solutions that enhance our autonomous vehicle technology.

Join us in revolutionizing personal transportation at Zoox, where we're creating a safer, cleaner, and more enjoyable future. Our unique vehicle design is tailored for navigating dense urban environments with bidirectional driving capabilities and four-wheel steering, enabling seamless maneuverability in tight spaces without the need to reverse. We are seeking an experienced Engineering Manager to lead our Perception Occupancy and Rare Events team. In this role, you will oversee the development of Zoox’s cutting-edge 3D environment model utilizing multi-modal sensor data. Your expertise will guide the creation of innovative AI architectures that blend the latest academic advancements with our pioneering in-house innovations. Our algorithms are meticulously optimized to perform effectively on diverse real-world data and in simulations. As a leader, you will steer high-impact teams, charting technical roadmaps and achieving milestone goals. Collaboration with other AI domains—such as Simulation, Sensor and Hardware, and Systems Design and Mission Assurance—will be essential in delivering a top-tier object occupancy perception system that integrates modalities including vision, lidar, radar, and long-wave IR. You will mentor a diverse team, tackling some of the most intricate challenges in artificial intelligence, perception, and sensor fusion.

Join Zoox's innovative Perception Object Detection and Tracking team, where we focus on the sophisticated perception of dynamic objects and individuals. In this pivotal role, you will collaborate directly with machine learning model teams to integrate state-of-the-art models into our vehicle technology stack.You will have unparalleled access to premier sensor data and a robust infrastructure designed for rigorous testing and validation of your algorithms. We are pioneering new algorithms for segmentation, tracking, classification, and high-level scene comprehension, and you will have the opportunity to contribute to any (or all!) of these critical components.

Join us at Zoox as a Senior/Staff Software Engineer, where you will spearhead the development and expansion of our cutting-edge cloud services and APIs for our innovative robotaxi service. In this pivotal role, you will work on key functionalities such as dispatch, routing, payment processes, mobile APIs, telemetry analytics, and service performance metrics, all aimed at enhancing the ride-hailing experience.

Join Zoox as a Software Engineering Manager and take the helm of our innovative Fleet Management team. This pivotal team is instrumental in delivering a seamless driverless robotaxi experience, focusing on essential operations such as dispatch, routing, and telemetry, which are vital to our customer satisfaction and operational success.In this role, you will guide a talented team of software engineers through a dynamic, interdisciplinary environment, collaborating closely across various facets of robotic systems and service optimization.

Join Zoox’s dynamic internship program, where you will gain invaluable experience with cutting-edge technology, receive mentorship from leading experts in the field, and contribute to our mission of revolutionizing autonomous driving. We seek passionate individuals with a strong academic track record, involvement in extracurricular activities, and a genuine curiosity for innovation. As part of our mapping team, you will collaborate with a diverse group of researchers and engineers to develop advanced machine perception algorithms that facilitate the creation of high-definition semantic maps vital for fully autonomous vehicles.

Join Zoox as a Senior Machine Learning Engineer specializing in Perception, where you will play a pivotal role in crafting and deploying state-of-the-art detection models that leverage integrated sensor data. This position focuses on pioneering projects tailored for the next generation of driving software, which includes developing joint detection and tracking models and innovating methods to transmit enriched embeddings to downstream models to enhance semantic understanding and uncertainty management.This unique opportunity allows you to significantly contribute to Zoox's venture into new horizons. By engineering more robust and adaptable models, you will aid in navigating complex and diverse scenarios, propelling our mission to achieve safe and dependable autonomous mobility. We seek an enthusiastic and driven individual who is eager to push the limits of perception technology in autonomous vehicles.

At Zoox, we are pioneering a revolution in personal transportation by crafting a future that is safer, cleaner, and more enjoyable for everyone. Our innovative vehicle is uniquely designed for navigating the complexities of dense urban environments. As the only vehicle on the market featuring bidirectional driving capabilities and four-wheel steering, we excel at maneuvering through tight spaces and changing directions seamlessly, eliminating the need for reversing. Join us in shaping the future of mobility!We are currently expanding our dynamic software engineering leadership team and seeking a visionary Director of Perception. In this pivotal role, you will oversee the development of Zoox’s state-of-the-art 3D environment model, utilizing multi-modal sensor data. Our team thrives on innovation, combining cutting-edge AI architectures with the latest academic advancements and our proprietary solutions. Your expertise will drive the optimization of our algorithms to ensure peak performance across a diverse range of real-world scenarios and simulations.As the Director of Perception, you will lead high-impact teams, guiding their technical roadmaps and setting milestone objectives. Collaboration will be key as you work alongside other AI and software leaders, simulation experts, and our systems design and mission assurance teams. Your mission will include delivering an exceptional dynamic object perception system that integrates various modalities such as vision, lidar, radar, and long-wave IR across complex pipelines including segmentation, detection, classification, fusion, and tracking. You'll manage a diverse and skilled team, tackling some of the most challenging problems in artificial intelligence, perception, and sensor fusion.

Onsite in Foster City, CA | at least 3 days onsiteThe Perception team seeks a talented Machine Learning Engineer to innovate advanced Computer Vision modules, significantly enhancing the onboard perception capabilities of our robotic fleet. This position will directly influence safety and operational efficiency. The ideal candidate will engage in the complete design and development process, encompassing data collection, dataset creation, and the design and implementation of machine learning models. Key Responsibilities:Architect and develop in-cabin Computer Vision ML modules for critical safety and monitoring applications.Implement advanced Perception model architectures and sophisticated training methodologies.Create high-quality datasets utilizing inputs from our sensor stack and large-scale data.Validate and optimize solutions through real-world driving scenarios, directly enhancing the safety and reliability of our autonomous systems. Essential Qualifications:Bachelor's Degree in Computer Science or Computer Engineering with a minimum of 4 years of relevant experience.Proficient in modern Computer Vision and Machine Learning, especially in areas like 3D reconstruction, detection, classification, and semantic segmentation.Experience in training and deploying Deep Learning models.Strong programming skills in C++ and/or Python.Exceptional communication abilities. Preferred Qualifications:Familiarity with any of the following:Experience in the self-driving industry.Expertise in integrating ML models within latency-sensitive systems.Proficiency in CUDA programming. Employee Benefits:Comprehensive Health Care Plan (Medical, Dental, and Vision).Life Insurance (Basic and Voluntary, including AD&D).Generous Paid Time Off (Vacation, Sick Leave, and Public Holidays).Opportunities for Training and Development.Retirement Plan options (401k, IRA).

Join the innovative Perception team at Zoox, where we harness the power of Generative AI to produce synthetic data that revolutionizes the training and evaluation of our autonomous systems. As a Machine Learning Engineer specializing in Generative AI, you will be at the cutting edge of developing and training advanced models for sensor-level scenario generation. By utilizing world models and radiance field techniques alongside our extensive proprietary datasets, your work will have a direct impact on enhancing the productivity, safety, and capabilities of Zoox's autonomous systems through real-world algorithm validation.

As a Staff Machine Learning Engineer at Zoox, you will play a crucial role in shaping the future of autonomous mobility. You will work with a talented team to design and implement cutting-edge algorithms that enable the mapping and understanding of the world around our vehicles. This position is ideal for innovative thinkers who thrive in a dynamic environment and are passionate about machine learning and artificial intelligence.

Join us at the forefront of autonomous mobility as we revolutionize the landscape of fleet operations. Our innovative team is dedicated to ensuring the seamless performance of our robotic fleet, which is pivotal for maintaining live service. Within our operations, Base Operations and Mission Readiness play a critical role in the maintenance and repair of our robots.As a rapidly growing startup, we experience high demand for our fleet of robots, which are deployed daily for missions ranging from stability testing to executing live routes. To maintain peak performance, our Technicians and Fleet Service Engineers depend on cutting-edge hardware and software solutions.In your role as the Product Manager for Operations Software, you will:Develop essential tools for our Operations teams.Oversee the software product line and curate its strategic roadmap.Collaborate closely with Design, Engineering, and Technical Program Managers to refine and prioritize features and requirements.Establish key performance metrics to assess system health and efficiency.Lead product development initiatives by reviewing startup requirements, identifying automation opportunities, and drafting engineering specifications for new functionalities.Implement a comprehensive supervisor view to enable remote management of multiple depots and charging processes, ensuring operational efficiency across locations.

Join Zoox as the Manager of Fleet Testing & Repair, where you will lead our cutting-edge fleet management initiatives. In this pivotal role, you will oversee the testing and repair processes of our innovative vehicles, ensuring operational excellence and safety standards are met. You will collaborate closely with engineers, technicians, and cross-functional teams to enhance fleet performance and reliability.

Join our innovative Motion Planning team, where you will play a critical role in enhancing the driving behaviors of our robots as they navigate public roads. Your mission will be to determine the robot's destination and devise safe routes in complex environments, such as the bustling streets of Downtown San Francisco or the iconic Las Vegas Strip.This is an exhilarating challenge that demands close collaboration with a diverse group of specialists, including experts in Planner, Perception, Prediction, and Operations. Together, you will drive the advancement of cutting-edge algorithms that enhance our robot's capabilities in navigating intricate traffic scenarios.Safety is our top priority. You will employ a systematic approach by developing modifications to the Planner, conducting simulations and closed-course tests, and collaborating with our safety drivers for real-world testing.Key Responsibilities:Develop, debug, and test features and enhancements related to driving behaviors in our production codebase.Collaborate closely with senior engineers to interpret design specifications and produce robust, high-quality code.Utilize our comprehensive backend tools to execute regression tests and validate your modifications across various driving scenarios.Engage in on-vehicle drive reviews, assisting in data collection and generating actionable insights on driving performance.