Software Engineer - Data Infrastructure

About Us Nuro is a pioneering self-driving technology company dedicated to making autonomous solutions accessible to everyone. Established in 2016, we are developing the most scalable autonomous driver by integrating advanced AI with automotive-grade hardware. Our flagship technology, the Nuro Driver™, is licensed to facilitate a variety of applications, including robotaxis, commercial fleets, and personal vehicles. With proven technology from years of self-driving deployments, Nuro provides automakers and mobility platforms with a clear pathway to achieving commercial-scale autonomous vehicles, promoting a safer, more connected future. Role Overview At Nuro, we adopt a machine-learning-first strategy in our approach to autonomous driving technology. The performance of our systems is significantly influenced by the quality and diversity of training and evaluation data. Your team will be pivotal in enhancing our autonomous driving systems by establishing a robust and scalable data infrastructure. This infrastructure will generate training and evaluation data from both real-world driving logs and simulated environments. Collaborating closely with system engineers, you will ensure thorough validation of the autonomous driving system prior to deployment. Key Responsibilities Design and implement cohesive, introspectable data pipelines capable of processing large-scale batch and streaming data across diverse evaluation use cases. Develop a storage solution that efficiently manages extensive volumes and a wide variety of performance metrics. Create user-friendly dashboards and reports to display evaluation results, enabling easy comparisons to highlight improvements and regressions in ML components and the overall system. Establish and maintain continuous testing and monitoring systems to ensure the integrity and robustness of our data and data pipelines. Build data mining tools utilizing applied ML techniques to meet data discovery requirements in areas such as Perception, Behavior, and Mapping. Develop data annotation tools to aid both first-party and third-party labeling efforts, ensuring high-fidelity perception, mapping, and trajectory labels. Scale data annotation labels with cutting-edge ML techniques. Qualifications A degree in Computer Science, Engineering, or a related field (BS, MS, or PhD) combined with at least 4 years of relevant professional experience. Strong programming skills in Python or similar languages. Experience in data engineering, machine learning, or related fields. Familiarity with data pipeline tools and frameworks. Ability to work collaboratively in a fast-paced, innovative environment.

Waymo is a pioneering company in autonomous driving technology, dedicated to becoming the world's most trusted driver. Originating from the Google Self-Driving Car Project in 2009, Waymo has committed to developing the Waymo Driver—The World’s Most Experienced Driver™—to enhance mobility access and save countless lives lost in traffic accidents. Our technology powers a fully autonomous ride-hail service and can be adapted to various vehicle platforms and applications. With over ten million rider-only trips and extensive experience driving more than 100 million miles on public roads and tens of billions of simulation miles across 15+ U.S. states, we are at the forefront of this transformative journey.The Simulation ML Infrastructure team is focused on creating scalable AI/ML infrastructure that accelerates the Simulator team in developing state-of-the-art realistic simulations for testing and training the Waymo Driver. To enhance the realism and steerability of these simulations, we leverage large foundation models trained on vast datasets to accurately represent the real world, including realistic agents (vehicles, pedestrians, cyclists, motorcyclists), road systems, traffic control measures, and environmental conditions.We are looking for a seasoned senior individual contributor to spearhead the advancement of sophisticated AI/ML infrastructure for multi-billion parameter foundation models within ML accelerator-friendly simulations. Your expertise in massive model scaling, ML accelerators, and large-scale distributed systems will be essential in designing and scaling our systems.This position reports to an Engineering Manager.Your Responsibilities:Join a top-tier, high-performing research engineering team to push the boundaries of ultra-realistic multi-agent simulations using foundation models.Collaborate closely with the Waymo Realism Modeling team located in London and the Waymo Oxford team to utilize large foundation models for enhancing simulation realism.Operate at the intersection of data engineering, model development, and simulations, making architectural decisions. Take ownership of large, complex systems, and ensure that architectures and designs align with both technical and business objectives.Design and scale extensive distributed systems that encompass the entire ML lifecycle, facilitating planet-scale dataset generation, model training, and evaluation.Work cross-functionally to derive performance and system-level requirements for large ML systems. Convert product and business goals into measurable technical deliverables, ensuring alignment of system components.

At Coupang, we are dedicated to delivering an exceptional experience for our customers. Our goal is to elicit the reaction, "How did we ever live without Coupang?" With a relentless passion for simplifying shopping, dining, and living, we are transforming the multi-billion-dollar e-commerce landscape from the ground up. We have rapidly emerged as one of the leading e-commerce companies in South Korea, known for our reliability and innovation. We embody the best of both worlds — a startup-like atmosphere paired with the resources of a global public enterprise. This unique combination propels our growth and accelerates the launch of new services, maintaining the swift pace we established at our inception. Our team is filled with entrepreneurial spirits eager to initiate new projects and innovations. At Coupang, you will witness personal, team, and company growth each day. Our mission to revolutionize commerce is genuine. We continuously push the limits of what is achievable, tackling challenges and dismantling traditional trade-offs. Join Coupang and contribute to creating an extraordinary experience in today’s fast-paced, technologically advanced, and interconnected world. Role Overview As a Senior Staff Software Engineer in the ML Infrastructure team for Search & Discovery, you will be tasked with designing and implementing robust and efficient software solutions that manage vast amounts of structured and unstructured data necessary for training complex machine learning models and serving them effectively online. The Search & Discovery team is pivotal in optimizing our customers' navigation experience and driving sustained growth. Each week, over 20 million customers utilize search on our app or coupang.com, with more than a third making purchases. A significant portion of Coupang's sales is directly linked to search and recommendation features, with many business strategies and growth initiatives being influenced by ranking and recommendation algorithms. This position offers a chance to develop scalable offline and online machine learning platforms to support ranking, recommendation, and business decision-making. You will work with billions of user interaction records and petabytes of raw log files, converting them into actionable data formats for engineers and scientists. Additionally, you will be responsible for delivering complex machine learning models in real-time, facilitating millions of Coupang customers in discovering and searching for products. If you are passionate about big data engineering, scalable serving systems, and making a tangible business impact, this role is an excellent fit for you.

At Databricks, we are committed to empowering data teams to tackle some of the world's most significant challenges—ranging from revolutionizing transportation to accelerating medical breakthroughs. Our mission is realized through the development and management of the foremost data and AI infrastructure platform, enabling our clients to derive deep insights from their data to enhance business outcomes. Founded by engineers and driven by a passion for customer success, we eagerly embrace each opportunity to confront technical hurdles, from innovating next-generation UI/UX for data interaction to scaling our services across millions of virtual machines. Our journey has just begun.As a Senior Staff Software Engineer, you will be a pivotal member of the executive leadership team within the Data Platform organization. You will utilize cutting-edge AI developer tools and methodologies to construct the Data Intelligence Platform, which will facilitate automated decision-making across Databricks. This role involves collaboration with distinguished Tech Leads, product teams, data scientists, and others. You will shape the future of various tools, including logging, orchestration, data transformation, metric stores, governance platforms, and data consumption layers.

P-1124 Summary At Databricks, we are driven by a passion for empowering data teams to tackle some of the most challenging problems in the world, spanning from security threat detection to advancements in cancer drug development. We achieve this by constructing and managing a top-tier data and AI infrastructure platform, enabling our customers to concentrate on their high-value missions. Our engineering teams are dedicated to creating highly technical products that address significant needs in the world. We continuously push the limits of data and AI technology while maintaining the resilience, security, and scalability essential for our customers’ success on our platform. Customers place their trust in Databricks with their most sensitive data, and our Trust & Safety team is committed to establishing the world’s most reliable data analytics and machine learning platform. Security Engineering plays a pivotal role within Trust & Safety, working diligently to safeguard customer data from malicious threats. We are seeking seasoned leaders like you to craft the vision and define the strategy for this critical area. The impact you will have: Enhance the safety of Databricks for our customers by identifying and addressing critical vulnerabilities in our infrastructure and services. Attract industry-leading talent to our team. Serve as a representative for the security engineering discipline throughout the organization, advocating for a data-driven approach. Represent Databricks at academic and industry conferences and events. What we look for: A minimum of 7 years of experience in Data Security or related fields, with expertise in at least two of the following areas: Cryptography, Kubernetes Security, Web Security, Governance, Privacy, Trust, Safety, Authentication, Identity Management, Access Control, Key Management, Inter-Service Authentication, Secure Application Frameworks, Detection & Response. Proven experience in building systems at large-scale internet companies is highly desirable. ...

Join Nuro as a Senior Software Engineer specializing in Perception Data Infrastructure. In this pivotal role, you will be responsible for developing and optimizing systems that process perception data, enabling our autonomous vehicles to navigate safely and efficiently. You will collaborate with cross-functional teams to enhance our data infrastructure, ensuring reliability and scalability.

Your Role at MoveworksDevelop and enhance core infrastructure services and microservices that support our machine learning, frontend, and platform teams.Implement critical functionalities such as distributed configuration management, rate limiting, feature flagging, A/B testing, and traffic capture and replay.Optimize the performance, scalability, and observability of Moveworks cloud infrastructure.Consistently deliver time-sensitive projects in collaboration with other engineering teams.Take full ownership of features from inception to deployment while actively influencing the infrastructure roadmap.Engage in a highly collaborative, in-person role, working across various teams including Core and ML engineering.

As a Senior Staff Software Engineer specializing in Compute Infrastructure, you'll play a pivotal role in designing, building, and optimizing our cloud infrastructure systems. Your expertise will help drive performance and scalability, ensuring our platforms support the ever-increasing demand for data processing and storage. You will work collaboratively with cross-functional teams to develop innovative solutions that enhance our technology stack.

About UsAt Aurora, our mission is to revolutionize transportation through safe and efficient self-driving technology, making it accessible to everyone.Explore the Aurora Driver and discover how we are paving the way for a new era in mobility and logistics.Join our team of dedicated professionals at Aurora, where you will engage in complex challenges and continuously enhance your expertise in a collaborative atmosphere. For updates, visit aurora.tech or connect with us on LinkedIn.We are on the lookout for a skilled and driven Staff Software Engineer to spearhead a new team focused on enhancing and modernizing our Offline Testing Infrastructure (OTI). OTI serves as a vital middle-layer infrastructure that supports our PR testing, test creation, and Verification & Validation (V&V) processes.This role is critical, with a strong emphasis on increasing the efficiency of our engineering teams and ensuring the reliability of our release cycles. The ideal candidate will build and lead a small, dedicated team to transition OTI to a stable, high-performance, and scalable platform.Responsibilities:Team Leadership: Act as the technical lead for the OTI team, guiding the strategic vision, execution, and long-term stability of our core infrastructure.Testing Ecosystem Development:Design a next-generation offline testing architecture that meets diverse team requirements, minimizes redundancy, and fosters collaboration across the organization.Collaborate with Test Creation and Test Drive teams to...

P-1124 Summary At Databricks, we are passionate about empowering data teams to tackle the world's most challenging issues, from detecting security threats to advancing cancer drug development. We achieve this by developing and maintaining the leading data and AI infrastructure platform, allowing our clients to concentrate on the critical challenges that define their missions. Our engineering teams are dedicated to creating highly sophisticated products that address genuine, vital needs in society. We continually explore the frontiers of data and AI technology while ensuring the resilience, security, and scalability essential for our customers' success on our platform. Clients trust Databricks with their most valuable data, and the Trust & Safety team is committed to establishing the most reliable data analytics and machine learning platform globally. Security Engineering plays a pivotal role within Trust & Safety, crucially safeguarding customer data from malicious threats. We seek senior leaders to craft the vision and define the strategy for this crucial domain. The impact you will have: Enhance the safety of Databricks for our customers by identifying and addressing critical gaps in our infrastructure and services. Attract top-tier talent from across the industry. Serve as a key advocate for the security engineering discipline throughout the organization, promoting a data-driven approach. Represent Databricks at academic and industry conferences and events.

The OpportunityAre you a seasoned Staff Software Engineer, Backend (Infrastructure) eager to drive transformative change at the convergence of scalable web services and state-of-the-art AI technologies? Join us at Otter.ai, where we are on the lookout for a skilled engineer to spearhead the development, deployment, and oversight of web services and infrastructure that fuel our AI-driven products and initiatives. In our vibrant engineering team, you will collaborate closely with AI researchers, product managers, and technology experts to deliver innovative solutions that significantly enhance the experiences of end-user professionals and enterprise clients across various sectors.Your ImpactUtilize your vast expertise in Python to design and refine backend systems that seamlessly integrate with machine learning and AI functionalities.Craft and execute robust business logic using web frameworks such as Django, ensuring full compatibility with AI components and integration with MySQL.Architect scalable solutions employing technologies like Nginx, Kafka, MySQL, Cassandra, Redis, and big data platforms to support advanced AI models and workflows.Produce reusable, efficient, and maintainable code that underpins our high-performance applications, delivering exceptional user experiences.

P-1126 Summary At Databricks, we are committed to empowering data teams to tackle some of the most complex challenges facing the world, from security threat detection to the development of innovative cancer treatments. We achieve this by developing and managing a state-of-the-art data and AI infrastructure platform, allowing our clients to concentrate on the high-impact issues that are critical to their goals. Our engineering teams craft advanced technical products that address significant and real-world needs. We consistently push the limits of data and AI technology while ensuring the resilience, security, and scalability that are essential for our customers' success on our platform. Clients entrust Databricks with their most sensitive data, and our Trust & Safety team is dedicated to creating the most secure data analytics and machine learning platform globally. The Security Engineering division plays a vital role in safeguarding customer data from malicious actors, and we are seeking visionary senior leaders to shape and define our strategy in this domain.

Join our dynamic team at LinkedIn Corporation as a Senior Staff Software Engineer specializing in Systems Infrastructure. In this pivotal role, you will be responsible for designing, implementing, and maintaining robust infrastructure systems that support our growing platform. You will collaborate with cross-functional teams to drive innovation and optimize our systems for scalability and performance.

Waymo is a leader in autonomous driving technology dedicated to becoming the most trusted driver in the world. Originating from the Google Self-Driving Car Project in 2009, our focus has been on creating the Waymo Driver—an exceptional driver that enhances mobility access while significantly reducing traffic-related fatalities. The Waymo Driver not only supports our fully autonomous ride-hailing service but can also be adapted to various vehicle platforms and applications. With over ten million rider-only trips completed, our technology has safely navigated more than 100 million miles on public roads and processed tens of billions of miles in simulation across over 15 U.S. states.The Perception Data team at Waymo plays a critical role in shaping the strategy and technical direction for all data utilized in training and evaluating the Waymo Driver's perception capabilities. We manage the complete data lifecycle, developing automated systems and 'infrastructure-as-product' solutions that convert vast amounts of driving sensor data into high-quality training datasets. Our team tackles complex challenges, including active learning loops and open-vocabulary modeling, bridging raw data with advanced machine learning techniques.By integrating data ingestion, curation, and evaluation into a unified ecosystem, we facilitate the swift development of foundational models and next-generation perception systems. We work closely with Machine Learning, Infrastructure, and Evaluation teams to address intricate data challenges, ensuring our models can effectively interpret the long-tail of rare events. Ultimately, our contributions lay the groundwork for the Waymo Driver to operate safely in diverse environments.

Join our innovative team at LinkedIn as a Senior Staff Software Engineer focused on AI Infrastructure. In this role, you will leverage your expertise to build and enhance scalable AI systems that empower millions of users worldwide. You will collaborate with cross-functional teams to develop efficient algorithms and contribute to cutting-edge projects that drive our commitment to AI excellence.

Unity Technologies is building an offline machine learning platform to support analytics, experimentation, attribution, and AI-driven decisions across the organization. This platform processes both batch and streaming data at scale, serving as the backbone for product intelligence, machine learning pipelines, and business operations. As data sets grow in size and complexity, the platform enables advanced model training, feature generation, and experimentation workflows that are critical for production ML systems. What you will do Design and enhance Unity's offline machine learning infrastructure to support large-scale needs Develop reliable systems for generating training datasets and managing machine learning workflows Support efficient, distributed model training across teams Collaborate with machine learning engineers and platform teams to ensure pipelines scale with data growth and evolving training requirements Shape processes for dataset preparation, model training, validation, and delivery to distributed systems Maintain high standards for reliability, scalability, and performance of the offline ML platform Requirements This role requires a senior technical leader with experience in large-scale machine learning infrastructure. A successful candidate has a strong background in building and maintaining reliable, scalable, and well-architected ML pipelines. Location This position is based in Mountain View, CA, USA.

At Databricks, we are dedicated to empowering data teams to tackle some of the most challenging issues in the world—whether it's realizing the next breakthrough in transportation or accelerating medical innovations. Our mission is to build and operate the leading data and AI infrastructure platform, allowing our clients to harness deep data insights for business enhancement.Our engineering teams create impactful technical products that address significant global needs. We consistently push the limits of data and AI technology while ensuring the security and scalability crucial for our customers' success on our platform.We manage one of the largest software platforms globally, comprising millions of virtual machines that generate terabytes of logs and process exabytes of data daily. At this scale, we monitor cloud hardware, network, and operating system faults, ensuring our software effectively shields our customers from these challenges.As a member of the Observability team, you will be at the forefront of developing solutions that deliver critical insights into the health and performance of our products and infrastructure.

Join LinkedIn as a Distinguished Software Engineer specializing in Data Infrastructure, where you will lead innovative projects that enhance our data capabilities and support millions of users worldwide. This role requires a deep understanding of data architecture and an ability to design scalable solutions.

At Databricks, we are dedicated to empowering data and AI teams to tackle some of the world's most significant challenges — from transforming transportation to expediting medical innovations. Our mission is to create and maintain the premier data and AI infrastructure platform, enabling our clients to leverage deep data insights to enhance their businesses. Founded by engineers with a customer-first mentality, we eagerly embrace every opportunity to address technical challenges, whether it’s designing next-gen UI/UX for data interaction or scaling our services across millions of virtual machines. And we are just getting started. As a member of the ML/AI Environments team, you will develop the systems that allow AI researchers and engineers to effortlessly establish their desired training and serving environments. You’ll join a high-agency, high-visibility team at the cutting edge of AI infrastructure, closely connected to research, product development, and real-world enterprise applications. Databricks Mosaic AI is one of our fastest-growing sectors, assisting thousands of customers in democratizing AI within their organizations. We are building the infrastructure that fuels the next generation of AI.