Senior Ml Data Infrastructure Engineer jobs in Palo Alto – Browse 734 openings on RoboApply Jobs

Senior Ml Data Infrastructure Engineer jobs in Palo Alto

Open roles matching “Senior Ml Data Infrastructure Engineer” with location signals for Palo Alto. 734 active listings on RoboApply Jobs.

734 jobs found

1 - 20 of 734 Jobs
Apply
company
Full-time|On-site|Palo Alto

At Rhoda AI, we are pioneering the development of a comprehensive technology stack for the future of humanoid robotics. Our focus ranges from high-performance, software-defined hardware to cutting-edge foundational models and video world models that govern these systems. Our robots are engineered as versatile generalists, adept at navigating complex, real-world scenarios that extend beyond conventional training environments. Collaborating at the forefront of large-scale learning, robotics, and systems, our research team comprises distinguished experts from renowned institutions such as Stanford, Berkeley, and Harvard. With an impressive funding of over $400 million, we are committed to substantial investments in research and development, hardware innovation, and the scaling of manufacturing processes to bring our vision to life.Position OverviewWe are currently seeking a Senior ML & Data Infrastructure Engineer to take ownership of and enhance our data model training pipeline. This role encompasses the entire lifecycle, from raw data ingestion and storage to sophisticated indexing, retrieval, and throughput optimization at an unprecedented scale.Key ResponsibilitiesDesign, develop, and scale a robust data infrastructure capable of processing and managing billions of video clips while ensuring reliability, low latency, and cost-effectiveness.Create and optimize large-scale storage solutions, including cloud object storage and databases, tailored for multimodal datasets.Develop high-performance indexing and retrieval systems to facilitate rapid dataset querying, filtering, and iteration for both research and production applications.Establish observability frameworks for data pipelines that encompass monitoring, alerting, failure recovery, and performance enhancements.Implement intelligent workload distribution and throughput enhancements across distributed compute and storage infrastructures.Oversee data artifacts, versioning, and lineage to guarantee reproducibility and traceability throughout training cycles.Create user-friendly internal interfaces and lightweight tools that empower researchers and engineers to explore, query, and analyze extensive datasets efficiently.Facilitate the integration and scalable deployment of vision-language models (VLMs) within data pipelines for purposes such as screening, enrichment, or metadata generation.QualificationsA minimum of 5 years of experience in data infrastructure, distributed systems, machine learning infrastructure, or a closely related field.Proven expertise in developing and managing large-scale data pipelines and storage solutions.Strong programming skills in languages such as Python, Java, or Scala, and proficiency with data processing frameworks.Experience with cloud-based storage solutions and databases, as well as knowledge of multimodal data management.Ability to work collaboratively in a fast-paced, innovative environment.

Mar 10, 2026
Apply
companyxAI logo
Full-time|$180K/yr - $440K/yr|On-site|Palo Alto, CA

Join xAI, a pioneering company dedicated to building AI systems that enhance humanity's understanding of the universe. We are seeking a talented ML Infrastructure Network Development Engineer with a specialization in high-speed interconnect technologies. In this pivotal role, you will design, construct, and optimize the network architecture that underpins large-scale AI training and inference clusters. Your expertise will drive innovations in high-bandwidth, low-latency, and energy-efficient interconnects essential for our cutting-edge AI/ML infrastructures. You will engage with various interconnect modalities, ensuring seamless connectivity between GPUs and switches in data centers, and contribute to the overall success of our AI initiatives.

Feb 6, 2026
Apply
companyRubrik, Inc. logo
Full-time|On-site|Palo Alto, CA

Join Rubrik, Inc. as a Senior Software Engineer specializing in API Infrastructure. In this role, you will play a pivotal part in designing and developing robust and scalable APIs that empower our cloud data management solutions. Your expertise will help shape the future of our platform, driving innovation and enhancing our product offerings.

Mar 10, 2026
Apply
companySpeechify logo
Full-time|Remote|Palo Alto, CA, USA

Role overview Speechify seeks a Software Engineer specializing in Data Infrastructure and Acquisition at its Palo Alto, CA office. This position focuses on building and refining the data pipelines and backend systems that support Speechify’s text-to-speech products. What you will do Design, develop, and improve data pipelines to meet product and business requirements Collaborate with engineering, product, and data teams to maintain reliable data flows Contribute to systems that support data-driven decisions and ongoing product improvements

Apr 25, 2026
Apply
companyMind Robotics logo
Full-time|On-site|Palo Alto

Join our team at Mind Robotics as a Machine Learning Infrastructure Engineer, where you'll play a pivotal role in developing the systems that facilitate effective large-scale model training. This position is ideal for individuals who thrive in high-scale environments—overseeing distributed training, managing core ML infrastructure, and leveraging rapid iteration loops across hundreds of GPUs. If you have experience building or managing large training systems in frameworks like PyTorch or JAX and have a passion for optimizing processes such as sharding, parallelism, and performance, you'll find a welcoming environment here. Collaborate closely with researchers to minimize friction, enhance reliability, and streamline the processes for training, evaluating, and deploying models that integrate into real-world applications.

Jan 26, 2026
Apply
companyBitGo logo
Full-time|On-site|Palo Alto, California, United States

Role overview BitGo is looking for a Senior Infrastructure Engineer in Palo Alto, California. This role focuses on building and maintaining the company's infrastructure to support reliable, high-performing services. What you will do Work with teams across the company to design, implement, and improve infrastructure systems Ensure systems remain highly available and deliver strong performance Apply cloud technologies and infrastructure as code practices to support and enhance services What we look for Experience with cloud platforms Strong background in infrastructure as code Ability to collaborate with engineers from different disciplines

Apr 14, 2026
Apply
companyLadder33 logo
Full-time|$145K/yr - $192K/yr|Hybrid|Palo Alto, California - Hybrid/Remote - United States

Senior Software Engineer, Infrastructure About Ladder At Ladder, we identified a significant issue in the life insurance sector: the lengthy application process, the excessive paperwork, and the numerous in-person meetings with agents. Motivated by personal loss, our CEO, Jamie, set out to simplify the process of obtaining essential coverage for families. We innovated real-time underwriting using AI, transforming the months-long life insurance application into a matter of minutes. Our user-friendly digital experience ensures instant decisions and has garnered exceptional user reviews, with over $74 billion in coverage issued. About the Role We are in search of a Senior Software Engineer who will enhance developer productivity within Ladder's engineering team. You will take charge of modernizing our CI/CD pipelines, build systems, and developer tools, while also contributing to the robustness of our cloud infrastructure and data platform. The ideal candidate will possess a proven track record in software engineering, demonstrate leadership qualities, and have a thorough understanding of engineering infrastructure. This position is remote, available in any of the 22 states where Ladder is hiring: AZ, CA, CO, CT, FL, GA, KS, MA, MD, MN, NC, NH, NJ, NV, NY, OH, OR, PA, TX, VA, WA, WI. Please note that Ladder is not sponsoring or transferring OPT or H1-B visas at this time. How You’ll Make a Difference As a senior engineer in our team, your responsibilities will extend beyond coding; you will influence our platform strategy. Your contributions will include: Enhancing developer velocity across the engineering organization by measuring and optimizing the developer workflow, which encompasses build times, test parallelization, deployment speeds, and daily tooling. Shaping the architecture of Ladder’s production infrastructure by evaluating design trade-offs and making impactful technical decisions, such as transitioning from custom monitoring tools to native cloud provider integrations or redefining data pipeline rebuild processes in response to upstream logic changes. You will have the insight to see the holistic view across systems and determine where to allocate engineering resources effectively. Engaging in incident response for infrastructure issues, leading retrospectives, and ensuring actionable follow-through on resolutions.

Mar 20, 2026
Apply
companyLatitude logo
Full-time|On-site|Pittsburgh, PA, Palo Alto, CA, Detroit, MI

Role Overview Latitude is looking for a Senior Software Engineer focused on Test Infrastructure. This role centers on strengthening testing frameworks to help deliver reliable software. The position is available in Pittsburgh, PA, Palo Alto, CA, or Detroit, MI. What You Will Do Work closely with teams across engineering, product, and QA to support development efforts. Design, build, and maintain test infrastructure that supports software quality. Help improve and extend frameworks used for automated and manual testing.

Apr 16, 2026
Apply
company1X logo
Full-time|$180K/yr - $250K/yr|On-site|Palo Alto, California, United States

AI Research Engineer, Data InfrastructureLocation: Palo Alto, CA (on-site)About 1XAt 1X, we are at the forefront of innovation, developing humanoid robots designed to collaborate with humans, effectively addressing labor shortages while fostering abundance across industries.The RoleAs an AI Research Engineer specializing in Data Infrastructure, you will play a pivotal role in designing and implementing a comprehensive data engine to efficiently manage the vast data generated by our humanoid robot fleet. Your contributions will ensure that this data is readily accessible for querying and training, supporting the development of high-quality data pipelines that facilitate effective model training, large-scale data annotation, and seamless integration across robotic, on-premise, and cloud-based systems.

May 12, 2024
Apply
company
Senior Data Engineer

Rivian and Volkswagen Group Technologies

Full-time|On-site|Palo Alto, California

Rivian and Volkswagen Group Technologies brings together two leaders in the automotive sector to develop new technology for electric vehicles. The partnership focuses on solutions ranging from advanced operating systems and zonal controllers to secure cloud connectivity. By combining expertise in connectivity, artificial intelligence, and security, the team works to shape a more connected and sustainable future in mobility. Role overview The Senior Data Engineer joins the Core Data team, which builds and scales the data platform supporting analytics and decision-making. Within this team, the Operational Insights group handles data from production environments, turning complex operational and quality data into dependable data products and performance metrics that drive business results. What you will do Design and maintain scalable data ingestion pipelines for analytics initiatives across multiple programs and locations Create well-structured datasets to support analytics and AI-driven insights Ensure data integrity and reliability across key operational systems Bridge operational systems, data platform engineering, and analytics to convert raw data into governed, high-value datasets Who thrives in this role This role suits those who enjoy building data infrastructure that connects operational systems and analytics, and who take pride in transforming raw data into reliable, actionable insights for a broad range of business needs.

Apr 28, 2026
Apply
companyRubrik logo
Full-time|$175.5K/yr - $263.3K/yr|On-site|Palo Alto, CA

About the Team: The Information Technology team at Rubrik is pivotal in shaping business processes, enhancing employee experience, and leveraging technologies to scale our organization beyond $1 billion. This dedicated team drives operational efficiencies across the enterprise by centralizing the management of Infrastructure, Technology, and Data. The IT team guarantees all stages of the software development lifecycle occur within a secure environment while meticulously overseeing the implementation of essential processes and governance. They are not just champions of Rubrik but also serve as primary users of the Engineering teams' offerings. Rubrik Corp IT operates entirely on a Software as a Service (SaaS) model, with no on-premises solutions. The IT team accelerates the enhancement of business value and optimizes daily operations through a diverse portfolio of SaaS applications, including Salesforce.com, Oracle Netsuite, Workday, Snowflake, Etrade, Jitterbit, and Allocadia. Their commitment to delivering high-velocity business outcomes is backed by a 100% system uptime, supported by agile, streamlined, and cohesive cloud architectures. About the Role: Become a part of our Data Engineering and Analytics team at our Palo Alto headquarters, where you will design and implement the data infrastructure that supports our General and Administrative (G&A) business functions. In this impactful role, you will manage the entire lifecycle of data initiatives, transforming complex business requirements into scalable data models and delivering insightful analytics that guide critical decision-making. You will work closely with stakeholders across Go-To-Market (GTM) programs, Product Operations, Pricing, and Treasury, facilitating precise reporting, operational transparency, and strategic planning. Your contributions will directly aid directors and senior leaders within Sales and G&A, shaping revenue growth, strategy, and operational effectiveness through reliable, data-informed decisions. What You'll Do: Business Partnership & Delivery: Act as a data partner across GTM and G&A business functions, leading high-impact projects from analysis to successful completion. Requirements Discovery: Conduct in-depth engagement sessions with stakeholders to convert business queries into actionable technical roadmaps, ensuring data solutions effectively address core strategic challenges. Architectural Excellence: Design and refine scalable data pipelines and advanced dbt models in Snowflake. Develop a robust Semantic layer to standardize metric definitions and ensure alignment across diverse G&A data sources. Advanced Analytics & Visualization: Produce executive-level narratives using Tableau. Transform raw data into proactive analytical tools that enhance insight and decision-making.

Feb 4, 2026
Apply
company1X logo
Full-time|$137.9K/yr - $240K/yr|On-site|Palo Alto, California, United States

Senior Software Engineer, Cloud & Infrastructure | Software EngineeringPalo Alto, CA (on-site)At 1X, we are at the forefront of innovation, developing humanoid robots that collaborate with humans to address labor shortages and foster abundance.In this pivotal role, you will spearhead the design and implementation of sophisticated software that bridges the physical and digital realms of our global robotic operations. From deployment tools and fleet management solutions to customer interfaces and internal operational platforms, your goal is to develop systems that can scale from hundreds to tens of thousands of robots. You will take charge of architectural decisions, construct core components, and mentor engineers across the technology stack, ensuring reliability, simplicity, and performance throughout.

Oct 29, 2025
Apply
companyxAI logo
Full-time|$180K/yr - $440K/yr|On-site|Palo Alto, CA; San Francisco, CA

About xAIAt xAI, we are on a mission to develop cutting-edge AI systems that not only comprehend the complexities of the universe but also empower humanity in its quest for knowledge. Our team is small yet highly driven, dedicated to achieving engineering excellence. We welcome individuals who relish challenges and have an insatiable curiosity. Operating with a flat organizational structure, we encourage hands-on contributions from all team members towards our collective mission. Leadership is earned through initiative and consistent high performance, making work ethic and prioritization crucial. Strong communication skills are essential, as sharing knowledge effectively with teammates is a key expectation.About the RolexAI is on the lookout for skilled software engineers to construct robust data pipelines, develop comprehensive evaluation frameworks for benchmarking large language models (LLMs), and create automation solutions that enhance the productivity of our researchers and engineers.Focus AreasDeveloping and maintaining frameworks for agent, data, and model evaluation tasks.Creating environments for AI agents.Designing tools to automate common workflows.Enhancing alerts, metrics, and error handling for large-scale reinforcement learning tasks.Refactoring existing agent, data, evaluation, and training frameworks for improved modularity.Establishing operational procedures and coding standards to facilitate the transition from small-scale experiments to large-scale reinforcement learning training.Implementing unit tests and CI/CD frameworks to support rapid development cycles.Ideal ExperienceProven experience in building and maintaining frameworks utilized by multiple engineers.Expertise in creating high-performance sandboxes, virtual machines, and simulations.Experience in developing full-stack applications for workflow automation and data visualization.Capability in rapidly iterating research into production cycles.Knowledge in test automation and CI/CD practices.Typical Challenges You Will EncounterExploring new agentic model capabilities...

Dec 29, 2025
Apply
companyPylon logo
Full-time|On-site|Palo Alto

Role Overview Pylon is hiring an Infrastructure Engineer, Foundation, based in Palo Alto. This role focuses on designing, implementing, and maintaining infrastructure that supports the company’s core products and services. The work directly supports operational reliability and technical growth across the organization. What You Will Do Design and build infrastructure solutions to support Pylon’s main offerings Maintain and improve existing systems to ensure reliability and performance Work with teams across engineering and other functions to integrate and support infrastructure needs Identify opportunities to optimize system performance and scalability Who We’re Looking For Proactive approach to problem solving and infrastructure development Interest in building scalable systems and improving performance Comfort working closely with cross-functional teams

Apr 13, 2026
Apply
companyMudflap logo
Full-time|$175K/yr - $215K/yr|Hybrid|Palo Alto, CA

Mudflap is revolutionizing the $800 billion trucking industry, which serves as a vital pillar of the U.S. economy. Our innovative payment solutions empower truckers to save significantly on their primary operational cost: fuel. Additionally, we connect our network of fuel stop partners with new, hard-to-reach clients. As a rapidly expanding marketplace, we are on the lookout for a passionate, customer-focused individual to join our dynamic team.In this pivotal role as a Senior Data Engineer, you will be instrumental in crafting the data infrastructure that enables faster and smarter decision-making across our organization. You will design, scale, and manage our modern, cloud-based data platform, ensuring that our data flows seamlessly and is effectively utilized by teams throughout the company.This is a rare opportunity to establish data standards, influence technical direction, and guarantee the quality, consistency, and scalability of the data platform relied upon by hundreds of thousands of small and medium-sized trucking companies each day.Our Palo Alto office offers a hybrid work environment that encourages collaboration in the office while also providing the flexibility to work remotely.

Apr 28, 2025
Apply
companyMashgin logo
Full-time|On-site|Palo Alto, CA

Join Mashgin as an Infrastructure Software Engineer and be a part of our innovative team dedicated to enhancing the efficiency of our cutting-edge technology. You will play a critical role in designing, developing, and maintaining robust infrastructure systems that power our products and services. Your expertise will help us streamline operations, improve performance, and ensure reliability across our platforms.

Mar 2, 2026
Apply
company
LLM Infrastructure Engineer

Ricursive Intelligence

Full-time|On-site|Palo Alto

At Ricursive Intelligence, we are pioneering advancements in artificial intelligence by creating self-improving systems with a focus on innovative chip design. Our mission is to revolutionize chip development, effectively bridging the gap between AI and the hardware that supports it, thereby accelerating the journey towards artificial superintelligence.We are seeking exceptional engineers who are passionate about tackling a wide range of challenges in scaling, low-level optimization, and the fundamental infrastructure necessary for large language model training and inference.

Jan 19, 2026
Apply
companyMudflap logo
Full-time|$185K/yr - $250K/yr|Hybrid|Palo Alto, CA

Join Mudflap, a pioneering force in the $800 billion trucking industry, where our innovative payment solutions empower truckers to save significantly on fuel costs—their largest operational expense. We connect fuel stop partners with new customers, creating a vibrant marketplace that is rapidly expanding. We are actively seeking a customer-focused Senior Software Engineer to help us shape our exciting future.As a Senior Software Engineer specializing in Data Platforms, you will be instrumental in constructing a robust data infrastructure that ensures reliable and scalable data flow throughout Mudflap's systems. Your contributions will be vital in designing and managing the frameworks and services that facilitate efficient data ingestion, processing, and accessibility on a large scale.In this role, you will architect and develop high-performance platform systems that drive data ingestion, orchestrate pipelines, and manage large-scale processing. Your efforts will lay the groundwork for high-availability data systems that empower Mudflap's teams to operate with speed and confidence.This position is based in the Bay Area and offers a hybrid work model, allowing for a blend of in-office collaboration and remote work.

Mar 17, 2026
Apply
companyRubrik, Inc. logo
Full-time|$154.3K/yr - $231.5K/yr|On-site|Palo Alto, CA

The IT team at Rubrik brings together infrastructure, technology, and data management to support the company’s growth and daily operations. This group focuses on streamlining business processes, enhancing the employee experience, and ensuring secure software development. IT also serves as a primary user group for new solutions developed by Rubrik’s Engineering teams. Rubrik’s IT infrastructure is fully cloud-based, relying on SaaS applications such as Salesforce.com, Oracle Netsuite, Workday, Snowflake, Etrade, Jitterbit, and Allocadia. This cloud-first approach helps maintain system uptime and enables fast, reliable business outcomes. Role overview The Senior Systems Engineer will join the Infrastructure team in Palo Alto, CA, with a focus on supporting Compute, Network, Storage, and Brik services for the R&D Engineering department. This role centers on deploying, configuring, and managing R&D equipment in colocation facilities and labs. What you will do Deploy, configure, and manage R&D equipment in colocation facilities and labs Support Compute, Network, Storage, and Brik services for the Engineering department Work closely with teams to complete projects on schedule and meet expectations Requirements Extensive technical experience in systems engineering Strong interpersonal and communication skills Proven ability to deliver projects promptly and exceed customer expectations

Apr 22, 2026
Apply
company
Full-time|On-site|Palo Alto, CA

Woven by Toyota is driving Toyota’s transformative journey into a modern mobility enterprise. Our vision is to redefine mobility through innovative, human-focused solutions that serve society at large.Our initiatives revolve around four core areas: Advanced Driver Assistance Systems (ADAS), our autonomous driving technologies; Arene, our software platform for software-defined vehicles; Woven City, a testbed for mobility innovations; and Cloud & AI, the digital backbone supporting our collaborative efforts. Our business-critical functions empower these teams to achieve a singular ambitious objective: creating a world with zero accidents and enhanced well-being for everyone.TEAMAt Woven by Toyota, we confront challenges in Autonomy at the intersection of AI, Robotics, and Advanced Driving. Our work encompasses analyzing vast amounts of multimodal driving data, tackling optimization challenges, reducing latency on hardware accelerators, deploying scalable machine learning (ML) training and evaluation pipelines, and innovating neural network architectures to advance state-of-the-art ML for Perception, Prediction, and Motion Planning. We are seeking proactive and innovative problem solvers to join our mission of enhancing mobility for all through human-centered automated driving solutions.WHO ARE WE LOOKING FOR?We are in search of a seasoned, hands-on ML Engineering Manager to lead a team of skilled and passionate ML Platform engineers. This role will involve close collaboration with our ML teams to enhance and scale our overall ML engineering initiatives, facilitating the deployment of Perception, Prediction, and Planning ML models alongside our AD/ADAS stack into millions of Toyota vehicles.This position will focus on developing and implementing tools, automation, and infrastructure that support the entire ML software lifecycle—ranging from data loading of curated ML datasets, large-scale ML model training, evaluation, and deployment, including quantization and the conversion of models into formats compatible with our edge devices.The ideal candidate possesses a collaborative spirit and a deep-seated passion for self-driving technology and its potential global impact. You will leverage your expertise in machine learning, a comprehensive understanding of the model lifecycle, and experience in developing tools and pipelines for vehicle perception, localization, prediction, and planning.

Dec 23, 2025

Sign in to browse more jobs

Create account — see all 734 results

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.