Senior Data Engineer - AI Model Evaluation

Mission: We are in search of a talented and driven Senior Data Engineering Analyst to join our innovative team focused on large-scale AI model evaluation through our platform, Ground Truth Regression. The ideal candidate will possess a solid foundation in data engineering, machine learning principles, and statistical analysis. At Motional, the orchestration of extensive data analysis is crucial for advancing our machine learning-driven autonomous driving technology. Our robo-taxi ML models and software are developed by a dedicated team of engineers and deployed multiple times daily. The Ground Truth Regression team is responsible for providing a comprehensive perception analysis framework to validate any changes that could influence the behavior of autonomous vehicles. The Ground Truth Regression team assesses the cumulative effects of ML and software modifications during the development phase, equipping the team with tools for root cause analysis and safety evaluations. We meticulously monitor model errors, anomalies, and rare occurrences across extensive driving scenarios, gathering insights over thousands of driving hours. The team is responsible for developing the full-stack infrastructure, including AWS Kubernetes orchestration, re-simulation, model metrics, regression reports, and deep-dive analytical tools. Collaboration with other perception and ML teams is integral for establishing metrics and analyzing outcomes. What You’ll Do: Collaborate with ML Engineers and Autonomy Software Developers to create new data analysis metrics and KPIs for validating autonomous vehicle performance. Pursue innovation by researching and developing new large-scale data analysis frameworks. Lead large-scale data analysis workflows to identify unexpected impacts of both planned and unplanned modifications to ML models and software. Construct high-quality datasets to enhance ML product performance through training and edge case validation. Deliver in-depth statistical insights on model performance and generalization through thorough error and change analysis. What We’re Looking For: Bachelor's or Master’s degree in Computer Science, Data Science, or a related field. Proficient programming skills in Python, SciPy, and related data analysis frameworks. Experience in machine learning, data mining, and statistical analysis. Familiarity with large-scale data processing and distributed computing technologies. Strong communication and software development skills, including goal setting, design documentation, testing frameworks, and collaborative team development.

About the RoleWe are seeking a talented Data Scientist to take charge of ensuring the quality, reliability, and trustworthiness of our clinical AI outputs. In this pivotal role, you will develop systems that help our AI recognize its limitations, including the creation of evaluation frameworks, calibrated confidence scoring, and automated quality assurance protocols that healthcare professionals can rely on.Key ResponsibilitiesDesign and deploy automated evaluation pipelines to assess the quality, accuracy, and safety of AI outputs at scale.Develop systems for uncertainty quantification where confidence scores are meaningfully aligned with accuracy.Create comprehensive evaluation frameworks that integrate automated assessments with clinician-validated test cases.Implement continuous feedback mechanisms to enhance model outputs based on validation signals.Establish scalable quality gates to identify errors before they impact end users.Contribute to efforts focused on model alignment and fine-tuning.

Veeva Systems, a trailblazer in the industry cloud space, is dedicated to expediting the delivery of therapies to patients in the life sciences sector. With a remarkable ascent as one of the fastest-growing SaaS companies globally, we achieved over $2 billion in revenue last fiscal year, with promising growth opportunities on the horizon.At Veeva, we embody core values that guide our mission: Doing the Right Thing, Customer Success, Employee Success, and Speed. In 2021, we made history by becoming a public benefit corporation (PBC), reinforcing our commitment to balancing the needs of customers, employees, society, and investors.As a Work Anywhere company, we empower you with the flexibility to choose your work environment, whether at home or in the office, enabling you to excel in your ideal setting.Join us in transforming the life sciences industry and making a meaningful impact on our customers, employees, and communities.

At Veeva Systems, we are on a mission to revolutionize the life sciences industry by accelerating the process of bringing therapies to patients. As a trailblazer in the industry cloud space, we have achieved remarkable success, surpassing $2 billion in revenue last year with a promising trajectory ahead.Our core values—Do the Right Thing, Customer Success, Employee Success, and Speed—guide every decision we make. In 2021, we proudly became a public benefit corporation, reinforcing our commitment to balance the interests of all stakeholders, including customers, employees, and society.As a Work Anywhere company, we embrace flexibility, allowing you to choose your work environment—whether remote or in-office—so you can thrive in the way that suits you best.Become part of our journey to transform the life sciences sector and make a positive impact on the communities we serve.

Join us in transforming how the Department of Defense (DoD) approaches multi-billion-dollar force design decisions. As a Senior Principal Software Engineer, you will integrate physics-based simulations, dynamic computing, and validated AI code generation to develop state-of-the-art wargaming platforms. We are looking for a proactive leader who can architect and develop a scalable, cloud-distributed simulation environment while motivating a small, dedicated team through hands-on leadership.Your ResponsibilitiesDesign & Implement: Create a robust, interactive physics simulation that operates efficiently across cloud and on-premises clusters.Own the Core Codebase: Manage the modern C++ codebase, focusing on multi-threaded performance optimization and continuous integration practices.Collaborate: Work closely with product and AI teams to incorporate verified, AI-generated algorithms directly into a developer SDK for platform enhancement.Prototype & Iterate: Deliver functional capabilities to government end-users in weeks, not months, through rapid prototyping.Set Engineering Standards: Uphold high coding standards, document processes thoroughly, and mentor team members through code reviews and pair programming.

Mission Summary The AI Data Foundry serves as the critical bridge linking our extensive data resources with the engineering teams that depend on them. We design and manage the essential services and infrastructure required to convert petabytes of raw data monthly into actionable insights for our Machine Learning and Autonomy engineers. This position is pivotal in driving our core initiatives: Data Processing: We are developing cutting-edge infrastructure to accommodate the demands of our rapidly expanding fleet and advanced ML engineering needs. Your responsibility will be to ensure that our core data pipelines are robustly engineered—performant, user-friendly, and highly fault-tolerant. Data Discovery: We are creating a platform that integrates data cataloging for search capabilities across our metadata stores, vector datastores, and various data warehouses to enhance our ML pipelines. You will collaborate with ML and autonomy stakeholders to develop this new discovery platform. Data Lineage: We are initiating the construction of our data lineage system to track data usage at Motional. You will partner with our stakeholders to ensure the widespread adoption of our system and address user pain points. What You'll Be Doing Playing a key role in designing and building the next generation of data infrastructure. Building scalable backend services for data discovery and data lineage systems. Writing high-quality, maintainable code to process petabytes of data. Leading and advocating for high-level system design and conducting quality code reviews and technical contributions. Designing, building, and maintaining scalable data processing and access using cloud ETL technologies.

Join us in transforming how the Department of Defense approaches multi-billion-dollar force design decisions. In this pivotal role, you will integrate physics-driven simulations, interactive computing, and verified AI code-generation to develop cutting-edge wargaming platforms. We are looking for a seasoned software engineer who can take ownership of critical components within a scalable, cloud-distributed simulation environment, while inspiring and leading a dedicated team.Your Responsibilities Create and implement a robust, interactive physics simulation that operates flawlessly across cloud and on-premises clusters. Manage core functionalities in modern C++, focusing on multi-threaded performance tuning and continuous integration. Collaborate with product and AI teams to integrate verified AI-generated algorithms into a developer SDK that enhances the platform. Rapid prototyping and iteration: deliver functional capabilities to government end-users in weeks, not months. Set high engineering standards: produce clean code, maintain rigorous documentation, and mentor team members through code reviews and pair programming. Why Choose Code Metal? Impactful Mission: Your contributions will shape digital battlefield models that directly affect real-world acquisition strategies. Agility: Work within small teams, experience rapid iteration cycles, and have the authority to deliver solutions. Ownership: Everyone is a contributor—no passengers, everyone pushes code to production.

About You: We are on the lookout for a seasoned Senior Software Engineer to lead the design, implementation, testing, and certification of flight-critical autonomy algorithms for cutting-edge aerospace systems. In this pivotal role, you will harness MathWorks tools to develop model-based flight software and oversee the complete lifecycle of DO-178C compliant development.

At Klaviyo, we celebrate the diverse backgrounds, experiences, and perspectives that each team member brings to our vibrant workplace. We believe that everyone deserves an equal opportunity to succeed, and we value the unique insights that individuals contribute beyond traditional qualifications. If you find that you closely match the criteria but not perfectly, we encourage you to apply. Interested in discovering more about life at Klaviyo? Visit klaviyo.com/careers to see how we empower creators to take charge of their future.At Klaviyo, we envision a future where software transcends traditional productivity tools, evolving into intelligent systems that autonomously optimize based on performance metrics. Our platform serves as a crucial bridge between businesses and their consumers, boasting over 167,000 customers, billions of consumer profiles, and a vast array of customer interactions and conversion data. This presents an exciting opportunity to develop cutting-edge AI and machine learning technologies that will enhance our product offerings and create AI agents capable of autonomously orchestrating marketing strategies and customer experiences across various industries.As a Senior AI Engineer at Klaviyo, you will be instrumental in architecting and developing scalable backend systems and user experiences that drive our AI innovations forward. You will collaborate closely with product managers, machine learning engineers, and data scientists to create substantial real-world impacts at scale. This role is primarily backend-focused, providing opportunities to influence system architecture, asynchronous processing pipelines, distributed systems, and more.

Join Klaviyo as a Senior AI Engineer and be a pivotal part of our innovative team, driving the future of AI technology in marketing automation. You will leverage your expertise to design, develop, and implement cutting-edge AI solutions that enhance our products and empower our clients.

FieldAI is at the forefront of revolutionizing robot interactions with the real world. Our dynamic R&D team, based in Boston, is committed to developing risk-aware, reliable, and field-ready AI systems that address the most challenging problems in robotics and unleash the potential of embodied intelligence. We adopt a pragmatic methodology that transcends traditional off-the-shelf and purely data-driven approaches, integrating cutting-edge research with practical deployment. Our solutions have been successfully implemented globally, and we continuously enhance model performance through rapid iterations informed by real-world applications.We are looking for a seasoned Senior Engineering Manager to lead an agile, high-performing team of research scientists and engineers at the cutting edge of robotics AI. In this pivotal role, you will craft and implement research strategies, oversee the creation of advanced AI algorithms, and steer initiatives from initial research to real-world deployment on physical robotic systems. You will harmonize deep technical leadership with effective people management, ensuring scientific excellence and tangible impact on the field.This is your chance to influence the future of robotic autonomy by transforming groundbreaking research into systems that function reliably in complex, dynamic environments on actual robots.

Rebuild Manufacturing is building an AI-powered platform to improve hardware product development. The platform connects with tools that hardware teams already use, helping them track change requests and share important context. By coordinating across different disciplines, it keeps projects moving smoothly as requirements shift. Supported by a parent company with deep roots in engineering and manufacturing, the team is focused on closing communication gaps in hardware development. The goal: make sure every update and decision reaches the right people at the right time. Role overview The Senior AI Engineer will design and build the core AI agents that drive the platform. This work involves developing systems that can spot potential issues in hardware workflows, offer timely assistance, and help teams stay aligned as projects evolve. What you will do Create AI systems that integrate with existing engineering tools Develop features to coordinate change requests and share critical information Build solutions that help engineering teams anticipate and resolve workflow challenges Locations Greater Boston, MA Los Angeles, CA United States (other locations considered)

ezCater stands at the forefront of the food for work technology sector in the United States, seamlessly connecting businesses in need of workplace catering with a vast network of over 100,000 restaurants nationwide. Our innovative platform delivers flexible and scalable solutions, catering to everything from regular employee meals to special one-off events, all supported by our dedicated 24/7 customer service team. Additionally, we empower companies to efficiently manage their food budgets through a single, customizable platform. For our restaurant partners, ezCater drives growth by increasing their order volume and attracting high-value customers. We are proud to be backed by prominent investors including Insight, Iconiq, Lightspeed, GIC, SoftBank, and Quadrille.Are you enthusiastic about harnessing the power of data? Are you ready to influence a rapidly expanding two-sided marketplace through data-driven insights? Do you have innovative ideas on how to empower data scientists within a billion-dollar organization to optimize workforce planning or predict real-time customer lifetime value? If so, we want to connect with you!The Data Technology team at ezCater is on an exciting growth trajectory! As we prepare for the future, data will remain a core strategic asset across the company—encompassing everything from advanced machine learning to business intelligence and data governance. Data is poised to be our key differentiator, driving significant impact within the $100 billion catering industry.We are looking for a Senior Data Engineer to join our dynamic team and tackle complex data and platform challenges that will help accelerate our business growth. The ideal candidate is a data aficionado who champions best practices in systems and architecture, and is dedicated to creating robust infrastructure that underpins accurate and efficient data. You will collaborate directly with executive stakeholders as we embark on an organization-wide data modeling initiative, making adaptability and the ability to translate business needs into technical solutions essential.

Senior AI EngineerLocation: Boston (preferred) or Nashville | Travel: ~15% | Reports to: CTOAbout SynqueryAt Synquery, we are revolutionizing the way organizations access and scale human expertise through cutting-edge AI research. Supported by leading venture capital firms such as Afore Capital, Audacious Ventures, and Caesar Ventures, we collaborate with top consulting firms and investors to redefine working methodologies. Our AI-driven platform delivers expert insights in days, not weeks, transforming how clients approach due diligence, competitive intelligence, and market research.We foster a culture that prioritizes speed, entrepreneurial spirit, and a relentless pursuit of success. As we expand rapidly, we seek extraordinary engineers eager to develop world-class AI systems and contribute to the future of AI in business.The RoleWe invite a seasoned Senior AI Software Engineer to join Synquery at an exhilarating phase of our growth. This pivotal role entails significant responsibility across the entire product lifecycle, collaborating directly with the CTO to design and develop the systems that power our platform from start to finish.Our platform processes vast amounts of data through a sophisticated expert network automation pipeline, identifying the right experts, vetting credentials, ensuring availability and compatibility, and executing AI-driven interviews that yield actionable insights—all for some of the most demanding clients in consulting and investment. The technical challenges are substantial, the stakes are high, and the pace is rapid.Our mission is to democratize access to expert-level answers for questions lacking digital solutions—knowledge that resides solely in the minds of seasoned professionals. You will be instrumental in building the AI infrastructure that enables this: robust, scalable, and genuinely advancing the possibilities of agentic AI in real-world applications.

Join our team at Klaviyo as a Senior AI Platform Engineer and be part of a transformative journey in the AI and machine learning landscape. We are looking for an innovative engineer who is passionate about designing and scaling backend systems that power cutting-edge AI products and solutions. In this role, you will have the opportunity to influence architecture decisions, enhance asynchronous processing, and work with distributed systems. Collaborate with product managers, machine learning engineers, and data scientists to create impactful solutions for over 167,000 customers globally. This hybrid role is based in the vibrant city of Boston, where creativity and technology converge.

ServiceNow is seeking a Senior AI Engineer focused on Delivery Acceleration in Boston. This position centers on using artificial intelligence to improve how the company delivers its services and solutions. Role overview The Senior AI Engineer works with cross-functional teams to design and implement AI-driven improvements in delivery processes. The goal is to make these processes more efficient and effective, supporting ongoing business transformation efforts. Key responsibilities Apply AI expertise to streamline and optimize service delivery workflows. Collaborate with colleagues from different departments to identify opportunities for AI solutions. Develop and deploy AI models that support business goals and enhance delivery outcomes. Collaboration This role involves regular interaction with teams across the organization. Working together, you will help shape and implement AI strategies that improve ServiceNow’s operations and customer experience.

OverviewJoin us as a Senior Principal AI Engineer where you will play a pivotal role in shaping and leading the development of complex, production-grade AI systems. This position is tailored for innovative builders—those with a proven track record of transforming AI concepts into operational systems, adept at identifying and overcoming challenges that arise during scaling, and skilled in empowering teams to accelerate progress without compromising quality.This is not a conventional strategy or management position; instead, it is a highly technical role that significantly influences organizational direction. You will establish the technical roadmap through coding, system design, and fostering a builder-centric culture even as we navigate increasing complexity and scale.

Who We AreAt CarGurus (NASDAQ: CARG), we empower individuals to navigate their automotive journey with confidence. What began as a small group of dedicated developers focused on enhancing trust and transparency in car shopping has transformed into the largest and fastest-growing automotive marketplace, achieving profitability for over 15 years.What We DoThe automotive landscape is rapidly changing, and so are we. We are committed to moving the entire car buying experience online, assisting our customers through every phase, from selling an old vehicle to financing, purchasing, and delivering a new one. Our platform attracts tens of millions of visitors each month, and approximately 30,000 dealerships utilize our innovative solutions. Our employees thrive in a culture that prioritizes kindness, collaboration, and innovation—equipping our Gurus with the resources they need for career advancement. Join us in disrupting a trillion-dollar industry!Role OverviewCar shopping can be a daunting task. At CarGurus, we leverage data and technology to simplify this process, providing individuals with the tools necessary to find, buy, finance, or sell a car with ease. Our impact is substantial as we are the most-visited car shopping site in the U.S. and are rapidly expanding our reach internationally. Ready to embark on this journey with us?The Data Engineering team is seeking a Senior Manager of Analytics Engineering to facilitate data-driven decision-making across the organization. You will oversee the development of scalable and high-performance data models that support reporting solutions for various stakeholders, including Product Management, Marketing, and Finance. We are in search of a collaborative leader who can actively influence our corporate analytics strategy as we grow and evolve.

Accordion’s AI Data Specialist role sits within the Data & Analytics team, supporting private equity clients and their portfolio companies across sectors such as Retail, Consumer Packaged Goods, Healthcare, Media & Entertainment, Technology, and Logistics. This position is based in any of Accordion’s U.S. offices, including Atlanta, Boston, Charlotte, Chicago, Dallas, Los Angeles, New York, or San Francisco, and follows a hybrid work model with up to two remote days per week. Candidates should reside near their selected office. Immigration sponsorship is not available. Role overview The AI Data Specialist works as part of an AI-enhanced delivery team, collaborating with AI engineers, data scientists, and product managers. The team’s mission is to transform financial operations for companies backed by private equity. The Data Specialist ensures that data is integrated, navigates complex data environments, and helps make information actionable to support client financial operations. Collaboration and focus This role involves close work with the Accordion Intelligence Lab, a group of software and AI engineers dedicated to advancing agentic-AI technologies. The Lab develops and maintains AI systems that underpin Accordion’s consulting work, including agentic architectures and production observability frameworks. AI Data Specialists contribute to building scalable, reliable tools that directly impact private equity clients and their portfolio companies. About the team The Data & Analytics group at Accordion brings together industry knowledge, advanced technology, and analytical skills to solve complex business problems. Team members deliver intelligent solutions and work in a collaborative, supportive environment alongside more than 1,400 finance and technology professionals.

At WHOOP, we are dedicated to enhancing human performance and extending healthspan through innovative solutions. Our mission is to empower individuals to reach their peak performance and enjoy longer, healthier lives. Utilizing advanced AI technologies, we transform continuous physiological data into meaningful insights and actionable recommendations. The AI platform is vital to our vision, converting raw physiological signals into personalized guidance that our members can implement daily.We are seeking a Senior AI/ML Engineer to play a crucial role in scaling our AI-driven experiences, which include WHOOP Coach, AI-powered Support, and various intelligent features across our product suite. In this pivotal position, you will be responsible for overseeing essential components of the AI Platform that power our internal AI Studio, such as evaluation pipelines, fine-tuning workflows, LLM observability, and experimentation tools. You will collaborate closely with product teams and data scientists to translate real user needs into robust, impactful AI systems that evolve based on actual usage.