About the job
Mission:
We are in search of a talented and driven Senior Data Engineering Analyst to join our innovative team focused on large-scale AI model evaluation through our platform, Ground Truth Regression. The ideal candidate will possess a solid foundation in data engineering, machine learning principles, and statistical analysis.
At Motional, the orchestration of extensive data analysis is crucial for advancing our machine learning-driven autonomous driving technology. Our robo-taxi ML models and software are developed by a dedicated team of engineers and deployed multiple times daily. The Ground Truth Regression team is responsible for providing a comprehensive perception analysis framework to validate any changes that could influence the behavior of autonomous vehicles.
The Ground Truth Regression team assesses the cumulative effects of ML and software modifications during the development phase, equipping the team with tools for root cause analysis and safety evaluations. We meticulously monitor model errors, anomalies, and rare occurrences across extensive driving scenarios, gathering insights over thousands of driving hours. The team is responsible for developing the full-stack infrastructure, including AWS Kubernetes orchestration, re-simulation, model metrics, regression reports, and deep-dive analytical tools. Collaboration with other perception and ML teams is integral for establishing metrics and analyzing outcomes.
What You’ll Do:
- Collaborate with ML Engineers and Autonomy Software Developers to create new data analysis metrics and KPIs for validating autonomous vehicle performance.
- Pursue innovation by researching and developing new large-scale data analysis frameworks.
- Lead large-scale data analysis workflows to identify unexpected impacts of both planned and unplanned modifications to ML models and software.
- Construct high-quality datasets to enhance ML product performance through training and edge case validation.
- Deliver in-depth statistical insights on model performance and generalization through thorough error and change analysis.
What We’re Looking For:
- Bachelor's or Master’s degree in Computer Science, Data Science, or a related field.
- Proficient programming skills in Python, SciPy, and related data analysis frameworks.
- Experience in machine learning, data mining, and statistical analysis.
- Familiarity with large-scale data processing and distributed computing technologies.
- Strong communication and software development skills, including goal setting, design documentation, testing frameworks, and collaborative team development.

