companyCanva logo

Machine Learning Engineering Manager - Evaluations

CanvaVienna
On-site Full-time

Clicking Apply Now takes you to AutoApply where you can tailor your resume and apply.


Unlock Your Potential

Generate Job-Optimized Resume

One Click And Our AI Optimizes Your Resume to Match The Job Description.

Is Your Resume Optimized For This Role?

Find Out If You're Highlighting The Right Skills And Fix What's Missing

Experience Level

Manager

Qualifications

To succeed in this role, candidates should have:A strong background in machine learning, specifically with hands-on experience in deploying generative models in large-scale environments. Proven leadership abilities, including mentoring and developing engineering teams. Experience with robust evaluation systems and metrics that drive user engagement and satisfaction. Excellent problem-solving skills with a focus on practical applications of machine learning technologies.

About the job

As Canva continues to expand, so does the significance and potential of our AI-driven features. We are in search of a Machine Learning Engineering Manager to mentor a team of exceptional Research Scientists and Machine Learning Engineers, develop production-ready evaluation systems, and transform state-of-the-art ML capabilities into engaging product experiences. If you excel at bridging rigorous engineering with practical applications, and you are passionate about nurturing talent while tackling challenging technical issues, this could be the ideal role for you.

About the Role:

Your primary responsibility will be to lead and develop a high-performing team of Machine Learning Engineers and Research Scientists based in the EU, who are shaping the future of AI on a large scale. You will focus on establishing strategic technical direction, mentoring team members to deliver impactful engineering solutions, and ensuring the deployment of robust and scalable ML systems into production. You will advocate for engineering excellence and measurable outcomes, connecting foundational model capabilities with real-world applications throughout Canva's platform.

This is a hands-on leadership position for someone who is dedicated to cultivating talent, developing a technical vision, and collaborating across functions to integrate cutting-edge AI into delightful user experiences.

This role involves:

  • Mentoring and coaching a high-performing team of Machine Learning Engineers and Research Scientists.

  • Owning the evaluation infrastructure - design, build, and maintain robust evaluation systems, quality metrics, safety monitoring, red-teaming, and competitive benchmarking to ensure enterprise readiness and user satisfaction at scale.

  • Creating automated metrics that accurately predict human aesthetic judgments across various dimensions such as visual hierarchy, layout coherence, typography, and brand alignment.

  • Advising on human evaluation pipelines and closing the feedback loop between user signals and model enhancements.

  • Establishing technical strategies aligned with Canva’s AI and product objectives.

  • Guiding engineering efforts in model deployment, evaluation infrastructure, and production systems.

  • Collaborating cross-functionally to ensure that ML capabilities deliver reliable product impacts.

You are likely a fit if you:

  • Have experience leading machine learning engineering teams, with a proven record of coaching and delivering production systems.

  • Possess expert knowledge in deploying and scaling generative models (Diffusion, GANs, VAEs, LLMs) in production environments, particularly with a strong focus on visual models (image, video, design).

  • Bring hands-on experience in building ML infrastructure, evaluation pipelines, and monitoring systems at scale.

  • Excel at developing data-driven evaluation methodologies, transforming user analytics and production metrics into actionable insights.

About Canva

Join the team that is transforming how the world experiences design. Welcome! We appreciate your interest in our organization. We understand that job hunting can be time-consuming, and you are eager to learn more about what we offer, so let's get right to it. Work Environment and FlexibilityOur flagship campus is located in Sydney, Australia, with a significant part of our European operations based in Austria. We believe in empowering our Canvanauts to choose the work style that best enables them to achieve their goals, whether that be in-office, hybrid, or remote. A fun fact: a significant portion of our work in Austria focuses on developing AI products within Canva, reimagining the use of artificial intelligence in design. Exciting, isn’t it?

Similar jobs

Tailoring 0 resumes

We'll move completed jobs to Ready to Apply automatically.