Machine Learning Engineering Manager - Evaluations

As Canva continues to expand, so does the significance and potential of our AI-driven features. We are in search of a Machine Learning Engineering Manager to mentor a team of exceptional Research Scientists and Machine Learning Engineers, develop production-ready evaluation systems, and transform state-of-the-art ML capabilities into engaging product experiences. If you excel at bridging rigorous engineering with practical applications, and you are passionate about nurturing talent while tackling challenging technical issues, this could be the ideal role for you.About the Role:Your primary responsibility will be to lead and develop a high-performing team of Machine Learning Engineers and Research Scientists based in the EU, who are shaping the future of AI on a large scale. You will focus on establishing strategic technical direction, mentoring team members to deliver impactful engineering solutions, and ensuring the deployment of robust and scalable ML systems into production. You will advocate for engineering excellence and measurable outcomes, connecting foundational model capabilities with real-world applications throughout Canva's platform.This is a hands-on leadership position for someone who is dedicated to cultivating talent, developing a technical vision, and collaborating across functions to integrate cutting-edge AI into delightful user experiences.This role involves:Mentoring and coaching a high-performing team of Machine Learning Engineers and Research Scientists.Owning the evaluation infrastructure - design, build, and maintain robust evaluation systems, quality metrics, safety monitoring, red-teaming, and competitive benchmarking to ensure enterprise readiness and user satisfaction at scale.Creating automated metrics that accurately predict human aesthetic judgments across various dimensions such as visual hierarchy, layout coherence, typography, and brand alignment.Advising on human evaluation pipelines and closing the feedback loop between user signals and model enhancements.Establishing technical strategies aligned with Canva’s AI and product objectives.Guiding engineering efforts in model deployment, evaluation infrastructure, and production systems.Collaborating cross-functionally to ensure that ML capabilities deliver reliable product impacts.You are likely a fit if you:Have experience leading machine learning engineering teams, with a proven record of coaching and delivering production systems.Possess expert knowledge in deploying and scaling generative models (Diffusion, GANs, VAEs, LLMs) in production environments, particularly with a strong focus on visual models (image, video, design).Bring hands-on experience in building ML infrastructure, evaluation pipelines, and monitoring systems at scale.Excel at developing data-driven evaluation methodologies, transforming user analytics and production metrics into actionable insights.

Join Canva as a Senior Machine Learning Engineer specializing in multimodal data.In this role, you will leverage advanced machine learning techniques to analyze and integrate diverse data forms, driving innovations that enhance user experiences across our platform. You will collaborate with cross-functional teams to develop and implement algorithms that power our features, optimize our services, and create data-driven insights.

Machine Learning Reply Austria partners with organizations to deliver projects in generative AI, web development, cloud, and data platforms. As part of a global network, the Vienna office collaborates with teams in Italy and Germany, contributing to a group of more than 15,000 professionals worldwide. The local team is growing, values collaboration, and regularly engages with the broader tech community and technology partners. Role overview The Senior GenAI Engineer (m/f/d) role focuses on both consulting and hands-on engineering for generative AI projects. The team builds custom end-to-end cloud solutions and supports clients throughout the entire project lifecycle, including strategic consulting, data architecture, infrastructure, data processing, and deploying production-ready systems. What you will do Develop and implement generative AI solutions for clients, balancing technical execution with consulting responsibilities. Work on projects that use open-source and cloud technologies. Guide clients through every stage of data-driven product development, from initial strategy to deployment. Assist organizations in major German HDAX industries as they adopt and enhance innovative data solutions. Team culture The Vienna team combines a laid-back atmosphere with a strong drive to deliver results. Collaboration and continuous learning are central values, and team members actively participate in the tech community while maintaining close ties with technology partners. Location This position is based in Vienna, Austria.

Join us at Machine Learning Reply Austria, where we are dedicated to pioneering cutting-edge technology projects in collaboration with our esteemed clients. We are on the lookout for seasoned Full Stack Engineer consultants who possess a robust technical background.As part of the global Reply network, which includes sister companies in Italy and Germany and employs over 15,000 professionals worldwide, we are a rapidly expanding consultancy. Our focus is on addressing challenges through Web Development, Cloud technologies, Data Platforms, and appropriate organizational frameworks. We pride ourselves on being a cohesive, motivated team that actively participates in conferences and collaborates within our tech community.We provide tailored end-to-end cloud-based solutions that encompass the entire project lifecycle—from initial strategy consulting to data architecture and infrastructure issues, and ultimately to data processing and deployment of production-ready solutions.Our extensive expertise spans all stages of product implementation across key industries, including the German HDAX companies. By emphasizing open-source and cloud technologies, we empower our clients to successfully adopt new data-driven solutions and enhance existing processes and products, all while transitioning to cloud technologies.

Machine Learning Reply Austria, located in Vienna, is part of a global consultancy specializing in technology projects for clients across various sectors. The team focuses on web development, cloud technologies, and data platforms, working together in a collaborative and motivated setting. Regular involvement in conferences and technology community events is part of the group's culture. Role overview The Senior Cloud Engineer position is based in Vienna, Austria. This role involves delivering customized, end-to-end cloud solutions as part of a team. Projects span the full lifecycle, including strategic consulting, data architecture, infrastructure management, and the deployment of production-ready systems. What you will do Consult with clients on cloud technology projects, offering technical expertise throughout each engagement Design and implement cloud architectures for clients in various industries, with a particular focus on German HDAX companies Manage infrastructure and oversee the deployment of cloud-based solutions Support clients in adopting new data-driven approaches and optimizing existing products and processes using cloud and open-source technologies Team culture The team values close collaboration and knowledge sharing. Members are encouraged to connect with technology partners and the broader tech community. The environment supports ongoing professional growth and learning, both within the company and through participation in external events.

At Machine Learning Reply Austria, we are dedicated to delivering cutting-edge technology solutions that empower our clients. We are currently on the lookout for skilled Cloud Engineer consultants who possess a robust technical background and a passion for innovation.Part of a dynamic network of over 15,000 employees at Reply globally, Machine Learning Reply specializes in solving complex challenges through Web Development, Cloud Technologies, and Data Platforms, supported by the right organizational frameworks. Our team is collaborative, relaxed, yet intensely motivated, actively engaging with communities and participating in conferences alongside our tech partners.We provide comprehensive, customized cloud-based solutions that encompass the complete project lifecycle—from initial strategy consulting and data architecture to infrastructure management and the deployment of production-ready solutions.Our extensive expertise covers every phase of product implementation across key industries, including the German HDAX companies. By leveraging open-source and cloud technologies, we enable our clients to successfully adopt new data-driven solutions and enhance existing processes and products while transitioning effectively to cloud environments.

Join Machine Learning Reply Austria, where we are dedicated to collaborating on innovative technology projects that drive success for our clients. We are currently on the lookout for skilled GenAI Engineer consultants who possess a robust technical foundation.As part of Machine Learning Reply, which operates alongside our sister companies in Italy and Germany and employs over 15,000 professionals globally, our fast-growing consultancy specializes in tackling challenges related to Web Development, Cloud technologies, Data Platforms, and the essential organizational frameworks that support them. Our team is a close-knit, relaxed, yet highly motivated group that actively participates in conferences and engages with a community of practice alongside our technological partners.We provide customized end-to-end cloud solutions that encompass the entire project lifecycle—from initial strategy consulting to data architecture, infrastructure management, data processing, and the deployment of production-ready solutions.With extensive expertise across all stages of product implementation in key industries, particularly among German HDAX companies, we leverage open-source and cloud technologies to empower our clients to implement new data-driven solutions and optimize their existing processes while adapting to cloud innovations.

Machine Learning Reply Austria partners with clients to deliver technology projects centered on web development, cloud platforms, and data solutions. The Vienna-based team works closely with colleagues in Italy and Germany, forming part of Reply’s global network of over 15,000 professionals. A collaborative and motivated culture shapes their approach, and the team regularly takes part in conferences and technology community events. Role overview The Senior Full-Stack Engineer (m/f/d) position focuses on consulting and hands-on engineering for cloud-based solutions. This role covers the entire project lifecycle, from strategy and architecture through deployment and production. Projects often involve web development, data processing, and infrastructure challenges for clients in various industries, with particular attention to German HDAX companies. What you will do Work as part of a close-knit engineering team to deliver cloud-based, data-driven solutions Contribute to every phase of the project lifecycle, including consulting, architecture, and deployment Use open source and cloud technologies to help clients implement new solutions and improve existing processes Collaborate with colleagues across Austria, Italy, and Germany Participate in conferences and community events alongside technology partners How the team works Projects span the full implementation cycle and place strong emphasis on open source tools and cloud innovation. The team helps clients adapt products and processes to data-driven approaches, always aiming to deliver solutions ready for production use.

Become a part of a prestigious global community dedicated to enhancing the customer experience for the world’s leading luxury brands! CXG, a premier customer experience agency, is seeking passionate Customer Experience Evaluators who actively engage with luxury brands.As a Freelance Luxury Brand Evaluator, you will have the opportunity to complete multiple evaluations each month, sharing your insightful feedback through questionnaires. Your assignments will cover a wide spectrum of luxury sectors, including fashion, high-end jewelry, cosmetics, luxury watches, automobiles, and more. You may engage in activities such as visiting retail stores, returning purchases, shopping online, or scheduling appointments at luxury boutiques.Important Note: To maintain the integrity and objectivity of our evaluations, applicants must not have current ties with any luxury retail brands.Your insights will play a crucial role in influencing brand strategies, providing you with a unique opportunity to impact the luxury market significantly.Key Responsibilities: Conduct confidential evaluations of your preferred luxury brands, both in-store and online. Offer unbiased feedback based on your experiences. Select assignments that align with your interests and profile. Complete detailed questionnaires following each evaluation. Adhere to project objectives and any specific requirements set forth by the luxury brands we represent. How to Apply:Follow these straightforward steps to join our evaluator team: Register at live.cxg.com to receive your credentials via email. Log into our platform and provide further details about yourself. Our team will verify your profile and reach out to you. Review the ‘welcome package’ and complete the general certification. You’re all set! You can now view and apply for assignments that pique your interest. About CXG:CXG is a globally recognized customer experience agency dedicated to premium and luxury brands. With 12 offices worldwide, we serve clients across 70 countries. Our team of over 220 customer experience professionals collaborates with a network of more than 80,000 evaluators around the globe. Discover more about our mission at www.cxg.com.Enjoy the flexibility of managing your assignments through our mobile application, where you can search for missions, complete certifications, submit surveys, and more—all from the palm of your hand.For additional information, feel free to reach out to us!

Join the global leader in language services and technology! We are seeking a Business Development Manager to cultivate new partnerships within the AI Solutions division (DataForce). DataForce specializes in delivering high-quality data for Human-Machine Interaction, serving some of the most prestigious tech companies globally. Our mission focuses on collecting, enhancing, and processing training data for Machine Learning across various AI sectors.As a part of the TransPerfect family, the world's largest provider of language and technology solutions with a presence in over 100 cities, we are expanding our team globally.Key Responsibilities:Identify and research potential clients in targeted markets to understand their business and technical requirements.Qualify and evaluate business opportunities.Manage the sales process from lead generation to closure.Ensure client satisfaction and success.Create and execute strategic business plans.Become an expert in our product offerings and stay informed on industry trends.Utilize TransPerfect’s CRM to track business opportunities.Collaborate with production and technology teams across diverse time zones and cultures.Drive high-value, profitable business deals.Monitor KPIs and provide regular internal and client updates, including progress reports and risk assessments.Participate in trade shows and support marketing initiatives, contributing to case studies and social media efforts.Deliver accurate weekly forecasts and status updates.Assist in financial planning and ensure adherence to budgets.Facilitate communication with stakeholders regarding client accounts.Support training and adoption of technologies for internal and client teams.

Transform your passion for luxury into a rewarding career. Discover the realm of high-end brands while making a significant impact in sectors like fashion, beauty, jewelry, and automobiles. Join CXG, the worldwide leader in customer experience, and collaborate with renowned brands such as Louis Vuitton, Dolce & Gabbana, Bentley, Prada, Versace, and many others.About the Role:As a Luxury Brand Evaluator, you will immerse yourself in the luxury market to discreetly evaluate customer experiences and provide essential feedback that aids brands in enhancing their services. Your role may involve visiting boutiques, making online purchases, or returning products, and your insights will shape the future of luxury.• Flexibility - Each in-store visit takes about 20 minutes, allowing you to complete multiple assignments conveniently.• Frequent Opportunities - Engage in several missions per month and work with some of the most prestigious brands globally.Our Luxury Partners:Fashion & Couture: Louis Vuitton, Saint Laurent, Balenciaga, Versace, Prada, Moncler, Fendi, Bottega Veneta, Ferragamo, COS, Bally, Dolce & Gabbana.Jewelry & Watches: Tiffany & Co., De Beers, Piaget, IWC, Boucheron, Pandora.Beauty & Skincare: Guerlain, Sephora, L’Oréal, Givenchy.Automotive: Bentley, Jaguar, Genesis, Maserati, Vespa.What You Will Do:1. Choose your assignments - Select missions that align with your interests and profile.2. Visit luxury stores or evaluate online - Interact with sales associates in-store or from home.3. Observe carefully - Assess the ambiance, service quality, and overall customer experience.4. Provide authentic feedback - Share your observations via our platform through questionnaires.Perks of the Role:• Collaborate with iconic brands across various industries.• Flexible assignments tailored to your preferences.• Compensation for your time and insights, with potential reimbursement for purchases.• An easy-to-use platform for managing missions and feedback.How to Join the CXG Community:1. Register: Sign up at live.cxg.com and confirm your email.2. Complete your profile: Fill out your details completely to get verified.3. Get certified: Pass the General Certification to access missions.4. Apply for missions: Explore assignments with brands that excite you.5. Start evaluating: Begin making a difference in the luxury market.Compensation:• Non-Purchase Evaluations: Earn a fee based on the complexity of missions.

Transform your enthusiasm for luxury into a rewarding career. Dive into the realm of high-end brands and leave your mark in industries such as fashion, beauty, jewelry, and automobiles. Join CXG, a global pioneer in customer experience, and collaborate with prestigious brands including Louis Vuitton, Dolce & Gabbana, Bentley, Prada, and Versace.About the Position:As a Luxury Brand Evaluator, you will immerse yourself in the luxury sector, discreetly evaluating customer experiences and delivering vital feedback that enables brands to enhance their offerings. Your insights will influence how luxury brands evolve, whether you are visiting boutiques, shopping online, or returning products.Flexible Scheduling: Each in-store visit lasts about 20 minutes, allowing you to manage multiple assignments.Regular Opportunities: Complete several missions monthly while partnering with some of the world’s most esteemed brands.Our Esteemed Partners:Fashion & Couture: Louis Vuitton, Saint Laurent, Balenciaga, Versace, Prada, Moncler, Fendi, Bottega Veneta, Ferragamo, COS, Bally, Dolce & GabbanaJewelry & Watches: Tiffany & Co., De Beers, Piaget, IWC, Boucheron, PandoraBeauty & Skincare: Guerlain, Sephora, L’Oréal, GivenchyAutomotive: Bentley, Jaguar, Genesis, Maserati, VespaYour Responsibilities:Select assignments that resonate with your interests and profile.Visit luxury locations or assess online services, engaging with sales representatives in-store or from home.Meticulously observe the environment, quality of service, and overall customer journey.Provide candid evaluations through our platform via questionnaires.Benefits of Working with Us:Collaborate with iconic brands across various sectors.Flexible assignments tailored to your personal interests.Compensation for your contributions, including potential reimbursement for purchases.User-friendly platform for managing tasks and submitting feedback.How to Join the CXG Community:Register at live.cxg.com and verify your email.Complete your profile to 100% for verification.Obtain certification by passing the General Certification to access assignments.Apply for missions that excite you.Start evaluating and making a meaningful impact in the luxury sector.Compensation:Non-Purchase Evaluations offer a fee based on the complexity of the mission, while Purchase-Based Evaluations may include reimbursement for approved items as specified in the mission brief.

Join Sportradar as a Senior Data Scientist, where you will leverage your expertise in data analysis, statistical modeling, and machine learning to drive insights in the sports industry. You will collaborate with cross-functional teams to develop innovative solutions that enhance our data offerings.

At Machine Learning Reply Austria, we are dedicated to pioneering state-of-the-art data science initiatives for our clients. We are on the lookout for Data Frameworks Consultants who possess a robust background in economics and IT, serving as a vital link between strategic consulting and data science.As part of the larger Machine Learning Reply family, which includes our esteemed sister companies in Italy and Germany and boasts over 15,000 employees globally, we are a rapidly expanding consultancy committed to tackling challenges through innovative Data Science solutions and the appropriate organizational frameworks. We pride ourselves on being a cohesive and motivated team, actively engaging in conferences and collaborating with our tech partners in communities of practice.If you bring experience in strategic project management and execution with a focus on fostering data-driven business models, or if you are a recent graduate who has gained initial exposure to big data technologies and strategic thinking, we want to connect with you.Are you a technology enthusiast at heart and aspire to be a Strategy Consultant? Do you maintain an unwavering focus, driven by numbers, while being passionate about data storytelling?We integrate what is essential. By collaborating with Data Scientists and Data Engineers, we empower our clients with cutting-edge open-source technology, enabling them to transition into truly Data-Driven organizations. Engaging with upper management, we thoroughly analyze our clients' core businesses, generate tangible value, and deliver solutions that others can merely envision.As a Data & AI Strategist, your role will involve advising clients on how data usage influences strategic decisions and how Advanced Analytics can unveil new operational avenues. You will work alongside technical specialists in big data and data science, so while hands-on experience is not mandatory, a genuine interest is expected.Depending on project scope and your interests, your work may include:Conducting analyses of client business needs to create pathways for data strategy initiatives.Participating in implementation projects as part of a team alongside Data Scientists and Data Engineers.Facilitating C-Level decision-making by providing business cases, qualitative assessments, and workshops.You'll have the opportunity to work across various industries including banking, insurance, automotive, retail, and more, ensuring a rich cross-industrial learning experience.

Join Machine Learning Reply Austria as we push the boundaries of innovation in cutting-edge technology projects. We are on the lookout for seasoned Data Science consultants with a robust technical foundation to collaborate with our clients.With a global presence of over 15,000 employees, Machine Learning Reply and its sister companies in Italy and Germany are at the forefront of consultancy, dedicated to addressing complex challenges involving Web Development, Cloud technologies, Data Platforms, and more. Our team is a cohesive, motivated group with a passion for engagement in conferences and tech communities.We specialize in delivering bespoke end-to-end cloud solutions that encompass the entire project lifecycle—from strategic consulting to data architecture, infrastructure management, and the deployment of production-ready systems.Our extensive expertise spans all stages of product implementation across key industries, particularly within the German HDAX companies. By leveraging open source and cloud technologies, we empower our clients to implement and optimize innovative data-driven solutions while adapting to cloud environments.Key Responsibilities:Analyze and identify problem solutions in collaboration with clients.Design and propose effective solutions, optimizing and deploying them into production.Develop and implement state-of-the-art algorithms, automating workflows in an agile setting.Stay abreast of technological advancements and collaborate with leading technology firms.Act as the main bridge between the technical team and management to fulfill business objectives.What We Offer:A competitive gross monthly salary starting at €3,215 (Consultant) or €4,286 (Senior Consultant), based on experience.Opportunities to work on diverse projects across various industries, including Banking, Insurance, Automotive, and Retail.An active social program featuring conference funding, team-building activities, and group events.Recognition for innovative contributions to encourage personal growth.A collaborative, open, and flat organizational environment.

Machine Learning Reply Austria is expanding its consulting team in Vienna. The group specializes in data science projects that help organizations build data-driven business models. With operations across Austria, Italy, and Germany, and a global network of over 15,000 colleagues, the team collaborates closely with technology partners and takes part in conferences and community events. Role overview The Data & AI Strategy Consultant position bridges economics, IT, and data science. This role connects strategic consulting with technical teams, guiding clients as they make decisions based on data and advanced analytics. Both experienced consultants and recent graduates with exposure to big data and strategic thinking are welcome to apply. What you will do Analyze client business needs and design data strategy projects Collaborate with Data Scientists and Data Engineers on implementation efforts Support C-level executives by developing business cases, conducting qualitative assessments, and facilitating workshops Projects cover industries such as banking, insurance, automotive, and retail, offering a wide range of learning opportunities. Requirements Educational background in economics and IT Interest in data science and big data technologies Comfort working with numbers and communicating insights through data Motivation and focus to develop as a Strategy Consultant Strong communication skills for working with technical teams and senior management Direct experience in big data or data science is not required, but a genuine interest in these fields is important.

At Canva, we are on a mission to empower individuals to unleash their creativity through design. We are innovating with artificial intelligence to deliver transformative experiences for millions, enabling everyone to design with confidence. We are seeking a passionate and experienced Senior Research Scientist specializing in reinforcement learning, agentic systems, and mixture of expert models to advance the boundaries of reasoning, tool usage, latency, and reliability, ultimately delivering impactful solutions to our users.About the TeamOur team engages in exploring multimodal agentic architectures, creating scalable training and evaluation loops, and collaborating closely with product and platform teams to translate our breakthroughs into user-friendly product features. As part of a pioneering post-training team, we are focused on developing state-of-the-art multimodal agentic systems, addressing various aspects of multimodal modeling, post-training methodologies, and design agents. We are in search of a candidate with robust experience in post-training, reinforcement learning (RL), and mixture of expert models to join our innovative group.About the RoleYou will lead research initiatives and be actively involved in hands-on tasks throughout the agent stack—from reward design and policy optimization to planning, memory management, and tool orchestration, as well as dataset construction and the development of cutting-edge post-training approaches. You will conduct tightly controlled experiments, iterate rapidly, and draw trustworthy conclusions. Most importantly, you will play a key role in converting research insights into reliable, safe, and high-quality product experiences.Your ResponsibilitiesDesign and develop agent systems (including planning, multimodal tool usage, retrieval, novel training approaches, and modeling ablations) for practical applications in design, vision, and language.Enhance post-training and RL processes across distributed systems (using PyTorch) while ensuring efficient data loaders, telemetry, stable training of mixture-of-experts (MoE) architectures, and reproducible pipelines; profile, debug, and optimize performance.Contribute to the research agenda for RL and agentic systems that align with Canva’s product objectives; quickly identify high-leverage opportunities and eliminate dead ends.Develop reward models and learning loops, including RLHF/RLAIF, preference modeling, DPO/IPO-style objectives, offline and online RL, curriculum learning, and credit assignment for multi-step reasoning.Create simulation and sandbox tasks that reveal failure modes (such as planning errors, tool-use brittleness, hallucination, and unsafe actions) and turn these into measurable targets.Establish rigorous evaluation standards for agents (task success, reliability, latency, safety, regressions). Implement offline suites and online A/B tests, prioritizing straightforward, controlled experiments that yield generalizable results.Work collaboratively with product, design, safety, and platform teams to successfully integrate research findings into dependable features.

Machine Learning Reply Austria is part of the Reply group, a consultancy with a global team of over 15,000 professionals and sister companies in Italy and Germany. The company focuses on advanced technology projects, including web development, cloud technologies, data platforms, and building effective organizational structures. Role overview The Senior Data Scientist (m/f/d) position in Vienna centers on consulting and technical expertise. The team values collaboration and motivation, maintaining a relaxed and supportive work environment. Team members often participate in conferences and contribute to the broader technology community. What you will do Develop customized, end-to-end cloud solutions for clients, managing the full project lifecycle Contribute to strategy consulting, data architecture, infrastructure management, and data processing initiatives Deploy production-ready solutions across various industries, with a focus on German HDAX companies Use open-source and cloud technologies to help clients build and refine data-driven products and processes Team and culture The Vienna office brings together a close-knit group that values knowledge sharing and a relaxed, motivated approach. Staying engaged with the tech community is an important part of the team’s culture.

Join Antithesis as an Engineering Manager, where you will lead a dynamic team of engineers in a collaborative and innovative environment. This is an exciting opportunity to influence product development and drive technical excellence.

Role Overview Sentry is looking for an Engineering Manager to guide a team focused on SDK development for Apple and Android platforms. This position is based in Vienna, Austria. What You Will Do Lead and support a team of engineers working on SDKs for Apple and Android. Oversee engineering projects from planning through delivery. Mentor engineers and help them grow their technical skills. Maintain high standards for code quality and project execution. Work closely with teams across the company to coordinate project goals and deliver strong software solutions.