Freelance AI Evaluation Engineer

Please submit your CV in English and specify your English proficiency level. Mindrift connects skilled professionals with contract-based AI projects from leading technology companies. This freelance role centers on evaluating, testing, and refining AI systems. It is a contract position only, not a path to permanent employment. Role overview This project focuses on building a dataset to assess how well AI coding agents perform real-world software development tasks. The work requires designing realistic challenges and evaluation methods within simulated developer environments. Key responsibilities Create virtual companies from high-level plans, building out codebases, infrastructure, and context such as conversations, documentation, and tickets to simulate authentic development histories. Develop and refine tasks for different stages of the virtual company, including writing prompts, setting evaluation criteria, and ensuring tasks are solvable and fairly assessed. Design assignments in isolated environments that closely resemble a developer’s workstation, including a Linux machine with development tools (terminal, CLI), MCP servers (repository, task tracker, messenger, documentation), and a live web application codebase. Implement tests that accept all correct solutions and reject incorrect ones, carefully balancing strictness and leniency. Collaborate with an AI agent during test runs to confirm that tests catch real issues, flagging faulty solutions without penalizing correct ones. Review code generated by AI agents, analyze reasons for success or failure, and design edge cases and adversarial scenarios to expose weaknesses. Iterate on your work based on feedback from expert QA reviewers who will check your outputs against quality standards. What this role does not involve Data labeling Prompt engineering Writing code from scratch (the AI agent generates most of the code; your focus is on guiding and evaluating) Much of the work involves close collaboration with AI models, as developing challenging tasks for advanced systems requires working directly with them.

Mindrift brings together specialists and AI projects from leading technology companies, with a focus on practical applications of Generative AI. The team values real-world expertise and works globally to advance AI-driven solutions. Role overview This is a part-time, remote freelance role supporting the Tendem project (https://tendem.ai/). As an AI Workflow Engineer (also referred to as an AI Pilot), the work centers on developing automation systems that blend Large Language Models (LLMs) with human input. The main objective is to build scalable and dependable AI-powered workflows for content creation, communication, and automation tasks. What you will do Design and evaluate workflows that utilize LLM APIs, including OpenAI, Claude, Gemini, and others. Develop and enhance AI automation systems for generating content and managing communications. Create prompt frameworks to ensure consistent, high-quality results across workflows. Set up personalized automated outreach systems, such as email and messaging flows. Organize and preprocess data to support stable model performance and reliable outputs. Analyze and refine AI-driven pipelines to improve scalability, efficiency, and accuracy. Who succeeds in this role Candidates with direct experience in LLM integrations, prompt engineering, and building AI automation systems tend to do well. Structured thinking and attention to quality control are important, especially in an environment where AI and human collaboration are key. Location This freelance position is remote, based in Rome, Metropolitan City of Rome Capital, Italy.

Please submit your CV in English and indicate your English proficiency level. Mindrift offers project-based AI work for specialists, connecting professionals with assignments that focus on testing, evaluating, and improving AI systems. All roles are freelance and do not represent permanent employment. Role overview This freelance Optical Engineer - AI Trainer position centers on designing and documenting complex optics problems for AI training. Work is remote and open to candidates based in Rome or elsewhere in Italy. Each project may differ in scope and requirements. Main responsibilities Develop original optics problems that reflect real-world physics research workflows Create computationally intensive challenges that cannot be solved by hand in a short period Design problems requiring advanced reasoning across mechanics, electromagnetism, thermodynamics, and quantum mechanics Base each challenge on real research questions or practical applications in optics and physics Document all problems clearly and provide accurate, verified solutions Requirements Background as an optical engineer interested in part-time, project-based work Degree in Physics (theoretical, experimental, or computational) or a closely related field Minimum 2 years of experience in applied, research, or teaching roles Experience with numerical simulation methods Ability to design problems that mirror authentic research workflows Creative problem-solving skills across multiple physics domains Familiarity with physics modeling and approximation techniques Strong written English skills at C1 level or higher Application process Apply with a CV and details on English proficiency Complete qualification steps Join a project Work on assigned tasks Receive compensation Project commitment Expect to dedicate 10–20 hours per week during active project phases. Actual hours may change depending on project needs. Compensation Rates can reach up to $29 per hour, depending on expertise and speed. Actual pay may vary by project scope, complexity, and required skills. Other Mindrift projects may offer different compensation based on their requirements.

toloka-ai seeks a Freelance AI Trainer who combines civil engineering experience with solid Python programming skills. This contract position centers on training AI systems, drawing from practical engineering knowledge and coding expertise. Role overview This role involves using civil engineering concepts and Python to help develop and refine AI models. The work calls for both technical understanding of engineering principles and the ability to implement solutions in code. Location Remote work is available, but candidates should be based in Rome, Metropolitan City of Rome Capital, Italy.

Toloka AI is looking for a freelance Mechanical Engineer with strong Python experience to assist with AI training projects. This contract position is remote and based in Rome, Metropolitan City of Rome Capital, Italy. Role overview This role combines mechanical engineering knowledge with Python programming to support the development and training of AI systems. The position involves working independently as a contractor while collaborating with Toloka AI’s technical team. What you will do Apply expertise in mechanical engineering to guide and improve the training of AI systems. Use Python to create or enhance tools and processes that support AI projects. Offer technical insights to help shape technology solutions for ongoing initiatives. Requirements Background in mechanical engineering. Proficiency in Python programming. Interest in AI and technology development. Available for freelance, remote work.

Mindrift is hiring a Freelance Low-Code Automation Engineer to contribute to the Tendem project. This is a part-time, remote contract role based in Rome, Metropolitan City of Rome Capital, Italy. The position centers on building and improving automation workflows that blend AI and human input. Key responsibilities Create and enhance automation workflows for use in a hybrid AI-human environment Work closely with Tendem Agents to manage repetitive tasks and improve process efficiency Apply structured problem-solving and quality control to keep workflows reliable and scalable across different systems Utilize low-code automation platforms and JavaScript to tailor and optimize solutions Requirements Proven experience with low-code automation tools Strong skills in workflow architecture and process optimization Comfort with customizing automation using JavaScript Interest in flexible, remote freelance work The role involves working with the Tendem project team and using both technical and collaborative skills to streamline operations. For more about the project, visit https://tendem.ai/.

Overview:Are you an internet-savvy individual with a knack for online searches? Do you aspire to impact the evolution of global AI search technology? If so, we invite you to join our dynamic team!As a representative of RWS, you will assess and evaluate how our clients' search engines respond to typical inquiries from everyday users.Utilizing your search acumen, you will engage in various tasks that play a vital role in refining AI data, ultimately enhancing the online search experience for our clients' audiences. Your Profile:- Naturally curious with a strong interest in artificial intelligence.- Exceptional online research skills.- Thrive in fast-paced work environments.- Consistently uphold quality and accuracy standards.- Demonstrate self-discipline to adhere to schedules and complete tasks despite home office distractions.- Employ critical thinking to analyze information and determine its relevance and significance.Quick Overview of this Flexible Part-Time Role:Language: Proficiency in English and ItalianLocation: Italy (Remote Work)Schedule: Approximately 8-30 hours/week, averaging 15 hours weeklyCompensation: Up to 10 EUR/hourWho Should Apply: This role is ideal for freelancers, students, stay-at-home parents, or anyone looking for flexible remote work opportunities to enhance AI models. No prior experience is necessary.Role Description: Join the RWS Group as a Search Engine Evaluator to improve search engine results. You will provide feedback on text, audio, images, and videos to refine AI data utilized by leading search engines, social media platforms, streaming services, and more.

Mindrift is looking for a freelance DevOps Engineer to support automation systems for the Tendem project. This part-time role is remote, with a location base in Rome, Metropolitan City of Rome Capital, Italy. The project brings together AI and human workflows, requiring thoughtful infrastructure and reliable automation. Key Responsibilities Design and maintain scalable infrastructure that supports automation workflows in a hybrid AI and human environment. Collaborate with Tendem Agents to streamline and improve repetitive processes. Manage infrastructure with a focus on high reliability and strong performance. Help ensure the stability and growth of automation pipelines as the project expands. Who Succeeds in This Role Engineers with hands-on experience in cloud infrastructure and system deployment. Those who have managed high-load automation environments. People comfortable working remotely and contributing to AI-driven projects. Learn more about the project at https://tendem.ai/.

Role overview Toloka AI seeks a Freelance Mathematics Expert - AI Trainer for a remote position based in Rome, Metropolitan City of Rome Capital, Italy. This role centers on developing and delivering training programs aimed at improving AI performance in mathematical contexts. Main responsibilities Apply mathematical expertise to guide the creation of AI training content and instructional methods. Design and deliver training programs that enhance AI's mathematical abilities. Assist in building tools and resources that use AI to support mathematics education. About Toloka AI Toloka AI creates artificial intelligence solutions for education and other fields, focusing on technology that addresses practical learning needs.

Toloka AI is hiring a Freelance English Writer and AI Trainer based in Rome, Metropolitan City of Rome Capital, Italy. This remote contract role centers on producing and refining English-language content to support the training and advancement of AI systems. Role overview This position involves writing clear and engaging content for different audiences. Collaboration with AI specialists is a key part of the job, as is providing feedback to help improve artificial intelligence models. The work directly supports the development of new AI technologies. What you will do Create well-written English content tailored to varied readers Work alongside AI experts to train and assess AI models Offer thoughtful feedback that guides technology improvements Requirements Strong command of English writing Ability to explain ideas clearly and informatively Interest in collaborating with AI professionals and supporting technology growth This freelance position provides an opportunity to contribute to the progress of artificial intelligence as part of a team focused on innovation.

Please submit your CV in English and specify your English proficiency level. This freelance contract role with Mindrift connects optical engineers to project-based work focused on testing, evaluating, and improving AI systems for top technology companies. All work is on a project basis, not a permanent employment arrangement. Role overview Freelance Optical Engineers with Python expertise join projects that center on designing and validating computational physics challenges. Tasks vary by project and may include: Developing original computational physics problems that reflect real research workflows Writing problems solvable with Python, using libraries such as Numpy, SciPy, and Sympy Ensuring problems are computationally intensive and not easily solved by hand Creating challenges in mechanics, electromagnetism, thermodynamics, and quantum mechanics Basing problems on real research questions or practical physics applications Validating solutions in Python with established simulation libraries Documenting problem statements clearly and providing verified solutions Requirements Degree in Physics (theoretical, experimental, or computational) or a related field Proficiency in Python for numerical validation; experience with MATLAB, R, C, SQL, Numpy, Pandas, SciPy, or similar tools is valued At least 2 years of relevant experience (applied, research, or teaching) Background in numerical simulation methods Ability to design problems that reflect authentic physics research processes Creative approach to problem design across various physics domains Solid grasp of physics modeling and approximation methods Strong written English skills at C1 level or higher Project workflow Application Qualification Project participation Task completion Compensation Time commitment During active project phases, expect to spend approximately 10–20 hours per week. Actual hours may change based on project needs and are not guaranteed. Compensation Earn up to $29 per hour, depending on contribution and pace. Rates may vary with project complexity and expertise required. Other projects on the Mindrift platform may offer different compensation levels. Location This is a remote position based in Rome, Metropolitan City of Rome Capital, Italy.

Toloka AI seeks a Freelance Junior Journalist - AI Trainer to join its remote team based in Rome, Metropolitan City of Rome Capital, Italy. This position blends journalistic skills with practical involvement in artificial intelligence training projects. Key responsibilities Develop and refine training data to support AI initiatives Contribute journalistic writing that offers insights and perspectives for AI training tasks Location This is a remote role, open to candidates located in Rome and the surrounding metropolitan area.

Please submit your CV in English and indicate your level of English proficiency. Mindrift connects professionals with project-based AI work for leading technology firms, focusing on testing, evaluating, and improving AI systems. This Mathematics & Python Specialist - Freelance AI Educator position is project-based and not a permanent role. What you will do Design original computational mathematics problems that reflect real research workflows Create problems that require Python programming to solve, using libraries such as Numpy, SciPy, and Sympy Ensure problems are computationally intensive and cannot be solved manually within a reasonable timeframe Develop problems involving complex reasoning in areas like number theory, combinatorics, graph theory, and numerical analysis Base problems on genuine research challenges or practical mathematical applications Validate solutions using Python and standard mathematical libraries Document problem statements clearly and provide verified solutions Requirements Degree in Mathematics (Pure or Applied) or a related field Proficiency in Python for numerical validation; experience with MATLAB, R, C, SQL, Numpy, Pandas, SciPy, or similar libraries is also acceptable At least 2 years of professional experience in applied, research, or teaching settings Background in numerical methods and symbolic computation Ability to design problems that mirror authentic mathematical research workflows Familiarity with computational complexity theory Strong written English skills (C1 or higher) Project details Project tasks typically require about 10–20 hours per week during active phases. Actual workload depends on project needs and is not guaranteed outside of active periods. Compensation Contributors can earn up to $29 per hour, depending on experience and the pace of contribution. Rates vary by project based on complexity, scope, and required expertise. Other projects on the platform may offer different earning potential depending on their requirements. Application process Submit your application Pass qualification(s) Engage in a project Complete assigned tasks Receive compensation

Please submit your CV in English and indicate your English proficiency level. Mindrift connects specialists with project-based AI work for technology companies. Projects focus on testing, evaluating, and improving AI systems. This is a project-based role, not a permanent position. Role overview This freelance AI Trainer (Research Physicist) role centers on designing and documenting advanced physics problems for AI training. Assignments vary but often involve: Creating original optics problems that reflect real-world research workflows Ensuring problems require computational effort and cannot be solved quickly by hand Developing complex problems in mechanics, electromagnetism, thermodynamics, and quantum mechanics Basing scenarios on actual research challenges or practical situations in optics and physics Writing clear problem statements and providing verified solutions Requirements Degree in Physics (theoretical, experimental, or computational) or a related field Minimum of 2 years’ experience in applied research or teaching Experience with numerical simulation methods Ability to design problems that mirror real research processes Creativity in developing problems across multiple physics domains Familiarity with modeling and approximation techniques Strong written English (C1 level or above) Time commitment Plan for approximately 10–20 hours per week during active project periods. Actual workload may change depending on project needs. Compensation Earn up to $29 per hour, depending on expertise and pace. Pay rates may vary by project, based on scope, complexity, and required skills. Other projects on the platform may offer different earning potential. Application process Apply Complete qualification(s) Join a project Complete assigned tasks Receive payment

Toloka AI is seeking a Freelance AI Trainer with a background in Biology and Python programming. This remote position is based in Rome, Metropolitan City of Rome Capital, Italy. Role overview This contract role centers on supporting AI training projects. The focus is on applying subject matter expertise in biology and hands-on Python skills to help improve machine learning models. Collaboration with a team of professionals is a key part of the work, aiming to advance AI capabilities. What you will do Contribute biological knowledge and Python programming experience to AI model training tasks Work remotely with a diverse team to enhance project outcomes Help refine and improve the quality of machine learning models Requirements Expertise in biology Proficiency in Python programming Ability to work effectively in a remote, collaborative setting

Submit your CV in English and include your English proficiency level. Mindrift connects subject matter experts with project-based AI work for leading technology companies. Assignments focus on evaluating and improving AI systems. This is a temporary, project-based position rather than a permanent role. Role overview Freelance AI Trainers specializing in Statistics and Python contribute to a variety of projects that draw on advanced mathematical and programming skills. Typical tasks include: Designing computational statistics problems inspired by real-world mathematical research workflows Developing problems that require Python programming, often using Numpy, SciPy, or Sympy Creating computationally intensive problems not feasible to solve manually Constructing problems involving complex reasoning in fields such as number theory, combinatorics, graph theory, or numerical analysis Basing problem sets on actual research challenges or practical mathematical scenarios Validating solutions in Python with established mathematical libraries Documenting problem statements clearly and providing verified solutions Who this role suits This position is a fit for statistics professionals with strong Python skills seeking flexible, non-permanent projects. The ideal background includes: A degree in Statistics or a related discipline Proficiency in Python for numerical validation; familiarity with MATLAB, R, C, SQL, Numpy, Pandas, or SciPy is a plus At least 2 years of experience in applied, research, or teaching roles Strong written English at C1 level or above Professional certifications (such as CMME, SAS Certifications, or CAP) and experience with international or applied projects are considered advantageous Project workflow Apply Pass qualifications Join a project Complete assigned tasks Receive compensation Time commitment During active project phases, tasks typically require about 10–20 hours per week, depending on project needs. This is an estimate and does not guarantee a set number of hours. Compensation Earn up to $34 per hour, depending on contribution and pace. Actual rates vary based on project scope, complexity, and required expertise. Other projects on the platform may offer different compensation levels according to their requirements. Location This is a remote position based in Rome, Metropolitan City of Rome Capital, Italy.

Transform your passion for luxury into a rewarding career opportunity. Immerse yourself in the realm of premium brands and make a lasting impact in the fashion, beauty, jewelry, and automotive sectors. Join CXG, a global leader in customer experience, and collaborate with iconic names such as Louis Vuitton, Dolce & Gabbana, Bentley, Prada, Versace, and many more.Role Overview:As a luxury brand evaluator, you will enter the exclusive world of luxury to discreetly assess customer experiences, providing critical feedback that assists brands in refining their services. Whether visiting boutiques, shopping online, or managing returns, your insights will help shape the future of luxury.Key Features of the Role:* Flexibility – each boutique visit lasts approximately 20 minutes, giving you the freedom to complete multiple assignments.* Frequent Opportunities – undertake various missions each month and collaborate with some of the world's most prestigious brands.Our Luxury Partners:Fashion & Couture* Louis Vuitton, Saint Laurent, Balenciaga, Versace, Prada, Moncler, Fendi, Bottega Veneta, Ferragamo, COS, Bally, Dolce & GabbanaJewelry & Watchmaking* Tiffany & Co., De Beers, Piaget, IWC, Boucheron, PandoraBeauty & Skincare* Guerlain, Sephora, L’Oréal, GivenchyAutomotive* Bentley, Jaguar, Genesis, Maserati, VespaYour Responsibilities:* Select your assignments – choose missions aligned with your interests and profile.* Visit luxury boutiques or evaluate online – engage with sales representatives in-store or from the comfort of your home.* Observe closely – assess the ambiance, service quality, and overall experience.* Provide honest feedback – utilize our platform to share your observations through structured questionnaires.Benefits of the Role:Collaborate with iconic brands across diverse sectors. Flexible assignments tailored to your interests. Compensation for your time and the possibility of reimbursement on purchases. User-friendly platform to manage missions and feedback.How to Join the CXG Community:1. Register at live.cxg.com and confirm your email address.2. Complete your profile fully to gain verification.3. Pass the General Certification to access missions.4. Apply for the missions that inspire you.5. Start evaluating and making a difference in the luxury market.Compensation:Evaluation without purchase: Receive compensation based on the complexity of the mission. Evaluation with purchase: Receive reimbursement for approved items, as specified in the mission briefing.

Submit your CV in English and include your proficiency level. Mindrift connects professionals with project-based roles in artificial intelligence, focusing on testing, evaluating, and improving AI systems for leading tech companies. All positions are contract-based and not permanent employment. Role overview This freelance AI Trainer position is designed for research physicists with strong Python skills. Projects involve creating and validating advanced computational physics problems that reflect real research workflows. Contributors typically: Develop complex physics problems requiring Python programming, often using libraries such as Numpy, SciPy, and Sympy Design computationally intensive challenges that may take days or weeks to solve Write problem statements involving mechanics, electromagnetism, thermodynamics, or quantum mechanics Base scenarios on authentic research or practical physics applications Validate solutions using Python and standard simulation tools Document problems clearly and provide verified answers Requirements Degree in Physics (theoretical, experimental, or computational) or a related field Strong experience with Python for numerical validation; experience with MATLAB, R, C, SQL, Numpy, Pandas, SciPy, or similar libraries is valued At least 2 years of relevant experience (applied, research, or teaching) Background in numerical simulation techniques Ability to design problems reflecting real-world research in physics Creative problem-solving skills across multiple physics domains Familiarity with modeling and approximation methods Excellent written English at C1 level or above Project process Apply Complete qualifications Join a project Carry out assigned tasks Receive payment Time commitment During active projects, tasks usually require 10–20 hours per week. Actual hours may vary depending on project needs. Compensation Contributors can earn up to $29 per hour, depending on contribution level and pace. Pay rates vary by project, based on scope, complexity, and expertise required. Other projects on the platform may offer different compensation structures. Location: Remote , Rome, Metropolitan City of Rome Capital, Italy

Exciting freelance collaboration opportunity for evaluating customer experience in the premium automotive sector.Join CXG, a global leader in customer experience, and work with iconic brands such as Genesis, Maserati, Jaguar, Bentley, and many more. We assist luxury brands in enhancing their customer experience through insights drawn from real evaluations.As part of our expansion in Italy, we are seeking reliable and detail-oriented individuals available to conduct customer experience evaluations at automotive dealerships and retail points.This is a freelance, project-based collaboration. Assignments are paid, well-structured, and allocated based on the collaborator's geographical location. Participation can be ongoing or occasional, depending on your availability.Your RoleAs a Freelance Customer Experience Evaluator, you will assess real customer experiences and provide structured feedback via our digital platform.Each assignment is clearly described and typically requires about 20–30 minutes, making this role ideal for students, young professionals, or anyone seeking a flexible opportunity that fits around other commitments.ResponsibilitiesSelect assignments based on your availability and location.Observe every detail: evaluate the atmosphere, level of service, digital and in-store interactions, follow-up communications, and the overall customer journey.Provide honest and detailed feedback through brief questionnaires.Why Collaborate with CXGFreelance and project-based collaboration with flexible hours.Paid assignments (details provided for each task).Opportunity to connect with luxury brands and international contexts.Selection ProcessApplication through this platform.Brief screening.Access to available projects in your area.RequirementsMinimum age: 18 years.Good knowledge of the automotive sector and interest in the automotive world.Interest in improving customer experience and retail environments.Good interpersonal skills and disposition towards public interaction.Attention to detail with the ability to discreetly observe the in-store experience.Possession of a valid driver's license and access to a personal vehicle.Ability to provide objective, unbiased, and structured feedback.Reliability and punctuality in completing online questionnaires after each assignment.

Role overview toloka-ai is hiring a Senior Consultant for freelance AI projects. This position involves collaboration with leading MBB and other top-tier consulting firms. The role is remote, with a focus on candidates based in Rome, Metropolitan City of Rome Capital, Italy. What you will do Collaborate with industry experts on advanced AI projects Apply your expertise to assignments for well-known consulting firms Work alongside top professionals to help develop new solutions Location and flexibility This freelance position is fully remote. Work is based in Rome, Metropolitan City of Rome Capital, Italy, and candidates must be located within this area.