About the job
Kindly submit your CV in English and specify your English proficiency level.
At Mindrift, we bridge talented professionals with project-based AI opportunities for top-tier tech companies, with a focus on the testing, evaluation, and enhancement of AI systems. This role is project-based and does not entail permanent employment.
Opportunity Overview
As a Senior Software Engineer in Test, you will develop complex coding test cases that challenge AI coding systems:
- Evaluate and enhance realistic coding tasks derived from provided production codebases, ensuring they maintain practical scope and requirements.
- Design detailed functional tests that assess true end-to-end behavior and edge cases, going beyond superficial checks.
- Create “fair yet challenging” tasks where the AI has the necessary context but must engage in complex reasoning with information distributed across files and external sources.
- Investigate AI failures to determine the model's weaknesses and strengths.
- Revise your work based on feedback from expert QA reviewers who assess your submissions against seven quality criteria.
Candidate Profile
We seek seasoned developers, software engineers, or test automation specialists who are interested in part-time, non-permanent projects. Ideal candidates should possess:
- A degree in Computer Science, Software Engineering, or a related field.
- 5+ years of experience in software development, with a strong emphasis on Python (pytest, async/await, subprocess, file operations).
- A background in Full-Stack development, emphasizing both React-based interfaces and robust back-end systems.
- Experience in writing tests (functional and integration, not just executing them).
- Familiarity with Docker containers (running evaluations locally within containers).
- An understanding of CI/CD processes (GitHub Actions as a user: triggers, labels, reading results).
- English proficiency at a B2 level or higher.
Application Process
Apply → Pass qualifications → Join a project → Complete tasks → Get compensated.
Effort Estimate
Tasks for this project are anticipated to require approximately 20 hours to complete, varying by complexity. This is a rough estimate, and you have the flexibility to choose when and how to work. Tasks must be submitted by the deadline and fulfill the specified acceptance criteria to be accepted.
Compensation
Participants in this project can earn up to $30 per hour, dependent on their experience and contribution pace. Compensation varies across projects based on scope, complexity, and required expertise. Please note that different projects on the platform may offer varying earning potential based on their specific requirements.

