Please submit your CV in English and indicate your level of English proficiency.
Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based, not permanent employment.
What this opportunity involves
We're building a dataset to evaluate AI coding agents - how well a model handles real-world developer tasks.
You'll create challenging tasks and evaluation criteria within realistic simulated environments:
What this is NOT
What we look for
Why this is hard
Frontier models are already good at coding. Creating a task that genuinely challenges the best models is non-trivial. You need to deeply understand where models fail and what scenarios reveal the difference between a good and a bad solution. Tasks have many valid solutions - writing tests that accept all correct solutions and reject incorrect ones is harder than it sounds.
How it works
Apply → Pass qualification(s) → Join a project → Complete tasks → Get paid
Effort estimate
Tasks for this project are estimated to take 20 hours to complete, depending on complexity. This is an estimate and not a schedule requirement; you choose when and how to work. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.
Compensation
Up to $50/hr equivalent, depending on level and pace. Tasks are estimated at ~20 hours each; you set your own schedule.
Freelance Agent Evaluation Engineer • Paris, Île-de-France, FR
Devoteam M Cloud recrute un AI Engineer avec au moins 4 ans d'expérience pour concevoir des solutions GenAI basées sur Azure, intégrant LLM, RAG et LLMOps.Vous travaillerez sur des architecture... Voir plus
Overview /h3pOctopus Energy is a global energy leader revolutionizing the way people use energy.We are a tech company building a cleaner, smarter energy future.The Global Energy Markets team ensure... Voir plus
Ingénieur Site Reliability recherché pour analyser les dysfonctionnements, développer le code Infra As Code, assurer le monitoring et collaborer avec les équipes. Voir plus
About AnthropicAnthropic’s mission is to create reliable, interpretable, and steerable AI systems.We want AI to be safe and beneficial for our users and for society as a whole.Our team is a quickly... Voir plus
Un(e) ingénieur(e) logiciel full-stack senior recherché(e) pour un contrat freelance.Développement de produit, collaboration avec le CTO, et opportunité d'embauche possible. Voir plus
As a subsidiary of SEALSQ CORP (NASDAQ: LAES), based in Grenoble and Toulouse, IC’Alps designs analog and digital integrated circuits (“ASIC-Application Specific Integrated Circuit”) for medical ap... Voir plus
Mission /h3 pEn tant que bSenior MLOps Engineer /b, vous intervenez comme expert technique de haut niveau auprès de nos clients internes et externes.Vous évoluez dans des environnements technologiq... Voir plus
Headquartered in San Francisco, our investors include.Internet-Native Bilingual Evaluator Expert (French).Analyse content from French- and English-speaking online communities to identify errors inv... Voir plus
A leading machinery manufacturing company seeks a Technical Sales Engineer to drive commercial development in the French market.You will manage relationships with pharmaceutical clients, identifyin... Voir plus
Research Engineer in digital solutions for product quality managementJoin to apply for theResearch Engineer in digital solutions for product quality managementrole atArcelorMittal Long Carbon LATAM... Voir plus
Une société de solutions logistiques recherche un Responsable Approvisionnement à Toulouse.Ce poste implique la gestion d'un portefeuille de fournisseurs complexes, le suivi de leurs performanc... Voir plus
About LenstraLenstra was founded by engineers with a passion for Computer Science and a track record of delivering high-quality solutions.We work at the intersection of Cloud Computing, DevOps, Dat... Voir plus
Notre missionbr/Chez Doctrine, nous nous engageons depuis 2016 pour un enjeu démocratique majeur : rendre le droit plus accessible.Nous sommes la première plateforme d’IA juridique qui permet aux a... Voir plus
Capital Fund Management (CFM) is a leader in applying quantitative techniques to the financial markets.We are committed to innovation and this role will participate in developing sophisticated AI-d... Voir plus
A leading defense technology company in Paris is seeking a Machine Learning Engineer to join their Semantic Scene Understanding team.You will develop state-of-the-art algorithms for tasks such as s... Voir plus
Be among the first 25 applicantsLysk is a VC-backed European defence startup.Our mission is to create modern software tailored for hostile environments.We’re assembling a world-class team at the in... Voir plus
Job Description Airbus Defence and Space is looking for an AI Decision Making Research Engineer (f/m) to join our Technology labs team based in Boulogne-Billancourt (Paris), France.As an expert in ... Voir plus
About LumosLumos is a health and life-science AI evaluation company based in San Francisco.Our mission is to make health and life-science AI genuinely accurate and safe.We build the benchmarks, RL ... Voir plus
Frontend Engineer - Advanced AI Systems /h3 pWe are partnered with a cutting-edge AI safety startup that is building the foundational reliability and optimization layer for advanced AI systems capa... Voir plus
Votre mission /h3pEn tant que Senior MLOps Engineer, vous intervenez comme expert technique de haut niveau auprès de nos clients internes et externes.Vous évoluez dans des environnements technologi... Voir plus
){kind=logo}
