Work Location: Paris, France (onsite)
Engagement Model: Part-time employment
Weekly Workload: 24 hours per week (can be up to 35 hours based on the project needs)
Estimated Start: September 2026
DataForce is seeking Software Engineers skilled in Python to join our team as Coding Annotators to support the development and evaluation of advanced AI models. This role focuses on creating high-quality coding prompts and answers, benchmarking model performance, and identifying failure cases across internal and competitor models. Candidates will contribute to building realistic evaluation environments and supporting reinforcement learning workflows.
Role Summary:
The Coding Annotator will be responsible for creating programming prompts and reference solutions aligned with industry benchmarks, such as SWE-Bench and Terminal-Bench. The role involves testing model outputs to identify failures.
The annotator will also support reinforcement learning workflows by building and maintaining coding environments and executing coding-specific validation checks. This role focuses on domain-specific evaluation, benchmarking, and technical analysis to surface model limitations and performance insights.
Key Responsibilities:
Create high-quality coding prompts and reference solutions aligned with industry benchmarks such as SWE-Bench and Terminal-Bench.
Develop prompts focused on code refactoring, code generation, and problem-solving scenarios.
Evaluate model outputs to identify errors, limitations, and failure patterns in reasoning, correctness, and execution.
Design and maintain coding environments used for evaluation and reinforcement learning (RL) pipelines.
Execute coding-specific validation checks using established criteria and tools provided by other annotation teams.
Document findings, evaluation results, and insights to support model improvement and training strategies.
Perform detailed code reviews and annotations for accuracy and compliance.
Work with Python and front-end technologies (JavaScript, TypeScript); potentially with Java, too.
Execute repetitive tasks with precision and maintain high standards of quality.
Collaborate with cross-functional teams to improve code quality and documentation.
Job Requirements:
Strong proficiency in Python and front-end languages (JavaScript, TypeScript).
Experience with Java is a plus.
Demonstrated experience in code review and quality assurance.
Ability to handle repetitive tasks with attention to detail.
3+ years of work experience in related field.
Excellent written and verbal communication skills in English.
Education:
Bachelor's degree in Computer Science, Software Engineering, Computer Engineering, or a closely related technical field is required.
DataForce by TransPerfect is part of the TransPerfect family of companies, the world's largest provider of language and technology solutions for global business, with offices in more than 100 cities worldwide.
We offer high-quality data for Human-Machine Interaction to some of the most prestigious technology companies in the world. Our department focuses on gathering, enriching and processing data for Machine Learning in different AI domains.
To learn more about DataForce please visit us at https://www.transperfect.com/dataforce
Coder with Python knowledge - Paris • Paris, Île-de-France, France
En tant que partie intégrante du service informatique Pre-Trade, l’équipe Commando est responsable du développement et du support de tous les outils de PnL, d’analyse du risque et des pricers pour ... Voir plus
Develops and enhances AI-powered SaaS features, collaborating with teams to build data-driven solutions and ensure system reliability. Voir plus
Since 2015, papernest has been transforming the way people manage their contracts, making subscription, management, and switching simple through one smart, intuitive platform.We have supported more... Voir plus
Join Cafeyn: Where Innovation Meets Inspiration.Cafeyn is more than a platform— it is transforming the way people access and experience content.Since 2006, we’ve grown in a fast-evolving market, ad... Voir plus
Ingénieur développement C# et Python recherché pour travailler sur les produits ETF en Market Making.Mission : optimiser les outils de cotation et d'ajustement en temps réel. Voir plus
Seeking a Python Developer for a remote, full-time role to build and maintain backend services and APIs.Responsibilities include product engineering and ML integration. Voir plus
We are looking for python software engineer for permanent position in Paris.Collaborate with cross-functional teams to define data harmonization & transformation requirements.Design, develop, and ... Voir plus
Senior Software Engineer role to design and maintain APIs and connectors for financial data aggregation using Python and/or Go. Voir plus
Ingénieur logiciel expérimenté en Python, rejoignant une entreprise leader dans la sécurité du code pour travailler sur l'IA, la performance et la scalabilité de nouveaux produits SaaS. Voir plus
Développeur backend ou fullstack expérimenté en Python pour une entreprise de sécurité du code.Vous travaillerez sur des problèmes de scalabilité et participerez au développement de fonctionnalités. Voir plus
Senior Software Engineer with expertise in Vue.Js and Python to design, develop, and deploy new features, contribute to technical workflow optimization, and ensure product quality in a fast-paced A... Voir plus
Seeking a Senior Software Engineer with VueJS and Python expertise for a cybersecurity firm in Paris.Responsibilities include feature design, performance maintenance, and workflow optimization in a... Voir plus
Consultant Développeur Senior Python & IA H/F.Le Groupe Noveo, acteur majeur dans le développement de solutions innovantes, accompagne ses Clients Grands Comptes, PME et Startups dans la transforma... Voir plus
Développeur backend recherché pour travailler sur des projets de scalabilité et de nouvelles fonctionnalités. Voir plus
Développeur Python recherché pour développer et maintenir des applications backend, avec une appétence pour DevOps et l'industrialisation des environnements. Voir plus
Develop and maintain AI-powered solutions.Requires 5+ years of experience in software engineering, strong skills in Python and React, and fluency in English and French. Voir plus
Ingénieur logiciel spécialisé en Python, responsable de l'évaluation, du test et de la validation de produits liés aux smartcards, ainsi que du développement de nouveaux projets et de la format... Voir plus
Seeking a Senior Python Engineer for AI testing and Docker environment management.Requires 5+ years of experience, strong Python/Docker skills, and ability to work remotely. Voir plus
Depuis 2018, Murfy s’engage pour que.Entreprise Solidaire d’Utilité Sociale (ESUS) depuis 2022.Nos techniciens — tous salariés — interviennent partout en France et ont réparé plus de 90 000 apparei... Voir plus
Senior Software Engineer to design and manage scalable software for cloud-based solutions, focusing on security and collaboration. Voir plus
){kind=logo}
