Work Location: Paris, France (onsite)
Engagement Model: Part-time employment
Weekly Workload: 24 hours per week (can be up to 35 hours based on the project needs)
Estimated Start: September 2026
DataForce is seeking Software Engineers skilled in Python to join our team as Coding Annotators to support the development and evaluation of advanced AI models. This role focuses on creating high-quality coding prompts and answers, benchmarking model performance, and identifying failure cases across internal and competitor models. Candidates will contribute to building realistic evaluation environments and supporting reinforcement learning workflows.
Role Summary:
The Coding Annotator will be responsible for creating programming prompts and reference solutions aligned with industry benchmarks, such as SWE-Bench and Terminal-Bench. The role involves testing model outputs to identify failures.
The annotator will also support reinforcement learning workflows by building and maintaining coding environments and executing coding-specific validation checks. This role focuses on domain-specific evaluation, benchmarking, and technical analysis to surface model limitations and performance insights.
Key Responsibilities:
Create high-quality coding prompts and reference solutions aligned with industry benchmarks such as SWE-Bench and Terminal-Bench.
Develop prompts focused on code refactoring, code generation, and problem-solving scenarios.
Evaluate model outputs to identify errors, limitations, and failure patterns in reasoning, correctness, and execution.
Design and maintain coding environments used for evaluation and reinforcement learning (RL) pipelines.
Execute coding-specific validation checks using established criteria and tools provided by other annotation teams.
Document findings, evaluation results, and insights to support model improvement and training strategies.
Perform detailed code reviews and annotations for accuracy and compliance.
Work with Python and front-end technologies (JavaScript, TypeScript); potentially with Java, too.
Execute repetitive tasks with precision and maintain high standards of quality.
Collaborate with cross-functional teams to improve code quality and documentation.
Job Requirements:
Strong proficiency in Python and front-end languages (JavaScript, TypeScript).
Experience with Java is a plus.
Demonstrated experience in code review and quality assurance.
Ability to handle repetitive tasks with attention to detail.
3+ years of work experience in related field.
Excellent written and verbal communication skills in English.
Education:
Bachelor's degree in Computer Science, Software Engineering, Computer Engineering, or a closely related technical field is required.
DataForce by TransPerfect is part of the TransPerfect family of companies, the world's largest provider of language and technology solutions for global business, with offices in more than 100 cities worldwide.
We offer high-quality data for Human-Machine Interaction to some of the most prestigious technology companies in the world. Our department focuses on gathering, enriching and processing data for Machine Learning in different AI domains.
To learn more about DataForce please visit us at https://www.transperfect.com/dataforce
Coder with Python knowledge - Paris • Paris, Île-de-France, France
En tant que partie intégrante du service informatique Pre-Trade, l’équipe Commando est responsable du développement et du support de tous les outils de PnL, d’analyse du risque et des pricers pour ... Voir plus
OverviewPython Developer – SaaS (Remote, UK or France).Full-time | Permanent | Remote (UK or France).Our client is a global leader in B2B SaaS Solutions.Their AI-driven data and analytics platforms... Voir plus
Senior Software Engineer with expertise in Vue.Js and Python to design, develop, and deploy new features, contribute to technical workflow optimization, and ensure product quality in a fast-paced A... Voir plus
Join Cafeyn: Where Innovation Meets Inspiration.Cafeyn is more than a platform— it is transforming the way people access and experience content.Since 2006, we’ve grown in a fast-evolving market, ad... Voir plus
Ingénieur développement C# et Python recherché pour travailler sur les produits ETF en Market Making.Mission : optimiser les outils de cotation et d'ajustement en temps réel. Voir plus
This position is based in New York, and relocation is mandatory.We are open to French nationals who are willing to relocate and for whom we can sponsor a work visa.Remote work from France is not po... Voir plus
We are looking for python software engineer for permanent position in Paris.Collaborate with cross-functional teams to define data harmonization & transformation requirements.Design, develop, and ... Voir plus
La société :Fond gérant plus 10 milliards dollars.Les 450 collaborateurs sont répartis dans les bureaux en plein centre de Paris ainsi qu’à Londres, Hong Kong et New York.En croissance permanente, ... Voir plus
Our client is looking for Python software developer for a permanent position in France (Paris or other location).Their solution, hosted on Azure, leverages services such as Azure Web App, Storage A... Voir plus
Senior Python Engineer needed for project-based AI opportunities focusing on functional testing.Requires strong Python, Linux, Docker skills, and experience with LLMs for development acceleration. Voir plus
Ingénieur logiciel expérimenté en Python, rejoignant une entreprise leader dans la sécurité du code pour travailler sur l'IA, la performance et la scalabilité de nouveaux produits SaaS. Voir plus
Développeur backend ou fullstack expérimenté en Python pour une entreprise de sécurité du code.Vous travaillerez sur des problèmes de scalabilité et participerez au développement de fonctionnalités. Voir plus
Consultant Développeur Senior Python & IA H/F.Le Groupe Noveo, acteur majeur dans le développement de solutions innovantes, accompagne ses Clients Grands Comptes, PME et Startups dans la transforma... Voir plus
Java Multithreading Developer - Investment Banking - New York CityJava Multithreading Developer - Investment Banking - New York CityWith over 7,000 experts in 20 countries, Talan is a global consul... Voir plus
Inside est apporteur de solutions, de services et de valeurs auprès des entreprises et DSI pour une transformation digitale agile.Ops et infra- Accompagnement et pilotage de projets IT- Digital & D... Voir plus
Développeur backend recherché pour travailler sur des projets de scalabilité et de nouvelles fonctionnalités. Voir plus
The Fixed Income Algo Technology team in EMEA supports Citi’s market making, algorithmic trading, and internal matching for the EMEA Business.We’re seeking to hire an AVP level candidate to advance... Voir plus
Seeking a Senior Software Engineer to design, build, and maintain core APIs and connectors for financial data aggregation.Responsibilities include developing scalable backend services using Python/... Voir plus
Seeking a Senior Python Engineer for AI testing and Docker environment management.Requires 5+ years of experience, strong Python/Docker skills, and ability to work remotely. Voir plus
Localisation :MontreuilTélétravail :2,5 jours par semaineSalaire :60 000 € – 70 000 € / anType :CDIContexteAu sein de la Squad DevOps, composée de 40 développeur·se·s Python et transverse à une diz... Voir plus
){kind=logo}
){kind=logo}
