Job Description
Job Description
Title: French AI Data Trainer - Remote
Location: Remote
Role Overview
We are seeking a detail-oriented and analytically strong AI Safety Trust Evaluation Specialist to support the development of safer, more reliable AI systems. In this fully remote, hourly contractor role, you will evaluate AI-generated responses, assess reasoning quality, and provide expert safety-focused annotations in both French and English.
Your work will directly contribute to improving the safety alignment of large language models by identifying risks, labeling sensitive content, and ensuring outputs comply with strict safety policies. This includes exposure to sensitive material, and requires strong emotional resilience and professional judgment.
Key Responsibilities
- Evaluate AI-generated content for accuracy, safety, and policy compliance
- Annotate and label safety-critical datasets in English and French with high linguistic precision
- Identify unsafe outputs related to:
- Hate and harassment
- Sexual content
- Violence and self-harm
- Bias and misinformation
- Illegal or harmful activities
- Malicious content or code
- Compare multiple AI responses and score them based on safety and quality rubrics
- Identify model failure patterns such as evasion, escalation, or unsafe normalization
- Conduct red-teaming and adversarial testing to uncover model vulnerabilities
- Document findings clearly, including reasoning behind safety judgments
- Support refinement of annotation guidelines and edge-case decision frameworks
- Ensure consistency in policy interpretation across evaluations
Required Qualifications
- Bachelors degree or equivalent experience in Linguistics, Communications, Psychology, Law, Policy, Security Studies, or related field
- Native or near-native French proficiency (reading and writing)
- Minimum C1 English proficiency (reading and writing)
- Experience in Trust Safety, content moderation, policy enforcement, risk operations, or safety evaluation
- Proven LLM red teaming experience (ability to test model safety boundaries and document findings)
- Strong analytical judgment and ability to work with ambiguous policy situations
- High attention to detail and ability to explain decisions clearly and consistently
- Comfortable working independently in a remote contractor setup
Preferred Qualifications
- Prior experience in AI training data, annotation, or model evaluation
- Familiarity with tools such as ChatGPT, Gemini, Perplexity, or similar AI systems
- Experience working with structured safety taxonomies or labeling frameworks
- Background in investigative or policy-driven analytical roles