Job Description
Job Description
Engagement Type: Independent Contractor
Work Mode: Remote
Schedule: (1525 hrs/week, flexible up to 40 hrs)
Duration: 13 Months | Immediate
Type: Full-time or Part-time Contract Work
Fluent Language Skills Required:English
Role Overview:
Partners with leading AI teams to improve the quality, usefulness, and reliability of general-purpose conversational AI systems. These systems are used across a wide range of everyday and professional scenarios, and their effectiveness depends on how clearly, accurately, and helpfully they respond to real user questions.
In chemistry-related contexts, conversational AI systems must demonstrate accurate mechanistic reasoning, quantitative precision, and a strong understanding of chemical principles across theoretical and applied settings. This project focuses on evaluating and improving how models reason about, explain, and communicate chemical concepts across foundational and advanced topics.
What Youll Do
-
Write and refine promptsto guide model behavior in chemistry contexts
-
Evaluate LLM-generated responsesto chemistry-related queries for scientific accuracy, mechanistic correctness, and quantitative reasoning
-
Conduct fact-checkingusing authoritative public sources and domain knowledge
-
Annotate model responsesby identifying strengths, areas of improvement, and factual or conceptual inaccuracies
-
Assess clarity, structure, and appropriateness of explanationsfor different audiences
-
Ensuremodel responses align with expected conversational behaviorand system guidelines
-
Apply consistent evaluation standardsby following clear taxonomies, benchmarks, and detailed evaluation guidelines
Who You Are
-
You hold aPhD in Chemistry or a closely related field
-
You have deep expertise inone or more of the following sub-domains:
-
Organic Biological Chemistry
-
Inorganic Materials Chemistry
-
Physical Theoretical Chemistry
-
Analytical Instrumental Chemistry
-
-
You havesignificant experience using large language models(LLMs) and understand how and why people use them
-
You haveexcellent writing skillsand can clearly explain complex chemistry concepts
-
You havestrong attention to detailand consistently notice subtle issues others may overlook
-
Experience reviewing or editing technical or academic writing
Nice-to-Have Specialties
-
Prior experience with RLHF, model evaluation, or data annotation work
-
Experience teaching, mentoring, or explaining chemistry concepts to non-expert audiences
-
Familiarity with evaluation rubrics, benchmarks, or structured review frameworks
What Success Looks Like
-
You identify inaccuracies or weak reasoning in chemistry-related model outputs
-
Your feedback improves the rigor, clarity, and correctness of AI explanations
-
You deliver consistent, reproducible evaluation artifacts that strengthen model performance
-
Customers trust their AI systems in chemistry contexts because youve rigorously evaluated them
Contract and Payment Terms
- You will be engaged as an independent contractor.
- This is a fully remote role that can be completed on your own schedule.
- Projects can be extended, shortened, or concluded early depending on needs and performance.
- Payments are weekly on Stripe or Wise based on services rendered.