Job Description
Job Description
Engagement Type: Independent Contractor
Work Mode: Fully Remote
Schedule: Flexible (Project-Based)
Role Overview
We partner with leading AI teams to improve the quality, usefulness, and reliability of conversational AI systems.
In chemistry-related contexts, AI systems must demonstrate:
-
Accurate mechanistic reasoning
-
Quantitative precision
-
Strong command of chemical theory and application
This role focuses on evaluating and improving how AI models reason about, explain, and communicate chemistry concepts across foundational and advanced topics.
Key Responsibilities
-
Write and refine prompts to guide AI model behavior in chemistry contexts
-
Evaluate AI-generated responses for:
-
Scientific accuracy
-
Mechanistic correctness
-
Quantitative reasoning
-
-
Conduct fact-checking using authoritative sources and domain expertise
-
Annotate responses by identifying:
-
Strengths
-
Weak reasoning
-
Conceptual inaccuracies
-
-
Assess explanation clarity and structure for different audience levels
-
Ensure responses align with conversational guidelines and evaluation standards
-
Apply structured taxonomies, benchmarks, and detailed review frameworks
Required Qualifications
-
PhD in Chemistry or a closely related field
Deep expertise in one or more of the following domains:
-
Organic Biological Chemistry
-
Inorganic Materials Chemistry
-
Physical Theoretical Chemistry
-
Analytical Instrumental Chemistry
Additional Requirements:
-
Significant experience using large language models (LLMs)
-
Strong understanding of how LLMs are used and where they fail
-
Excellent technical writing and explanation skills
-
Exceptional attention to detail
-
Experience reviewing or editing academic or technical writing
Nice-to-Have Qualifications
-
Experience with RLHF, AI model evaluation, or data annotation
-
Teaching or mentoring experience
-
Familiarity with structured evaluation rubrics or benchmarking systems
What Success Looks Like
-
You identify subtle inaccuracies or weak reasoning in chemistry outputs
-
Your feedback improves scientific rigor and clarity
-
You deliver reproducible evaluation artifacts
-
AI systems become more reliable in chemistry-related applications
Why Join
-
Apply PhD-level expertise to frontier AI development
-
Contribute to high-impact AI research beyond traditional academic roles
-
Flexible schedule with project-based autonomy
-
Competitive compensation aligned with expertise
Contract Payment Terms
-
Independent Contractor engagement
-
Fully remote with flexible working schedule
-
Project-based work (may be extended or concluded based on needs and performance)
-
Weekly payments via Stripe or Wise
-
Unable to support H1-B or STEM OPT candidates at this time