Job Description
Job DescriptionRemote AI Trainer, Data Science
Contract | Part-Time or Full-Time | 100% Remote
Location: Open to applicants based in the United States or Canada
Pay: $40–$125 per hour (USD), based on experience and qualifications
Put your data science judgment to work on the future of AI
We’re looking for experienced data scientists to test how well advanced AI models handle real data science work. That means messy-data analysis, experiment design, model validation, and SQL/Python development. You’ll design realistic tasks from your own experience and grade the AI’s output against the standard you’d hold a colleague to.
The work is fully remote and self-directed. Clear written reasoning matters as much as technical depth.
What You’ll Do
- Design realistic tasks drawn from your own work, such as exploratory analyses, A/B test readouts, model validation, SQL pipelines, and forecasts. Each task includes prompts and supporting files like datasets, schemas, notebooks, and stakeholder briefs.
- Put frontier AI models to the test by running your tasks and evaluating the analyses, code, models, and write-ups they produce against a professional standard.
- Compare outputs head to head, decide which model performed better, and document where each one fell short.
- Write detailed grading rubrics and tests that define what a correct deliverable must include, with written pass/fail justifications.
- Call out concrete failures with evidence, including data leakage, confounding, incorrect joins, misapplied tests, and off-brief interpretations.
- Review and refine tasks built by other experts.
What You Bring
- 2+ years of applied data science experience preferred (analytics, ML, statistical modeling, experimentation, or analysis-adjacent data engineering). Undergraduate study doesn’t count, but strong practical work can offset less experience.
- Current or recent hands-on experience as an individual contributor
- A bachelor’s degree in a quantitative field, completed or in progress. An advanced degree is a plus but not required.
- Working proficiency in Python and/or SQL
- Depth in at least one area: business analytics/BI, applied ML, statistics and experimentation, forecasting, data engineering, or applied NLP/computer vision
- Experience owning a multi-step analysis end-to-end, from raw data to a decision
- The ability to judge whether results are valid (leakage, confounding, selection effects, multiple testing, power) and explain them in business or scientific terms
- Familiarity with AI/LLM tools and a sharp eye for answers that sound right but aren’t
- Full professional or native-level English with strong written communication
- Strong attention to detail, comfort with ambiguity, and the ability to work independently from written instructions
Why You’ll Like It
- Competitive pay: $40–$125/hour, paid via PayPal on a regular schedule
- Work your way: Fully remote with flexible scheduling and multi-day task timers
- Hours that scale with you: 10-hour weekly minimum, with full-time hours available
- Tools on us: Free access to leading AI platforms
- Paid at every completed stage, including training and task proposals
- Support and growth: Onboarding materials, a dedicated Slack channel, office hours, expert feedback, and a path into reviewer roles
How to Get Started
- Apply and we’ll review your resume.
- Take the assessment. If your experience is a good fit, we’ll send you a link to an unpaid assessment (about 2–4 hours). All work must be your own, and AI-assisted submissions are rejected.
- Onboard and train. Pass the assessment, then complete onboarding and a short paid training project.
- Propose a task from your own experience and get expert feedback.
- Build and test. Once your proposal is accepted, build the full task and test it against frontier models.
Each stage has to be accepted before you move on, and revisions are a normal part of the process.
Ready to show what AI still can’t do? Apply now.