Search

Remote | Bilingual Korean Generalist Evaluator Expert -- Up to $30/hr

24-MAG
locationSan Francisco, CA, USA
PublishedPublished: 6/14/2022
Full Time

Job Description

Job Description

We are sharing a specialised remote opportunity for Bilingual Korean Evaluator Experts with strong writing and analytical skills. This role supports a leading AI research lab by contributing to projects that train and evaluate advanced language models.

Experts will create and evaluate Korean and English prompt–answer pairs, ensuring linguistic accuracy, cultural relevance, and natural phrasing aligned with language conventions used in South Korea.

Key Responsibilities

Design and develop Korean and English prompts with structured instructions
Create high-quality prompt–golden answer pairs for AI model evaluation
Define evaluation standards and develop detailed grading rubrics
Review AI-generated responses for accuracy, fluency, and cultural relevance
Compare Korean and English outputs to ensure consistency and clarity
Support benchmarking and quality assurance for Korean-language AI evaluation tasks

Ideal Profile

Strong candidates may have:

Native-level written fluency in Korean
Strong English reading and writing proficiency
Bachelors degree from a reputable institution (completed or in progress)
Strong writing, analytical thinking, and critical reasoning skills
Familiarity with ChatGPT or similar AI tools in personal or professional contexts
Deep understanding of Korean language usage and cultural context
Ability to work independently and meet deadlines

Preferred qualifications:

Experience in teaching, research, editing, or academic writing
Experience designing evaluation criteria, grading rubrics, or review frameworks
Familiarity with LLM prompting or model evaluation workflows

Why This Opportunity

Contribute to frontier AI research in multilingual language models
Help improve how AI systems understand Korean language and cultural nuance
Work on high-impact evaluation tasks for advanced AI systems
Flexible remote work with competitive compensation

Contract Details

Independent contractor role
Fully remote with flexible scheduling
Expected commitment: minimum 20 hours per week
Project duration: approximately 2+ months
Weekly payments via Stripe or Wise
Projects may be extended depending on performance and project needs

About the Platform

This opportunity is available through a leading AI-driven work platform.

Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...