Originally posted on RemoteOK · 2 days ago
Expert Talent Pool Feedback and Alignment
Clera
Job description
About the Role
Join a remote expert network as a senior rater and reviewer, evaluating complex AI model outputs and helping calibrate other graders. Your work supports the development of high-quality, trustworthy AI systems across specialized fields.
What You'll Do
• Rank and rate expert-level model answers using detailed rubrics and write clear rationales.
• Evaluate steps in model reasoning across fields such as mathematics, coding, law, medicine, and finance.
• Fact-check complex claims against primary sources and verify accuracy.
• Assess answers against content policies, style guides, and edge cases.
• Review other raters' work, calibrate standards, and develop or refine grading guidelines.
• Assess search relevance and provide feedback in live sessions.
What We're Looking For
• At least 5 years of professional experience in rating, review, editing, fact-checking, trust and safety, or a relevant professional domain.
• Native or near-native written English proficiency.
• Experience grading or reviewing expert-level answers against rubrics, policies, or style guides.
• Experience leading or reviewing other raters, such as as a QA lead, rubric owner, or reviewer of reviewers.
• An advanced degree, professional license, or deep working expertise in the domain you grade.
• Hands-on AI data annotation experience, search-quality rating, or experience writing and maintaining grader guidelines is a plus.
Compensation & Benefits
Compensation is $50 to $120 per hour, depending on the project, field, and expertise level. Payment is based on hours worked.