C

Expert Talent Pool, Feedback and Alignment (Senior Expert)

Clera

Remote (Worldwide) Remote Software Engineering Posted 8h ago

About this job

About the Role Join a remote expert network as a senior rater and reviewer, evaluating complex AI model outputs and helping calibrate other graders. Your work supports the development of high-quality, trustworthy AI systems across specialized fields. What You'll Do

  • Rank and rate expert-level model answers using detailed rubrics and write clear rationales.
  • Evaluate steps in model reasoning across fields such as mathematics, coding, law, medicine, and finance.
  • Fact-check complex claims against primary sources and verify accuracy.
  • Assess answers against content policies, style guides, and edge cases.
  • Review other raters' work, calibrate standards, and develop or refine grading guidelines.
  • Assess search relevance and provide feedback in live sessions. What We're Looking For
  • At least 5 years of professional experience in rating, review, editing, fact-checking, trust and safety, or a relevant professional domain.
  • Native or near-native written English proficiency.
  • Experience grading or reviewing expert-level answers against rubrics, policies, or style guides.
  • Experience leading or reviewing other raters, such as as a QA lead, rubric owner, or reviewer of reviewers.
  • An advanced degree, professional license, or deep working expertise in the domain you grade.
  • Hands-on AI data annotation experience, search-quality rating, or experience writing and maintaining grader guidelines is a plus. Compensation & Benefits Compensation is $50 to $120 per hour, depending on the project, field, and expertise level. Payment is based on hours worked. Location Fully remote. Projects typically run from one week to several months. Originally posted on Himalayas

This job was collected from Himalayas. You apply on the original posting; TechShilpo is not the employer.

Keep looking

Similar Software Engineering jobs

All →
Dhaka, Bangladesh On-site 🇧🇩 Bangladesh

💼 PositionMERN Stack Developer Intern 📌 Internship Details Duration: 6 Months Salary: Unpaid Internship Working Hours: 9:00 AM –…

Salary: negotiable 8h ago · via LinkedIn

Junior Software Developer (Vista SysTech Limited)

Career Development Center(CDC-DIU)

New
Bangladesh On-site 🇧🇩 Bangladesh

Vista SysTech Limited is seeking a motivated Junior Software Developer to join its development team. The role involves developing…

Salary: negotiable 8h ago · via company site
New
Remote (Anywhere) Remote

About Supabase Supabase is the Postgres development platform, built by developers for developers. We provide a complete backend s…

Salary: negotiable 8h ago · via Jobicy
New
Remote (Worldwide) Remote

Business Development Manager — uPhone uPhone · Fully remote (work from anywhere) · Full-time · Apply to Posted 18 November 2026 ·…

USD 47,400 – 59,400 / annual 8h ago · via Himalayas
Remote (Worldwide) Remote

Workster is an international recruitment agency specializing in connecting businesses with top talent across multiple industries…

Salary: negotiable 8h ago · via Himalayas
New
Remote (Remote job) Remote

Data Architecture & Governance Designs scalable and reusable data architectures to support transversal use across multiple domain…

Salary: negotiable 8h ago · via Arbeitnow