Math Reasoning RLHF Annotator
Apply NowReferral link · no cost to you
← Back to all jobs
Get new roles the moment they’re postedTelegramDiscord
CL
Claru.aiAI Training & Evaluation

Math Reasoning RLHF Annotator

Remote$35–$55 per hourContract / Freelance

About the Role

You'll spend your time evaluating model-generated solutions to math problems — ranging from algebra and calculus to combinatorics and proof-based reasoning. Your core task is to compare two or more responses side by side, rank them by correctness and clarity, and flag specific reasoning errors (wrong setup, arithmetic mistakes, skipped logical steps) using a structured rubric. You won't just say "this one is better" — you'll annotate exactly where and why. The workflow runs inside a browser-based annotation tool. Each task presents a problem statement and two to four model responses. You'll read each solution, verify the math independently, score it across dimensions like factual accuracy, step completeness, and explanation quality, then submit a ranked preference with written rationale. Tasks average 8–15 minutes each depending on problem complexity. You'll work asynchronously across flexible hours with a weekly throughput target. Strong candidates hold at least an undergraduate background in math, engineering, physics, or a related quantitative field. You should be comfortable doing manual verification — not just pattern-matching for "looks right." Familiarity with LaTeX notation is a plus since many prompts and responses are rendered that way. You won't need to write code, but you will need to show your own working when the rubric asks for it. Skills: Mathematical reasoning, Step-by-step solution verification, Preference ranking, Rubric-based annotation, LaTeX reading comprehension, Error classification.


Eligibility

Not open to residents of: Afghanistan, Belarus, Central African Republic, Côte d'Ivoire, Cuba, Democratic Republic of the Congo, Ghana, Haiti, Iran, Iraq, Libya, Mali, Myanmar (Burma), Nicaragua, Nigeria, North Korea, Pakistan, Russia, Somalia, South Sudan, Sudan, Syria, Venezuela, Yemen, Zimbabwe, and the regions of Crimea, Donetsk and Luhansk.

Similar Opportunities

Recommended AI training and data annotation positions

View all jobs →
Up to $15per hour
SME CareersFeatured

PowerPoint Specialist

RemoteBangladesh, India & Pakistan onlyContract / FreelanceAdvanced / Expert

1w ago
Up to $51per hour
SME Careers

Senior Video Editor

Remote28 countries onlyContract / FreelanceAdvanced / Expert

3w ago
More AI Training and Evaluation Jobs