Mercor opens its Explore page; search for "ML Challenge Task Auditor" to find this role.

ML Challenge Task Auditor
Apply NowReferral link · no cost to you
← Back to all jobs
Get new roles the moment they’re postedTelegramDiscord
MC
MercorDomain Experts

ML Challenge Task Auditor

Remote · US only$70–$90 per hourContract / Freelance

About the Role

Evaluate the quality, correctness, and methodological rigor of applied machine-learning tasks used to train and evaluate a frontier AI lab's models. You'll assess experiment design, model-selection reasoning, and evaluation methodology — and provide clear, rubric-based written feedback. Basic Qualifications • 3+ years hands-on applied/experimental ML (experiment design, model selection, hyperparameter tuning, evaluation methodology) • Strong grasp of data-quality rigor: leakage detection, metric gaming, and train/test/CV hygiene • Proficiency with standard ML frameworks (PyTorch, TensorFlow, scikit-learn, XGBoost) • Ability to critique ML claims against evidence and reproduce results Preferred Qualifications • Competition / benchmark experience (e.g., Kaggle) • Graduate research or publication record in applied ML • Prior task-grading or peer-review experience Note: this role evaluates applied/experimental ML rigor — it is not an LLM-application-building or MLOps role.


Eligibility

Mercor lists this role for residents of the United States.

Similar Opportunities

Recommended AI training and data annotation positions

View all jobs →
Up to $55per hour
SME Careers

Social Media Expert

Remote17 countries onlyContract / FreelanceAdvanced / Expert

2026-10-03
More Domain Expert Jobs