ML Challenge Task Auditor - Remote | $70-$90/hr

[u/mkithan]

Remote | United States | Hourly Contract | Mercor

Mercor is seeking experienced applied ML professionals to audit machine-learning challenges used to train and evaluate frontier AI models.

The focus is on experiment quality, methodological rigor, and whether results are genuinely supported by evidence.

What You'll Review:

• Experiment design, model selection, and evaluation methodology
• Data leakage, metric gaming, and train/test/CV hygiene
• ML claims against experimental evidence
• Reproducibility and technical correctness
• Task quality using clear, rubric-based feedback

Ideal Background:

• 3+ years of hands-on applied or experimental ML experience
• Strong understanding of model evaluation and experiment design
• Experience with PyTorch, TensorFlow, scikit-learn, or XGBoost
• Ability to reproduce results and identify methodological weaknesses
• Strong written communication and critical reasoning

A Plus:

• Kaggle or other competition/benchmark experience
• Graduate research or publications in applied ML
• Previous grading, auditing, or peer-review experience

Important: This role focuses on applied/experimental ML evaluation, not LLM application development or MLOps.

Pay: $70-$90/hr
Location: United States
Type: Hourly contract

APPLY HERE - https://t.mercor.com/Geg5X

[u/AutoModerator]

Thanks for sharing your job post! To keep this community readable for humans, we kindly request that each recruiter only post once per day and group your jobs into one text post. You can only also post your jobs in the "Who's Hiring" post. Please apply the correct "Hiring" flair and start your post with "[Hiring]" for clarity.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.