ML Evaluation Designer - Expert - AI Trainer
M
Mercor
📍 Austin, Texas, United States
Job Description
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Code-Data Eval Author — Machine Learning Engineer
Type: Contract
Compensation: $45–$140/hour
Location: Remote
Commitment: 30+ hours/week
Role Responsibilities
- Design ML/LLM evaluation tasks, rubrics, and metrics to enhance model performance.
- Grade model/agent outputs and improve evaluation quality through thorough review.
- Apply training-side judgment...