LLM Response Evaluator & Data Annotator

Mercor

📍 Johor Bahru, Johor, Malaysia

Full-time Human Resources Posted February 28, 2026

Job Description

A leading technology firm is seeking a General Chat Behavior Evaluator to evaluate language model responses for effectiveness and quality. The ideal candidate will have a Bachelor’s degree, be a native or fluent Mandarin speaker, and have substantial experience with large language models. This role requires attention to detail, adaptability across topics, and strong analytical skills. It offers competitive compensation at $36/hour, with responsibilities including evaluating responses and fact-checking them against reliable sources.
#J-18808-Ljbffr