Content Moderator | Up to $40/hr Rate

<strong>About The Job<br><br></strong><strong>Mercor</strong> connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include <strong>Benchmark</strong>, <strong>General Catalyst</strong>, <strong>Peter Thiel</strong>, <strong>Adam D'Angelo</strong>, <strong>Larry Summers</strong>, and <strong>Jack Dorsey</strong>.<br><br><strong>Position:</strong> AI Model Evaluator<br><br><strong>Type:</strong> <strong>Full-time or Part-time Contract Work<br><br></strong><strong>Compensation:</strong> <strong>$41/hour<br><br></strong><strong>Location:</strong> <strong>Geography restricted to Israel, USA<br><br></strong><strong>Role Responsibilities<br><br></strong><ul><li>Evaluate LLM-generated responses for effectiveness in answering user queries.</li><li>Conduct fact-checking using trusted public sources and external tools.</li><li>Generate high-quality human evaluation data by annotating response strengths, areas for improvement, and factual inaccuracies.</li><li>Assess reasoning quality, clarity, tone, and completeness of responses.</li><li>Ensure model responses align with expected conversational behavior and system guidelines.</li><li>Apply consistent annotations by following clear taxonomies, benchmarks, and detailed evaluation guidelines.<br><br></li></ul><strong>Qualifications<br><br></strong><strong>Must-Have<br><br></strong><ul><li>Bachelor’s degree</li><li>Native speaker or ILR 5/primary fluency (C2 on the CEFR scale) in Hebrew</li><li>Significant experience using large language models (LLMs)</li><li>Excellent writing skills</li><li>Strong attention to detail</li><li>Adaptable across topics, domains, and customer requirements</li><li>Background in domains requiring structured analytical thinking</li><li>Excellent college-level mathematics skills<br><br></li></ul><strong>Preferred<br><br></strong><ul><li>Experience with RLHF, model evaluation, or data annotation work</li><li>Experience writing or editing high-quality written content</li><li>Experience comparing multiple outputs and making fine-grained qualitative judgments</li><li>Familiarity with evaluation rubrics, benchmarks, or quality scoring systems<br><br></li></ul><strong>Compensation & Legal<br><br></strong><ul><li>Hourly contractor</li><li>Paid weekly via Stripe Connect<br><br></li></ul><strong>Application Process (Takes 20–30 mins to complete)<br><br></strong><ul><li>Upload resume</li><li>AI interview based on your resume</li><li>Submit form<br><br></li></ul><strong>Resources & Support<br><br></strong><ul><li>For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome</li><li>For any help or support, reach out to: support@mercor.com<br><br></li></ul><em>PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.<br><br></em>,<br><br>