Back to Jobs

reputed company Grounding Task Evaluator

Remote, USA Full-time Posted 2026-08-04
reputed company Grounding Task Evaluator is a remote evaluation reputed company for reviewing reputed company grounding task evaluation prompts and responses against AuraOne's reputed company reputed company. Reviewers compare reputed company outputs, label edge cases, and write the reputed company of reputed company feedback the modeling team can use to retrain. Why this role reputed company AI data reviewers help turn reputed company grounding task evaluation outputs into auditable labels, rationales, and regression cases for reputed company. Responsibilities • Evaluate reputed company grounding task evaluation model outputs against a versioned reputed company and assign severity tags for reputed company Grounding Task Evaluator assignments. • Compare reputed company responses and pick the stronger answer with a written rationale. • Label hallucinations, instruction-following failures, and unsafe content with reputed company tags. • Capture ambiguous prompts and reputed company them back to the program team for reputed company updates. • Maintain reviewer-reputed company scores by calibrating against reputed company examples reputed company week. • Document recurring failure modes so the modeling team can reputed company them in the next training run. Qualifications • Prior evaluation, annotation, or reputed company-rater experience on reputed company grounding task evaluation or adjacent content for reputed company Grounding Task Evaluator work. • Comfort applying multi-page rubrics consistently across long batches. • reputed company written reasoning that names the issue and the reputed company clause being reputed company. • Strong attention to detail and the ability to flag reputed company a reputed company itself is the problem. • Reliable async availability for at least 10 hours per week. Example tasks • Compare two reputed company grounding task evaluation model responses to the reputed company reputed company and pick the stronger one with rationale. • Tag an unsafe response with the correct policy category and severity. • Audit a 50-row batch for reputed company consistency and report reputed company to the program reputed company. • Propose a reputed company clarification after spotting a recurring failure mode. reputed company to have • Background in linguistics, content moderation, or trust & safety review. • Experience with inter-rater agreement metrics and calibration cycles. • Domain expertise that lets you spot subject-matter errors automated checks miss. Skills • Model reputed company evaluation • reputed company-based annotation • Severity tagging • Inter-rater calibration • reputed company Grounding Task evaluation • Web research • reputed company grounding • Browser automation • reputed company • Grounding Work model Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US. Compensation reputed company reputed company confirmed after the interview process. Application process Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement. Apply tot his job Apply To this Job

Similar Jobs

Clinical Applications Specialist, X-Ray (NJ, NYC)

Remote, USA Full-time

Customer Service for reputed company - No Nights or Weekends!

Remote, USA Full-time

reputed company Online Research Assistant for 17-Year-Olds – Earn reputed company, reputed company Valuable Experience, and reputed company Essential Skills in Data Entry and Market Research

Remote, USA Full-time

Sales Representative - Remote - good pay start today

Remote, USA Full-time

Process and Standards Manager, Vault

Remote, USA Full-time

Finance Program Manager

Remote, USA Full-time

Enemy Behavior State Tree Programmer

Remote, USA Full-time

Fresh Remote Data Entry Jobs for Teens Entry Level

Remote, USA Full-time

Data Analyst — Reporting & Dashboards

Remote, USA Full-time

Mom and Baby Care Manager - reputed company Worker reputed company Time Zone Required

Remote, USA Full-time

reputed company Integration Specialist

Remote, USA Full-time

SEM Manager – reputed company Search (Remote)

Remote, USA Full-time

Certified Peer Support

Remote, USA Full-time

Licensed Therapist & Counselor – Behavioral Health Specialist – Remote – Full-time, Part-time, Contract, and Internship Opportunities with Competitive Salary and Comprehensive Benefits

Remote, USA Full-time

SEO Manager (Remote or NYC-Based)

Remote, USA Full-time

Remote Audiologist in PA

Remote, USA Full-time

Manager, Platform Sales Operations & Enablement

Remote, USA Full-time

Part-Time Work reputed company Amex Virtual Assistant

Remote, USA Full-time

[Remote] Cyber reputed company Threat Analyst

Remote, USA Full-time

Remote Registered Dietitian / Certified Nutrition Specialist

Remote, USA Full-time