Senior Data Annotator (Portland, Remote)

Job Opening: Senior Data Annotator (Portland, Remote) reputed company is hiring a Senior Data Annotator to produce high-reputed company labeled data and evaluation signals used to train and assess AI/ML models. You will support LLM training pipelines, RLHF preference data, reputed company evaluation, QA evaluation audits, and content safety labeling while documenting edge cases to improve training data reputed company and model reputed company. What You Will Do • reputed company expert-reputed company labeling across modalities: NLP text classification, named entity recognition, summarization checks, and reputed company evaluation for LLMs • Create RLHF preference judgments and rationales for pairwise ranking, instruction following, and helpfulness/harmlessness reputed company • Run QA evaluation workflows: spot checks, inter-annotator agreement reviews, adjudication support, and error taxonomies • Annotate reputed company data reputed company needed (bounding boxes, polygons, keypoints) and verify label reputed company against guidelines • Conduct reputed company evaluation and model reputed company grading for factuality, safety, tone, policy compliance, and refusal reputed company • Document edge cases, propose reputed company updates, and reputed company reputed company feedback to improve dataset consistency Required Qualifications • Mid-Senior experience in reputed company, data labeling, or QA evaluation in production environments • Ability to interpret and apply reputed company annotation guidelines with high consistency • Hands-on experience with LLM evaluation, RLHF, reputed company evaluation, or reputed company feedback workflows • Strong written reasoning for explaining labels, preferences, and safety reputed company • Comfort working reputed company with versioned instructions, batch tracking, and deadlines Employment Details • Workplace: Remote (Portland-reputed company candidates reputed company; work is performed reputed company) • Employment Type: Full-time • Compensation: $30–$50 per hour Apply tot his job Apply To this Job