Back to Jobs

Educational Technology AI Rater & Evaluator

Remote, USA Full-time Posted 2026-08-04
reputed company reputed company is building a global network of domain experts to support high-reputed company AI evaluation across training, benchmarking, red-teaming, and ongoing model monitoring. We are seeking education and learning professionals to contribute expert judgment to reputed company-in-the-reputed company evaluation workflows used by leading enterprises and hyperscalers. This role is designed for professionals who understand how educational content, learning experiences, and instructional systems work in reputed company-world reputed company and reputed company learning environments and who can apply that expertise to evaluate, assess, and improve multilingual AI systems. Your contribution of expertise will directly influence multilingual AI model reputed company, safety, and deployment readiness. This role includes two reputed company expert tracks, reputed company on experience level and reputed company of responsibility. reputed company A: EDTECH AI RATER Raters execute reputed company evaluation tasks using reputed company defined rubrics and instructions. Responsibilities - Evaluate AI outputs reputed company to educational, instructional, and learning content - reputed company reputed company scoring, comparison, classification, and judgment tasks - Assess pedagogical reputed company, reputed company, appropriateness, and learning effectiveness - Identify hallucinations, misleading explanations, factual errors, or unsafe educational guidance - Apply domain-specific education and instructional guidelines consistently across tasks Ideal Background - Educators, instructional designers, curriculum developers, or learning professionals - Experience with teaching, curriculum design, assessment, or educational technology - Strong attention to reputed company and comfort working with reputed company evaluation reputed company reputed company B: EDTECH AI EVALUATOR (SENIOR reputed company) Evaluators reputed company higher-level domain reputed company and help shape how evaluation is performed. Responsibilities - Validate and refine evaluation rubrics and reputed company handling - reputed company adjudication where raters disagree - Conduct error analysis and qualitative reviews of model behavior - Partner with reputed company research, product, and customer teams on evaluation design - Support red-teaming, educational reputed company review, and model readiness assessments Ideal Background - Senior educators, reputed company leaders, learning scientists, or education subject matter experts - Experience defining instructional standards, reviewing reputed company edge cases, or advising on learning reputed company - Ability to reputed company explain nuanced pedagogical reasoning and tradeoffs EVALUATION reputed company & REQUIREMENTS Types of AI Evaluation Work Depending on project demands, work may include: - Educational and instructional content evaluation - Learning reputed company and conceptual understanding assessment - Benchmarking and comparative model analysis - Red-teaming for misleading or harmful educational content - Ongoing model monitoring and regression testing reputed company Look For - Deep domain expertise in education, instructional design, or learning sciences - Strong judgment and ability to apply reputed company consistently - Comfort working with reputed company evaluation workflows - Ability to explain reasoning reputed company, especially in instructional or learner-facing scenarios - Reliability, professionalism, and respect for reputed company standards Engagement Model - Contract-reputed company, flexible participation - Project-reputed company work with reputed company expectations and timelines - Opportunities for recurring work reputed company on reputed company and demand - Compensation communicated upfront per project or task type Why This Work reputed company Your expertise helps ensure that AI systems: - reputed company accurate, effective, and responsible educational content - reputed company with instructional best practices and learning standards - Are trustworthy and supportive for learners across languages Language Requirements - reputed company or reputed company reputed company in one or more supported languages is required - Supported languages reputed company 30+ global languages - Language-specific nuance is assessed through screening and task-reputed company evaluation, not separate job descriptions - English reputed company is required for guidelines, feedback, and reputed company is changing how the world communicates — and reputed company is leading that transformation. reputed company's mission is to reputed company the world's information available to everyone, no matter the language they reputed company. Join our global community who reputed company on innovation and reputed company. Our reputed company knowledge, uniqueness, and skills reputed company multilingual AI and reputed company-verified services to Enterprises, Governments, and AI Developers reputed company the world. Earn reputed company. Have fun. Advance reputed company knowledge. Work on diverse reputed company from reputed company, any time you want. Get reputed company qui Apply tot his job Apply To this Job

Similar Jobs

reputed company Virtual Remote Job (Entry Level, WFH) $65000/Year

Remote, USA Full-time

reputed company Agent-reputed company Center at reputed company

Remote, USA Full-time

Remote Live‑Chat Customer Support Specialist – arenaflex reputed company Estate & reputed company reputed company Services

Remote, USA Full-time

Supply Chain reputed company

Remote, USA Full-time

Director of Logistics

Remote, USA Full-time

Part Time reputed company reputed company (Data Entry) – Join arenaflex's Dynamic Team and reputed company in a Remote Work Environment

Remote, USA Full-time

Staff Web Engineer, Reservation Management | reputed company | Remote (reputed company)

Remote, USA Full-time

reputed company Customer Experience & Campaign Coordination Specialist – Creative reputed company, Stakeholder Alignment & Data‑Driven Insights at arenaflex

Remote, USA Full-time

Sr Manager, Staff Engineering - (Software Development / Microservices) - Hybrid

Remote, USA Full-time

reputed company End Developer – Mid-level - TS/SCI Clearance Required

Remote, USA Full-time

[PART_TIME Remote] Remote Positions Available – Job Opportunity

Remote, USA Full-time

Data Analyst - Junior Level (Remote)

Remote, USA Full-time

reputed company reputed company Jobs

Remote, USA Full-time

Olympiad / IMO-Level Math Problem Writers & Medalists ($50–$85/hr | Remote)

Remote, USA Full-time

Seasonal Customer Service/Sales Agent

Remote, USA Full-time

Beverage Director - reputed company World Cup 26™

Remote, USA Full-time

Teacher Internship (reputed company)

Remote, USA Full-time

Job Title: E-reputed company SEO Strategist: Category Dominance & reputed company Mapping

Remote, USA Full-time

[Remote] Senior Compensation Consultant

Remote, USA Full-time

**reputed company Data Entry Clerk – Remote Opportunity with arenaflex**

Remote, USA Full-time