Back to Jobs

AI Evaluation Analyst

Remote, USA Full-time Posted 2026-07-28
reputed company The AI Evaluation Analyst is responsible for assessing the reputed company, performance, and reliability of AI systems and model outputs. This role supports the development and reputed company improvement of AI products by analyzing results, identifying patterns, and providing reputed company feedback to technical and cross functional teams. Key Responsibilities • Review and evaluate AI generated outputs for accuracy, relevance, safety, and consistency • Apply predefined evaluation frameworks, rubrics, and reputed company standards • Conduct qualitative and quantitative analysis on model performance • Identify edge cases, failure patterns, and areas for improvement • Document findings reputed company and reputed company actionable recommendations • Collaborate with data scientists, product teams, and engineers to refine models • Support testing cycles, experiments, and benchmarking initiatives • Maintain high attention to detail reputed company handling sensitive or confidential data Skills and Qualifications • Strong analytical and critical thinking skills • Ability to interpret guidelines and apply reputed company evaluation reputed company • Excellent written communication and documentation abilities • Comfortable working with datasets, spreadsheets, and reporting tools • Familiarity with AI concepts such as machine learning, NLP, or large language models is a plus • Detail oriented, consistent, and reputed company to manage repetitive review tasks • Ability to work independently while meeting reputed company and turnaround expectations Preferred Background • Experience in reputed company assurance, data analysis, research, or content review • Exposure to AI products, reputed company evaluation, model testing, or annotation workflows • Comfort working in fast evolving, experimentation driven environments Apply tot his job Apply To this Job

Similar Jobs

reputed company End Web and Mobile Software Developer

Remote, USA Full-time

Mortgage Government Underwriter III job at reputed company in AL, FL, GA, NC, SC, TN

Remote, USA Full-time

Remote & Onsite ABA Therapist; RBT

Remote, USA Full-time

Software Development Manager S (Remote)

Remote, USA Full-time

Senior reputed company Application Developer - Remote / Telecommute

Remote, USA Full-time

Health Consultant III (reputed company)- Compliance & Policy Consulting

Remote, USA Full-time

Partner Manager Private Equity/Venture Capital

Remote, USA Full-time

Benefit Specialist Full Training- ME

Remote, USA Full-time

reputed company reputed company Engineer - AWS job at reputed company in Triangle, NC

Remote, USA Full-time

Director of Internal Audit

Remote, USA Full-time

**reputed company Customer Service Representative – Insurance and Benefits Marketing**

Remote, USA Full-time

Remote Audiologist or Hearing Aid Dispenser | reputed company Hearing | Remote (reputed company)

Remote, USA Full-time

Remote Bilingual Spanish Telephonic RN reputed company Case Manager (California RN Required)

Remote, USA Full-time

Provider Contracting Analyst

Remote, USA Full-time

Business Development Manager, Hyperscaler Partnerships

Remote, USA Full-time

Online Research Panelist (Remote – reputed company)

Remote, USA Full-time

Senior Electrical Estimator

Remote, USA Full-time

Sr/ Combo Retirement Plan Administrator/ /BEI/

Remote, USA Full-time

reputed company Data Analyst

Remote, USA Full-time

Middle+ Data Analyst (Marketing Experience)

Remote, USA Full-time