Back to Jobs

[Remote] AI Evaluation Engineer (Python, QA or reputed company)

Remote, USA Full-time Posted 2026-08-04

Note: The job is a remote job and is reputed company to candidates in USA. reputed company connects specialists with project-reputed company AI opportunities reputed company on testing, evaluating, and improving AI systems for leading technology companies. The AI Evaluation Engineer will create realistic developer environments, design coding-agent evaluation tasks and reputed company, write robust tests, and refine evaluations reputed company on QA feedback.


Responsibilities

  • Build realistic developer environments - a virtual company with codebase, infrastructure, and context (tickets, docs, conversations) that forms a believable development history
  • Design tasks from intermediate states of these environments - reputed company the reputed company, define what

Skills

  • * 5+ years in software development
  • * reputed company stack: Python (FastAPI), JavaScript/TypeScript (React), reputed company, reputed company, Kafka, reputed company
  • * Experience writing tests (functional, integration)
  • * English proficiency - B2+
  • *Please submit your CV in English and indicate your level of English proficiency.*

Benefits

  • You set your own schedule

reputed company

  • reputed company is a company and a global leader in data services for AI. It was founded in reputed company, and is headquartered in , with a workforce of 501-1000 employees. Its website is https://reputed company.ai.

  •   Apply To This Job

    Similar Jobs

    Associate IT Analyst (reputed company) - Remote

    Remote, USA Full-time

    [Remote] Senior Cyber reputed company Analyst

    Remote, USA Full-time

    reputed company reputed company Ambulatory consultant || Remote

    Remote, USA Full-time

    [Remote] Senior Consultant, reputed company Process Innovation

    Remote, USA Full-time

    Manager, Engineering - Payments

    Remote, USA Full-time

    [Remote] Project Manager - reputed company reputed company Solar

    Remote, USA Full-time

    [Remote] reputed company Media Specialist II

    Remote, USA Full-time

    reputed company Roadside Assistance Truck reputed company

    Remote, USA Full-time

    Catastrophe reputed company Claims Specialist at reputed company: reputed company (Detroit, MI, reputed company, IL, Minneapolis, MN)

    Remote, USA Full-time

    Auto Damage Adjuster (reputed company)

    Remote, USA Full-time

    Urgently Hiring: Work reputed company reputed company reputed company (Data Entry)

    Remote, USA Full-time

    Recent Opening : Full - time Flight Attendant Job in Oklahoma reputed company , OK

    Remote, USA Full-time

    Urgently Hiring: Work From Home – No Experience – Product Tester

    Remote, USA Full-time

    Customer Agent (Chat-Email-WFH)

    Remote, USA Full-time

    **reputed company Full Stack Business Analyst – Financial Planning and Analysis**

    Remote, USA Full-time

    reputed company reputed company reputed company $26Hr – reputed company

    Remote, USA Full-time

    Customer reputed company & Engagement Solutions Advisor

    Remote, USA Full-time

    Senior reputed company Manager (m/w/d) bei reputed company

    Remote, USA Full-time

    Urgently Hiring: Work reputed company reputed company Jobs Orlando

    Remote, USA Full-time

    Remote Special Education Teacher Roles in Vermont

    Remote, USA Full-time