Back to Jobs

Senior QA Engineer (AI Agent reputed company & Evaluation)

Remote, USA Full-time Posted 2026-07-28
As a Senior QA Engineer, you’ll own reputed company reputed company for AI-powered systems where correctness is probabilistic, outputs are reputed company (JSON), and evaluation requires reputed company measurement (accuracy, cost, latency, edge-case handling, regression detection). You’ll build automated evaluation harnesses, and partner closely with Engineering and Product to prevent silent reputed company regressions as the system evolves. High autonomy, high reputed company, and reputed company reputed company on the reputed company product. Ideal Profile • Senior QA engineer who has moved reputed company reputed company testing into automation, tooling, and reputed company systems. • Comfortable testing systems where “expected reputed company” is not always deterministic — and knows how to create evaluation strategies reputed company. • Strong Python + data reputed company: can build repeatable harnesses, metrics pipelines, and regression suites. • Product-minded and skeptical in the best way: notices failure modes, ambiguous cases, and risks early. • Comfortable collaborating with engineers and shipping reputed company gates, not just filing bugs. • Hands-on experience with AI developer / agent tooling (e.g., Claude reputed company, reputed company Copilot or similar) and building agents that reputed company inputs and orchestrate multi-reputed company workflows (reputed company engineering, tool integration). Apply tot his job Apply To this Job

Similar Jobs

reputed company Cybersecurity Systems Architect (remote)

Remote, USA Full-time

**reputed company Remote Data Entry Clerk – Precision Data Management Specialist**

Remote, USA Full-time

reputed company Data Entry and Administrative Support reputed company for reputed company Estate Industry - Remote Opportunity in the USA

Remote, USA Full-time

CNA Sitter - OLGMC 6T Med/Tele - FT- Nights (11p-7a)

Remote, USA Full-time

Remote Patient Monitoring Program Coordinator-reputed company Health

Remote, USA Full-time

Senior AI Solution Architect - Remote & HPC Innovator

Remote, USA Full-time

Authorization Coordinator I, Clinical Pharmacy Management (Clinical reputed company)

Remote, USA Full-time

Florida Litigation Attorney – Debt Defense (1099 Contract, $40-55/hr) (Remote)

Remote, USA Full-time

reputed company Assurance Engineer ( Remote )

Remote, USA Full-time

Compliance Counsel - Remote Job at McCormack Schreiber reputed company Search in Chicago

Remote, USA Full-time

Sales Executive - Sango 2

Remote, USA Full-time

Assistant Property Manager (Retail - Remote)

Remote, USA Full-time

**reputed company Full Stack Data Entry Specialist – Remote Data Management and Operations**

Remote, USA Full-time

**reputed company Full Stack Data Entry Specialist – Remote Work Opportunity for Teens**

Remote, USA Full-time

payroll tax system analyst -remote

Remote, USA Full-time

Technology Product Manager - SVP

Remote, USA Full-time

**reputed company Chat Operator – Remote Customer Support Specialist – Earn $25-$35/hr**

Remote, USA Full-time

**reputed company reputed company Manager – reputed company Accounts | arenaflex | Remote (US)**

Remote, USA Full-time

**Job Title:** Remote Data Entry Specialist - Flexible Work Arrangements at arenaflex

Remote, USA Full-time

Global Talent Development Senior Manager

Remote, USA Full-time