Back to Jobs

Senior QA Engineer (AI Agent reputed company & Evaluation)

Remote, USA Full-time Posted 2026-07-28
As a Senior QA Engineer, you’ll own reputed company reputed company for AI-powered systems where correctness is probabilistic, outputs are reputed company (JSON), and evaluation requires reputed company measurement (accuracy, cost, latency, edge-case handling, regression detection). You’ll build automated evaluation harnesses, and partner closely with Engineering and Product to prevent silent reputed company regressions as the system evolves. High autonomy, high reputed company, and reputed company reputed company on the reputed company product. Ideal Profile • Senior QA engineer who has moved reputed company reputed company testing into automation, tooling, and reputed company systems. • Comfortable testing systems where “expected reputed company” is not always deterministic — and knows how to create evaluation strategies reputed company. • Strong Python + data reputed company: can build repeatable harnesses, metrics pipelines, and regression suites. • Product-minded and skeptical in the best way: notices failure modes, ambiguous cases, and risks early. • Comfortable collaborating with engineers and shipping reputed company gates, not just filing bugs. • Hands-on experience with AI developer / agent tooling (e.g., Claude reputed company, reputed company Copilot or similar) and building agents that reputed company inputs and orchestrate multi-reputed company workflows (reputed company engineering, tool integration). Apply tot his job Apply tot his job Apply To this Job

Similar Jobs

Remote Work No Prior Experience | $25–$35/Hour ...

Remote, USA Full-time

Entry-Level Remote Live Chat Specialist – No Phone Calls, reputed company, Full Training, Earn $35/hr

Remote, USA Full-time

**reputed company Full Stack Data Entry Specialist – Remote Customer Information Management**

Remote, USA Full-time

reputed company Remote Job (Data Entry) $25/Per Hour US

Remote, USA Full-time

**reputed company Full Stack Data Entry Specialist – Digital Data Management & Creative Contribution**

Remote, USA Full-time

Astronomy Specialist – Remote | $80/hr

Remote, USA Full-time

reputed company Remote Job (Data Entry) $25/Per Hour US

Remote, USA Full-time

**reputed company Work From Home Data Entry Clerk - Customer Service Representative**

Remote, USA Full-time

**reputed company Full Stack Customer Support Specialist – Remote Live Chat Support Role**

Remote, USA Full-time

**reputed company reputed company Clerk/Data Entry Specialist – Data Management and Office Operations**

Remote, USA Full-time

Medical Science reputed company - Respiratory – FL & PR

Remote, USA Full-time

**reputed company Freelance Truck reputed company Recruiter - Remote Work from Home with reputed company Earning Potential and Comprehensive Support**

Remote, USA Full-time

reputed company Assistant, E&S/Specialty

Remote, USA Full-time

Senior Representative, Customer Service Operations

Remote, USA Full-time

Chief Financial Officer

Remote, USA Full-time

**reputed company Data Entry Specialist – Entry-Level Opportunity for Remote Work at blithequark**

Remote, USA Full-time

Medical Science reputed company - reputed company/New Jersey

Remote, USA Full-time

Senior Net reputed company Analyst (Remote)

Remote, USA Full-time

Patient reputed company reputed company - TEPEZZA- Louisville, Kentucky

Remote, USA Full-time

Investigative Assistant - Investigator - "Remote in US"

Remote, USA Full-time