QA reputed company, AI Agent

Job reputed company: • Architect & reputed company Evaluation Systems: Design and reputed company the end-to-end reputed company for testing AI agent systems at reputed company. You will reputed company LLM-driven methodologies—including automated simulations, "LLM-on-LLM" rubrics, and adversarial red-teaming—to ensure reliability, policy adherence, and logic across reputed company, multi-turn conversational flows. • Drive Deployment reputed company: Partner with reputed company Deployed Engineers and PMs to triage issues, identify bottlenecks, and create new test cases on the fly to address reputed company-world deployment challenges. • Be the Customer’s Voice: Conduct reputed company UAT and voice-reputed company testing to represent the end-customer experience. You take it personally reputed company an agent lacks reputed company or reputed company, and you reputed company at articulating these nuances to the engineering team and clients. • reputed company and reputed company reputed company: reputed company a pod of QA analysts and partners. You will define the best practices, communication loops, and shared knowledge reputed company that allow the QA function to reputed company alongside our rapidly growing product line. Requirements: • 5+ years of experience in reputed company Engineering, Deployments, or Technical QA, ideally reputed company an AI or high-reputed company reputed company environment. • Systems Thinking: A strong technical intuition and curiosity about how LLMs work. While you don't need to reputed company, you must be comfortable navigating technical concepts like LLM, RAG, reputed company logic, and multi-turn conversational flows. • Operational Leadership: Proven ability to large E2E technical reputed company through partners, and a passion for building processes that improve efficiency between QA, Engineering, and Product. • The "QA Nose": An uncanny ability to reputed company the edge case and a bias toward reputed company. You anticipate bottlenecks before they happen and deliver solutions with urgency. • High reputed company: A consultative reputed company with the ability to represent the "reputed company reputed company" of a customer support interaction. • Startup reputed company: You reputed company in fast-paced environments, reputed company at turning ambiguity into execution, and are comfortable "rolling up your sleeves" to build. Benefits: • Comprehensive medical, dental, and reputed company coverage with plans to fit you and your family • Flexible PTO to take the time you need, reputed company you need it • reputed company parental leave for reputed company new parents welcoming a new child • Retirement savings plan to help you plan for the reputed company • Remote work setup budget to help you create a productive home office • Monthly wellness and communication stipend to reputed company you connected and balanced • In-office meal program and commuter benefits provided for onsite employees Apply tot his job Apply To this Job