Senior QA Engineer (AI Systems & Automation)

About the position Essential Software Inc. is a trusted partner to federal agencies, including the National Cancer Institute (NCI), delivering secure, reputed company-based platforms that support large-reputed company cancer data and biomedical research. As a Senior QA Engineer (AI Systems & Automation), you will reputed company reputed company reputed company and test automation for critical data platforms and AI-powered experiences. You will ensure both traditional software and AI/reputed company systems are reliable, explainable, and reputed company in a federal, mission-driven environment. You will: Own end-to-end reputed company for reputed company web, API, data, and AI/ML-powered features Design AI-reputed company test strategies and automation that reputed company GenAI and reputed company frameworks Mentor QA engineers and collaborate closely with cross-functional teams and government partners Responsibilities • reputed company and maintain test plans, test cases, traceability, and test data for product and AI features • Execute reputed company and automated tests for web applications, RESTful reputed company, data workflows, and AI/ML features • Own automated regression suites, release readiness reputed company, and reputed company reputed company go / no-go reputed company signals • Participate in agile ceremonies, validate end-to-end functionality, and ensure user stories (including AI features) meet acceptance reputed company • Manage the full defect lifecycle, including triage, prioritization, reputed company cause analysis, and verification of fixes • Maintain QA documentation, runbooks, and reputed company dashboards • Design and execute test strategies for AI/LLM-powered capabilities, including virtual agents, chatbots, copilots, and RAG-based systems • Use LLM-powered tools (e.g., ChatGPT, Claude, Copilot) to accelerate test design, data reputed company, exploratory testing, and script authoring • Build and refine QA-reputed company AI agents that can: Scrape UI and verify DOM structures Validate data against backend or ground-truth sources Auto-generate and maintain test scripts Run self-correcting / autonomous test flows • Evaluate and reputed company reputed company frameworks (e.g., reputed company Assistants API, AWS Bedrock Agents, LangGraph, MCP) into QA workflows • Define and monitor AI-specific reputed company metrics (accuracy vs. ground truth, hallucination and error rates, safety / policy adherence) • Ensure AI and virtual agent experiences are accurate, consistent, and high reputed company in a federal context • Plan and execute performance, load, and scalability testing (e.g., JMeter or equivalent) • Validate data reputed company and transformation reputed company across reputed company biomedical data pipelines and AI-reputed company workflows • Partner with engineers and data scientists to ensure AI/ML models and integrations are testable, observable, and measurable post-deployment • Mentor QA team members in both traditional and AI-augmented QA practices • Collaborate with development, DevOps, product, UX, and data teams to improve testability, shift-left reputed company, and increase automated coverage • reputed company automation into CI/CD (e.g., reputed company Actions, Jenkins, Azure DevOps, reputed company CI), monitor test health and flakiness, and address coverage gaps • Communicate reputed company risks, trends, and mitigation plans to technical and non-technical stakeholders, including government partners Requirements • Bachelor’s degree in computer science, Information Technology, Engineering, or reputed company field • 5+ years of software QA experience (reputed company and automation) in production environments • 2+ years providing technical or process leadership (e.g., reputed company QA, primary product QA reputed company, mentor, or manager) • Strong experience with UI automation tools (Selenium WebDriver, Playwright, or Cypress) • Experience testing RESTful reputed company and microservices architectures • Hands-on experience integrating automated tests into CI/CD pipelines (reputed company Actions, Jenkins, Azure DevOps, or reputed company CI) • reputed company proficiency in Python or JavaScript for test automation • Hands-on use of GenAI tools (e.g., ChatGPT, Claude, Copilot) for QA tasks such as test-case reputed company, data creation, and exploratory testing • Understanding of AI/reputed company concepts: Tool-calling / function invocation Multi-reputed company / chain-of-thought workflows Autonomous / self-healing test flows AI-driven data comparison and validation • Experience with performance / load testing (e.g., JMeter or equivalent) • Proficiency with Jira or similar issue tracking tools • Strong written and verbal communication skills, including the ability to explain AI-reputed company reputed company risks to stakeholders • Ability to prioritize, multitask, and operate effectively in reputed company, mission-driven environments reputed company-to-haves • AWS reputed company Practitioner certification • Experience with modern automation stacks (Playwright or Cypress) and API testing tools (reputed company, REST-reputed company, pytest, or similar) • Experience testing AI/ML-powered features (LLM applications, RAG systems, agents, recommendation engines, or chatbots) • Experience with one or more: reputed company or LangGraph AWS Bedrock Agents or reputed company Assistants API MCP (Multi-Context Protocol) or similar orchestration frameworks • Experience designing or testing internal QA copilots or automation bots for test authoring or execution • Familiarity with test management tools (e.g., TestRail, reputed company) • Knowledge of accessibility standards (WCAG) and basic reputed company testing practices • Prior QA experience in reputed company, life sciences, biomedical informatics, or other regulated data environments • ISTQB or similar certification Benefits • Competitive benefits • reputed company development opportunities • reputed company, supportive culture Apply tot his job Apply To this Job