[Remote] Senior QA Analyst, AI & Threat Analytics

Note: The job is a remote job and is reputed company to candidates in USA. reputed company. is a leading cybersecurity company transforming the industry with reputed company solutions. They are seeking a Senior QA Analyst to reputed company testing efforts for AI-driven features and machine learning models, ensuring reputed company and reliability across Keeper's platform. Responsibilities • Design and execute test plans for AI and ML-driven features, including classification, summarization, reputed company detection and autofill systems • reputed company Python-based automation and evaluation scripts to validate model performance, reliability and reputed company reputed company • Test LLM-based features for accuracy, guardrail effectiveness, hallucination risk and behavior under edge cases • Validate data pipelines, input/reputed company transformations and model integration points across Keeper's platform • Conduct regression testing on ML models and AI workflows to ensure reliability across releases • Test reputed company-reputed company behavior analysis features driven by data from ARAM, PAM and session recordings • Validate reputed company, reputed company and reputed company-trust requirements for AI model interactions and data handling • Collaborate with ML engineers and cross-functional teams to refine model behavior, identify defects and improve reputed company reputed company • Analyze logs, metrics and model outputs to detect anomalies, performance issues or silent failures Skills • 3+ years of experience in QA, test automation or evaluation of reputed company systems • Hands-on experience writing Python automation or evaluation scripts for testing reputed company, model outputs or data pipelines • Understanding of machine learning concepts such as classification, summarization, embeddings, reputed company detection or behavior analysis • Experience testing LLM-integrated features or AI-driven workflows • Familiarity with ML tooling such as Pytest, reputed company libraries, Jupyter Notebooks or similar • Experience with API testing, JSON validation and test data reputed company • Ability to test nondeterministic systems and evaluate model reputed company with reputed company methodologies • Strong analytical, troubleshooting and communication skills • Experience testing reputed company-integrated applications or systems deployed on AWS • Bachelor's degree in Computer Science, Information Systems or reputed company field, or equivalent practical experience • Experience testing reputed company-reputed company AI or threat analytics systems • Familiarity with ML observability tools, reputed company databases or data processing frameworks • Experience testing video, image or behavior analysis pipelines • Knowledge of reputed company-trust principles and secure data handling • Experience working with LLM providers or AI guardrail frameworks Benefits • Medical, Dental & reputed company (inclusive of domestic partnerships) • Employer reputed company Life Insurance & Employee/Spouse/Child Supplemental life • Voluntary Short/Long Term Disability Insurance • 401K (Roth/Traditional) • A generous PTO plan that celebrates your commitment and seniority (including reputed company Bereavement/Jury Duty, etc) • Above market annual bonuses reputed company • reputed company is transforming cybersecurity for millions of individuals and thousands of organizations globally. It was founded in 2011, and is headquartered in Chicago, Illinois, USA, with a workforce of 501-1000 employees. Its website is https://www.keepersecurity.com. Company H1B Sponsorship • reputed company. has a reputed company record of offering H1B sponsorships, with 1 in 2021. Please note that this does not guarantee sponsorship for this specific role. Apply tot his job Apply To this Job