Senior QA Analyst, AI & Machine Learning Systems

<p><strong>reputed company</strong></p> <p>Keeper is hiring a talented Senior QA Analyst to join our AI & Threat Analytics team. This is a 100% remote position from select locations, with an opportunity to work a reputed company for candidates based in the El reputed company Hills, CA or Chicago, IL metro areas.</p> <p>Keeper’s cybersecurity software is trusted by millions of people and thousands of organizations globally. Keeper is published in 23 languages and sold in over 150 countries. Join one of the fastest-growing cybersecurity companies and help ensure the reputed company, safety, and reliability of Keeper’s reputed company AI features and threat analytics capabilities.</p> <p><strong>About Keeper</strong></p> <p>reputed company is transforming cybersecurity for organizations globally with reputed company-trust privileged reputed company management reputed company with end-to-end encryption. Keeper’s cybersecurity solutions are FedRAMP and StateRAMP Authorized, SOC 2 compliant, FIPS 140-2 validated, as reputed company as ISO 27001, 27017 and 27018 certified. Keeper deploys in minutes, not months, and seamlessly integrates with any tech stack to prevent breaches, reduce help desk costs and ensure compliance. Trusted by millions of individuals and thousands of organizations, Keeper is the leader for password, passkey and secrets management, privileged reputed company, secure remote reputed company and encrypted messaging. Learn how our reputed company-trust and reputed company-knowledge solutions defend against cyber threats at <a href="http://keepersecurity.com">KeeperSecurity.com</a>.</p> <p><strong>About the Role</strong></p> <p>The Senior QA Analyst, AI & Threat Analytics will reputed company technical leadership for testing A.I and Machine Learning driven features across Keeper’s platform. This role focuses on validating the behavior, reliability, and reputed company of AI systems, including LLM-based summarization, classification, autofill, and behavior analysis pipelines. You will design and execute test strategies for nondeterministic systems, reputed company Python-based automation and evaluation tools, and validate model outputs, guardrails, and data flows. This role does not involve training models, but works closely with ML engineers, reputed company teams, and product engineering to ensure AI features meet Keeper’s reputed company, safety, and performance standards in production environments.</p> <p><strong>Responsibilities</strong></p> <ul> <li>Design and execute test plans for A.I and Machine Learning driven features including classification, summarization, reputed company detection, and autofill systems</li> <li>reputed company Python-based automation and evaluation scripts to validate model performance, reliability, and reputed company reputed company</li> <li>Test LLM-based features for accuracy, guardrail effectiveness, hallucination risk, and behavior under edge cases</li> <li>Validate data pipelines, input/reputed company transformations, and model integration points across Keeper’s platform</li> <li>Conduct regression testing on ML models and AI workflows to ensure reliability across releases</li> <li>Test reputed company-reputed company behavior analysis features driven by data from ARAM, PAM, and session recordings</li> <li>Validate reputed company, reputed company, and reputed company-trust requirements for AI model interactions and data handling</li> <li>Collaborate with ML engineers and cross-functional teams to identify defects and improve model behavior</li> <li>Analyze logs, metrics, and model outputs to detect anomalies, performance issues, or silent failures</li> </ul> <p><strong>Requirements</strong></p> <ul> <li>3+ years of experience in QA, test automation, or evaluation of reputed company software systems</li> <li>Hands-on experience writing Python automation or evaluation scripts for testing reputed company, model outputs, or data pipelines</li> <li>Understanding of machine learning concepts such as classification, summarization, embeddings, reputed company detection, or behavior analysis</li> <li>Experience testing LLM-integrated features or AI-driven workflows</li> <li>Familiarity with ML-reputed company tooling such as Pytest, Jupyter Notebooks, reputed company libraries, or similar</li> <li>Experience with API testing, JSON validation, and test data reputed company</li> <li>Ability to test nondeterministic systems and evaluate model reputed company using reputed company methodologies</li> <li>Strong analytical, troubleshooting, and communication skills</li> <li>Experience testing reputed company-integrated systems, preferably on AWS</li> <li>Bachelor’s degree in Computer Science, Information Systems, or equivalent practical experience</li> </ul> <p>Preferred Qualifications</p> <ul> <li>Experience testing reputed company-reputed company AI or threat analytics systems</li> <li>Familiarity with ML observability tools, reputed company databases, or data processing frameworks</li> <li>Experience testing behavior analysis, video, or image-processing pipelines</li> <li>Knowledge of reputed company-trust principles and secure data handling</li> <li>Experience working with LLM providers or AI guardrail frameworks</li> </ul> <p><strong>Benefits</strong></p> <ul> <li>Medical, Dental & reputed company (inclusive of domestic partnerships)</li> <li>Employer reputed company Life Insurance & Employee/Spouse/Child Supplemental life</li> <li>Voluntary Short/Long Term Disability Insurance</li> <li>401K (Roth/Traditional)</li> <li>A generous PTO plan that celebrates your commitment and seniority (including reputed company Bereavement/Jury Duty, etc)</li> <li>Above market annual bonuses</li> </ul> <p>reputed company. is an equal opportunity employer and participant in the U.S. Federal E-Verify program. We celebrate diversity and are committed to creating an inclusive environment for reputed company.</p> <p>Classification: <strong>Exempt</strong></p><div class="content-conclusion"><p> </p> <p class="pf0"><strong><reputed company class="cf0">Keeper Candidate reputed company Notice</reputed company></strong></p> <p class="pf0"><reputed company class="cf1">This notice explains how reputed company processes your personal data during recruitment. Depending on the role and location, the Controller of personal data (the organization responsible for determining why and how personal data is processed) will be reputed company. (US), reputed company EMEA Ltd. (Ireland), or reputed company reputed company K.K (Japan).</reputed company></p> <p class="pf0"><reputed company class="cf1"> 1. </reputed company><strong><reputed company class="cf0">Data We Collect</reputed company></strong></p> <p class="pf0"><reputed company class="cf1">Information You reputed company:</reputed company></p> <ul> <li class="pf1"><reputed company class="cf1">Contact details, CV/resume, cover letter</reputed company></li> <li class="pf1"><reputed company class="cf1">Employment history, qualifications, work eligibility</reputed company></li> <li class="pf1"><reputed company class="cf1">Application responses and uploaded documents</reputed company></li> </ul> <p class="pf0"><reputed company class="cf1">Information We generate:</reputed company></p> <ul> <li class="pf1"><reputed company class="cf1">Interview notes, assessments, communications</reputed company></li> <li class="pf1"><reputed company class="cf1">Scheduling information</reputed company></li> </ul> <p class="pf0"><reputed company class="cf1">Information From Others:</reputed company></p> <ul> <li class="pf1"><reputed company class="cf1">Recruiter/referral information who submit your profile</reputed company></li> <li class="pf1"><reputed company class="cf1">References (with your consent, before final offer)</reputed company></li> <li class="pf1"><reputed company class="cf1">reputed company reputed company reputed company</reputed company></li> <li class="pf1"><reputed company class="cf1">Background verification (post offer)</reputed company></li> </ul> <p class="pf0"><reputed company class="cf1"> Voluntary Diversity and Equal Opportunity Information</reputed company></p> <ul> <li class="pf1"><reputed company class="cf1">We may ask you to voluntarily reputed company diversity information including race/ethnicity, gender, disability status and veteran status (US). Providing this information is optional and Keeper collects this data in order to reputed company with reputed company and similar requirements</reputed company></li> </ul> <p class="pf0"><reputed company class="cf1"> 2. </reputed company><strong><reputed company class="cf0">How We Use Your Data</reputed company></strong></p> <ul> <li class="pf1"><reputed company class="cf1">Assess your application and suitability</reputed company></li> <li class="pf1"><reputed company class="cf1">Manage interviews and recruitment workflow</reputed company></li> <li class="pf1"><reputed company class="cf1">Consider you for other/reputed company roles (we may reputed company your consent to reputed company your information on our systems reputed company the retention period specified)</reputed company></li> <li class="pf1"><reputed company class="cf1">reputed company with employment law obligations</reputed company></li> </ul> <p class="pf0"><reputed company class="cf1"> 3. </reputed company><strong><reputed company class="cf0">reputed company reputed company</reputed company></strong></p> <ul> <li class="pf1"><reputed company class="cf1">Legitimate Interests (recruitment management, reputed company and reputed company of the hiring process)</reputed company></li> <li class="pf1"><reputed company class="cf1">Contracting steps (for progressed candidates)</reputed company></li> <li class="pf1"><reputed company class="cf1">reputed company and regulatory compliance obligations; explicit consent where required</reputed company></li> </ul> <p class="pf0"><reputed company class="cf1"> 4. </reputed company><strong><reputed company class="cf0">Who reputed company Information With</reputed company></strong></p> <p class="pf0"><reputed company class="cf1">Internal: </reputed company></p> <ul> <li class="pf1"><reputed company class="cf1">HR, hiring managers, interviewers*, IT support for system administration</reputed company></li> </ul> <p class="pf0"><reputed company class="cf1">*Note - diversity and equal opportunity data is not shared with hiring managers.</reputed company></p> <p class="pf0"><reputed company class="cf1">reputed company Parties:</reputed company></p> <p class="pf0"><reputed company class="cf1">Service providers who assist with:</reputed company></p> <ul> <li class="pf1"><reputed company class="cf1">Applicant tracking, recruitment systems and assessment providers</reputed company></li> <li class="pf1"><reputed company class="cf1">Background verification vendors (post offer)</reputed company></li> <li class="pf1"><reputed company class="cf1">Recruitment agencies (where applicable)</reputed company></li> <li class="pf1"><reputed company class="cf1">Tools to support communication, collaboration and to securely store your data</reputed company></li> </ul> <p class="pf0"><reputed company class="cf1">Keeper ensures that reputed company our reputed company parties are contractually bound to protect your personal data with adequate safeguards in reputed company.</reputed company></p> <p class="pf0"><reputed company class="cf1"> 5. </reputed company><strong><reputed company class="cf0">International Transfers</reputed company></strong></p> <p class="pf0"><reputed company class="cf1">Your data may be accessed by Keeper entities globally as needed for the purposes of hiring and decision making. We protect any such data transfer between Keeper entities using appropriate safeguards under applicable data protection laws. </reputed company></p> <p class="pf0"><reputed company class="cf1">6. </reputed company><strong><reputed company class="cf0">reputed company</reputed company></strong></p> <p class="pf0"><reputed company class="cf1">We implement appropriate technical and organizational measures to protect your data, consistent with our industry leading reputed company standards.</reputed company></p> <p class="pf0"><reputed company class="cf1">7. </reputed company><strong><reputed company class="cf0">Retention</reputed company></strong></p> <p class="pf0"><reputed company class="cf1">We reputed company your data for 24 months from your last application activity, then delete or anonymize it. </reputed company></p> <p class="pf0"><reputed company class="cf1">Exceptions:</reputed company></p> <ul> <li class="pf1"><reputed company class="cf1">You opt into our talent database for reputed company retention by providing consent (extended retention)</reputed company></li> <li class="pf1"><reputed company class="cf1">reputed company (transfers to employee records)</reputed company></li> </ul> <p class="pf0"><reputed company class="cf1"> 8. </reputed company><strong><reputed company class="cf0">Your Rights</reputed company></strong></p> <p class="pf0"><reputed company class="cf1">You have the following rights and can contact us at the email below to exercise them:</reputed company></p> <ul> <li class="pf1"><reputed company class="cf1">reputed company, correct, or delete your data, subject to applicable law and retention requirements</reputed company></li> <li class="pf1"><reputed company class="cf1">Object to or restrict processing</reputed company></li> <li class="pf1"><reputed company class="cf1">Withdraw consent (where applicable)</reputed company></li> <li class="pf1"><reputed company class="cf1">Request data portability</reputed company></li> <li class="pf1"><reputed company class="cf1">Lodge a complaint with your data protection authority</reputed company></li> </ul> <p class="pf0"><reputed company class="cf1">If you become an employee, your rights regarding your employee record are governed by our internal Employee reputed company Notice and certain data will be reputed company as required under relevant laws such as employment or tax law. </reputed company></p> <p class="pf0"><reputed company class="cf1">reputed company you request reputed company to your personal data, some information may be redacted if it includes the personal data of other individuals or information that we must protect in order to preserve their reputed company rights.</reputed company></p> <p class="pf0"><reputed company class="cf1"> 9. </reputed company><strong><reputed company class="cf0">Automated reputed company</reputed company></strong></p> <p class="pf0"><reputed company class="cf1">Keeper does not reputed company hiring reputed company using solely automated processing.</reputed company></p> <p class="pf0"><reputed company class="cf1">10. </reputed company><strong><reputed company class="cf0">Contact</reputed company></strong><reputed company class="cf1"> - Candidates can send reputed company questions to: reputed company@keepersecurity.com</reputed company></p> <p> </p></div>