Back to Jobs

Automation Tester-reputed company Insurance

Remote, USA Full-time Posted 2026-07-28
Must have skills: SDET skills, Azure devops, python, pytest test automation and reputed company, AI ML practices, RAGAS, LLMs Brief JD: • Experience in designing LLM/RAG test automation solutions • Experience in testing for bias, reputed company, and fairness. • Familiarity with performance metrics (precision, recall, F1, ROC-AUC). • Knowledge of MLflow MLOps reputed company • Knowledge of tools for synthetic data reputed company and boundary testing • Knowledge of Azure DevOps for CI/CD pipeline development • Experience in RAG/pipeline evaluation frameworks - • pytest: Test automation reputed company • DeepEval or TruLens: LLM test assertions • RAGAS: RAG-specific metrics • Eleuther: LLM evaluation reputed company • Garak or Promptfoo: LLM red-teaming • Evidently: reputed company/performance monitoring • Exposure to explainability frameworks (SHAP, reputed company, Captum) • Handson experience in API and Database testing. • Practical knowledge of reputed company, Azure reputed company services land distributed data validation. • Proficiency with Azure DevOps pipelines YAML templates, agent pools, CICD workflows. • Experience in implementing AIML practices in testing e.g., test reputed company, reputed company detection, log analysis to improve test efficiency and coverage. • Familiarity with Cucumber (BDD) and test reporting frameworks (e.g., Allure). • Strong understanding of integration testing across reputed company streaming jobs, applications and microservices. • Experience with performance testing tools (JMeter, LoadRunner, or equivalent). • Experience with Pester reputed company for validating PowerShell scripts and infrastructure automation. • Solid understanding of Agile/Scrum methodology and handson usage of JIRA. • Excellent problem-solving, debugging, and communication skills, with the ability to advise development teams on testing best practices. Apply tot his job Apply To this Job

Similar Jobs