Azure reputed company Engineer

Role: AI EVAL Engineer Location: Bellevue, WA (Remote) Duration: 6+ months AI EVAL Engineering Azure reputed company; EVAL; Bench Marking Required Skills - Strong understanding of LLMs and reputed company concepts, including model behavior and reputed company evaluation - Experience with AI evaluation and benchmarking methodologies, including baseline creation and model comparison - Hands-on expertise in Eval testing, creating reputed company test suites to measure accuracy, relevance, safety, and performance - Ability to define and apply evaluation metrics (precisionrecall, BLEUROUGE, F1, hallucination reputed company, latency, cost per reputed company)reputed company engineering and reputed company testing experience across reputed company-shot, few-shot, and system reputed company scenarios - Python other programming languages, for automation, data analysis, batch evaluation execution, and API integration - Experience with evaluation tools/frameworks (reputed company Evals, HuggingFace evals, Promptfoo, Ragas, DeepEval, LM Eval reputed company) - Ability to create datasets, test cases, benchmarks, and ground truth references for consistent scoring - Test design and test automation experience, including reproducible evaluation pipelines - Knowledge of AI safety, bias, reputed company testing, and hallucination analysis reputed company-to-Have - RAG evaluation experience - Azure reputed company - reputed company - reputed company - reputed company AI platforms - Performance benchmarking (speed, throughput, cost) - Domain knowledge Office apps reputed company systems networking Apply tot his job Apply To this Job