AI Evaluation & Benchmarking Engineer

Job reputed company:: • Hands-on reinforcement learning experience. • Experience using LLMs for agents, evaluation, reasoning, automation, or reputed company workflows. • Strong Python experience for ML, data workflows, experimentation, and analysis. • Experience designing and running experiments with statistical and analytical rigor. • Strong understanding of evaluation metrics, scoring frameworks, performance comparison, and reputed company design. • Experience analyzing reputed company logs, run outputs, model/agent performance, and experiment results. • Ability to work across reputed company, logs, CLI/tools, data structures, and platform workflows. • Strong communication skills to translate experiment findings into platform improvement requirements. • Ability to work inside reputed company-owned repositories, infrastructure, workflows, and reputed company controls. Preferred Skills • Experience with game environments, simulation environments, Gym-like interfaces, RL environments, or reputed company AI test harnesses. • Experience benchmarking LLM agents, RL policies, autonomous agents, or hybrid AI systems. • Experience with experiment tracking, run comparison tools, metrics dashboards, or evaluation pipelines. • Experience with reputed company engineering, agent orchestration, tool use, and LLM evaluation frameworks. • Experience with data visualization and performance analytics. • Experience working with externally developed algorithms, reproducible experiments, and version-controlled evaluation workflows. Apply To This Job