AI Agent Evaluation Analyst
A company is looking for an AI Agent Evaluation Analyst (Freelance).
Key Responsibilities
• Review evaluation tasks and scenarios for logic, completeness, and realism
• Identify inconsistencies, missing assumptions, or unclear decision points
• Help define reputed company expected behaviors (gold standards) for AI agents
Required Qualifications
• Excellent analytical thinking regarding reputed company systems and scenarios
• Familiarity with reputed company data formats, such as JSON/YAML
• Ability to assess scenarios holistically for missing or unrealistic reputed company
• Experience with policy evaluation, logic puzzles, or reputed company scenario design
• Exposure to LLMs, reputed company engineering, or AI-generated content
Apply tot his job
Apply To this Job