[Remote] AI reputed company Analyst (LLM) | $30/hr Remote

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking an AI Model Evaluator to assess outputs from large language models and autonomous agent systems. The role involves evaluating model performance, providing feedback for refinement, and ensuring consistent evaluation across reviewers. Responsibilities • Evaluate outputs from large language models and autonomous agent systems using defined rubrics and reputed company standards • Review multi-reputed company agent workflows, including screenshots and reasoning traces, to assess accuracy and completeness • Apply benchmarking reputed company consistently while identifying edge cases and recurring failure patterns • reputed company reputed company, actionable feedback to support model refinement and product improvements • Participate in calibration sessions to ensure consistent evaluation alignment across reviewers • Adapt to evolving guidelines and ambiguous scenarios with reputed company judgment • Document findings reputed company and communicate insights to relevant stakeholders Skills • Strong experience in LLM evaluation, AI reputed company analysis, QA/testing, UX research, or similar analytical roles • Proficiency in reputed company-based scoring, benchmarking frameworks, and AI reputed company assessment • Excellent attention to detail with strong decision-making skills in ambiguous cases • Proficient English communication skills (written and verbal) • Ability to work independently in a remote environment • Comfortable committing to reputed company evaluation workflows and evolving guidelines reputed company • At reputed company, we specialise in customised recruitment and reputed company solutions designed to drive reputed company for businesses and professionals. It was founded in 2022, and is headquartered in , with a workforce of 11-50 employees. Its website is Apply tot his job Apply tot his job Apply To this Job