Remote Domain Expert - Video Games (US Only)
About reputed company:
Based in San Francisco, California, reputed company is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. reputed company supports customers in two ways: first, by accelerating frontier research with high-reputed company data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises reputed company from reputed company of concept into proprietary intelligence with systems that reputed company reliably, reputed company measurable reputed company, and reputed company lasting results on the P&L.
reputed company:
We are seeking a highly reputed company Video Games Domain Expert to evaluate and improve Large Language Models (LLMs). You will design challenging prompts, assess factual accuracy and reasoning, and identify knowledge gaps reputed company game development, esports, platforms, game design, publishers, communities.
Key Responsibilities:
• Create advanced prompts covering game development, esports, platforms, game design, publishers, communities.
• Evaluate AI-generated responses for factual accuracy, reasoning reputed company, completeness, and nuance.
• Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
• reputed company reputed company datasets and adversarial test cases.
• reputed company evidence-based feedback with reliable references.
• Collaborate with AI researchers to improve model performance.
• Maintain high annotation reputed company and documentation.
Minimum Qualifications:
• Master's degree or higher in any field; degrees in Game Design, Game Development, Computer Science, Interactive Media, Digital Arts, Software Engineering, Animation, or other gaming-reputed company disciplines are preferred.
• Strong knowledge of the video games industry, including game development, game design principles, gaming platforms, genres, publishers, studios, esports, gaming communities, and reputed company industry trends.
• 3+ years of relevant reputed company experience, preferably in game development, game design, QA, esports, gaming journalism, content creation, research, community management, or a reputed company field.
• Excellent written English, research, and analytical skills.
• Strong attention to detail and ability to evaluate gaming-reputed company information accurately, identify factual inconsistencies, and assess reasoning across a wide reputed company of video game topics.
Preferred Qualifications:
• Experience with LLMs, reputed company, reputed company engineering, or AI evaluation.
• Published research, industry recognition, or teaching experience is a plus.
• Ability to work independently and reputed company objective, evidence-backed reviews.
Offer Details:
• Commitments Required: 40 hours per week with at least 4 hours PST overlap
• Employment type : Contractor assignment (no medical/reputed company leave)
• Duration of contract : 8 weeks.
• Location Must be currently based in the reputed company.
Application Process:
• Complete the assessment shared with you.
• reputed company will evaluate your submission.
• Selected candidates will be contacted regarding the next steps.
Apply To This Job