History Longlist
Job Title: History Expert Evaluator
Job Type: Part-time
Location: Remote
Job Summary
Join our customer's team as a History Expert Evaluator and play a pivotal role in shaping the quality and accuracy of AI-generated historical content. In this full-time, remote position, you will leverage your deep historical knowledge and evaluative skills to improve how AI interprets, communicates, and reasons about historical events and ideas.
Key Responsibilities
• Critically review AI-generated historical explanations and narratives for factual accuracy, coherence, and analytical depth.
• Reframe complex or ambiguous history questions to enhance clarity, fairness, and academic rigor.
• Apply standardized rubrics to assess historical reasoning, evidence use, and interpretive quality in AI responses.
• Classify AI responses at the sentence and word level, identifying thesis statements, supporting evidence, and analytical commentary.
• Deliver structured, constructive written feedback to guide AI improvement and rubric alignment.
• Collaborate with interdisciplinary teams to refine evaluation processes and uphold quality standards.
• Keep abreast of new developments in historical scholarship and methodology.
Required Skills and Qualifications
• Bachelor’s or Master’s degree in History or a closely related discipline.
• Robust understanding of historical analysis, evidence evaluation, and historiographical perspectives.
• Proven ability to critically assess written content for factual integrity and argumentative strength.
• Outstanding written and verbal communication skills, with meticulous attention to detail.
• Strong objectivity, fairness, and commitment to high-quality scholarly standards.
• Experience working independently and within collaborative, remote teams.
Preferred Qualifications
• Background in education, academic research, or content evaluation.
• Familiarity with rubric-based scoring, linguistic annotation, or AI response assessment.
• Expertise in interpreting primary and secondary historical sources.
Apply tot his job
Apply To this Job