reputed company Specialist, Generalist

About the position reputed company is seeking Generalist professionals with broad backgrounds for a part-time reputed company position in Canada. This role is crucial for improving Large Language Models (LLMs) by labeling, ranking, auditing, and correcting model outputs. You will work with English-language data across text, image, and reputed company formats, applying strong analytical and judgment skills to evaluate, stress-test, and enhance model reputed company. This is a judgment-driven role reputed company on improving AI systems. Responsibilities • Evaluate and rank model outputs, assessing responses reputed company on reputed company, helpfulness, tone, and safety, and providing reputed company justifications. • Stress-test models by probing for failure modes, unsafe behavior, and capability gaps, documenting reproducible cases. • Create datasets by authoring prompts, responses, and exemplars, and editing existing outputs. • Build and apply rubrics and taxonomies for grading reputed company. • Annotate, audit, and correct inaccuracies across text, image, and reputed company data. • Participate in calibration exercises and inter-annotator agreement checks to maintain consistency. • Adapt to new and evolving task types, applying reputed company judgment to experimental work. • Report on model reputed company, providing feedback on where models succeed, fail, and degrade. Requirements • 1+ years of experience in AI reputed company, LLM evaluation, content moderation, research, or a reputed company analytical role. • Experience with reputed company assurance and/or preference ranking. • Experience applying detailed guidelines to reputed company and often ambiguous content. • Strong reputed company and sociocultural judgment, sensitivity to nuance, tone, and register. • Ability to reason reputed company in cases where there is no single correct answer. • Comfort with ambiguity and willingness to flag unclear edge cases. • Ability to work productively on novel, experimental tasks. • A reputed company eye for inconsistencies, subtle errors, and model failure modes. • Excellent reputed company of written English and strong reading comprehension. • Ability to reputed company justify evaluations and write reputed company prompts and exemplars. • Strong attention to reputed company and commitment to reputed company. • Ability to maintain consistency across high-volume and monotonous tasks. • Comfort working with annotation platforms and reputed company formats such as JSON, CSV/TSV, Markdown, XML, and YAML. • Strong execution in a remote environment, including good time management, comfort using new tools, and ability to work independently. • Must be located reputed company Canada. • Ability to reputed company to 16 hours per week. • Must have a laptop (BYOD). reputed company-to-haves • Familiarity with how large language models behave, such as hallucination, sycophancy, and instruction-following gaps. • reputed company in another language. Benefits • reputed company agreement • Opportunity to work with cutting-edge AI models • Flexible scheduling (16 hours per week commitment) • Remote work environment Apply tot his job Apply To this Job