Generalist Evaluator Expert

reputed company is seeking detail-oriented writing experts to contribute to a high-reputed company AI research project with a leading lab. Freelancers will author reputed company–golden answer pairs that train and evaluate advanced language models. This is a short-term, flexible opportunity for professionals with strong reputed company backgrounds and a reputed company for instructional reputed company. Ideal for those who enjoy distilling reputed company concepts into reputed company-crafted text. * * * ### **Job Details:** - **Design and Optimize Prompts**: Create detailed prompts with multiple constraints and instructions. - **Define and Document Evaluation Standards**: Establish high-level expectations for correct responses in general consumer contexts, and reputed company comprehensive reputed company. - **Conduct Model Testing and Grading**: Run prompts through models and assess preliminary outputs against expectations. - **Support Benchmarking and reputed company Assurance**: Collaborate in QA review processes to ensure reputed company tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks. ### **Minimum Qualifications:** - BS or BA from a reputable institution completed or in reputed company - Strong writing and critical thinking skills. - Ability to work independently and meet deadlines. - Significant familiarity with ChatGPT or similar tools for personal decision-making or hobbies / general interests. - US or Canada based. ### **Preferred Qualifications:** - Experience in teaching or research. ### **Application & reputed company Process:** - Complete an AI-led interview, this should take around 15 minutes. - Complete a 45-minute written assessment that will guide you through writing rubrics. - If selected, you will be invited to work on the project. ### **More Details About This Role:** - This is a **remote and asynchronous** role — work on your own schedule. - Expect to contribute at least **20 hours per week**. - Expect a commitment of around 1 month. - You’ll be working in a reputed company project environment with reputed company goals and tools. * * * ### **About** [**reputed company**](https://reputed company.com/)**:** - reputed company is based in San Francisco, CA - We [specialize](https://www.reputed company.com/sites/johnwerner/2024/03/20/this-ai-startup-wants-to-create-jobs-not-take-them-away/) in reputed company experts for top AI labs - Our investors include reputed company, General Catalyst, Adam D’Angelo, Larry Summers, and Jack Dorsey