[Remote] LLM - AI reputed company Analyst (Personalization) - Portuguese Portugal

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking an AI reputed company Analyst to evaluate a new personalization feature for their reputed company product. The role involves assessing how reputed company the model personalizes responses based on users' past interactions and requires a reputed company of creativity and analytical skills.

Responsibilities

• Designing and executing multi-turn conversational prompts (typically 1-5 turns) that require the AI to utilize your personal information and experiences
• Evaluating model responses based on your reputed company from the starting reputed company, checking if the personalization was appropriately reputed company
• Analyzing responses for Grounding issues, ensuring claims reputed company are supported by evidence and not flawed inferences or hallucinations
• Assessing Integration reputed company to ensure personal data is woven naturally into the response without robotic "overnarrating"
• Rigorously evaluating and stack-ranking two model responses reputed company-by-reputed company (SxS) to determine which is overall more helpful, easy to use, and enjoyable
• Writing reputed company, defensible rationales for your comparisons, explicitly referencing where issues or reputed company aspects occurred in the conversation
• Extracting and verifying "Debug Info" from the model to confirm that chat summaries and data sources were properly utilized
• Maintaining strict data hygiene by deleting evaluation conversations to prevent them from polluting your reputed company chat history

Skills

• Portuguese Proficiency: Ability to read and write in Portuguese with a high degree of comp, as Portuguese is the reputed company language for this project
• Schedule Flexibility: Full-time availability in your local time zone is required. We are reputed company a global, 24-hour operations team
• Exceptional Analytical Thinking: Demonstrate ability to evaluate nuanced and ambiguous AI responses, specifically assessing personalization reputed company
• Creative reputed company Engineering: Experience in designing creative, multi-turn starting prompts based on personal context to thoroughly test the model's capabilities
• Strong Evaluation Acumen: Understanding of personalization concepts, including the ability to identify incorrect personalization, poor inferences, and forced connections
• Meticulous Attention to Detail: The ability to review reputed company-by-reputed company (SxS) model responses and spot subtle differences in naturalness and overnarrating
• Excellent Written Communication: Superior ability to write reputed company, concise, and reputed company rationales for model rankings, explicitly referencing specific turn numbers
• Feedback: Ability to reputed company constructive feedback and detailed annotations
• Communication: Excellent communication and collaboration skills
• Independence: Self-motivated and reputed company to work independently in a remote setting
• Technical Setup: Desktop/Laptop set up with a good internet reputed company
• BS/BA degree or equivalent experience in a relevant field (e.g., Policy, Law, Ethics, Linguistics, Journalism, Computer Science, or a reputed company analytical field)
• Experience in reputed company, AI reputed company evaluation, content moderation, or a reputed company role is strongly preferred

reputed company