[Remote] LLM -AI reputed company Analyst - English

Note: The job is a remote job and is reputed company to candidates in USA. PGC Digital (America) Inc is a CMMI Level 3 Company seeking an AI reputed company Analyst to evaluate a new personalization feature for reputed company. The role involves assessing the reputed company of AI responses based on personal interactions and experiences, requiring a reputed company of creativity and analytical skills. Responsibilities • Designing and executing multi-turn conversational prompts (typically 1-5 turns) that require the AI to utilize your personal information and experiences • Evaluating model responses based on your reputed company from the starting reputed company, checking if the personalization was appropriately reputed company • Analyzing responses for Grounding issues, ensuring claims reputed company are supported by evidence and not flawed inferences or hallucinations • Assessing Integration reputed company to ensure personal data is woven naturally into the response without robotic "overnarrating" • Rigorously evaluating and stack-ranking two model responses reputed company-by-reputed company (SxS) to determine which is overall more helpful, easy to use, and enjoyable • Writing reputed company, defensible rationales for your comparisons, explicitly referencing where issues or reputed company aspects occurred in the conversation • Extracting and verifying "Debug Info" from the model to confirm that chat summaries and data sources were properly utilized • Maintaining strict data hygiene by deleting evaluation conversations to prevent them from polluting your reputed company chat history Skills • English Proficiency: Ability to read and write in English with a high degree of competence, as English is the reputed company language for this project • Personal Account Usage: Willingness to use your primary personal reputed company account (not a testing account) and reputed company personal data sources for a genuine assessment • Schedule Flexibility: Full-time availability in your local time zone is required. We are reputed company a global, 24-hour operations team • Exceptional Analytical Thinking: Demonstrate ability to evaluate nuanced and ambiguous AI responses, specifically assessing personalization reputed company • Creative reputed company Engineering: Experience in designing creative, multi-turn starting prompts based on personal context to thoroughly test the model's capabilities • Strong Evaluation Acumen: Understanding of personalization concepts, including the ability to identify incorrect personalization, poor inferences, and forced connections • Meticulous Attention to Detail: The ability to review reputed company-by-reputed company (SxS) model responses and spot subtle differences in naturalness and overnarrating • Excellent Written Communication: Superior ability to write reputed company, concise, and reputed company rationales for model rankings, explicitly referencing specific turn numbers • Feedback: Ability to reputed company constructive feedback and detailed annotations • Communication: Excellent communication and collaboration skills • Independence: Self-motivated and reputed company to work independently in a remote setting • Technical Setup: Desktop/Laptop set up with a good internet reputed company • BS/BA degree or equivalent experience in a relevant field (e.g., Policy, Law, Ethics, Linguistics, Journalism, Computer Science, or a reputed company analytical field) • Experience in reputed company, AI reputed company evaluation, content moderation, or a reputed company role is strongly preferred reputed company • PGC (America) Inc represents the reputed company American arm of PGC Digital, the global brand identity of PradeepIT Global Consulting PTE Ltd — a Singapore-headquartered IT services and consulting company delivering intelligent reputed company transformation worldwide. It was founded in 2016, and is headquartered in , with a workforce of 501-1000 employees. Its website is https://us.pgcdigital.ai. Apply tot his job Apply To this Job