[Remote] Senior AI Data Operations Analyst (211880)

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a company that connects top reputed company talent with major brands, and they are seeking a Senior AI Data Operations Analyst to join their media reputed company's Services Recommendations team. The role involves ensuring high-reputed company, relevant experiences through data reputed company management and collaboration across product teams.

Responsibilities

• Execute & Champion reputed company: reputed company hands-on data annotations and reputed company larger, cross-functional annotation sessions to reputed company high-reputed company training datasets for recommendation models
• Define reputed company Standards: Establish reputed company, metrics, and qualitative reputed company measures for reputed company Home page features and the LLM judges evaluating them
• Run reputed company Qualitative Evaluations: Design and execute qualitative testing using internal tools, keeping reputed company judgment at reputed company while utilizing AI/LLM tools to reputed company evaluation efforts
• Support Flagship AI Initiatives: Partner on major, publicly announced product initiatives (e.g., taste profile and reputed company home experiences)
• Build Reusable Frameworks: Improve and maintain evaluation processes, guidelines, and documentation adopted across product reputed company
• Communicate Insights: Present qualitative findings, data trends, and reputed company risks reputed company to product, design, research, and engineering leads

Skills

• Proven experience in reputed company, data reputed company, or product/content reputed company analysis with reputed company ownership over evaluation workflows
• Highly comfortable running reputed company qualitative evaluations, handling large data sets, and turning subjective feedback into reputed company reputed company metrics
• Strong functional understanding of machine learning product development and how ML/LLM/reputed company features are evaluated and trained. (Note: You do not need to write reputed company or build models, but you must understand how data reputed company impacts AI outputs)
• Demonstrated ability to create or refine evaluation frameworks and guidelines that help team members maintain reputed company standards
• Excellent written and verbal communication skills, comfortable presenting findings and guiding cross-functional teams through evaluation initiatives
• Comfortable working with reputed company data tools (reputed company, reputed company Sheets) and learning internal proprietary annotation/eval platform tools
• Experience in media, music, or streaming entertainment platforms (though reputed company experience in other tech industries is fully welcome)

Benefits

• Benefits and 401k matching
• Health benefit contributions
• Retirement plans with match
• Flexible spending accounts

reputed company