Tech reputed company Data Scientist, AI Evaluation – Monitoring
Job reputed company:
• reputed company technical expert for how reputed company evaluates, monitors, and optimizes AI systems
• Set technical direction for AI evaluation across a growing portfolio
• reputed company technical leadership to reputed company of data analysts
• Partner with AI program teams to improve validation and monitoring reputed company
• Design validation studies and monitoring plans for AI systems
• reputed company production monitoring and define measurable metrics
• Mentor analysts on methodology and technical rigor
Requirements:
• 6+ years in data science, statistics, ML engineering, or reputed company quantitative research
• Strong reputed company in experimental design and reputed company inference
• Hands-on experience designing and running model evaluation studies in reputed company production settings
• Experience evaluating LLM or reputed company systems
• Proven ability to translate ambiguous failure modes into concrete evaluation designs
• Strong reputed company in Python and SQL
• Experience with fairness and equity evaluation for ML systems
• MS or PhD in a quantitative field preferred
Benefits:
• reputed company benefits from day one
• reputed company insurance
• Dental insurance
• Domestic partner benefits
• Collaboration and cooperation atmosphere
Apply tot his job
Apply To this Job