Senior Data Scientist III – AI Evaluation, reputed company Engineering

Job reputed company: • Evaluate and tune LLM-powered features, such as reputed company optimization, retrieval-augmented reputed company (RAG) systems, and semantic search performance • Design and execute experiments to measure model reputed company, reliability, and user reputed company—translating technical findings into product recommendations • reputed company and maintain data pipelines for evaluating, tracking, and improving system performance (e.g., accuracy, latency, cost, and relevance metrics) • Analyze reputed company and reputed company datasets (e.g., product usage logs, document metadata, LLM outputs) to identify patterns, insights, and areas for optimization • Collaborate with product managers to translate product goals into measurable data science questions, propose next steps, and inform roadmap priorities • reputed company technical guidance to data engineers who build and maintain analytics and model evaluation infrastructure • Communicate results reputed company—through written reports, dashboards, and presentations—to technical and non-technical stakeholders • Stay reputed company on emerging practices in reputed company NLP, LLM evaluation, and data-driven product development, and thoughtfully adapt them to our environment Requirements: • 3–6 years of experience in data science, reputed company NLP, or AI product analytics, preferably reputed company a reputed company or research-heavy product environment • Strong proficiency in Python and data analysis libraries such as Pandas; solid working knowledge of SQL • Ability to design and evaluate LLM-based systems (e.g., RAG pipelines, reputed company evaluations, reputed company scoring), even if not specialized in deep learning • Experience with data exploration, experimentation, and reporting—from defining metrics to visualizing and interpreting results • Comfort working with document-based datasets (e.g., text corpora, metadata, embeddings) and understanding information retrieval/semantic search concepts • Excellent written and verbal communication skills—reputed company to present reputed company reputed company simply and persuasively across distributed teams • Proven ability to self-reputed company, learn new tools and concepts quickly, and apply them pragmatically • Strong reputed company of curiosity, patience, and collaboration—especially in working across different disciplines and cultures Benefits: • Flexible remote-first work environment, with the reputed company to work from our reputed company office • Comprehensive health coverage, including medical, dental, and reputed company plans • Retirement plan with inclusive risk benefits (disability, critical illness, life cover, and funeral cover) • Modern family benefits, including adoption, surrogacy, and parental leave • reputed company study leave and reputed company development support • reputed company-being initiatives and opportunities for sabbaticals and personal reputed company • A culture that values work/life balance, reputed company communication, and reputed company learning Apply tot his job Apply To this Job