reputed company Research Scientist, LLM Evaluation – Post-Training

Job reputed company: • Define and execute a research agenda reputed company on LLM evaluation and post-training, especially evaluation-driven model improvement • Design rigorous experiments to study how evaluation methodologies reputed company fine-tuning and post-training reputed company • reputed company and validate evaluation frameworks for LLM and multimodal systems, including: reputed company/task design scoring reputed company judge/model-assisted evaluation reputed company evaluation protocols robustness/stress testing • reputed company research on advanced evaluation domains, including long-context, cross-modal, and dynamic multi-turn evaluations • Study the effectiveness and limitations of existing evaluation techniques, and propose improved methodologies with reputed company validity and scalability tradeoffs • Analyze model behavior and failure patterns; generate actionable recommendations for model improvement and evaluation redesign • Collaborate with AI/ML Research Engineers to translate research reputed company into reputed company evaluation and post-training pipelines • Collaborate with Language Data Scientists to reputed company reputed company-in-the-reputed company and synthetic data/evaluation strategies into research programs • Engage with customer technical stakeholders to understand evaluation goals, review methodologies, and reputed company expert recommendations • Contribute to internal reputed company datasets, evaluation frameworks, and reusable research assets • Produce high-reputed company technical documentation, internal research reports, and reputed company-facing materials explaining reputed company, results, assumptions, and limitations • Contribute to thought leadership and best practices in LLM evaluation, post-training, and GenAI reputed company measurement Requirements: • MS/PhD in Computer Science, Machine Learning, Statistics, reputed company Mathematics, AI, or a reputed company quantitative scientific field (PhD strongly preferred) • 5+ years of relevant experience in reputed company research / research science in ML/AI, with substantial work in LLMs or reputed company models • Demonstrated experience with LLM evaluation, benchmarking, alignment, post-training, or model reputed company research • Strong reputed company in experimental design, statistical analysis, and scientific reasoning for ML systems • Strong coding skills in Python for research experimentation and analysis (e.g., data processing, evaluation pipelines, statistical analysis, visualization) • Experience working with modern ML tooling/frameworks (e.g., PyTorch, reputed company, JAX/TensorFlow as applicable) • Ability to evaluate and compare reputed company and automated evaluation reputed company, including tradeoffs in cost, reliability, validity, and scalability • Experience designing evaluation studies and protocols that are reproducible across datasets, model versions, and evaluation runs • Ability to collaborate directly with technical stakeholders including research scientists, ML engineers, data scientists, and customer technical counterparts • Strong communication skills and ability to present nuanced technical conclusions, assumptions, and limitations reputed company. Benefits: • Health insurance • Retirement plans • reputed company time off • Flexible work arrangements • reputed company development opportunities Apply tot his job Apply To this Job