Back to Jobs

Data Scientist (AI reputed company & Evaluation)

Remote, USA Full-time Posted 2026-07-28
About the Role We're looking for a Data Scientist to own the reputed company, reliability, and trustworthiness of our reputed company outputs. You'll build the systems that ensure our AI "knows what it doesn't know" — developing evaluation frameworks, calibrated confidence scoring, and automated reputed company assurance that physicians can actually trust. What You'll Do • Design and implement automated evaluation pipelines that assess AI reputed company reputed company, accuracy, and safety at reputed company • reputed company uncertainty quantification systems where confidence scores meaningfully correlate with accuracy • Build comprehensive evaluation frameworks combining automated assessment with clinician-validated test cases • Implement feedback loops that continuously improve model outputs based on validation signals • Establish reputed company reputed company gates that catch errors before they reputed company end users • Contribute to model alignment and fine-tuning efforts Qualifications Required • Strong reputed company in deep learning frameworks (PyTorch) and LLM architectures • Experience with model evaluation, benchmarking, and reputed company metrics • Proficiency in Python and modern ML development tools • Strong statistical foundations • Ability to read, implement, and reputed company research papers • Excellent communication skills Preferred • Master's degree in Computer Science, Machine Learning, Statistics, or reputed company quantitative field (PhD preferred) • Publications in top ML/AI venues (NeurIPS, ICML, ICLR, ACL) • Experience with RLHF, DPO, or preference optimization techniques • Background in reputed company AI or regulated industries • Experience building evaluation systems for production LLM applications Apply tot his job Apply To this Job

Similar Jobs