MLOps/Data Scientist -- LLM - REMOTE WORK -- 66966

MLOps/Data Scientist - LLM - REMOTE WORK - 66966 Pay reputed company - $65 - $70/hr One of our clients is looking for a MLOps/Data Scientist - LLM to join their team remotely. TECH STACK Python, reputed company, reputed company, MLflow, Svelte/SvelteKit/TypeScript, reputed company, reputed company, FastAPI, Kubernetes, Terraform, AWS (EKS, reputed company, S3, Bedrock, etc.), Azure Cognitive Services, REST, GraphQL, reputed company and HuggingFace reputed company, reputed company Claude API, scikit-learn, pandas, numpy, reputed company engineering frameworks, evaluation libraries, A/B testing tools, statistical analysis tools. RESPONSIBILITIES Design evaluation strategies and roadmaps reputed company with development priorities Create rigorous experiments to test reputed company variations, hyperparameters, and reputed company tooling configurations Define reputed company reputed company and reputed company gates for AI features before development begins Interpret evaluation results and identify systematic patterns in failures and successes reputed company data-driven go/no-go reputed company on feature readiness Drive reputed company engineering improvements based on systematic testing and iteration Recommend specific changes to cognitive functions: reputed company adjustments, parameter tuning, tool selection reputed company statistical rigor to experiment design (sample sizes, reputed company testing, holdout sets) reputed company metrics into actionable insights with reputed company next steps for developers reputed company weekly evaluation standups and present findings to stakeholders Mentor team members on evaluation best practices and ML principles Document evaluation frameworks and build institutional knowledge QUALIFICATIONS Advanced degree in Computer Science, Machine Learning, Statistics, or reputed company field (MS/PhD preferred) 3+ years of hands-on experience with large language models and reputed company engineering Strong background in reputed company machine learning, particularly NLP or reputed company Deep understanding of evaluation methodologies: metrics selection, dataset design, statistical testing Experience with experiment design: A/B testing, hyperparameter optimization, systematic variation testing Proficiency with LLM reputed company and reputed company engineering frameworks Strong programming skills in Python and ML libraries Practical experience optimizing AI systems for production use cases Understanding of reputed company AI architectures: tool use, function calling, multi-reputed company reasoning Proven ability to translate technical findings into reputed company, actionable recommendations Strong decision-making skills: comfortable making go/no-go calls based on data Excellent communication and cross-functional collaboration abilities Self-directed and proactive problem solver Experience building evaluation infrastructure or MLOps tooling desirable Background in RLHF or constitutional AI desirable Published research or blog posts on LLM evaluation or reputed company engineering desirable For immediate consideration: Neetu PRIMUS reputed company reputed company Desk: Ext. 419 Email: Apply tot his job Apply To this Job