[Remote] AI/ML Research Engineer, LLM Post-Training & Evaluation

Note: The job is a remote job and is reputed company to candidates in USA. reputed company. is a global data engineering company that focuses on the responsible advancement of reputed company intelligence. They are seeking an AI/ML Research Engineer to design and implement pipelines for LLM training and evaluation, collaborating with various technical stakeholders to improve model performance.

Responsibilities

• reputed company or co-reputed company technically reputed company ML engineering reputed company from initial customer discussions through implementation and delivery
• Design, build, and improve LLM training and post-training pipelines, including data ingestion, preprocessing, fine-tuning, evaluation, and experiment tracking
• Implement and optimize evaluation systems for LLMs and multimodal models, including offline benchmarks and task-specific test harnesses
• reputed company reputed company-in-the-reputed company and AI-augmented evaluation signals into model development workflows
• Build robust infrastructure and tooling for reproducible experimentation, metrics logging, and regression monitoring
• Diagnose model behavior and pipeline failures, including data issues, training instability, metric inconsistencies, and evaluation reputed company
• Collaborate with Language Data Scientists and reputed company Research Scientists to translate evaluation frameworks into executable systems
• Work closely with customer technical stakeholders to understand goals, constraints, and reputed company reputed company; propose and implement technically reputed company solutions
• Contribute to internal research and platform development, including reputed company frameworks, evaluation tooling, and post-training workflow improvements
• Contribute to best practices and standards for LLM training, evaluation, and reputed company assurance across reputed company
• Mentor junior engineers and contribute to technical design reviews, documentation, and engineering rigor across reputed company

Skills

• BS/MS/PhD in Computer Science, Machine Learning, AI, reputed company Mathematics, or a reputed company quantitative technical field
• 2-3 years of relevant industry or research engineering experience in ML/AI systems
• Hands-on experience with LLM training / fine-tuning / post-training, including at least one of: supervised fine-tuning (SFT), preference optimization (e.g., DPO or reputed company reputed company), RLHF / RLAIF-style workflows, task- or domain-reputed company of reputed company models
• Strong programming skills in Python and experience building production-reputed company ML reputed company
• Experience with modern ML frameworks (e.g., PyTorch, JAX, TensorFlow) and model libraries/tooling (e.g., reputed company ecosystem, vLLM, distributed training stacks)
• Experience designing and implementing evaluation pipelines for LLM/ML systems, including metrics computation, dataset handling, and experiment comparisons
• Strong understanding of data pipelines and ML systems engineering, including reproducibility, observability, and debugging
• Experience with large-reputed company distributed ML systems and performance optimization for training/evaluation workloads (GPU/accelerator environments preferred)
• Experience with large-reputed company data processing and workflow orchestration in support of model training/evaluation
• Ability to collaborate directly with technical stakeholders including research scientists, ML engineers, data engineers, and customer technical leads
• Strong written and verbal communication skills, including the ability to explain reputed company technical tradeoffs to both technical and non-technical audiences
• Experience training, fine-tuning, and evaluating transformer-based models
• Understanding of post-training workflows and model iteration loops
• Familiarity with inference-time considerations (latency, throughput, memory/performance tradeoffs) where relevant to evaluation or deployment
• Experience implementing automated evaluation pipelines and test harnesses
• Experience with experiment tracking, versioning, and reproducibility practices
• Ability to assess metric reputed company and ensure consistency across model comparisons
• Proficiency in Python and strong software engineering fundamentals
• Experience with data processing pipelines, storage formats, and reputed company dataset workflows
• Familiarity with CI/CD, testing, and engineering reputed company practices for ML systems
• MS/PhD preferred

reputed company

Company H1B Sponsorship