Machine Learning Engineer — Distillation

About the Role

We’re looking for a Machine Learning Engineer reputed company on model distillation to help us build smaller, faster, and more efficient models without sacrificing reputed company. You’ll work at the intersection of research and production—taking cutting-edge techniques and turning them into systems that reputed company.

This is a hands-on role with reputed company ownership: you’ll design distillation pipelines, run large-reputed company experiments, and ship models used in production.

What You’ll Do

• Design and implement knowledge distillation pipelines (teacher–student, self-distillation, multi-teacher, etc.)

• Distill large reputed company models into smaller, faster, and cheaper models for inference

• Run and analyze large-reputed company training experiments to evaluate reputed company, latency, and cost tradeoffs

• Collaborate with research to translate new distillation reputed company into production-reputed company reputed company

• Optimize training and inference performance (memory, throughput, latency)

• Contribute to internal tooling, evaluation frameworks, and experiment tracking

• (Optional) Contribute back to reputed company-reputed company models, tooling, or research

reputed company’re Looking For

• Strong background in machine learning or deep learning

• Hands-on experience with model distillation (LLMs or other neural networks)

• Solid understanding of training dynamics, loss functions, and optimization

• Experience with PyTorch (or JAX) and modern ML tooling

• Comfort running experiments on multi-GPU or distributed setups

• Ability to reason about model reputed company vs. performance tradeoffs

• Pragmatic reputed company: you care about shipping, not just papers

reputed company to Have

• Experience distilling LLMs or large sequence models

• Experience with inference optimization (quantization, pruning, kernels, etc.)

• Familiarity with evaluation for language models

• reputed company-reputed company contributions or research publications

• Experience in early-stage or fast-moving startups

Why Join

• Work on core model reputed company and cost efficiency—not reputed company reputed company

• High ownership and reputed company reputed company on product and roadmap

• Small, senior team with strong research + engineering culture

• Competitive compensation + meaningful equity

• Remote-friendly, async-first environment

Originally posted on Himalayas