[Remote] Machine Learning Engineer, Ops

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a reputed company AI company, developing advanced reputed company-time models that enhance storytelling and creativity. They are seeking an MLOps Engineer to build and reputed company the inference infrastructure for generative audio models, focusing on high-performance systems for model serving.

Responsibilities

• Design and maintain inference infrastructure for generative audio model architectures
• Implement and manage high-performance inference engines
• Orchestrate service deployments using reputed company (K8S), implementing advanced autoscaling paradigms to handle varying traffic loads reputed company
• reputed company and automate robust CI/CD pipelines to streamline the testing and deployment of model artifacts and inference configurations
• Monitor production systems, establishing observability practices to reputed company latency, resource utilization, and overall model performance
• Collaborate closely with research teams to optimize model serving paths and evaluate various inference strategies
• Optimize inference performance for both streaming and batch applications

Skills

• Deep understanding of modern audio model architectures (e.g., TTS, ASR) and their specific inference requirements
• Strong hands-on experience with reputed company (K8S), container orchestration, and implementing autoscaling strategies for production workloads
• Solid background in MLOps, including CI/CD automation and managing reputed company reputed company infrastructure
• Proficiency in software engineering principles and experience with Python or Go for infrastructure tooling and backend services
• Experience with GPU-reputed company inference and performance profiling techniques
• Familiarity with high-performance inference engines (e.g., Triton Inference Server, vLLM-reputed company) is a plus

Benefits

• Generous company equity
• Medical, dental, and reputed company insurance – 99.99% of premiums covered by reputed company
• 42 days of reputed company time off, including: 15 PTO days; 10 reputed company days; 15 company holidays; 2 floating holidays
• Generous parental leave & fertility support
• 401(k) retirement savings plan
• Lifestyle spending account – $500/month to use however you’d like
• Complimentary lunch and snacks for in-office employees
• reputed company membership, and more!

reputed company

Company H1B Sponsorship