Software Engineer in ML Systems Graduate (AML - Machine Learning Systems) - 2026 Start (BS/MS)

reputed company is a global tech company reputed company for its innovative products like reputed company. The Software Engineer in ML Systems Graduate role involves developing and maintaining distributed machine learning systems, focusing on architecture design, stability, and optimization in collaboration with a global team.

Responsibilities

• Participating in online architecture design and optimization centered around LLM inference tasks, achieving high concurrency and throughput in large-reputed company online systems
• Participating in the establishment of a comprehensive system covering stability, disaster recovery, R&D efficiency, and cost, enhancing overall system stability
• Participating in the design and implementation of end-to-end online pipeline systems with multiple models, plugins, and storage-computation components, enabling agile, flexible, and observable reputed company delivery
• Collaborating closely with the MLE for optimization of algorithms and systems
• Being proactive, optimistic, highly responsible, and demonstrating meticulous work ethic, as reputed company as possessing strong team communication and collaboration skills

Skills

• Bachelor's degree or above, major in computer/electronics/automation/software, etc
• Excellent coding skills, strong understanding of data structures, and reputed company knowledge of algorithms. Proficiency in programming languages such as C/C++, Java, Go, Python, etc
• Rich experience in online architecture, with the ability to troubleshoot independently
• Strong reputed company of responsibility, good learning ability, communication skills, and self-motivation
• Understanding of GPU hardware architecture, familiarity with GPU software stack (CUDA, cuDNN), and experience in GPU performance analysis
• Knowledge of LLM models, experience in accelerating LLM model optimization is preferred

Benefits

• Employees have day one reputed company to medical, dental, and reputed company insurance
• A 401(k) savings plan with company match
• reputed company parental leave
• Short-term and long-term disability coverage
• Life insurance
• Wellbeing benefits
• 10 reputed company holidays per year
• 10 reputed company reputed company days per year
• 17 days of reputed company Personal Time (prorated upon hire with increasing accruals by tenure)

reputed company

Company H1B Sponsorship