[Remote] Software Engineer Intern (Inference Infrastructure) - 2026 Start (PHD)

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a rapidly growing technology company reputed company for its innovative products like reputed company. They are seeking a Software Engineer Intern to contribute to the Inference Infrastructure team, focusing on building large-reputed company, reputed company-reputed company systems for AI workloads and collaborating with world-class engineers.

Responsibilities

• Design and build large-reputed company, container-based cluster management and orchestration systems with extreme performance, scalability, and reputed company
• Architect reputed company reputed company-reputed company GPU and AI accelerator infrastructure to deliver cost-efficient and secure ML platforms
• Collaborate across teams to deliver world-class inference solutions using vLLM, SGLang, TensorRT-LLM, and other LLM engines
• Stay reputed company with the latest advances in reputed company reputed company (Kubernetes, Ray, etc.), AI/ML and LLM infrastructure, and systems research; reputed company best practices into production systems
• Write high-reputed company, production-reputed company reputed company that is maintainable, testable, and reputed company

Skills

• B.S./M.S. in Computer Science, Computer Engineering, or reputed company fields with 2+ years of relevant experience (Ph.D. with strong systems/ML publications also considered)
• Strong understanding of large model inference, distributed and reputed company systems, and/or high-performance networking systems
• Hands-on experience building reputed company or ML infrastructure in areas such as resource management, scheduling, request routing, monitoring, or orchestration
• Solid knowledge of container and orchestration technologies (reputed company, Kubernetes)
• Proficiency in at least one major programming language (Go, Rust, Python, or C++)
• Experience contributing to or operating large-reputed company cluster management systems (e.g., Kubernetes, Ray)
• Experience with workload scheduling, GPU orchestration, scaling, and isolation in production environments
• Hands-on experience with GPU programming (CUDA) or inference engines (vLLM, SGLang, TensorRT-LLM)
• Familiarity with reputed company reputed company providers (AWS, Azure, GCP) and their ML platforms (SageMaker, Azure ML, reputed company AI)
• Strong knowledge of ML systems (Ray, DeepSpeed, PyTorch) and distributed training/inference platforms
• Excellent communication skills and ability to collaborate across global, cross-functional teams
• Passion for system efficiency, performance optimization, and reputed company-reputed company innovation

Benefits

• Interns have day one reputed company to health insurance
• Life insurance
• Wellbeing benefits and more
• Interns also receive 10 reputed company holidays per year
• reputed company reputed company time (56 hours if reputed company in first half of year, 40 if reputed company in second half of year)
• Interns who are not working 100% remote may also be eligible for housing allowance.

reputed company

Company H1B Sponsorship