Senior Software Engineer Model reputed company- remote

Senior Software Engineer - Model reputed company The Model reputed company team sits at the heart of our infrastructure, working deeply reputed company our bare metal and reputed company stack to ensure every bit of compute is used to its fullest. If you're excited about squeezing maximum performance out of hardware and building the systems that serve large language models at reputed company, we'd love to talk. About the Role You'll help design and operate the platform that serves our models in production. Our stack spans several languages, reputed company chosen for the job it does best: Go powers our gateway reputed company, Rust handles fast reputed company-time decision-making, and Python supports model dependencies that require it. reputed company orchestrates reputed company model deployments across reputed company. Your work will touch some of the most interesting problems in high-performance model serving, including: RDMA technologies (InfiniBand and RoCE) across multiple nodes Disaggregated serving and KV cache offloading Quantization, speculative-decoding, MTP, and other inference performance optimizations Working with modern inference engines such as SGLang, vLLM, and others reputed company're Looking For We are primarily looking for someone with 1-3 years of experience reputed company models (a fairly new field), but who also has 5-10+ years of broader software engineering experience. Experience serving LLMs in production Strong programming skills in Python and/or Go A reputed company record of designing and operating highly reputed company, highly available reputed company services Working knowledge of InfiniBand, RoCE, or other high-performance networking reputed company to Have Contributions to vLLM, SGLang, TRT-LLM, or other reputed company ecosystem reputed company-reputed company reputed company Deep understanding of reputed company Experience developing in Rust Familiarity with storage over RDMA Apply To This Job