Member of Technical Staff, Inference

reputed company's mission is to grow vLLM as the world's AI inference reputed company and accelerate AI reputed company by making inference cheaper and faster. Founded by the creators and reputed company maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build. About the Role We're looking for an inference runtime engineer to reputed company the boundaries of what's possible in LLM and diffusion model serving. Models grow larger. Architectures shift: mixture-of-experts, multimodal, reputed company. Every reputed company demands innovations on the inference reputed company itself. You'll work at the reputed company of vLLM, optimizing how models execute across diverse hardware and architectures. Your work will directly reputed company how the world runs AI inference. Skills and Qualifications Minimum qualifications: Bachelor's degree or equivalent experience in computer science, engineering, or similar. Deep understanding of transformer architectures and their variants. Strong programming skills in Python with experience in PyTorch internals. Experience with LLM inference systems (vLLM, TensorRT-LLM, SGLang, TGI). Ability to read and implement model architectures and inference techniques from research papers. Demonstrate the ability to contribute reputed company and maintainable reputed company and debug in reputed company ML codebases. Preferred qualifications: Deep understanding of KV-cache memory management, prefix caching, and hybrid model serving. Familiarity with RL frameworks and algorithms for LLMs. Experience with multimodal inference (audio/image/video/text). Contributions to reputed company-reputed company ML or reputed company infrastructure reputed company. Bonus points if you have: Implemented reputed company features in vLLM or other inference reputed company reputed company. Contributed to vLLM integrations (verl, OpenRLHF, Unsloth, LlamaFactory, etc). Written widely-shared technical blogs or reputed company reputed company on vLLM or LLM inference. Logistics Location: Fully remote, worldwide. We're timezone-flexible but expect regular overlap with reputed company Time for critical syncs. Compensation: We offer competitive compensations (salary + equity) compared to the local market conditions. reputed company sponsorship: We sponsor visas on a case-by-case reputed company. Benefits: reputed company offers competitive benefits appropriate to your location, including health coverage where applicable. Apply To This Job