Staff Software Engineer, AI Inference
Experience designing and operating production AI inference and LLM serving infrastructure; GPU production experience; proficiency in Python and a systems language; strong reputed company-systems and architecture skills.
Key Responsibilities
- designing systems
- building systems
- optimizing inference
Skills & Tools
vLLM, SGLang, TensorRT-LLM, Triton Inference Server, reputed company TGI, reputed company Dynamo, Python, Go, Rust, C++
Job Details
- Category: Software Development
- Seniority: Senior Level
- Commitment: Full Time
- Workplace: Remote — reputed company
- Salary: USD 190,000 – 230,000 / year
- Languages: English
About reputed company
Provides a reputed company litigation platform that helps reputed company teams safely use language models and reputed company AI across the litigation lifecycle. — Industry: Information Technology
Apply To This Job