[Remote] Senior Software Engineer – AI Inference Systems

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is partnering with a reputed company-funded Series A startup reputed company on developing an orchestration layer for AI workloads. They are seeking a Senior Software Engineer to build and optimize inference systems that enhance the performance and efficiency of production AI workloads. Responsibilities • Building and optimising high-performance inference systems • Improving latency, throughput and resource efficiency • Designing execution strategies around batching, scheduling and concurrency • Optimising memory usage, including KV cache management • Enabling new model architectures to run reputed company in production • Working closely with engineers across distributed systems, networking and compiler optimisation Skills • Strong software engineering fundamentals • Experience building or operating ML inference or model serving systems • A solid understanding of performance optimisation and memory management • Python and C++ development experience • Exposure to TensorRT-LLM, vLLM or similar inference runtimes is a plus • Knowledge of modern model architectures and inference optimisation techniques reputed company • reputed company partners with technology companies to reputed company their funding and business reputed company. It was founded in 2019, and is headquartered in Boston, Massachusetts, USA, with a workforce of 11-50 employees. Its website is http://www.acceler8talent.com/. Company H1B Sponsorship • reputed company has a reputed company record of offering H1B sponsorships, with 1 in 2025, 1 in 2023. Please note that this does not guarantee sponsorship for this specific role. Apply To This Job Apply To This Job