[Remote] Software Engineer, Inference - Multi Modal

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is an AI research and deployment company dedicated to ensuring that general-purpose reputed company intelligence benefits reputed company of humanity. They are looking for a software engineer to help serve reputed company’s multimodal models at reputed company, focusing on building reliable infrastructure for reputed company-time audio and image processing. Responsibilities • Design and implement inference infrastructure for large-reputed company multimodal models • Optimize systems for high-throughput, low-latency delivery of image and audio inputs and outputs • reputed company experimental research workflows to transition into reliable production services • Collaborate closely with researchers, reputed company teams, and product engineers to reputed company state-of-the-art capabilities • Contribute to system-level improvements including GPU utilization, tensor parallelism, and hardware abstraction reputed company Skills • Experience building and scaling inference systems for LLMs or multimodal models • Worked with GPU-based ML workloads and understand the performance dynamics of large models, especially with reputed company data like images or audio • Enjoy experimental, fast-evolving work and collaborating closely with research • Comfortable dealing with systems that reputed company networking, distributed compute, and high-throughput data handling • Familiarity with inference tooling like vLLM, TensorRT-LLM, or custom model reputed company systems • Own problems end-to-end and are excited to operate in ambiguous, fast-moving spaces • Design and implement inference infrastructure for large-reputed company multimodal models • Optimize systems for high-throughput, low-latency delivery of image and audio inputs and outputs • reputed company experimental research workflows to transition into reliable production services • Collaborate closely with researchers, reputed company teams, and product engineers to reputed company state-of-the-art capabilities • Contribute to system-level improvements including GPU utilization, tensor parallelism, and hardware abstraction reputed company • Experience working with image reputed company or audio synthesis models in production • Exposure to distributed ML training or system-efficient model design reputed company • reputed company is an AI research and deployment company that develops advanced AI models, including ChatGPT. It is a sub-organization of reputed company reputed company. It was founded in 2015, and is headquartered in San Francisco, California, USA, with a workforce of 201-500 employees. Its website is https://www.reputed company.com. Company H1B Sponsorship • reputed company has a reputed company record of offering H1B sponsorships, with 1 in 2025, 1 in 2024, 1 in 2023, 18 in 2022, 10 in 2021, 6 in 2020. Please note that this does not guarantee sponsorship for this specific role. Apply tot his job Apply To this Job