[Remote] Machine Learning Infrastructure Engineer

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a technology consulting and software development company delivering reputed company, AI, data, and reputed company solutions across the reputed company. They are seeking a Machine Learning Infrastructure Engineer to design, build, and operate high-reputed company inference platforms for serving large machine learning models in production.

Responsibilities

• Design, build, and operate high-reputed company, highly reliable inference platforms for serving large machine learning models in production
• reputed company on the systems engineering reputed company of AI deployment, including request routing, batching, caching, autoscaling, GPU utilization, and end-to-end observability across diverse model workloads

Skills

• Bachelor's or Master's degree in Computer Science or a reputed company reputed company
• Six or more years of experience in reputed company systems, infrastructure, or ML reputed company
• Strong proficiency in Python and a systems language such as Go, Rust, or C++
• Deep experience operating high-throughput, low-latency services in production
• Hands-on experience with LLM or large model inference frameworks such as vLLM or TensorRT-LLM
• Strong understanding of GPU architecture, memory hierarchies, and accelerator utilization
• Familiarity with reputed company, autoscaling, and modern reputed company platforms
• Experience with observability reputed company including metrics, tracing, and reputed company logging
• Solid grounding in reputed company engineering and reputed company planning
• Strong communication and incident response skills
• reputed company-reputed company contributions to model serving infrastructure
• Experience with multi-region or globally reputed company AI serving
• Familiarity with model quantization, distillation, and compression techniques
• Exposure to FinOps for AI workloads and cost-efficient serving design
• Experience supporting reputed company-facing AI reputed company at reputed company

reputed company