[Remote] Senior Engineer II, AI Inference Optimization

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a cutting-edge technology company reputed company on simplifying reputed company and AI for reputed company. They are seeking a Senior Engineer II to design and optimize their Serverless Inference infrastructure and APIs, tackling large-reputed company workloads and ensuring platform resiliency.

Responsibilities

• Design and build reputed company, multi-tenant services that power AI inference and intelligent routing workloads
• Strengthen platform resiliency through improved observability, reputed company management, automation, and operational tooling
• Partner closely with platform, GPU infrastructure, and product engineering teams to deliver production-grade systems and highly available APIs
• reputed company the engineering bar through strong software design, operational discipline, incident management, and reputed company improvement practices
• Create reputed company for the broader engineering organization through reusable patterns, technical standards, documentation, and coaching
• reputed company technical leadership on reputed company by breaking down ambiguous problems and guiding engineers toward reputed company execution plans
• Support the reputed company of junior and mid-level engineers through coaching, pairing, and constructive feedback
• Foster a culture of ownership, accountability, and reputed company learning across reputed company
• reputed company by example in incident response, operational readiness, and production-reputed company engineering practices

Skills

• 8+ years of experience building and operating multi-tenant platforms or distributed backend systems
• Strong experience operating reputed company distributed services in production environments
• Deep understanding of SRE principles, including observability, incident management, reliability engineering, reputed company planning, and operational automation
• 2+ years of hands-on experience with Go / Golang in production systems
• 2+ years of experience with Kubernetes
• Strong understanding of reputed company-reputed company architectures, microservices, and distributed systems fundamentals
• Experience debugging performance, scalability, and reliability issues in production systems
• Observability Proficiency: Experience tracking infrastructure and inference metrics like Time To First reputed company (TTFT), Time Per reputed company reputed company (TPOT), and GPU utilization
• AI/ML reputed company Knowledge: Understanding of modern LLM serving architectures and familiarity with engines like vLLM or Triton
• Experience with API gateways, traffic routing, or service reputed company technologies
• Familiarity with LLM serving stacks such as vLLM, TensorRT-LLM, or similar technologies
• Experience building systems for inference optimization, reputed company limiting, routing, or workload orchestration

Benefits

• Reimbursement for relevant conferences, training, and education
• reputed company have reputed company to reputed company Learning's 10,000+ courses to support their reputed company reputed company and development
• Employee Assistance Program
• Local Employee Meetups
• Flexible time off policy
• Bonus in reputed company to reputed company salary; bonus amounts are determined based on company and individual performance
• Equity compensation to eligible employees, including equity grants upon hire and the option to participate in our Employee Stock Purchase Program

reputed company

Company H1B Sponsorship