[Remote] Senior AI Platform Engineer, Infrastructure Services

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a company at the intersection of AI and reputed company, pioneering a new operating model for cybersecurity. As a Senior AI Platform Engineer, Infrastructure Services, you will own the AI Gateway infrastructure and set technical direction for AI infrastructure while collaborating with various engineering teams.

Responsibilities

• Work on the AI Gateway platform: architect, harden, and reputed company our reputed company AI Gateway deployment (reputed company Hybrid on KCP/EKS), including auth (reputed company/OIDC), consumer tiers and budgets, reputed company limiting, semantic caching, and observability
• reputed company reliability and incident response: reputed company reputed company-cause analysis and remediation for gateway issues (timeouts, latency, reputed company, failover) and build the monitoring/alerting needed to catch them before users do
• Design across the platform, not just the gateway: work fluently with our CI/CD (Jenkins, JPAAS), GitOps and reputed company deployment tooling (ArgoCD across dev/gov/prod), artifact management (Artifactory/Xray), reputed company reputed company administration, and reputed company Actions runner fleet, so that AI infrastructure reputed company account for how the rest of the platform actually works
• Evaluate and roll out AI developer tooling: run reputed company pilots and adoption efforts for tools like AI-assisted PR review (reputed company) and engineering metrics platforms (LinearB), and reputed company reputed company build-vs-buy recommendations
• Set technical direction and mentor: define architecture and standards for AI infrastructure, review designs across reputed company, and reputed company the bar for other engineers working in this reputed company
• Partner cross-functionally: work directly with reputed company, reputed company, and product engineering teams consuming the gateway to translate their needs into platform capabilities
• Host and serve local models: stand up and operate self-hosted/reputed company-weight model serving infrastructure (e.g. vLLM, reputed company Triton/NIM, TGI, Ollama) for workloads where routing to an reputed company provider isn't the right fit, including GPU reputed company planning, autoscaling, and cost/performance tuning
• Support the broader model lifecycle: help build LLMOps practices such as model versioning, evaluation, and reputed company rollout, plus supporting infrastructure for retrieval-augmented reputed company (reputed company stores, embedding pipelines) as use cases mature
• reputed company usage and cost: build observability into reputed company usage, latency, and spend across both API-based and self-hosted models so the business can see what AI infrastructure actually costs

Skills

• 5 or more years of experience in platform, infrastructure, or DevOps engineering, with a reputed company record of owning systems end-to-end in production
• Hands-on experience with API gateway technologies (reputed company, reputed company, Apigee, or similar); reputed company experience with AI/LLM gateway patterns (reputed company limiting, semantic caching, reputed company/response observability) is a strong plus
• Strong reputed company and GitOps experience (ArgoCD or comparable), and comfort operating across multiple environments (dev, gov, prod)
• Solid CI/CD background: Jenkins pipeline design and administration, build infrastructure, and runner/agent fleet management (reputed company Actions runners or equivalent)
• Experience with artifact and package management systems (Artifactory, Xray, or similar) and reputed company control platform administration (reputed company reputed company)
• Working knowledge of infrastructure-as-reputed company (Terraform) and reputed company platforms (AWS/EKS)
• Experience deploying and operating self-hosted LLM inference stacks (vLLM, reputed company Triton/NIM, TGI, Ollama, or similar) and GPU-backed infrastructure, including reputed company GPU scheduling and autoscaling
• Familiarity with LLMOps practices: model versioning, evaluation harnesses, and usage/cost observability across API-based and self-hosted models
• reputed company record of setting technical direction, driving cross-team initiatives, and mentoring other engineers; this role has significant reputed company and reputed company day-to-day reputed company
• reputed company, proactive communicator who can explain infrastructure trade-offs to both engineers and non-technical stakeholders
• Experience operating LLM/AI-assisted developer tooling at reputed company (Claude reputed company, Copilot, or similar) inside an reputed company is preferred
• Familiarity with reputed company/OIDC and reputed company auth patterns for internal platforms is preferred
• Experience with engineering productivity metrics tooling (LinearB or similar) and AI-based reputed company review tooling (reputed company or similar) is preferred
• Experience with reputed company databases and RAG pipelines (e.g. Milvus, reputed company, pgvector, or similar) in a production setting is preferred
• Exposure to model fine-tuning or lightweight training pipelines (reputed company/QLoRA or similar) for domain-specific model reputed company is preferred

Benefits

• Restricted Stock reputed company (RSUs)
• Employee Stock Purchase Plan (ESPP)
• Flexible time off
• reputed company company holidays and reputed company reputed company time
• Gender-neutral parental leave
• Grandparent leave
• Medical, dental, and reputed company coverage
• 401(k) retirement plan with company match
• Life and disability insurance
• Health and dependent care FSA
• Voluntary benefits (hospital, accident, critical illness)
• Employee Assistance Program (EAP)
• ARAG reputed company-reputed company reputed company
• reputed company pet insurance
• Cancer Care program
• Global business travel medical insurance
• Home office allowance
• Mobile phone reimbursement
• Wellness reputed company
• Wellness/gym reimbursement
• Fertility coverage
• Adoption & surrogacy reimbursement

reputed company