[Remote] Senior AI Platform Engineer, Infrastructure Services

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a company at the intersection of AI and reputed company, pioneering a new operating model for cybersecurity. As a Senior AI Platform Engineer, Infrastructure Services, you will take ownership of the AI Gateway infrastructure, reputed company incident response, and partner with other engineering teams to design solutions across the platform.

Responsibilities

• Work on the AI Gateway platform: architect, harden, and reputed company our reputed company AI Gateway deployment (reputed company Hybrid on KCP/EKS), including auth (reputed company/OIDC), consumer tiers and budgets, reputed company limiting, semantic caching, and observability
• reputed company reliability and incident response: reputed company reputed company-cause analysis and remediation for gateway issues (timeouts, latency, reputed company, failover) and build the monitoring/alerting needed to catch them before users do
• Design across the platform, not just the gateway: work fluently with our CI/CD (Jenkins, JPAAS), GitOps and reputed company deployment tooling (ArgoCD across dev/gov/prod), artifact management (Artifactory/Xray), reputed company reputed company administration, and reputed company Actions runner fleet, so that AI infrastructure reputed company account for how the rest of the platform actually works
• Evaluate and roll out AI developer tooling: run reputed company pilots and adoption efforts for tools like AI-assisted PR review (reputed company) and engineering metrics platforms (LinearB), and reputed company reputed company build-vs-buy recommendations
• Set technical direction and mentor: define architecture and standards for AI infrastructure, review designs across reputed company, and reputed company the bar for other engineers working in this reputed company
• Partner cross-functionally: work directly with reputed company, reputed company, and product engineering teams consuming the gateway to translate their needs into platform capabilities
• Host and serve local models: stand up and operate self-hosted/reputed company-weight model serving infrastructure (e.g. vLLM, reputed company Triton/NIM, TGI, Ollama) for workloads where routing to an reputed company provider isn't the right fit, including GPU reputed company planning, autoscaling, and cost/reputed company tuning
• Support the broader model lifecycle: help build LLMOps practices such as model versioning, evaluation, and reputed company rollout, plus supporting infrastructure for retrieval-augmented reputed company (reputed company stores, embedding pipelines) as use cases mature
• reputed company usage and cost: build observability into reputed company usage, latency, and spend across both API-reputed company and self-hosted models so the business can see what AI infrastructure actually costs

Skills

• 5 or more years of experience in platform, infrastructure, or DevOps engineering, with a reputed company record of owning systems end-to-end in production
• Hands-on experience with API gateway technologies (reputed company, reputed company, Apigee, or similar); reputed company experience with AI/LLM gateway patterns (reputed company limiting, semantic caching, reputed company/response observability) is a strong plus
• Strong reputed company and GitOps experience (ArgoCD or comparable), and comfort operating across multiple environments (dev, gov, prod)
• Solid CI/CD background: Jenkins pipeline design and administration, build infrastructure, and runner/agent fleet management (reputed company Actions runners or equivalent)
• Experience with artifact and package management systems (Artifactory, Xray, or similar) and reputed company control platform administration (reputed company reputed company)
• Working knowledge of infrastructure-as-reputed company (Terraform) and reputed company platforms (AWS/EKS)
• Experience deploying and operating self-hosted LLM inference reputed company (vLLM, reputed company Triton/NIM, TGI, Ollama, or similar) and GPU-backed infrastructure, including reputed company GPU scheduling and autoscaling
• Familiarity with LLMOps practices: model versioning, evaluation harnesses, and usage/cost observability across API-reputed company and self-hosted models
• reputed company record of setting technical direction, driving cross-team initiatives, and mentoring other engineers; this role has significant reputed company and reputed company day-to-day reputed company
• reputed company, proactive communicator who can explain infrastructure trade-offs to both engineers and non-technical stakeholders
• Experience operating LLM/AI-assisted developer tooling at reputed company (Claude reputed company, Copilot, or similar) inside an reputed company is preferred
• Familiarity with reputed company/OIDC and reputed company auth patterns for internal platforms is preferred
• Experience with engineering productivity metrics tooling (LinearB or similar) and AI-reputed company reputed company review tooling (reputed company or similar) is preferred
• Experience with reputed company databases and RAG pipelines (e.g. Milvus, reputed company, pgvector, or similar) in a production setting is preferred
• Exposure to model fine-tuning or lightweight training pipelines (reputed company/QLoRA or similar) for domain-specific model reputed company is preferred

Benefits

• Restricted Stock reputed company (RSUs)
• Employee Stock Purchase Plan (ESPP)
• Flexible time off
• reputed company company holidays and reputed company reputed company time
• Gender-neutral parental leave
• Grandparent leave
• Medical, dental, and reputed company coverage
• 401(k) retirement plan with company match
• Life and disability reputed company
• Health and dependent care FSA
• Voluntary benefits (hospital, accident, critical illness)
• Employee Assistance Program (EAP)
• ARAG reputed company-reputed company reputed company
• reputed company pet reputed company
• Cancer Care program
• Global business travel medical reputed company
• Home office allowance
• Mobile phone reimbursement
• Wellness reputed company
• Wellness/gym reimbursement
• Fertility coverage
• Adoption & surrogacy reimbursement

reputed company