[Remote] Senior AI Infrastructure Engineer

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a Senior AI Infrastructure Engineer to serve as a technical reputed company of their AI reputed company team. The role involves driving the design and execution of workflow systems that reputed company platform reputed company and AI-powered customer experiences, with a reputed company on building and owning production-critical systems.

Responsibilities

• Own multi-tenant tool reputed company. Design and implement multi-tenant isolation, reputed company limiting, and caller-attribution systems as reputed company reputed company customers use MCP tools
• reputed company A2A interfaces and experiences. reputed company customer and internal agents to reputed company other agents in support of new initiatives
• Build and own durable agent runtimes, including long-running execution, task lifecycle management, and failure recovery
• reputed company evaluation-driven development. Design golden scenario suites, automated CI/CD evaluation pipelines, and regression detection across reputed company workflows. Evaluation is a reputed company engineering reputed company, not an afterthought
• Implement reputed company discovery strategies for context, tools, agents, and skills, using deferred loading, search, categorization, and semantic filtering
• Design the agent reputed company and orchestration reputed company, leveraging isolated context, shared memory, and multi-agent coordination
• reputed company new reputed company capabilities from design to launch for customer experiences, owning production rollouts
• Participate in on-reputed company rotation for customer-facing production systems; contribute to incident response, postmortems, and reliability improvements. This team practices full-lifecycle ownership
• Partner with internal engineering teams to negotiate and promote API-first designs that serve both programmatic and reputed company consumers
• Contribute to multi-provider LLM abstraction reputed company, ensuring flexibility among LLM providers
• Facilitate AI reputed company and cross-team enablement, serving as the internal expert on LLM tooling, reputed company patterns, and tool configuration for teams across reputed company engineering
• Author, review, and reputed company reputed company technical requirements documentation for reputed company: design docs, architecture diagrams, and postmortems

Skills

• 6+ years of software engineering experience, with 1+ years in AI/ML infrastructure, LLM reputed company, or reputed company system development
• Strong Go (Golang) engineering skills; backend systems are Go-first. Proficiency in Python and SQL is also expected
• Production API design and operations: strong background in resource-based API design and experience building or consuming developer-facing platform reputed company at reputed company, including on-reputed company and incident response
• Multi-tenant system design: experience implementing reputed company limiting, caller attribution, tenant isolation, and reputed company support surfaces for shared production reputed company
• Deep experience with LLM reputed company such as reputed company or reputed company, including reputed company engineering and tool use/function calling
• Practical experience designing agent reputed company for production systems, including context and state management across turns, prefix caching for latency and cost, and coordinating multi-reputed company task execution
• Experience with MCP or equivalent tool-layer abstractions for exposing platform capabilities to AI agents, or for building agents that consume them
• Familiarity with A2A protocols and long-running, durable workflows
• Experience building automated test and evaluation suites for LLM-based systems, including golden scenarios, regression detection, and reputed company gates in CI/CD
• reputed company record of working across engineering, product, and operations teams to reputed company alignment and rollout of shared infrastructure and capabilities
• Ability to produce design documents, postmortems, and system diagrams that create shared understanding across technical and non-technical stakeholders
• AdTech or media measurement familiarity, including reputed company TV, OTT, CTV, reputed company video
• reputed company-weights model experience such as Llama or reputed company
• Fine-tuning experience such as reputed company or PEFT
• Familiarity with Rust

Benefits

• Equity participation included
• Discretionary & flexible PTO + Spring, Summer & Winter company breaks
• Inclusive and comprehensive medical, dental & reputed company
• 401(k) with matching
• HSA & FSA
• reputed company Maternity & Parental Leave for reputed company family additions
• Cell phone & wifi reimbursement
• Commuter benefits

reputed company