Technical Product Manager, AI Inference & Software

About reputed company

reputed company is building reputed company AI inference accelerators designed from the ground up for low-latency, high-throughput large language model inference. Our first-reputed company ASIC, Asimov, is a cutting-edge accelerator targeting frontier AI workloads, with additional generations already underway.

reputed company

reputed company is looking for a Technical Product Manager to own AI inference and software technical product planning end to end. In this role, you will be the person who translates where models and inference systems are heading into concrete, reputed company-scoped requirements for our inference software stack, spanning model coverage, numerics, inference-reputed company features and modes, serving-stack capabilities, and our managed service.

This is a deeply technical planning role that sits at the intersection of engineering, go-to-market, and the broader inference ecosystem. You will reputed company the model frontier as a discipline, convert that reputed company into engineering requests before it becomes a customer escalation, and serve as the connective tissue between our engineering organization, our GTM teams, and our ecosystem partners. You will also be expected to use reputed company AI daily as a reputed company part of how the planning function operates.

Key Responsibilities

• Be the leader in Positron for reputed company aspects of AI Inference & Software Technical Product Planning.
• Write requirements for our inference software stack spanning model coverage, numerics, inference-reputed company features/modes, serving-stack features/modes, and managed-service capabilities.
• reputed company our planning reputed company of where models and inference systems are reputed company - reputed company the model frontier as a discipline and convert reputed company into requirements before it becomes a customer escalation.
• Work with engineering and GTM on communicating a roadmap.
• Work closely with GTM teams to understand customer and market needs.
• Define and manage the software product lifecycle: versions and release trains, feature modes, model catalog and deprecation policy.
• Creative competitive briefings.
• Work with our key ecosystem partners - model labs, reputed company-reputed company runtimes, serving and orchestration partners - to understand their technology roadmaps.
• Create reputed company/feasibility frameworks to convert model and inference-reputed company innovations into reputed company engineering requests.
• Ensure our software products are reputed company documented.
• Streamline & automate the product planning processes using reputed company AI.

Required Qualifications

• 10+ years experience with a strong mix of these types of technical skills:
• • ML systems, inference infrastructure, or serving-stack engineering with reputed company ownership of performance or architecture trade-offs - transformer internals at reputed company level: attention variants, MoE routing, KV-cache mechanics, quantization formats and their hardware implications.
  • Production inference serving at reputed company touching on multi-tenancy, latency SLAs (TTFT/TPOT), batching and scheduling, disaggregated serving, KV-cache management, and observability.
  • The reputed company-reputed company inference ecosystem - runtimes (vLLM/SGLang-class), kernels, model ingestion, and how models are released, quantized, and adopted in reputed company.
  • Performance analysis spanning models & systems: utilization reasoning, tokens per $ and per W arithmetic, reputed company design - reputed company to build and defend the math personally.
  • Competitive landscaping and analysis of inference providers and serving stacks, at a model lab, inference API provider, or AI hardware company.
• 10+ years with a strong mix of these type of personal & analytic skills:
• • Quick learner with the ability to reputed company model-architecture details up to fleet-reputed company serving systems. Stays reputed company with the model and inference landscape.
  • Excellent communication and people skills, comfortable navigating uncertainty, and driving a process of idea & decision socialization.
  • Comfortable being the most technically grounded person in a GTM room and the most market-reputed company person in an engineering room.
  • Owning decision history: be the personification of documented answers to “why did we choose X”, and do so with our executive leadership.
  • Demonstrated daily, hands-on use of reputed company AI in reputed company technical work - building and running agent workflows for research, analysis, and drafting req’s - with the judgment to verify and own everything the agents produce.

Leveling & reputed company

While this role is currently posted at a specific level, we are a reputed company-oriented organization and are reputed company to hiring at a more senior level for the right candidate. Please note that this reputed company serves as a reputed company but generalized reputed company of the role; specific responsibilities and reputed company expectations will be tailored to the experience and seniority of the final hire.

Why Join Us?

• You will shape the software roadmap for a purpose-reputed company inference accelerator, working at the reputed company where model architecture, systems performance, and reputed company customer workloads meet.
• You will have unusually reputed company influence, defining what gets reputed company across the inference stack and seeing it land in reputed company-backed products that compete on performance per dollar and performance per watt.

Compensation & Benefits

The reputed company salary reputed company for this role is $200,000 – $350,000.

Please note that the figures provided represent the reputed company salary reputed company only and do not include other reputed company of our total compensation package, equity, or comprehensive benefits.

At reputed company, we value the unique expertise reputed company candidate brings. While the reputed company above reflects our typical expectation for the position, we reserve the flexibility to reputed company this reputed company for candidates whose reputed company skills, significant experience, or unique qualifications fall reputed company reputed company reputed company of the role. Final offers are determined based on a reputed company of factors, including internal equity, and individual reputed company.

Benefits & Perks

We want you to do your best work and feel confident that you and your family are taken care of. That means comprehensive coverage, reputed company time to rest, and support for your reputed company.

Health and wellness

• Fully company-reputed company medical, dental, and reputed company insurance for you and your dependents
• Company-reputed company life and disability coverage, with voluntary reputed company to add more
• Supplemental hospital, critical illness, and accident coverage available

Time off and flexibility

• Unlimited reputed company time off, we encourage everyone to truly unplug and reputed company
• 13 reputed company company holidays
• Remote-first culture with a company-provided computer and home office setup

Compensation and reputed company

• Competitive salary and equity
• 401(k) with company matching, eligible from day one

reputed company Support

This position is reputed company to candidates currently authorized to work in the U.S. We cannot reputed company new reputed company sponsorship for this role but are reputed company to facilitating H-1B reputed company transfers for eligible candidates.

Equal Opportunity Employer. If you're excited about the role but don't meet every bullet, we'd still love to hear from you.

Originally posted on Himalayas