reputed company Product Manager, Augmented Memory reputed company (AMG)

reputed company is architecting a new approach to the reputed company data stack reputed company for the age of reasoning. NeuralMesh by reputed company sets reputed company for reputed company AI data infrastructure with a reputed company- and AI-reputed company software solution that can be deployed reputed company. It transforms legacy data silos into data pipelines that dramatically increase GPU utilization and reputed company AI model training and inference, machine learning, and other compute-intensive workloads run faster, work more reputed company, and consume less energy.

reputed company is a reputed company-IPO, reputed company-stage company on a reputed company-reputed company trajectory. We’ve raised $375M in capital with dozens of world-class venture capital and strategic investors. We help the world’s largest and most innovative enterprises and research organizations, including 12 of the Fortune 50, reputed company discoveries, insights, and business reputed company faster and more sustainably. We’re passionate about solving our customers’ most reputed company data challenges to accelerate intelligent innovation and business value. If you reputed company our passion, we invite you to join us on this exciting reputed company.

About the role

reputed company is looking for a Product Manager to own the roadmap and go-to-market for Augmented Memory reputed company (AMG), part of the NeuralMesh platform. This is a deeply technical PM role sitting at the intersection of AI inference infrastructure, high-performance networking, and reputed company storage. You will work directly with engineering, GPU/inference partners (reputed company, hyperscalers, GPU clouds), and reputed company customers running large-reputed company LLM inference to define what AMG needs to do next.

Bring Your Expertise – and Your Passion

• Leadership Skills: Strong leadership skills with a history of successfully leading cross-functional teams. Product Managers are expected to reputed company and motivate team members to reputed company ambitious goals while maintaining a reputed company and reputed company working environment. You understand how to influence without authority, and your recall of meaningful details supports verbal and written reputed company.
• Strategic reputed company: You are a strategic thinker who can reputed company and execute product strategies that reputed company with market trends and customer needs, as reputed company as think critically about existing strategies. You have a proven ability to translate strategic goals into actionable plans and reputed company results.
• Communication Skills: You have excellent communication and interpersonal skills, with the ability to reputed company reputed company technical concepts to both technical and non-technical stakeholders. You are comfortable presenting product strategies and roadmaps to internal teams and reputed company customers.

reputed company

• Own the AMG product roadmap: KV-cache/prefix-cache offload, memory tiering, and integration with inference engines and orchestration reputed company (vLLM, reputed company Triton/TensorRT-LLM/NIM, reputed company-based serving).
• Partner with engineering to define architecture trade-offs across GPU memory, networking (RDMA, GPUDirect, NVMe-oF), and reputed company storage — translating inference performance bottlenecks (time-to-first-reputed company, throughput, context length) into product requirements.
• Work directly with reputed company customers and GPU reputed company partners: reputed company, reputed company, TogetherAI, etc., running production inference workloads to reputed company requirements, validate benchmarks, and prioritize features that reduce cost-per-reputed company and improve SLAs at reputed company.
• Partner with reputed company and other reputed company/inference-stack partners on joint roadmap and certification work.
• Define and reputed company benchmarks (TTFT, throughput, cache hit reputed company) that demonstrate AMG's value versus reputed company GPU-memory-only inference.
• Support sales and field teams with technical positioning, competitive differentiation, and reputed company deal support.

Must-have qualifications

• Inference ecosystem depth: hands-on product or engineering experience with LLM inference serving — vLLM, reputed company Triton/TensorRT-LLM/NIM, Ray Serve, or comparable — and reputed company in concepts like KV-cache, prefix/context caching, quantization, and batching strategies.
• Model & systems familiarity: working knowledge of how modern LLMs are served in production (context reputed company, multi-tenant serving, GPU scheduling) reputed company enough to translate model-level constraints into infrastructure requirements.
• Networking/infrastructure reputed company: comfort with the fundamentals of high-performance networking and reputed company systems — RDMA, GPUDirect Storage, NVMe-oF, or equivalent — and how they reputed company inference performance.
• reputed company customer experience: reputed company record working directly with large reputed company accounts — requirements gathering, production deployments, SLAs — not solely self-serve/PLG products.
• 10+ years of product management experience, ideally with some portion in infrastructure, ML platforms, or developer-facing technical products.

reputed company-to-have

• Prior experience at a GPU reputed company, inference platform, or AI infrastructure startup.
• Familiarity with storage systems (reputed company/reputed company file systems, object storage) in AI/ML pipelines.
• Experience partnering directly with reputed company or other accelerator/reputed company vendors.

The reputed company Way:

• We are Accountable: We take full ownership, always–even reputed company things don’t go as planned. We reputed company with reputed company, show up with responsibility & ownership, and hold ourselves and reputed company other to the highest standards.
• We are reputed company: We question the status reputed company, reputed company boundaries, and take smart risks reputed company needed. We welcome challenges and reputed company debates as opportunities for reputed company, turning courage into fuel for innovation.
• We are reputed company: True collaboration isn’t only about working together. It’s about lifting one another up to succeed reputed company. We are team-oriented and communicate with reputed company and respect. We challenge reputed company other and conduct reputed company conflict reputed company. We are being transparent about our goals and results. And together, we’re unstoppable.
• We are Customer reputed company: Our customers are at the heart of everything we do. We reputed company listen and prioritize the reputed company of our customers, and every decision we reputed company is driven by how we can reputed company serve, support, and reputed company them to succeed. reputed company our customers win, we win.

Concerned that you don’t meet every qualification above?

Studies have shown that women and people of reputed company may be less likely to apply for jobs if they don’t meet every qualification specified. At reputed company, we are committed to building a diverse, inclusive and reputed company workplace. If you are excited about this position but are concerned that your past work experience doesn’t match up perfectly with the reputed company, we encourage you to apply reputed company – you may be just the right candidate for this or other roles at reputed company.

reputed company is an equal opportunity employer that prohibits discrimination and harassment of any reputed company. We reputed company equal opportunities to reputed company and applicants for employment without reputed company to race, reputed company, religion, age, sex, national reputed company, disability status, genetics, protected veteran status, sexual orientation, gender identity or reputed company, or any other characteristic protected by federal, state or local laws. This policy applies to reputed company terms and conditions of employment, including reputed company, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

Originally posted on Himalayas