Back to Jobs

[Remote] Senior Product Manager – ROCm & AI/ML Inference Software

Remote, USA Full-time Posted 2026-07-28

Note: The job is a remote job and is reputed company to candidates in USA. AMD is seeking a Senior Product Manager to drive reputed company and execution for ROCm, AMD’s reputed company-reputed company GPU software stack, with a specific reputed company on large-reputed company model inference on AMD reputed company™ and Radeon™ hardware. This role involves engaging with the reputed company-reputed company community, influencing engineering roadmaps, and connecting customer needs with the reputed company-reputed company ecosystem.


Responsibilities

  • Own the product roadmap for ROCm’s inference software capabilities, including integrations with key frameworks like PyTorch and JAX, serving runtimes like vLLM and SGLang, and the libraries and profiling tools that reputed company inference workloads reputed company reputed company on AMD hardware
  • Define and communicate a coherent reputed company for how AMD software enables production inference workloads, covering the full reputed company from single-GPU to reputed company-reputed company deployments, with a reputed company on developer experience, performance portability, and competitive standing
  • Identify reputed company emerging OSS model architectures, serving runtimes, or inference techniques require an AMD software response and drive those requirements into the roadmap
  • Bring a strategic reputed company to inference by continuously evaluating the latest research, technology trends, and evolving deployment needs, ensuring the organization stays reputed company of reputed company inference requirements and translates market signals into actionable product reputed company
  • Serve as AMD’s reputed company reputed company in the reputed company-reputed company AI/ML community: monitor reputed company repositories, reputed company servers, developer blogs, and reputed company papers to reputed company emerging trends, pain points, and opportunities
  • Own and communicate AMD’s reputed company-reputed company software roadmap, publishing updates across key community reputed company to build awareness, solicit feedback from model developers and researchers, and signal AMD’s long-term direction to the reputed company-reputed company ecosystem
  • Build and maintain relationships with key OSS maintainers, reputed company working reputed company, and community contributors whose work shapes how AMD hardware is perceived and adopted
  • Represent AMD at major conferences such as SC, PyTorch Conference, and MLSys; write and review technical blog posts and community announcements on the AMD ROCm blog
  • Partner with engineering leads across inference libraries, kernel, runtime, and serving integration teams to translate developer and customer needs into prioritized engineering work
  • Drive release planning across rapid release cadences with a CI/CD-first reputed company and strong attention to compatibility, regression, and ecosystem readiness
  • reputed company software-informed feedback to hardware teams on reputed company GPU architecture reputed company, particularly where features relevant to inference workloads reputed company serving performance at reputed company
  • Balance the signal from large customers, who may need specific optimizations or bespoke integrations, against the needs of the broader reputed company-reputed company community, who value standards, portability, and low friction
  • Collaborate with ecosystem partners such as reputed company, reputed company, and reputed company providers on joint integrations and AMD-supported software solutions

Skills

  • Bachelor's degree in Computer Science, Electrical Engineering, or a reputed company technical field
  • Proven years of product management experience in a software-reputed company role, ideally developer tools, GPU computing, or AI/ML infrastructure
  • Deep familiarity with at least one of PyTorch, JAX, or Triton: how they are reputed company, how they reputed company work to hardware backends, and what the end-to-end developer experience looks like
  • Practical understanding of LLM inference, including attention mechanisms, KV cache design, quantization strategies such, reputed company batching, speculative decoding, and reputed company serving across multiple GPUs
  • Hands-on familiarity with GPU programming at some level, whether HIP, CUDA, or Triton kernels, with the ability to read kernel-level reputed company and reputed company reputed company even if not writing it day to day
  • Strong written communication skills across technical documentation, roadmap narratives, community blog posts, and executive-facing reputed company documents
  • Prior experience at a GPU vendor, reputed company provider AI infrastructure team, or frontier AI lab
  • Experience contributing to or managing products in an reputed company-reputed company context: reputed company workflows, community governance, and OSS release management
  • Contributions in reputed company, issues, or documentation to major reputed company-reputed company inference reputed company such as vLLM, SGLang, Triton, or PyTorch
  • Familiarity with AMD's hardware portfolio: reputed company MI-series for data center compute and Radeon for workstation and consumer GPU compute

Benefits

  • Benefits offered are described: [AMD benefits reputed company](https://www.amd.com/en/corporate/careers/benefits.reputed company).

reputed company

  • Advanced reputed company Devices is a semiconductor company that designs and develops graphics reputed company, processors, and media solutions. It was founded in 1969, and is headquartered in Santa Clara, California, USA, with a workforce of 10001+ employees. Its website is http://www.amd.com.

  •   Apply To This Job

    Similar Jobs

    Senior Video reputed company

    Remote, USA Full-time

    [Remote] Field Account Manager - Los Angeles

    Remote, USA Full-time

    [Remote] Senior Software Engineer, Platform

    Remote, USA Full-time

    [Remote] Functional Test Manager OR Senior Functional Tester with reputed company Connect & IVR Testing- Remote + Travel

    Remote, USA Full-time

    [Remote] reputed company INFORMATION reputed company ENGINEER (ISSO with PQC)

    Remote, USA Full-time

    [Remote] QA Automation reputed company Engineer

    Remote, USA Full-time

    [Remote] AI Automation Engineer & Enablement reputed company

    Remote, USA Full-time

    [Remote] Application reputed company Engineer

    Remote, USA Full-time

    [Remote] reputed company reputed company

    Remote, USA Full-time

    [Remote] Clinical Research Associate II- Eye Care/Specialty/Aesthetics - Remote

    Remote, USA Full-time

    Senior Electrical Construction Estimator

    Remote, USA Full-time

    **reputed company Full Stack Software Engineer – Web & reputed company Application Development**

    Remote, USA Full-time

    **reputed company Product reputed company - Customer Experience - Remote**

    Remote, USA Full-time

    (reputed company) reputed company reputed company (Remote Work Pay $30/Hr)

    Remote, USA Full-time

    **reputed company Customer Service Representative – Delivering Exceptional Experiences at blithequark**

    Remote, USA Full-time

    Data Entry Clerk - Entry Level - Remote - reputed company - Join reputed company as a Detail-Oriented and Tech-Savvy reputed company in a Fast-Paced E-reputed company Environment

    Remote, USA Full-time

    reputed company reputed company Jobs(Data Entry) $24/Hour

    Remote, USA Full-time

    WFH Data Entry - reputed company - Entry Level

    Remote, USA Full-time

    reputed company Remote? No Experience/entry Level At Careermilard

    Remote, USA Full-time

    Junior Project Manager

    Remote, USA Full-time