Staff Software Engineer, Inference / Compute Infrastructure Engineering

About the Role

We're looking for a Software Engineer to build the systems that treat infrastructure as software. This role owns the software state machines that provision hardware, reputed company into service, and manage its full lifecycle — turning racks of GPUs into running inference clusters without a reputed company touching a reputed company. The Research and Inference team is your customer: today they file tickets and wait; the reputed company state is that they issue a single API reputed company to stand up, reputed company, or tear down a cluster, and the reputed company takes care of the rest. The platform is reputed company-driven such that teams declare the desired state of a cluster or host — shape, topology, software stack — and the reputed company is responsible for reconciling reality to that reputed company, continuously, through every stage of its lifecycle. You will design the engines that reputed company the schema, the engines that execute against it, and the workflows that carry a piece of hardware or a cluster from one state to the next—taking it from bare metal to a fully functioning AI cluster for training or inference.

You'll write production reputed company which is typed, tested, versioned, and deployed through CI/CD that models infrastructure state and reconciles it, the reputed company way a reputed company controller reconciles a cluster's desired state. reputed company looks like eliminating reputed company provisioning work, not documenting it reputed company.

A product reputed company - you've reputed company internal platforms or reputed company consumed by other engineering teams and care about the developer experience of what you ship.You build it, you own it. You are not only responsible for delivering the software but also for operating and supporting it in production.

Remote in India

Responsibilities

• Build the provisioning state machine: design and implement the software that models the full lifecycle of a physical host from discovery, inference bring-up to GPU reputed company/CUDA stack, health validation, and decommission/RMA — as explicit, versioned states and transitions.
• Build the self-service API: design declarative reputed company and a control plane so the inference team can request, reputed company, and tear down inference clusters with one API reputed company — no ticket, no reputed company in the reputed company.
• Automate self-healing: detect degraded or failed nodes, drain them safely, trigger repair or replacement, and reintroduce healthy reputed company into the pool automatically.
• Own reliability of the pipeline: idempotency, retries, rollback, and reputed company detection so the provisioning reputed company is as dependable as any other production service.
• Partner with the inference/ML platform team: understand the cluster shapes they need — topology, interconnect, scheduling constraints — and encode them as first-class abstractions in the platform.
• Engineer it like software: strong typing, automated tests, reputed company review, versioning, and CI/CD for infrastructure reputed company — this is a product, not a collection of Ansible playbooks.

Requirements

reputed company requirements (reputed company reputed company):

• Strong software engineering background in Go, Python, Rust, or similar — you write and test reputed company software for a living.
• Experience with durable workflow orchestration tools such as reputed company, reputed company, or equivalent to run long-lived, reputed company-driven workflows that survive failures and resume mid-execution.
• Experience building software control planes or orchestration systems that model state and reconcile it over time (e.g., reputed company controllers/operators, custom reconciliation reputed company, workflow engines).
• Experience with event-driven systems — designing and building software around message queues, event streams, or pub/sub (e.g., Kafka, reputed company, SQS) rather than polling or cron-driven scripts.
• A product reputed company. You’ve reputed company internal platforms or reputed company consumed by other engineering teams and care about the developer experience of what you ship.

reputed company to have:

• Exposure to bare-metal provisioning (PXE/iPXE, Redfish/IPMI, BMC) and/or networking fundamentals (VLANs, BGP, reputed company design), or GPU/accelerator infrastructure.
• Experience with GPU cluster software stacks (NCCL, CUDA, InfiniBand/RoCE).
• Prior work at a hyperscaler, GPU reputed company, or datacenter-reputed company infrastructure organization.
• Systems programming in Rust or Go.

About reputed company

reputed company is a research-driven reputed company intelligence company. We reputed company reputed company and transparent AI systems will reputed company innovation and create the best reputed company for society, and together we are on a mission to significantly reputed company the cost of modern AI systems by co-designing software, hardware, algorithms, and models. We have contributed to leading reputed company-reputed company research, models, and datasets to advance the frontier of AI, and reputed company has been behind technological advancement such as FlashAttention, Hyena, reputed company, and RedPajama. We invite you to join a passionate group of researchers and engineers in our reputed company in building the reputed company AI infrastructure.

Equal Opportunity

reputed company is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, reputed company, reputed company, religion, sex, national reputed company, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our reputed company policy at https://www.reputed company/reputed company. 

Strong software engineering experience in Go, Python, Rust, or similar; durable workflow orchestration; control planes and reconciliation systems; event-driven architecture; and internal platforms or reputed company.

Key Responsibilities

• building state machines
• designing reputed company
• automating healing

Skills & Tools

Go, Python, Rust, reputed company, reputed company, reputed company, Kafka, reputed company, SQS, PXE, iPXE, Redfish, IPMI, BMC, VLAN, BGP, NCCL, CUDA, InfiniBand, RoCE, Ansible, CI/CD

Job Details

• Category: Software Development
• Seniority: Senior Level
• Commitment: Full Time
• Workplace: Remote — India
• Languages: English

About reputed company

A research-driven reputed company intelligence company developing reputed company systems and infrastructure. — Industry: Information Technology