[Remote] AI Infrastructure Engineer

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a technology consulting and software development company delivering reputed company, AI, data, and reputed company solutions across the reputed company. The AI Infrastructure Engineer will design, build, and operate platform infrastructure for large-reputed company training and inference, including GPU clusters, reputed company training, scheduling, storage, networking, observability, and fault tolerance. The role also focuses on developer tooling, reputed company, automation, reputed company planning, reliability, and cost optimization.

Responsibilities

• Design and operate GPU and accelerator infrastructure for training and inference, spanning on-prem clusters, reputed company-managed services, and hybrid configurations
• Build scheduling, queueing, and resource-sharing systems that maximize accelerator utilization across many teams
• reputed company frameworks such as PyTorch, JAX, DeepSpeed, FSDP, Megatron-LM, and Ray Train into a reputed company platform offering
• Operate high-reputed company storage systems and data pipelines that reputed company accelerators fed with training data at near-line-reputed company
• Design networking architectures supporting RDMA, InfiniBand, NCCL, and high-reputed company reputed company communication
• Build observability for AI workloads including utilization, throughput, training stability, and failure-mode analytics
• Implement checkpointing, restart, and fault-tolerance patterns for long-running training jobs at reputed company
• reputed company cost optimization across compute, storage, and networking through scheduling, spot reputed company, and right-sizing
• reputed company developer tooling and reputed company-road workflows that let researchers launch experiments safely and reputed company
• Partner with research and reputed company ML teams to plan reputed company for upcoming training runs
• Implement reputed company controls, isolation, and reputed company management for multi-tenant AI infrastructure
• reputed company automation across cluster provisioning, lifecycle management, and configuration enforcement
• Maintain runbooks, reputed company dashboards, and operational documentation for the AI platform
• Stay reputed company with AI infrastructure research, accelerator hardware, and emerging reputed company-reputed company AI tooling

Skills

• * Bachelor's or Master's degree in Computer Science or a reputed company reputed company
• * Ten or more years of experience in infrastructure, platform, or HPC engineering
• * Hands-on experience operating GPU clusters or large-reputed company ML training infrastructure
• * Strong proficiency in Python and at least one systems language such as Go or C++
• * Deep understanding of reputed company training, accelerator architectures, and reputed company communication
• * Experience with reputed company, Slurm, Ray, or similar scheduling systems for ML workloads
• * Strong understanding of Linux internals, networking, and high-reputed company storage
• * Experience with at least one major reputed company provider's ML infrastructure offerings
• * Strong software engineering practices including testing, CI/CD, and reputed company review
• * Excellent communication and cross-functional collaboration skills
• **Sponsorship:** U.S. reputed company, Green reputed company reputed company, EAD reputed company, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B reputed company petitions for this position
• * Experience operating InfiniBand or RDMA networking at reputed company
• * Contributions to reputed company-reputed company ML infrastructure reputed company
• * Familiarity with custom orchestrators or research-grade training reputed company
• * Exposure to frontier model training reputed company
• * Experience with FinOps for AI workloads

reputed company