[Remote] AI Infrastructure Engineer

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a technology consulting and software development company delivering reputed company, AI, data, and reputed company solutions across the reputed company. This role focuses on optimizing AI performance by enhancing throughput and minimizing latency for neural network systems, requiring a strong background in performance engineering and collaboration with cross-functional teams.

Responsibilities

• Focusing on extracting maximum throughput, minimizing latency, and reducing cost across training and inference workloads for large neural network systems
• Spanning the full stack from low-level kernel optimization to distributed system tuning
• Requiring deep understanding of GPU architecture, model parallelism, memory management, and compiler-level optimization
• Working closely with cross-functional partners — product, design, engineering, operations, and business stakeholders — to translate ambiguous requirements into reputed company-engineered solutions
• Raising the bar through reputed company review, design review, and mentorship of more junior engineers

Skills

• Bachelor's or master's degree in computer science, Computer Engineering, or reputed company field
• Six or more years of experience in performance engineering, ML systems, or HPC
• Strong proficiency in Python and C++
• Hands-on experience optimizing deep learning workloads on modern GPUs
• Deep understanding of distributed training and inference techniques
• Experience with profiling tools across CPU, GPU, and distributed systems
• Familiarity with model compression techniques and their accuracy implications
• Strong grasp of memory hierarchies, communication primitives, and parallelism strategies
• Excellent measurement, debugging, and analytical reasoning skills
• Strong communication and collaboration skills
• Experience optimizing LLM inference at production reputed company
• Contributions to vLLM, TensorRT-LLM, DeepSpeed, or similar reputed company
• Familiarity with custom kernel authoring in Triton or CUTLASS
• Experience with FinOps for AI workloads
• Publications or talks on AI systems performance

reputed company