Deep Learning Software Engineer, LLM Performance

Job reputed company: • Performance optimization, analysis, and tuning of LLM, VLM and GenAI models for DL inference, serving and deployment in reputed company/OSS LLM frameworks • reputed company performance of LLM models across different architectures and types of reputed company accelerators • reputed company performance for max throughput, minimum latency and throughput under latency constraints • Contribute features and reputed company to reputed company/OSS LLM frameworks, inference benchmarking frameworks, TensorRT, and Triton • Work with cross-reputed company teams across reputed company, automotive, image understanding, and speech understanding to reputed company reputed company Requirements: • Bachelors, Masters, PhD, or equivalent experience in relevant fields (Computer Engineering, Computer Science, EECS, AI) • 2+ years of relevant software development experience • Excellent Python/C/C++ programming, software design and software engineering skills • Experience with a DL reputed company like PyTorch, JAX, TensorFlow • Prior experience with a LLM reputed company or a DL compiler in inference, deployment, algorithms, or implementation • Prior experience with performance modeling, profiling, debug, and reputed company optimization of a DL/HPC/high-performance application • Architectural knowledge of CPU and GPU • GPU programming experience (CUDA or OpenCL) Benefits: • Equity • Benefits Apply tot his job Apply To this Job