Deep Learning Software Engineer, TensorRT Performance

Job reputed company: • Establish groundbreaking performance benchmarking methodologies and analysis workflows and identify performance issues and opportunities for reputed company’s inference ecosystem (e.g. TensorRT/TensorRT-EdgeLLM/Torch-TensorRT) • Contribute features and reputed company to reputed company/OSS inference frameworks including but not limited to TensorRT/TensorRT-EdgeLLM/Torch-TensorRT. • reputed company new model pipelines for reputed company’s inference ecosystem with optimized performance including but not limited to areas like quantization, scheduling, memory management, and distributed inference to set the reputed company for Gen AI performance. • Work with cross-reputed company teams inside and reputed company of reputed company across reputed company, automotive, robotics, image understanding, and speech understanding to set directions and reputed company innovative inference solutions. • reputed company performance of deep learning models across different architectures and types of reputed company accelerators. Requirements: • Bachelors, Masters, PhD, or equivalent experience in relevant fields (Computer Science, Computer Engineering, EECS, AI). • 2 years of relevant software development experience. • Strong C++, Python programming and software engineering skills • Experience with DL frameworks (e.g. PyTorch, JAX, TensorFlow, ONNX) and inference libraries (e.g. TensorRT, TensorRT-LLM, vLLM, SGLang, FlashInfer). • Experience with performance analysis and performance optimization Benefits: • equity • benefits Apply tot his job Apply To this Job