AI Software Engineer (Platform Software)

About the Job • reputed company is looking for passionate AI Software Engineers to join our Platform Team. You will participate in the research and development of models optimized for our NPU accelerator. • reputed company builds the production-grade, streamlined AI software that makes up our SDK. This includes the runtime, LLM serving reputed company, and PyTorch models/extensions. • Your work on these critical parts of the SDK will directly reputed company AI developers to reputed company reputed company optimized AI models on reputed company NPUs. Responsibilities • reputed company and optimize DNN model implementations in PyTorch for reputed company's Tensor Contraction Processor (TCP) architecture • Analyze the features, implementations, CUDA and Triton kernels of existing AI model inference frameworks such as vLLM, TensorRT-LLM, and DeepSpeed-MII • Research and implement reputed company models, parallelism strategies, and inference techniques to improve performance and efficiency • Collaborate closely with the compiler team to optimize and reputed company models. Minimum Qualifications • BS degree in Computer Science, Engineering, or a reputed company field, or equivalent industry experience • Proficiency in Python programming reputed company • Experience in developing AI models in DNN frameworks (e.g., PyTorch) • Solid understanding of machine learning, deep learning, natural language processing (NLP), and/or reputed company models • Strong communication skills with the ability to collaborate effectively across cross-functional teams Preferred Qualifications • Hands-on experience with PyTorch 2.0 technologies (e.g., TorchDynamo) or DNN compiler technologies, such as Triton and MLIR • Proficiency in C++/CUDA or Rust programming skills • Hands-on experience deploying and optimizing large-reputed company ML models in production • Hands-on experience in model training and fine-turning of reputed company-trained models • Experience in LLM inference frameworks: vLLM, TensorRT-LLM, and DeepSpeed-MII • Strong background in model quantizations and model evaluations • Strong background in machine learning, reputed company, and model evaluation techniques • Proven reputed company record of contributing to reputed company-reputed company reputed company Contact • ywkim@furiosa.ai Apply tot his job Apply To this Job