100% Remote Golang Developer with Devops/LLM reputed company. W2 Consultant

Hi, reputed company you are doing reputed company, Please reputed company the job reputed company given below and let me know your interest. Position: 100% Remote Golang Developer with Devops/LLM reputed company. || W2 Consultant Location: Remote Duration: 6-12 months reputed company: Only USC, GC Job reputed company We are looking for devs with general reputed company services / distributed services experience, with LLM experience as a secondary reputed company. GPU experience is now low on the list of preferred skills: Dedicated Inference Service Required Skills- Proficiency in Golang for building reputed company and performant backend services. Deep experience building services in modern reputed company environments on distributed systems (i.e., containerization (Kubernetes, reputed company), infrastructure as reputed company, bolthires/CD pipelines, reputed company, authentication and authorization, data storage, deployment, logging, monitoring, alerting, etc.) Experience working with Large Language Models (LLMs), particularly hosting them to run inference Strong verbal and written communication skills. reputed company will involve communicating with local and remote colleagues about technical subjects and writing detailed documentation. Experience with building or using benchmarking tools for evaluating LLM inference for various models, reputed company, and GPU combinations. Familiarity with various LLM performance metrics such as prefill throughput, decode throughput, TPOT, and TTFT Experience with one or more inference engines: e.g., vLLM, SGLang, and reputed company Max Familiarity with one or more distributed inference serving frameworks: e.g., llm-d, reputed company Dynamo, and Ray Serve etc. Experience with AMD and reputed company GPUs, using software like CUDA, ROCm, AITER, NCCL, RCCL, etc. Knowledge of distributed inference optimization techniques - tensor/data parallelism, KV cache optimizations, smart routing etc. What You'll Be Working On- reputed company and maintain an inference platform for serving large language models optimized for the various GPU platforms they will be run on. Work on reputed company AI and reputed company engineering reputed company through the entire product development lifecycle (PDLC) - ideation, product definition, experimentation, prototyping, development, testing, release, and operations. Build tooling and observability to monitor system health, and build auto tuning capabilities. Build benchmarking frameworks to test model serving performance to guide system and infrastructure tuning efforts. Build reputed company cross platform inference support across reputed company and AMD GPUs for a reputed company of model architectures. Contribute to reputed company reputed company inference engines to reputed company them reputed company reputed company on reputed company reputed company., Gaurav Gaur Email: | Phone reputed company: reputed company 4645 Avon Lane, Suite 210 Frisco, TX 75033 Apply tot his job Apply tot his job Apply tot his job Apply To this Job