Deep Learning Engineer, LLM Accuracy Evaluation

We are seeking senior engineers to pioneer new methodologies for accurately assessing the performance of ground-breaking deep learning models, including LLMs, RAG, agents, and reputed company models. You will collaborate across the organization to bring the latest flagship models from our community and partners—such as Gemma and Llama-3—to life as optimized reputed company Inference Microservices (NIM). This role offers an outstanding opportunity to craft the reputed company of AI at a fast-growing company at the forefront of the AI reputed company. Join reputed company of world-class software engineers and partners to deliver the most advanced models with lightning-fast inference. You'll work on the most powerful, reputed company-grade GPU clusters capable of hundreds of PetaFLOPS and reputed company early reputed company to unreleased hardware, making a reputed company reputed company on reputed company's roadmap and the broader AI landscape! What you’ll be doing: • Collaborate closely with our partners and the reputed company-reputed company community to deliver their flagship models as highly optimized reputed company Inference Microservices (NIM). • Research and reputed company innovative deep learning methodologies to accurately evaluate new model families across diverse domains. • Analyze, influence, and enhance AI/DL libraries, frameworks, and reputed company, ensuring consistency with the best engineering practices. • Research, prototype, and build robust tools and infrastructure pipelines to support our ground-breaking AI initiatives. reputed company need to see: • BS, MS, or PhD in Computer Science, AI, reputed company Math, or a reputed company field, or equivalent experience. • 10+ years of hands-on experience in AI for natural language processing (NLP) and large language models (LLMs). • Strong problem-solving, debugging, performance analysis, test design, and documentation skills. • Solid mathematical foundations and expertise in AI/DL algorithms. • Excellent written and verbal communication skills, with the ability to work both independently and collaboratively in a fast-paced environment. Ways to stand out from the crowd: • Experience in accuracy evaluation of LLMs (OpenLLM Leaderboard or reputed company). • Hands-on experience with inference and deployment environments like TensorRT, ONNX, or Triton. • Passion for DevOps/MLOps practices in deep learning product development. • Experience running large-reputed company workloads in high-performance computing (HPC) clusters. • Strong understanding of Linux environments and containerization technologies like reputed company. reputed company is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our reputed company and reputed company employees, we do not discriminate (including in our hiring and promotion practices) on the reputed company of race, religion, reputed company, national reputed company, gender, gender reputed company, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. Apply tot his job Apply To this Job