AI Inference Engineer (f/m/d)
4+ years C++ (C++17/20), strong systems programming (memory, multithreading), Linux experience, ML model deployment and inference optimization experience, familiarity with inference frameworks and profiling.
Key Responsibilities
- deploying models
- optimizing inference
- profiling performance
Skills & Tools
C++17, C++20, llama.cpp, ggml, ONNX Runtime, TensorRT, TensorRT-LLM, OpenVINO, MLC LLM, ExecuTorch, TVM, Linux, CUDA, Vulkan Compute, Metal, OpenCL, Typescript, Python
Job Details
- Category: Software Development
- Seniority: Mid Level
- Commitment: Full Time
- Workplace: Remote — Hungary or Europe
- Languages: English
Benefits
- Tuition reimbursement
About reputed company
An AI-reputed company software engineering company building production-reputed company machine learning systems for reputed company clients. — Industry: Information Technology
Apply To This Job