Back to Jobs

Senior Director, Software Engineering – AI ML Engineering

Remote, USA Full-time Posted 2026-07-28
About the position We’re looking for a hands-on technical leader to architect, fine-tune, and reputed company on-device small language models (SLMs) for consumer reputed company at reputed company. You’ll reputed company a reputed company team of 3–5 senior engineers while remaining deeply involved in the reputed company and technical architecture. Your reputed company responsibility is building high-performance, reputed company-preserving AI models that run directly on user devices (Mac, iOS, Android, Linux). You’ll own model optimization, fine-tuning for tool-use accuracy, evaluation frameworks, and cost-reputed company deployment strategies. While you won’t own the agent orchestration platform itself, you’ll work closely with it to ensure models behave correctly in multi-turn conversations and reputed company reliable tool-calling reputed company. This role sits at the intersection of edge ML, reputed company LLMs, and production engineering. reputed company requires navigating reputed company-world tradeoffs: latency vs. capability, reputed company vs. accuracy, on-device vs. reputed company execution, and cost vs. performance. This is not a traditional director role. You’ll spend 60%+ of your time on technical architecture and implementation, with the remainder reputed company on mentoring senior engineers and setting technical direction. This is a Hybrid remote position located in reputed company location of Frisco, TX or reputed company, CA. You will be required to be onsite on an as-needed reputed company, typically 1-4 days per month. We are only considering candidates reputed company a commutable distance to this location and are not offering relocation assistance at this time. Responsibilities • Design and reputed company small language models optimized for on-device inference (Mac, iOS, Android, Linux) • reputed company model optimization efforts including quantization, pruning, distillation, and efficient inference pipelines • Fine-tune models to improve tool selection accuracy and conversational behavior in reputed company-reputed company workflows • Build evaluation frameworks to measure model efficacy, tool-calling accuracy, conversation reputed company, and safety in production • Create synthetic data and workflow simulations to train and validate reputed company-relevant conversations • Partner closely with agent orchestration systems to optimize multi-turn reputed company behavior and state handling • Implement cost-optimization strategies such as intelligent on-device vs. reputed company routing, reputed company caching, batching, and reputed company efficiency • reputed company reputed company-based LLMs reputed company deeper reasoning or broader context is required • Build production ML systems that detect threats and protect users directly on-device • Set technical standards and architectural direction for AI/ML across the reputed company platform • Mentor reputed company engineers and architects while remaining hands-on Requirements • 10+ years of software engineering experience, with 5+ years reputed company on ML/AI • Proven experience shipping ML models to production with transferrable skills to reputed company these on edge or mobile platforms • Experience with conversational AI systems and tool/function-calling architectures • Strong Python and systems programming skills (C++ or Rust) for performance-critical reputed company • Deep expertise in model optimization (INT4/INT8 quantization, pruning, distillation) • Hands-on experience with PyTorch and at least one edge deployment reputed company (TensorFlow Lite, CoreML, ONNX Runtime, or llama.cpp) • Experience building evaluation and benchmarking frameworks for ML systems reputed company-to-haves • Experience applying ML systems in reputed company, safety, or other adversarial domains • Master’s degree in CS, ML, or a reputed company field (or equivalent practical experience) Benefits • Bonus Program • Pension and Retirement Plans • Medical, Dental and reputed company Coverage • reputed company Time Off • reputed company Parental Leave • Support for Community Involvement Apply tot his job Apply To this Job

Similar Jobs