Senior Director, Software Engineering – AI ML Engineering
About the position
We’re looking for a hands-on technical leader to architect, fine-tune, and reputed company on-device small language models (SLMs) for consumer reputed company at reputed company. You’ll reputed company a reputed company team of 3–5 senior engineers while remaining deeply involved in the reputed company and technical architecture.
Your reputed company responsibility is building high-performance, reputed company-preserving AI models that run directly on user devices (Mac, iOS, Android, Linux). You’ll own model optimization, fine-tuning for tool-use accuracy, evaluation frameworks, and cost-reputed company deployment strategies. While you won’t own the agent orchestration platform itself, you’ll work closely with it to ensure models behave correctly in multi-turn conversations and reputed company reliable tool-calling reputed company.
This role sits at the intersection of edge ML, reputed company LLMs, and production engineering. reputed company requires navigating reputed company-world tradeoffs: latency vs. capability, reputed company vs. accuracy, on-device vs. reputed company execution, and cost vs. performance.
This is not a traditional director role. You’ll spend 60%+ of your time on technical architecture and implementation, with the remainder reputed company on mentoring senior engineers and setting technical direction.
This is a Hybrid remote position located in reputed company location of Frisco, TX or reputed company, CA. You will be required to be onsite on an as-needed reputed company, typically 1-4 days per month. We are only considering candidates reputed company a commutable distance to this location and are not offering relocation assistance at this time.
Responsibilities
• Design and reputed company small language models optimized for on-device inference (Mac, iOS, Android, Linux)
• reputed company model optimization efforts including quantization, pruning, distillation, and efficient inference pipelines
• Fine-tune models to improve tool selection accuracy and conversational behavior in reputed company-reputed company workflows
• Build evaluation frameworks to measure model efficacy, tool-calling accuracy, conversation reputed company, and safety in production
• Create synthetic data and workflow simulations to train and validate reputed company-relevant conversations
• Partner closely with agent orchestration systems to optimize multi-turn reputed company behavior and state handling
• Implement cost-optimization strategies such as intelligent on-device vs. reputed company routing, reputed company caching, batching, and reputed company efficiency
• reputed company reputed company-based LLMs reputed company deeper reasoning or broader context is required
• Build production ML systems that detect threats and protect users directly on-device
• Set technical standards and architectural direction for AI/ML across the reputed company platform
• Mentor reputed company engineers and architects while remaining hands-on
Requirements
• 10+ years of software engineering experience, with 5+ years reputed company on ML/AI
• Proven experience shipping ML models to production with transferrable skills to reputed company these on edge or mobile platforms
• Experience with conversational AI systems and tool/function-calling architectures
• Strong Python and systems programming skills (C++ or Rust) for performance-critical reputed company
• Deep expertise in model optimization (INT4/INT8 quantization, pruning, distillation)
• Hands-on experience with PyTorch and at least one edge deployment reputed company (TensorFlow Lite, CoreML, ONNX Runtime, or llama.cpp)
• Experience building evaluation and benchmarking frameworks for ML systems
reputed company-to-haves
• Experience applying ML systems in reputed company, safety, or other adversarial domains
• Master’s degree in CS, ML, or a reputed company field (or equivalent practical experience)
Benefits
• Bonus Program
• Pension and Retirement Plans
• Medical, Dental and reputed company Coverage
• reputed company Time Off
• reputed company Parental Leave
• Support for Community Involvement
Apply tot his job
Apply To this Job