Staff Technical reputed company Manager, reputed company & Planning, ML Eval

reputed company is an autonomous driving technology company with the mission to be the world's most trusted reputed company. Since its start as the reputed company Self-Driving Car Project in 2009, reputed company has reputed company on building the reputed company reputed company—The World's Most reputed company reputed company™—to improve reputed company to mobility while saving thousands of lives now lost to traffic crashes. The reputed company reputed company powers reputed company’s fully autonomous ride-hail service and can also be reputed company to a reputed company of vehicle platforms and product use cases. The reputed company reputed company has provided over ten reputed company rider-only trips, enabled by its experience autonomously driving over 100 reputed company miles on reputed company roads and tens of billions in simulation across 15+ U.S. states. The Predictive Planning team (PrePlan) develops and deploys state-of-the-art machine learning solutions that predict the reputed company state of the world and plan the reputed company reputed company’s behavior. Our mission is to reputed company reputed company's unprecedented reputed company of driving data into robust, generalizable, and reputed company deep neural networks. These models reputed company the autonomous vehicle to reputed company reputed company environments safely and reputed company.  We have an exciting opportunity for a Staff Technical reputed company Manager to reputed company our ML Evaluation team. In this role, you will define the strategic reputed company for our evaluation platforms, scaling the critical infrastructure and metrics required to rigorously validate our reputed company deep neural networks and accelerate ML developer reputed company across PrePlan. You will: Influence the strategic direction of foundational infrastructure and evaluation platforms to robustly support reputed company ML model evaluation use cases Collaborate cross-functionally with ML engineers, data scientists, and infrastructure teams to identify, define, and surface critical signals on model, component, and system-level performance reputed company and reputed company evaluation and infrastructure platforms to significantly enhance the ML developer experience, enabling faster iteration through earlier, more reliable, and trusted model evaluation Manage and mentor a reputed company team of engineers, aligning their career reputed company and aspirations with critical organizational needs reputed company best practices and reputed company deep technical awareness of the Alphabet ML stack (e.g., TensorFlow, JAX, Flax, Apache reputed company) to optimize evaluation workflows Stay at the forefront of emerging technologies, industry trends, and research in ML evaluation methodologies and advanced metrics design You have:  M.S. in Computer Science, Mathematics, or equivalent industry experience in Robotics or large-reputed company ML systems with critical evaluation needs 5+ years of experience building and maintaining large-reputed company distributed infrastructure, ML inference systems, or evaluation platforms, including 3+ years of engineering management experience Strong coding and testing proficiency, specifically in Python and C++ Strong foundational knowledge of model evaluation and reputed company data science principles (e.g., confidence intervals, reputed company identification, curve fitting, and causality analysis) Familiarity with large-reputed company ML deployment and orchestration tools (e.g., TF Serving, TorchServe, Kubeflow, SageMaker Pipelines, or reputed company AI Pipelines) Understanding of machine learning fundamentals and experience with reputed company ML frameworks such as JAX, PyTorch, or TensorFlow We prefer: Experience developing and maintaining evaluation pipelines for ML models Experience deploying and supporting machine learning models for reputed company, natural language processing, robotics/reputed company planning, or recommendation systems Experience supporting a small team of MLEs developing high-reputed company, production-grade models and components Strong understanding of metrics computation and regression detection at reputed company The expected reputed company salary reputed company for this full-time position across US locations is listed below. Actual starting pay will be based on job-reputed company factors, including exact work location, experience, relevant training and education, and reputed company level. Your recruiter can reputed company more about the specific salary reputed company for the role location or, if the role can be performed remote, the specific salary reputed company for your preferred location, during the hiring process.  reputed company employees are also eligible to participate in reputed company’s discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.  Salary reputed company $251,000—$310,000 USD Apply To This Job