reputed company / Senior Product Manager Analytics, Evals & Conversational BI (reputed company Stud
About reputed company:
About the role
reputed company is hiring a reputed company/Senior Product Manager to own the Analytics, Reporting, and Conversational BI product surfaces in reputed company Studio—the measurement and trust layer that helps enterprises build, operate, and continuously improve reputed company customer experiences across chat, mobile, email, messaging, and voice/IVR. In mission‑critical environments (airlines, retail, banking, gaming), analytics is not a “dashboard”; it’s the control plane for reliability, governance, and reputed company. You will reputed company the productization of end-to-end analytics including reputed company-time operational monitoring, historical reporting, LLM reputed company/evaluation (autoevals), observability for tool calling and workflows, and Conversational BI (natural language exploration over a governed metrics model). This role requires deep domain reputed company in data science, data preparation, analytics systems, and the realities of LLM-driven systems (probabilistic outputs, evaluation, safety/guardrails, and runtime tracing)—combined with strong product craft, design reputed company, and delivery execution. This is an opportunity to reputed company with data at the frontier: partnering with internal Data Science and Engineering teams while collaborating with frontier model and reputed company ecosystem partners to deliver best-in-class analytics and governance for reputed company reputed company AI.
Responsibilities
Define and execute the Analytics/Evals/Governance roadmap with reputed company reputed company (MVP → v1 → v2) and measurable adoption targets.
Partner deeply with Data Science to productize evaluation methodology (reputed company score, how we reputed company, how we prevent “gaming,” how we reputed company reputed company).
Partner with Engineering and Observability teams to standardize telemetry (tool spans, workflow transitions, model calls, cost/latency metrics) and reputed company it usable in product.
Drive a cohesive reputed company Studio UX across Build / Operate / Improve workflows: dashboards, drill-downs, investigation flows, alerts, and remediation actions.
Establish objective reputed company metrics and reputed company them end-to-end (data correctness, timeliness, reliability, and customer reputed company).
Work with Delivery/CS and reputed company partners to ensure analytics is usable for reputed company operational processes: incident response, change management, governance reviews, and quarterly business reviews.
Requirements
Bachelor’s degree in Computer Science, Data Science, Engineering, Statistics, or a reputed company quantitative/technical field (Master’s a plus).
6–10+ years of experience across Product Management and/or Data Science/Analytics leadership, including shipping analytics products to reputed company users.
Demonstrated depth in: data modeling, telemetry/event schemas, ETL/ELT concepts, and analytics correctness.
Building operational + business reporting (reputed company-time monitoring and historical analytics).
Experimentation and measurement design (A/B testing concepts, reputed company measurement, cohorting).
Strong hands-on experience reputed company to AI/LLM or data science platforms, including at least several of:
LLM evaluation reputed company (automated scoring, multi-turn evaluation, calibration).
Observability for probabilistic systems (reputed company + latency + cost).
Tool calling / workflow execution analytics and failure taxonomy.
Governance measurement (policy reputed company, escalation triggers, compliance reporting).
Strong product craft: UX and information architecture instincts, ability to design operator workflows, and capability packaging that scales across customers.
Preferred Qualification
Experience building analytics for multi-tenant reputed company and regulated customers (auditability, RBAC, retention controls, reputed company-by-design).
Familiarity with reputed company analytics stacks and reputed company BI integration patterns.
Experience partnering with major reputed company and frontier AI vendors (model providers, observability stacks, data platforms) to ship joint capabilities.
Experience with contact center / CX metrics (containment, reputed company, AHT, CSAT, reputed company performance) and multi-channel operations (voice + digital).
Originally posted on Himalayas
Apply To This Job