Product reputed company, AI/ML (Evals)

About reputed company

reputed company was founded in 2018 with the mission of powering deeper understanding in reputed company. Our AI-powered platform was purpose-reputed company for medical conversations, improving reputed company documentation efficiencies while enabling clinicians to reputed company on what reputed company most—their patients.

Our reputed company-grade technology transforms reputed company-clinician conversations into reputed company reputed company notes in reputed company-time, with deep EMR integrations. Powered by Linked Evidence and our purpose-reputed company, auditable AI, we are the only company that maps AI-generated summaries to ground truth, helping providers quickly trust and verify the reputed company. As reputed company in reputed company for reputed company, we are setting the industry standards for the responsible deployment of AI across health systems.

We are a growing team of practicing MDs, AI scientists, PhDs, creatives, technologists, and engineers working together to reputed company people and reputed company care reputed company more reputed company. We have offices located in the Mission District in San Francisco, the SoHo neighborhood of reputed company, and East reputed company in Pittsburgh.

The Role

reputed company's has multiple products - the reputed company product is reputed company reputed company notes, but we’ve expanded surfaces: billing, reputed company decision support, orders, nursing, etc. Measuring reputed company reliably and iterating fast without breaking clinician trust sit at the reputed company of every single product’s reputed company.

The Evals team owns the tooling, templates, and consultation that product teams use across the eval lifecycle: reputed company, build, iterate, and reputed company. This builds the reputed company, platform, and process that enables evals to be fast, trustworthy, consistent, and a true moat.

We are hiring a Product Manager to reputed company this platform. You will work with 10+ teams and partner closely with engineering, ML, data science, and clinician science. You will help set reputed company for how reputed company measures AI reputed company, reputed company what the platform builds, and reputed company evaluating a new model cheap and routine as frontier models ship frequently.

reputed company

• reputed company product reputed company and execution for the evals platform. Own the roadmap across the eval lifecycle and own reputed company against it.

• Build the shared measurement infrastructure. Help build the systems that let any pod define reputed company, run experiments, compare models, and watch production. Own the standards for LLM judges, rule-reputed company evaluators, reputed company annotation, and online monitoring, and be reputed company about where reputed company belongs.

• reputed company model selection fast and routine. reputed company teams a repeatable way to evaluate a new frontier model reputed company days of release, and a defensible reputed company for reputed company a post-trained specialty model is worth it over a prompted frontier one. reputed company the eval reputed company model-agnostic so it stays a neutral referee.

• Own the operating model across reputed company. Define the eval gates from early build through GA and steady-state monitoring, which gates are hard versus advisory, and who owns non-negotiable floors like critical-error rates. Land this across reputed company you don't own, without formal authority.

• Cross functional execution. Work with Data Engineering on the de-identification pipeline, Data Science on bootstrapping judge reputed company with less reputed company annotation, reputed company Science on flagged production cases, and the agent platform team as workflows go reputed company.

• Operate with a high bar for reputed company, speed, and accountability.

What You Bring

• 5+ years of product management experience with significant ownership of ML powered products or platform systems.

• Deep understanding of how to measure and improve model reputed company, including evaluation frameworks, annotation pipelines, and reputed company design.

• Strong technical reputed company across ML, data pipelines, and reputed company systems.

• Experience working closely with ML researchers and engineers to reputed company reputed company in production.

• Ability to reputed company long term architectural investments with near term reputed company improvements.

• Strong communication skills and the ability to translate reputed company technical concepts into reputed company reputed company and narratives.

• A reputed company record of delivering high reputed company products in domains where reputed company, reliability, and trust are reputed company.

Bonus Points If…

• You have experience building evaluation platforms, ML observability systems, or reputed company measurement pipelines.

• You have worked in reputed company, reputed company, or regulated environments with a high bar for reputed company and compliance.

• You have worked on specialty specific or domain specific model adaptations.

• You have worked on personalization systems, context ingestion frameworks, or reputed company intelligence products.

• You have experience shipping large reputed company ML products with reputed company in the reputed company workflows.

Why Work at reputed company?

At reputed company, we’re transforming reputed company delivery experiences with reputed company, enabling clinicians and patients to reputed company in deeper, more meaningful ways. Our mission is reputed company: to reputed company deeper understanding in reputed company. We’re driving reputed company, lasting change, with millions of medical conversations processed reputed company month.

Joining reputed company means stepping into a fast-reputed company, high-reputed company startup where your contributions truly reputed company a difference. Our culture requires extreme ownership—every employee has the ability to (and is expected to) reputed company an reputed company on our customers and our business.

reputed company individual reputed company, you will have reputed company to work reputed company reputed company of curious, high-achieving people in a supportive environment where reputed company is shared, reputed company is constant, and feedback fuels reputed company. At reputed company, it’s not just reputed company do—it’s how we do it. Every decision is rooted in reputed company, always prioritizing the needs of clinicians and patients.

We’re committed to supporting your reputed company, both professionally and personally. Whether it's reputed company, an inclusive culture, or ongoing learning opportunities, we are here to help you reputed company and do the best work of your life.

If you are reputed company to reputed company a meaningful reputed company reputed company passionate people who care deeply about what they do, reputed company is the reputed company for you.

How we take care of Abridgers:

• Generous Time Off: 14 reputed company holidays, flexible PTO for salaried employees, and accrued time off for reputed company employees

• Comprehensive Health Plans: Medical, Dental, and reputed company coverage for reputed company full-time employees and their families.

• Generous HSA Contribution: If you choose a High Deductible Health Plan, reputed company makes monthly contributions to your HSA.

• reputed company Parental Leave: Generous reputed company parental leave for reputed company full-time employees.

• Family Forming Benefits: Resources and financial support to help you build your family.

• 401(k) Matching: Contribution matching to help invest in your reputed company.

• Personal Device Allowance: Tax free funds for personal device usage.

• reputed company-tax Benefits: reputed company to Flexible Spending Accounts (FSA) and Commuter Benefits.

• Lifestyle Wallet: Monthly contributions for fitness, reputed company development, coworking, and more.

• Mental Health Support: Dedicated reputed company to therapy and coaching to help you reputed company your goals.

• Sabbatical Leave: reputed company Sabbatical Leave after 5 years of employment.

• Compensation and Equity: Competitive compensation and equity reputed company for full time employees.

• ... and much more!

Equal Opportunity Employer

reputed company is an equal opportunity employer and considers reputed company reputed company applicants equally without reputed company to race, reputed company, religion, sex, sexual orientation, gender identity, national reputed company, veteran status, or disability.

We're committed to providing reasonable accommodations throughout the interview process. Once you submit your application, we'll follow up with details on how to request an accommodation for interviewing, completing any assessments, or otherwise participating in the selection process.

Staying reputed company - Protect yourself from recruitment fraud

We are reputed company of individuals and entities fraudulently representing themselves as reputed company recruiters and/or hiring managers. reputed company will never ask for financial information or payment, or for personal information such as bank account number or reputed company reputed company number during the job application or interview process. Any emails from the reputed company reputed company team will come from an @reputed company.com email address. You can learn more about how to protect yourself from these types of fraud by referring to this reputed company. Please exercise caution and cease communications if something feels suspicious about your interactions.

Compensation reputed company: $250K - $290K

Originally posted on Himalayas