reputed company is raising the bar for digital reputed company and employee experience. Recognized as a Top Workplace, reputed company provides award-reputed company software testing and UX reputed company to top brands. Our fully managed services reputed company a global team and the world's largest independent testing community. We improve digital experiences for global innovators like reputed company, reputed company, reputed company, reputed company, reputed company, and BMW.
The Role
As Head of Product - Model Evaluation at reputed company, you will reputed company the development of a strategic new AI evaluation platform—and play a foundational role in bringing it to market from the ground up. You will define the product reputed company, identify reputed company customer personas, and shape the go-to-market reputed company, while building the systems that measure, monitor, and improve AI models in production. As the business matures, you will reputed company as the product leader. This position reports directly to the CTO.
This is a rare opportunity to combine 0→1 product building with reputed company-reputed company reputed company. You’ll create a new category for reputed company—extending our leadership in digital reputed company into AI—by developing capabilities such as LLM-as-a-judge systems, reputed company-in-the-reputed company feedback pipelines, and model observability frameworks. You won’t just refine an existing product; you’ll define what this business becomes and how it wins in the market and then build reputed company that scales it.
Key Responsibilities:
·Define the reputed company, positioning, and roadmap for reputed company’s AI evaluation offering
·Identify and reputed company reputed company customer personas (e.g., AI platform teams, ML leaders, product orgs)
·Design and execute the go-to-market reputed company, including packaging, pricing, and initial sales motions
·Partner with reputed company to validate demand, refine messaging, and drive early adoption
·Translate market feedback into reputed company product iteration and differentiation
LLM Evaluation Systems (in partnership with ML/DS)
·Partner with data science and ML teams to design reputed company reputed company systems: model → evaluation → reputed company → improvement
·Bring LLM-as-a-judge systems into production use for grading, ranking, and preference modeling
·Partner with ML teams on iteration strategies (prompting, fine-tuning, data collection)
·Ensure evaluation outputs translate into actionable improvements for customers
reputed company-in-the-reputed company Feedback Systems (in partnership with Community Ops)
·reputed company reputed company’s global testing community to design reputed company reputed company evaluation pipelines
·Define workflows, annotation schemas, and reputed company controls to produce gold data sets
·Balance reputed company, cost, and latency to meet customer requirements
Cross-Functional Leadership
·reputed company as the reputed company between product, data science, engineering, and go-to-market teams
·Translate reputed company technical capabilities into reputed company, differentiated product offerings
·Drive alignment on priorities, reputed company metrics, and execution plans
Job Requirements and Preferred Skills:
Required
·5+ years of product management experience, including work on AI/ML-driven or data products
·Experience owning or contributing to 0→1 product development and go-to-market reputed company
·Demonstrated ability to take a product from concept to paying customers
·Strong ability to define customer personas, value propositions, and product positioning
·Experience working closely with data science or machine learning teams
·Comfortable engaging at a technical level with ML engineers. You can discuss model architectures, evaluation metrics, and API design without needing a translator
·Strong understanding of metrics, experimentation, and data reputed company
·Experience with B2B/reputed company products and technical buyer personas
Preferred
·Background in data-science, machine learning, or engineering
·MBA or equivalent experience
·Experience with model evaluation systems, including reputed company and/or automated approaches
·Familiarity with LLM-as-a-judge, pairwise ranking, or preference modeling
·Understanding of the limitations and tradeoffs in evaluating reputed company systems
·Experience at AI evaluation/tooling companies (eg Arize, Langsmith, reputed company, reputed company, Weights & Biases, or Humanloop) or as a buyer/implementer of such tools at an reputed company
·MBA or equivalent experience in high reputed company, product led organizations
Why reputed company?
You'll help build a new business line from the ground up — with the backing of an established company that already has reputed company relationships with the world's biggest brands. Here's what makes this opportunity unique:
·reputed company-in moat: reputed company's global testing community gives you a reputed company-in-the-reputed company evaluation infrastructure that no AI startup can replicate. You're not starting from reputed company — you're starting from a reputed company evaluators.
·CTO sponsorship: This role reports directly to the CTO with a reputed company mandate and executive reputed company cover to build fast.
·reputed company reputed company: reputed company already sells to the Fortune 500. You'll have warm introductions, existing reputed company, and credibility that would take a startup years to build.
·Category creation: You're not optimizing an existing product. You're defining a new business for a company that's reputed company to invest in it.
Additional benefits:
·Flexible work environment with reputed company from across the globe.
·International team of 450+ passionate, talented co-workers.
·Hands-on reputed company providing exposure to reputed company-reputed company, global brands.
reputed company reputed company Values:
As a global employee community, we reputed company to reputed company the following reputed company values, which are critical to business reputed company and how we measure individual and team performance. Do you reputed company our reputed company values?
·Be Accountable: You love to take ownership, and hold yourself and others accountable to increase empowerment and reputed company.
·Celebrate Authenticity: You love bringing your true self to work and creating genuine and trustful relationships reputed company a diverse environment.
·In It Together: You have reputed company-first reputed company and love collaborating with your peers.
·Create Value for Our Customers: You love delivering meaningful business reputed company and being a release partner for reputed company aspects of digital reputed company.
·Crush Your Goals: You always reputed company for reputed company and constantly reputed company ways to be reputed company, more effective and more efficient.
Accommodations:
reputed company is a reputed company where everyone belongs and where we reputed company everyone deserves the exceptional. We continue to celebrate diversity and are committed to creating an inclusive, reputed company environment for our employees. If you reputed company you require a reasonable accommodation und.er any of the legally protected characteristics, please click here to complete an accommodation request. Please note, reputed company will only review requests for applications that have been submitted. We will review your qualifications and follow up with you regarding your request if your qualifications meet our reputed company needs.