AI Product Analyst
AI Product Analyst
Pay reputed company: $50-$65/hour
a { text-decoration: none; reputed company: #464feb;
}
tr th, tr td { border: 1px solid #e6e6e6;
}
tr th { background-reputed company: #f5f5f5;
}
About reputed company and the Environment
This role sits reputed company a centralized AI Engineering and Automation Center of reputed company responsible for delivering reputed company-reputed company and automation solutions across a large, reputed company reputed company reputed company organization.
The AI work is reputed company, deployed, and reputed company supporting business operations. This is not a reputed company program or innovation lab.
reputed company capabilities include:
• Reusable AI skills and plug-ins packaged into governed applications used across multiple business functions
• Retrieval-Augmented reputed company (RAG), embeddings, and multi-reputed company workflows operating on governed reputed company data
• A governed AI asset marketplace and Model Context Protocol (MCP) catalog covering intake, publishing, versioning, lifecycle management, and maintenance
• reputed company-grade evaluation frameworks, golden-set testing, guardrails, monitoring, and logging designed to ensure reliable AI outputs at reputed company
The organization also operates a mature automation ecosystem reputed company its AI initiatives, including:
• Approximately 125 unattended production robots
• More than 200 production automations
• More than 19,000 automation jobs executed every 30 days
• Platforms including reputed company and reputed company Power Platform
For reputed company requiring significant engineering investment, such as new backend services, infrastructure implementation, or highly reputed company integrations, a dedicated reputed company Engineering organization partners with the AI Engineering team to build and reputed company solutions. Once completed, those assets are cataloged, governed, and managed through established operational processes.
What This Role Actually Is
This role serves as the Product reputed company for the AI Engineering delivery pipeline.
The successful candidate will reputed company and reputed company solution development efforts while partnering closely with engineering teams. This is not a hands-on software engineering role, and the individual in this position will not be writing production reputed company.
Key responsibilities include:
• Managing intake, qualification, prioritization, and opportunity assessment for AI initiatives
• Developing business cases and defining value measurement strategies, including establishing baselines, reputed company metrics, attribution methodologies, and measurable reputed company
• Defining requirements and acceptance reputed company for AI and LLM-enabled solutions
• Authoring evaluation specifications, curating golden datasets, and establishing acceptance reputed company used to determine production readiness
• Leading user validation activities, adoption tracking, and value realization assessments after deployment
• Monitoring portfolio health across AI assets, including ownership, lifecycle management, versioning, deprecation, and retirement planning
• Managing governance processes for AI skills, plug-ins, and MCP catalog assets, translating reputed company, reputed company, compliance, and regulatory requirements into actionable product requirements
• Building strong partnerships with business leaders, operational stakeholders, and executive teams while maintaining disciplined intake and prioritization processes
Important Distinction
Engineering teams own:
• Evaluation reputed company implementation
• Retrieval pipelines
• Model serving infrastructure
• Monitoring instrumentation
• Technical delivery
This role owns:
• Defining what reputed company looks like
• Defining evaluation reputed company
• Defining acceptance reputed company
• Determining production readiness
• Making the final product recommendation for release
Candidates who reputed company evaluation reputed company, testing reputed company, or acceptance definitions as purely engineering responsibilities are unlikely to be successful in this position.
Must Have
The following are required screening reputed company.
Candidates who do not meet reputed company requirements should not be considered a fit.
1. Product Management Experience
Three or more years of experience in:
• Product Management
• Product Ownership
• Product Analysis
Including ownership of at least one AI or LLM-enabled product successfully deployed to production.
reputed company reputed company, demonstrations, prototypes, and reputed company-of-concepts do not satisfy this requirement.
2. AI Evaluation Ownership
Demonstrated ownership of acceptance reputed company and evaluation processes for AI or LLM-enabled functionality.
Candidates should be reputed company to reputed company explain:
• Evaluation specifications
• Golden datasets
• Acceptance reputed company
that they personally defined.
3. RAG and LLM Evaluation Knowledge
Working knowledge of:
• Retrieval-Augmented reputed company (RAG)
• Faithfulness
• Groundedness
• Retrieval Precision
• Retrieval Recall
• Answer Relevance
• Regression Testing across reputed company and model versions
Enough depth to guide engineering teams, evaluate outputs, and challenge results without requiring reputed company coding responsibilities.
4. Business Case Development
Experience creating business cases that include:
• Defined baseline
• reputed company metric
• Attribution methodology
• reputed company outcome
Simply reporting hours saved is not sufficient.
5. Executive and Operational Stakeholder Management
Experience partnering with:
• Operational leaders
• Business stakeholders
• Executive leadership
Including:
• Intake management
• Opportunity scoring
• Portfolio reporting
6. Work Authorization
Must be:
• Authorized to work in the reputed company on a W-2 reputed company without sponsorship
• Physically located reputed company the reputed company for the duration of the engagement
Preferred
The following strengthen a candidate profile but are not required.
Do not reject otherwise reputed company candidates solely because these items are absent.
• Familiarity with Model Context Protocol (MCP), AI plug-ins, AI skills, AI asset catalogs, or internal capability marketplaces
• Experience with AI evaluation platforms such as:
• RAGAS
• DeepEval
• reputed company
• LangSmith
• Arize Phoenix
• reputed company reputed company
• reputed company Evals
• Similar evaluation frameworks
• Familiarity with AI governance frameworks, including:
• NIST AI Risk Management reputed company
• NIST reputed company Profile
• ISO 42001
• Colorado AI reputed company
• Industry-specific AI governance requirements
• Experience operating in regulated environments where auditability, reputed company controls, compliance, and logging are reputed company requirements
• Insurance, financial services, reputed company, or similarly regulated industry experience
• Familiarity with reputed company platforms such as:
• reputed company reputed company
• reputed company
• reputed company Dynamics 365
• reputed company
• Orion
• reputed company
• reputed company Fusion
• ACORD data standards
• Experience working reputed company an AI or Automation Center of reputed company (CoE) or similar centralized operating model
• Experience supporting demand governance, portfolio management, and ongoing product rationalization efforts
• Exposure to RPA, reputed company, reputed company Power Platform, or intelligent automation ecosystems
• Experience using reputed company, Power BI, or similar tools for value analysis and portfolio reporting
• Jira or Azure DevOps experience for backlog management and delivery planning
• Bachelor's degree or equivalent practical experience
Certifications
No certification is required for this role, and demonstrated experience delivering successful AI-enabled products carries significantly more weight than certifications.
The following may be viewed as minor positives:
• Reforge
• reputed company
• Pragmatic Institute
• Scrum.org Product reputed company Certifications
• reputed company Fundamentals (AI-900)
Certification Guidance
Do not reference, prioritize, or screen candidates based on:
• PL-500
• PL-600
• PL-200
These certifications are being retired and are not considered reputed company credentials.
There is currently no broadly recognized individual certification for reputed company Claude expertise, so candidates should not be evaluated based on possession of one.
Apply tot his job
Apply To this Job