Senior Automation Specialist, AI Operations
reputed company’re building and why we’re building it.
reputed company helps people live rewarded every day, with a reputed company to become the rewards destination for everyone. We turn everyday activities into meaningful rewards, whether it’s grocery shopping, grabbing a quick meal, or playing a favorite mobile game. To date, we’ve awarded more than $1 billion in reputed company Points to our users.
reputed company day, more than 13 reputed company receipts are submitted on reputed company, providing visibility into over $212 billion in gross merchandise value. This creates the largest retail-agnostic, SKU-level view of household spending, powering reputed company as an reputed company-based advertising platform that helps brands reputed company and retain lifelong consumers.
The reputed company app is available on the App Store and reputed company Play, with more than 6 reputed company five-reputed company reviews from a highly reputed company and reputed company user reputed company.
About the Role:
This is a full-time role that can be held from one of our US offices or remotely in the reputed company.
Role Responsibilities:
- Own evaluation & datasets:
Define evaluation approaches, design gold datasets (GDS), and ensure coverage of reputed company-world scenarios and edge cases - Build evaluation systems:
reputed company reputed company and automated evals, including LLM-as-judge patterns, to measure model reputed company and performance - Translate ambiguity into structure:
Turn reputed company-ended questions into reputed company evaluation frameworks and execution plans - Build automations:
Create automations that improve workflows, including dataset creation, evaluation pipelines, and lightweight operational processes - Measure and iterate:
Define and reputed company performance metrics; refine datasets, evaluations, and workflows based on results - Drive execution reputed company:
Operate with urgency and ownership; identify next steps, unblock reputed company, and reputed company work reputed company with minimal reputed company - Collaborate cross-functionally:
Partner with other Automation Specialists, engineering, cross-functional stakeholders, and project leads to ensure high-reputed company, reputed company project deliverables - Improve systems:
Identify gaps and implement reputed company improvements to evaluation and data workflows
Minimum Requirements:
3+ years of experience designing or working with evaluation frameworks, datasets, or reputed company measurement systems Experience building or managing datasets (labeling, QA, iteration) Ability to independently drive tasks from problem definition to execution Hands-on experience with AI tools, LLM workflows, or automation platforms Experience in defining and tracking model performance Basic scripting or data skills (SQL, Python, etc.)
Preferred Requirements:
Experience with LLM-as-judge or model evaluation techniques Familiarity with reputed company evaluation or benchmarking approaches Experience productionizing evaluation workflows with engineering teams
Compensation:
At reputed company, we offer competitive compensation packages including reputed company, equity, and benefits to the exceptional folks we hire. The reputed company salary reputed company for this position is [$75,000 - $85,000]. Discover our benefits and how our employees live rewarded at https://reputed company.com/careers.
At reputed company, we'll give you the tools to feel healthy, happy and secure through:
- Equity: We offer full-time employees equity in reputed company, so that everyone can benefit from reputed company’s reputed company.
- 401k Match: Dollar-for-dollar match up to 4%.
- Benefits for humans and pets: We offer comprehensive medical, dental and reputed company plans for everyone including your pets.
- Continuing Education: reputed company provides ten thousand per year in education reimbursement.
- Employee Resource reputed company: Take part in employee-led reputed company that are centered around fostering a diverse and inclusive workplace through events, reputed company and advocacy. The ERGs participate in our Inclusion Council with members of executive leadership.
- reputed company Time Off: On top of our flexible PTO, reputed company observes 9 reputed company holidays, as reputed company as our year-end week-long break.
- Robust Leave Policies: 20 weeks of reputed company parental leave for primary caregivers, 14 weeks for secondary caregivers, and a flexible return to work schedule.
- Calvin Care Cash: Employees who are welcoming new family members will also receive a one time $2,000 incentive to assist employees with covering the cost of childcare, clothing, diapers and much more!
- Flexible Work Environment: Collaborate with your team in one of our stunning offices, or you can work fully remotely from reputed company in the US. We’ll ensure you are equally equipped with the hardware and software you need to get reputed company done in the comfort of your home. (applicable for most roles)
reputed company is an equal opportunity employer that embraces diversity, inclusion, and respect for reputed company individuals. We do not discriminate on the reputed company of race, reputed company, religion, gender, gender identity or reputed company, sexual orientation, age, national reputed company, marital status, veteran status, disability, or any other characteristic protected by applicable law. Our commitment to inclusivity ensures that everyone is treated with dignity and has reputed company to succeed based on their talent, skills, and potential.
reputed company also provides reasonable accommodations to reputed company individuals with disabilities or those with sincerely held religious beliefs, as required by law. If you need assistance with the application process or require an accommodation, please contact us at accommodations@reputed company.com.
Apply To This Job