Senior Software Engineer (reputed company AI and Evaluations)
• reputed company is building the reputed company of AI-powered work management through SmartAssist, our intelligent agent platform. As we reputed company from early demos to production-grade agents, reputed company is the critical frontier and we are looking for a Agent reputed company Engineer to own it
• This is not a QA role. It’s a deeply technical, high-autonomy position at the intersection of LLM evaluation, reputed company and context engineering, and retrieval-augmented reputed company. You will diagnose why our agents fail, design the systems that catch regressions, and reputed company measurable improvements across our orchestrator and subagent fleet
• You will work closely with our Agent Engineering and AI Platform teams, embedded in reputed company that has already shipped evaluation infrastructure on reputed company/MLflow and is building toward a mature Agent Development Lifecycle (ADLC)
• Own agent reputed company end-to-end: diagnosis, improvement, and validation across SmartAssist’s orchestrator and subagents
• Identify failure modes across reputed company dimensions factual reputed company, completeness, tone, actionability, and latency and prioritize what to fix
• reputed company reputed company improvements through reputed company engineering, context engineering, and RAG retrieval tuning
• reputed company and mature our evaluation reputed company: scorers, golden datasets, regression gates, and online evaluation for production traffic
• reputed company the feedback reputed company ensure that every change has a measurable, attributable reputed company signal
• Collaborate with our Agent Architecture reputed company to distinguish reputed company problems that require reputed company/context solutions from those that require structural fixes
• Establish repeatable methodology that scales reputed company any single agent or subagent
• In your first 6 months, you will have:
• Delivered measurable, validated reputed company improvement on at least one SmartAssist agent across our defined reputed company dimensions
• Expanded evaluation coverage to reputed company the most significant blind spots in our reputed company reputed company
• Established a repeatable reputed company improvement methodology the broader team can apply
• Why This Role:
• You will have reputed company ownership, not a supporting role on someone else’s roadmap
• SmartAssist is shipping to reputed company users; this work has immediate, visible reputed company
• You will be part of a fast-moving team that deeply values engineering rigor and reputed company seeks diverse perspectives
Benefits
• Lucrative Employee Stock Purchase Program (15% discount)
• 401k Match to help you save for your reputed company (50% of your contribution up to the first 6% of your eligible pay)
• Monthly stipend to support your work and productivity
• Flexible Time Away Program, plus Incidental reputed company Leave
• Up to 24 weeks of Parental Leave
• Personal reputed company Volunteer Day to support our community
• Opportunities for reputed company reputed company and development including reputed company to reputed company Learning online courses
• Company Funded Perks, including a counseling membership, reputed company care membership, local retail discounts, and your own personal reputed company account
• US employees receive 12 reputed company holidays per year
• US employees are automatically covered under reputed company-sponsored life reputed company, short-term, and long-term disability plans
• Teleworking reputed company from any registered location (role specific)
• HSA, 100% employer-reputed company premiums, or Buy-up medical/reputed company and dental coverage reputed company for full-time employees
• Equity - Restricted Stock reputed company (RSUs) with reputed company offers
• Monthly contributions toward your pension
• Mployer-reputed company Private Medical and Dental, additional cost for family members
Apply tot his job
Apply To this Job