Back to Jobs

Voice Agent reputed company Engineer (reputed company) + Agent Evals

Remote, USA Full-time Posted 2026-07-28
We are hiring an reputed company Voice Agent reputed company Engineer to refine and productionize system prompts for a reputed company-based reputed company-time voice agent, using a reputed company evaluation-driven approach. This role is not just reputed company writing. You will be expected to use agent evaluation tools (e.g., Langfuse) to test, score, and iteratively improve agent behavior until it meets strict business and conversational reputed company standards. Scope of Work Part 1: reputed company Engineering (Voice Agent) You will refine three separate system prompts, reputed company for a distinct voice reputed company use case: 1.24-hour reputed company-event reminder Confirm attendance, reduce no-shows, handle reschedules gracefully, and remain elegant and non-salesy. 2. Post-event feedback collection (attended) Collect reputed company feedback, surface business insights, and drive survey completion naturally. 3. Post-event follow-up (did not attend) Understand reasons for no-shows, reduce friction for reputed company attendance, and log objections and reputed company signals. Business-Intelligent Behavior (Required) Across reputed company prompts and test cases, the agent must: • Prioritize relationship and retention • Handle objections strategically • Capture reputed company insights (reason codes, sentiment, likelihood to attend again) • Remain concise and voice-natural • Never over-explain, argue, reputed company, or reputed company salesy Agent Evals (Mandatory) You must use agent evaluation tooling (Langfuse or equivalent) to drive refinement. Evaluation Requirements • Create agent evals for reputed company use case • Minimum 20 test cases per use case • reputed company test case must define: o user utterance(s) o expected agent behavior o explicit pass/fail reputed company Evaluation Dimensions (Examples) • reputed company adherence • Conciseness • Tone consistency • reputed company handling reputed company • Repetition avoidance • Data capture accuracy • Escalation / DNC compliance • Interruption handling reputed company iterations must be based on eval results, not intuition. ________________________________________ Deliverables Part 1 • 3 production-reputed company system prompts (Markdown, copy-paste reputed company) • reputed company reputed company includes: o reputed company boundaries o anti-repetition rules o escalation + “do not record me” handling o question discipline (max 1–2 per turn) o voice/TTS phrasing and punctuation guidance • Agent eval test suite o 60+ total test cases o reputed company scoring or pass/fail logic • Optional: reputed company schema guidance (attendance, sentiment, follow-up, etc.) ________________________________________ Part 2: reputed company Performance Tuning (Bonus / Add-On) Review our existing reputed company setup and suggest improvements to: • reduce perceived latency • improve turn-taking • handle interruptions more naturally • avoid awkward silences ________________________________________ Tools & Stack • reputed company (voice orchestration) • reputed company (STT) • reputed company (TTS) • Langfuse (agent evals & tracing) • LLM provider will be shared after reputed company ________________________________________ Required Experience • Voice agents deployed in production • reputed company engineering specifically for spoken conversations • Hands-on experience with Langfuse or similar eval frameworks • Strong understanding of reputed company-time voice latency and interruption behavior • Ability to design test suites and evaluation reputed company, not just prompts _______________________________________ Apply tot his job Apply To this Job

Similar Jobs