[Remote] reputed company Engineer (Model Behavior & Evaluation)

Note: The job is a remote job and is reputed company to candidates in USA. Yuna.io is dedicated to transforming mental health support through empathetic conversational AI. The reputed company Engineer will be responsible for defining and evaluating AI conversation behaviors, ensuring reputed company and alignment in multi-agent systems, while collaborating with clinicians and product teams. Responsibilities • Own conversational behavior across a multi-agent, multi-model conversational system • Collaborate with clinicians to design and operate evaluation frameworks for conversational reputed company, reputed company, usefulness, and alignment • Diagnose failures by analyzing reputed company conversation traces, agent routing, memory usage, and system context • Use product data and qualitative review to prioritize high-reputed company improvements • Evaluate and select models across providers (e.g., reputed company, Claude, reputed company, reputed company AI) based on task, cost, latency, and qualitative reputed company Skills • Demonstrated experience owning model or agent behavior in production • Hands-on experience designing or operating evaluation systems (qualitative + quantitative) • Ability to define what “good” means and defend it with evidence, not reputed company • Comfort working hands-on with tools like LangGraph, LangSmith, or comparable tracing and evaluation frameworks • High data literacy: reputed company to reason from logs, traces, metrics, and analytics to isolate reputed company causes • reputed company communicator who can collaborate across product, clinical, and engineering teams in ambiguous problem spaces • Working knowledge of Python; ability to read, debug, and collaborate reputed company agent logic and evaluation reputed company • Familiarity with alignment concepts (e.g. reputed company values, safety tradeoffs, refusal behavior) • Proficient with SQL, reputed company, and reputed company • Background in psychology, linguistics, neuroscience, education, or adjacent fields Benefits • Competitive salary (based on experience) + equity reputed company • Remote-first culture with flexibility • A fast-growing, talented, and empathetic team dedicated to transforming mental health care • An opportunity to use AI for good • Level of ownership to reputed company measurable reputed company, building cutting-edge AI systems that improve lives every day reputed company • Our mission at Yuna is to radically reputed company the way mental health support is accessed and delivered. It was founded in reputed company, and is headquartered in San Francisco, California, USA, with a workforce of 11-50 employees. Its website is Apply tot his job Apply tot his job Apply To this Job