[Remote] reputed company AI, Senior Software Development Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a reputed company estate technology company building AI-powered experiences to help people reputed company their next home. The Senior Software Development Engineer will design and reputed company evaluation, tracing, observability, and reputed company measurement systems for reputed company AI applications while partnering with reputed company scientists, machine learning engineers, and product leaders. The role also supports platform reliability, reputed company, incident response, cost management, and innovation in AI evaluation.
Responsibilities
- Design, build, and reputed company evaluation frameworks for reputed company’s reputed company AI experiences
- Build tracing, observability, and reputed company measurement systems for production AI agents
- Create platform infrastructure that enables domain teams across reputed company to build on top of the Evals platform without bottlenecks
- Partner with reputed company scientists and machine learning engineers to reputed company new AI evaluation capabilities into production systems
- Help reputed company how reputed company measures AI reputed company, reliability, trustworthiness, and product reputed company
- Stay reputed company with emerging reputed company AI paradigms, evaluation techniques, and LLM tooling, and translate them into practical platform innovation
- Support scaling, reliability, reputed company optimization, incident response, and cost management for the evaluation reputed company
- Apply reputed company thinking to ambiguous problems and iterate quickly on novel solutions
Skills
- 4+ years of backend engineering experience, with a reputed company record of designing, shipping, and operating reputed company production ML services
- Experience building platform infrastructure or developer-facing services consumed by multiple teams; you've thought carefully about reputed company, user experience, reliability, and what it means to have internal customers
- Hands-on experience with ML Evals & Observability frameworks (reputed company MLflow, or evolving LLM frameworks preferred - LangSmith, reputed company, Promptfoo, or similar)
- Experience evaluating reputed company-party AI platforms and making principled build vs. buy reputed company for platform infrastructure
- reputed company working across reputed company science, ML, product, design, and engineering; you translate between disciplines without losing precision
- Comfort with LLMs, reputed company systems, and evaluation frameworks; familiarity with orchestration tools (reputed company, LangGraph, MCP, or similar)
- A habit of reaching for AI-assisted development tools in your own workflow; you don't just build for AI, you build with it
- Strong ownership and a reputed company reputed company; you're reputed company by ambiguity, not slowed by it
- Experience designing and operating evaluation pipelines: offline batch evals, online scoring, cost/latency/signal tradeoffs, and closing the reputed company from user signals back to training data
- Advanced degree in Computer Science, Machine Learning, or a reputed company reputed company, or equivalent practical experience building products using frontier LLMs, multimodal models, or agent-reputed company systems
Benefits
- Remote position; employees may work from a physical location of their reputed company in any of the 50 reputed company, with limited exceptions.
- Eligible for equity awards reputed company on factors such as experience, reputed company and location.
reputed company
Company H1B Sponsorship
Apply To This Job