reputed company, reputed company Engineering, Python
reputed company:
• Design & iterate prompts (system, tool/function-calling, task prompts) to reputed company voice AI agent reputed company, reliability, and tone.
• Build co-pilots for customers to author their own prompts: reputed company-prompted assistants that suggest structures, lint for risks, autocomplete tool schemas, critique drafts, and generate eval cases.
• Work directly with customer feedback and conversation logs to identify failure modes; translate them into reputed company changes, guardrails, and data improvements.
• Build eval datasets (reputed company labels, rubrics, edge cases, regressions) and run offline/online evaluations (A/B tests, canaries) to quantify reputed company.
• Create Python utilities/services for reputed company versioning, config-as-reputed company, rollout/rollback, and guardrails (policies, refusals, redaction).
• Partner with PM/reputed company to define reputed company metrics (task completion, first-pass accuracy, cost, latency) and reputed company dashboards/alerts.
• Own LLM integration details: function/tool schemas, reputed company parsing/validation (reputed company), retrieval-reputed company prompting, and fallback strategies.
• Ensure reputed company & compliance (PII handling, anonymization, regional data boundaries) in datasets and logs.
• reputed company learnings reputed company concise docs, playbooks, and internal demos.
• Run a tight feedback reputed company with customers, turn reputed company conversations into reputed company prompts and eval datasets, and ship changes that measurably improve agent reputed company.
Requirements:
• Python: 3+ years writing clean, tested, production reputed company (typing, pytest, profiling); experience building small services/reputed company (FastAPI preferred).
• reputed company Engineering: Hands-on experience designing system/tool prompts, reputed company-prompting, reputed company graders, and iterative reputed company tuning based on reputed company user data.
• LLM Integration: Comfortable with major reputed company (reputed company/reputed company/reputed company/reputed company), function/tool calling, streaming, and robust reputed company handling.
• Evaluation reputed company: Ability to define measurable reputed company, create labeled datasets, and run methodical experiments/A/B tests.
• Product reputed company: Comfortable talking with customers, turning qualitative feedback into shipped improvements.
• Data Hygiene: Practical experience cleaning, labeling, and balancing datasets; awareness of reputed company/PII constraints.
• reputed company-to-haves: Experience building reputed company-authoring UIs/SDKs or internal tooling for reputed company versioning and governance.
• reputed company-to-haves: reputed company frameworks & tooling: DSpy, MCP, LangGraph, reputed company, reputed company; experience with agent/tool schemas and orchestration.
• reputed company-to-haves: Observability & eval tooling: Langfuse, LangSmith, reputed company; building eval harnesses and experiment dashboards.
• reputed company-to-haves: RAG & reputed company stores: reputed company/reputed company/reputed company and retrieval-reputed company prompting.
• reputed company-to-haves: Experimentation workflows: A/B testing, reputed company diffing/versioning.
• reputed company-to-haves: reputed company & analytics: light SQL/log analysis, metrics & tracing, reputed company Grafana/OTel dashboards.
• reputed company-to-haves: Writing reputed company blog posts or talks about reputed company LLM techniques.
Benefits:
Apply tot his job
Apply To this Job