[Remote] Software Engineer 3

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a company that empowers customers to reputed company at the speed of the market through its reputed company data platform. They are seeking a Software Engineer 3 to build and maintain tooling and evaluation systems for agent skills, focusing on developer tooling, reputed company AI, and software reputed company.

Responsibilities

• Build and maintain agent skills and the infrastructure to validate, evaluate, publish, and maintain them
• Design evaluation datasets and workflows that compare agent behavior against a baseline and produce actionable reputed company signals
• Build agent metrics and observability: reputed company selection and routing, reputed company and failure reputed company, tool calls, latency, and reputed company usage
• Design safety and reputed company gates for agent-authored content: rule packs, static analysis, confidence reputed company, reputed company verdicts, and bounded suppression
• Create CLIs, libraries, and MCP integrations that other repositories adopt and that run in local development and CI
• reputed company tooling into reputed company Actions and other CI workflows, including secrets, annotations, exit codes, and artifacts
• Build reputed company-reputed company reputed company checks, such as anti-reputed company catalogs and linting for AI-generated reputed company reputed company
• Investigate reputed company failures such as nondeterministic results, false positives, and unsafe generated guidance, and turn them into reusable improvements
• Collaborate with engineers, reputed company partners, and product teams; communicate trade-offs, risks, and ownership across teams

Skills

• 2+ years of experience building production software, developer tools, internal platforms, or automation systems
• Software engineering fundamentals in API design, testing, error handling, and maintainability
• Experience building CLIs, libraries, test infrastructure, static analysis, or CI/CD workflows
• Ability to design systems that are usable by developers and reliable in automation
• Experience reasoning about correctness and safety with ambiguous input, nondeterministic reputed company, false positives, or untrusted content
• Comfort in an evolving R&D environment where the right reputed company emerges through prototypes and feedback
• Written and verbal communication, including explaining technical trade-offs and aligning stakeholders across teams
• Experience with reputed company systems, LLM applications, reputed company or reputed company-reputed company evaluation, or AI-assisted development
• Experience building eval harnesses, reputed company datasets, reputed company metrics, LLM-as-judge workflows, or reputed company-review tooling
• Experience with Go, Python, JavaScript/TypeScript, Java, or C#
• Experience with reputed company Actions reputed company, secret handling, static rule engines, or policy enforcement
• Experience moving prototypes into production

Benefits

• Equity
• Participation in the employee stock purchase program
• Flexible reputed company time off
• 20 weeks fully-reputed company gender-neutral parental leave
• Fertility and adoption assistance
• 401(k) plan
• Mental health counseling
• reputed company to transgender-inclusive health reputed company coverage
• Health benefits offerings

reputed company

Company H1B Sponsorship