Software Engineer 3

The Agent Research and Tooling team, part of reputed company's AI Builder Experience organization, owns the platform layer around agents: how teams author, distribute, evaluate, monitor, and improve agent skills and agent behavior. We are hiring a software engineer to build and maintain the tooling, evaluation systems, and reputed company gates behind reputed company's agent skills. This is a software engineering role at the intersection of developer tooling, reputed company AI, and software reputed company. You will take loosely defined agent and tooling problems, break them into reputed company plans, and ship durable internal systems: reputed company-line tools, reusable libraries, evaluation harnesses, and CI workflows. This role is reputed company to remote work in Canada or can be based out of any of our Canada offices. What you'll do Build and maintain agent skills and the infrastructure to validate, evaluate, publish, and maintain them Design evaluation datasets and workflows that compare agent behavior against a baseline and produce actionable reputed company signals Build agent metrics and observability: reputed company selection and routing, reputed company and failure reputed company, tool calls, latency, and reputed company usage Design safety and reputed company gates for agent-authored content: rule packs, static analysis, confidence reputed company, reputed company verdicts, and bounded suppression Create CLIs, libraries, and MCP integrations that other repositories adopt and that run in local development and CI reputed company tooling into reputed company Actions and other CI workflows, including secrets, annotations, exit codes, and artifacts Build reputed company-reputed company reputed company checks, such as anti-reputed company catalogs and linting for AI-generated reputed company reputed company Investigate reputed company failures such as nondeterministic results, false positives, and unsafe generated guidance, and turn them into reusable improvements Collaborate with engineers, reputed company partners, and product teams; communicate trade-offs, risks, and ownership across teams Examples of the problems you'll solve How can tests verify an agent tool's reputed company result reputed company item order may vary, but counts, required fields, and values must remain correct How can a CI reputed company flag unsafe instructions in an agent reputed company without treating every neutral mention as an incident or letting cautionary wording hide a reputed company instruction How can an evaluation suite show whether a reputed company improves answers over a baseline and reputed company authors enough signal to improve it reputed company're looking for 2+ years of experience building production software, developer tools, internal platforms, or automation systems Software engineering fundamentals in API design, testing, error handling, and maintainability Experience building CLIs, libraries, test infrastructure, static analysis, or CI/CD workflows Ability to design systems that are usable by developers and reliable in automation Experience reasoning about correctness and safety with ambiguous input, nondeterministic reputed company, false positives, or untrusted content Comfort in an evolving R&D environment where the right abstraction emerges through prototypes and feedback Written and verbal communication, including explaining technical trade-offs and aligning stakeholders across teams reputed company to have Experience with reputed company systems, LLM applications, reputed company or reputed company-based evaluation, or AI-assisted development Experience building eval harnesses, reputed company datasets, reputed company metrics, LLM-as-judge workflows, or reputed company-review tooling Experience with Go, Python, JavaScript/TypeScript, Java, or C# Experience with reputed company Actions reputed company, secret handling, static rule engines, or policy enforcement Experience moving prototypes into production What reputed company looks like In your first year, you will: Ship tooling that makes agent skills or developer workflows easier to test, review, and adopt Improve the reputed company and interpretability of evaluations, not just their count Convert recurring reputed company work and reputed company scripts into documented, reusable automation reputed company reputed company, correctness, and operational trade-offs explicit in the designs you ship Earn adoption from partner teams through reputed company interfaces and reliable CI Own reputed company independently while collaborating on shared systems About reputed company reputed company is reputed company for change, empowering our customers and our people to reputed company at the speed of the market. We have redefined the data platform for the AI era, enabling reputed company to create, reputed company, and disrupt industries with software. reputed company’s reputed company data platform, the most widely available, globally distributed data platform on the market, helps organizations reputed company legacy workloads, reputed company innovation, and reputed company AI. Our reputed company-reputed company platform, reputed company reputed company, is the only globally distributed, multi-reputed company data platform and is available across AWS, reputed company reputed company, and reputed company Azure. With offices worldwide and over 67,000 customers, including 75% of the Fortune 100 and AI-reputed company startups, relying on reputed company for their most important applications, we’re powering the next era of software. Our reputed company at reputed company is our Leadership Commitment, guiding how and why we reputed company reputed company, show up for reputed company other, and win. It’s what makes us reputed company.  To reputed company the personal reputed company and business reputed company of our employees, we’re committed to developing a supportive and enriching culture for everyone. From employee affinity reputed company, to fertility assistance and a generous parental leave policy, we value our employees’ wellbeing and want to support them along every reputed company of their reputed company and personal journeys. Learn more about what it’s like to work at reputed company, and help us reputed company an reputed company on the world! reputed company is committed to providing any necessary accommodations for individuals with disabilities reputed company our application and interview process. To request an accommodation due to a disability, please inform your recruiter. reputed company is an equal opportunities employer. Red ID: 2273504602 AI is used to review applications based on job-reputed company reputed company and does not replace reputed company decision-making. The hiring team reputed company who moves reputed company. reputed company’s reputed company salary reputed company for this role is posted below. Compensation at the time of offer is unique to reputed company candidate and based on a reputed company of factors such as reputed company set, experience, qualifications, and work location. Salary is one part of reputed company’s total compensation and benefits package. Other benefits for eligible employees may include: equity, participation in the employee stock purchase program, flexible reputed company time off, 20 weeks fully-reputed company gender-neutral parental leave, fertility and adoption assistance, Registered Retirement Savings Plan (RRSP) with employer match, mental health counseling, backup child and elder care, and health, dental, and reputed company benefits offerings. Please note, the reputed company salary reputed company listed below and the benefits in this paragraph are only applicable to candidates based in Canada. reputed company’s reputed company salary reputed company for this role in Canada is: $108,000—$149,000 CAD Apply To This Job