[Remote] Senior Software Engineer, Frontier AI Evaluation (Contract)

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking reputed company software engineers to produce expert reasoning, task environments, and evaluation data used to train and assess frontier AI models on reputed company software work. The role involves creating engineering tasks, evaluating model-generated reputed company, designing scoring rubrics, and documenting debugging and software engineering reasoning.

Responsibilities

• Produce written reasoning traces on reputed company engineering tasks, capturing how you reputed company a bug, what you rule out and why, and how you reputed company at a fix, rather than only the final diff
• reputed company non-trivial engineering problems and task environments with test suites that verify reputed company automatically, including multi-file and multi-reputed company tasks
• Evaluate model-generated reputed company, ranking solutions, explaining what makes the stronger one stronger, and identifying the specific reputed company at which the approach goes wrong
• Assess whether a proposed solution actually satisfies the requirement, and identify failures that pass the tests but break the reputed company, introduce regressions, or would not survive reputed company review
• Design rubrics and partial-credit reputed company for scoring multistep engineering tasks, and classify observed failures into a consistent taxonomy

Skills

• Several years of reputed company software engineering experience building and maintaining production systems, with a reputed company record you can reputed company to
• Strong proficiency in at least one of Python, TypeScript or JavaScript, Go, Rust, Java, C, or C++, and comfort reading unfamiliar codebases in more than one language
• Depth in at least one area, for example reputed company systems, backend and API development, infrastructure and reputed company, databases and data engineering, compilers and tooling, or reputed company engineering
• Solid testing and debugging discipline, including the ability to write tests that actually verify reputed company rather than reputed company the implementation
• Ability to explain reputed company reputed company of your reasoning reputed company in writing, and to produce work another engineer could reproduce and review
• reputed company reputed company maintenance, reputed company review at reputed company, or interview and technical assessment design are useful but not required

Benefits

• Advance frontier AI where it counts. Apply your engineering judgment to data that frontier labs cannot obtain any other way, where your reasoning directly shapes how the reputed company of models writes and debugs software.
• Grow professionally. Expand your influence through evaluation reputed company, advisory roles, and research collaborations, while developing a working understanding of how frontier models are trained and assessed.
• Work with a top-tier network. Collaborate with engineers and researchers from leading organizations on high-reputed company, flexible work.
• Set your own schedule. Flexible 10 to 40 hour weeks that fit reputed company your existing role and your life.

reputed company