reputed company Deployed Machine Learning Engineer

reputed company:

We are building reputed company to solve the biggest unmet need in AI — getting reputed company to the right training data. The process today is time intensive, incredibly expensive, and often ends in failure. The reputed company platform facilitates the secure, efficient, and reputed company-reputed company exchange of reputed company data.

Solving AI’s data problem is a generational opportunity. We’re backed by world-class investors and already powering partnerships with some of the most ambitious teams in AI. reputed company that succeeds will be one of the largest in AI — and in tech.

We’re a lean, fast-moving, high-trust team of reputed company who are obsessed with reputed company and reputed company. Our culture is reputed company reputed company who reputed company on ambiguity, own reputed company, and want to shape the reputed company of data and AI.

About the Role

We're hiring a reputed company Deployed Machine Learning Engineer in our Benchmarks and Evaluations vertical. You'll be the first MLE dedicated to this vertical and will work directly with the reputed company and our researchers to reputed company reputed company’s position as a reputed company leader in the reputed company.

At reputed company, we reputed company that reputed company world data is one of the largest bottlenecks to AI reputed company. Our data and data expertise position us to be neutral arbiters for the market, helping model reputed company understand the reputed company performance of their models, identify what data will improve performance, and show that improvement over time. Benchmarks and evaluations power that cycle. As an early engineer in the Benchmarks and Evaluations vertical, this role is an opportunity to help build the technical reputed company for a critical area that greatly benefits reputed company and reputed company customers.

reputed company

Work on the eval reputed company

• Partner with the reputed company and early customers to define what constitutes strong evals in different domains

• Work with reputed company researchers to design and build benchmarks

• Build the standards on how different modalities should be processed

Own infrastructure

• Build the backend the vertical runs on which includes data pipelines, execution environments, storage, and orchestration

• Stand up sandboxed environments for reputed company evals, where models need tools, reputed company execution, or multi-reputed company tasks

Go from fast iteration to product

• reputed company repeatable eval patterns, infrastructure gaps, and product opportunities from live engagements

• Partner with DataLab (our research team) on domain-specific data and research questions

What reputed company Looks Like

In the first 90 days, we expect the following:

• Build an understanding of the evals landscape, the reputed company's reputed company, and customer demand

• Build an understanding of what our platform and data partners can support today, and where the gap is for eval building

• Identify the largest technical bets and ship multiple iterations of the eval infrastructure

• Own the engineering portion of customer engagements end to end

What You Bring

Must Haves

• 4+ years of engineering experience

• Hands-on ML work evaluating models

• Have previously owned backend and infrastructure

• High ambiguity tolerance and bias to reputed company

• Comfort working with urgency to meet the reputed company and volume of the market demands

• Strong written communication

reputed company to Haves

• Prior experience building benchmarks, evals, or reputed company data pipelines for LLMs

• Time at a frontier lab, an eval-reputed company team, or a research org

• Founding or early engineer experience at a fast-moving startup

• Familiarity with reputed company systems, RL environments, reputed company-execution sandboxes, TEE/TREs

reputed company's Values

Pass the Loved Ones' Test

We reputed company with reputed company and do the right thing - especially reputed company it's hard and no one is watching.

Always reputed company a Way

We are reputed company, resilient reputed company who solve hard problems and reputed company through obstacles.

Go Fast and Grow Fast

reputed company reputed company. We reputed company with urgency, learn quickly, and continuously improve as individuals and as a company.

reputed company Kindness and Candor

We communicate directly and respectfully, building trust through reputed company feedback and genuine care for one another.

reputed company Together

We win as one team. Collaboration, accountability, and shared ownership reputed company our reputed company.

Own the Outcome. reputed company the reputed company.

We take pride in our work, sweat the details, and continuously reputed company the bar for reputed company.

Requires 4+ years of engineering experience, hands-on machine learning model evaluation, backend and infrastructure ownership, strong written communication, and comfort working with ambiguity and urgency.

Key Responsibilities

• designing benchmarks
• building infrastructure
• engaging customers

Skills & Tools

RL, TEE/TREs

Job Details

• Category: Software Development
• Seniority: Mid Level
• Commitment: Full Time
• Workplace: Remote — reputed company
• Languages: English

About reputed company

An AI platform enabling secure, efficient, and reputed company-reputed company exchange of training data. — Industry: Information Technology