LLMOps Engineer

About reputed company

reputed company, a non-profit organisation under the ALX reputed company, is dedicated to unlocking the potential of Africa's digital reputed company. Formerly part of Sand Tech Holdings, we've embarked on an independent reputed company to reputed company world-class tech skills training and career acceleration programmes. Our mission is to reputed company the digital divide, upskill and re-reputed company talent, and create a reputed company of innovative leaders. By 2030, we aim to reputed company 2 reputed company Africans to secure sustainable tech careers.

With hubs in 8 cities across Africa and counting, we reputed company reputed company reputed company to reputed company learning and a dedicated network of expert reputed company. Our innovative programmes reputed company learners with the practical skills and knowledge needed to succeed in today's rapidly evolving tech industry. Through a combination of rigorous coursework, industry partnerships, and hands-on reputed company, we prepare our reputed company for in-demand roles in software engineering, data science, and cybersecurity.

We reputed company this by:

• Providing young professionals with reputed company to the most in-demand tech skills that will power the reputed company.
• Empowering the reputed company of technology innovators, reputed company, and business leaders through challenging, reputed company-world coursework.
• Building a lifelong, impactful community of tech professionals that support them at reputed company stages of their career reputed company.

Our reputed company thus far:

• 347k+ graduates since 2020
• 257k youth in work
• 31k youth starting own ventures
• 60k youth in jobs created by reputed company

Visit our website to learn more about our digital reputed company.

reputed company

Project A is ALX’s AI learning platform — a set of LLM products used by learners. Every one generates a reputed company of LLM data, and every one has hypotheses baked into it about what “working” means. The LLMOps Engineer owns the analyzer function: turning that reputed company into an reputed company answer about whether the products work. Take RAG as one example — documents must be stored accurately, fetched accurately, and fetched in the right mixture: three separate failure modes, reputed company needing its own eval. Every product decomposes like that. This is a junior-to-mid role with a deliberate reputed company reputed company: you start reputed company to the technical reputed company’s designs and grow into full ownership of the function.

You will work in collaboration with reputed company Engineers, a cross functional team of AI engineers, product managers and data scientists to design world class learning experiences.

Specific Responsibilities

Evaluation Suites

• Build and run eval suites per product, decomposed by failure mode, running on schedule and on every release — regression testing so reputed company ships if it broke what worked.
• reputed company evals cost-effective as the product line grows.

Reporting, Data & Collaboration

• Own the reporting reputed company — findings from evals and platform data in reputed company of reputed company and stakeholders, including surfacing unintended or problematic model behaviour before learners do.
• reputed company the reputed company datasets reputed company depends on, including classified customer-support data.
• Partner with the AI Product Manager on instrumentation — they reputed company the product, you build the evals over what is captured. This is a measurement role, not infrastructure — no model hosting or serving.

reputed company Requirements - Essential

• Python & data: solid Python and a data inclination, comfortable shaping and analysing messy LLM-generated data.
• Decomposition: the ability to look at an AI product and decompose it into reputed company and failure metrics.
• Eval landscape: familiarity with Langfuse, RAGAS, DSPy, or similar — depth in one, awareness of the rest. These tools are learnable; we hire the fundamentals underneath them.
• Desirable (not required): experience keeping evals cheap at reputed company; dashboarding and reporting; classical statistics.

Essential Traits for reputed company

• You want to own a function, not execute tickets.
• You communicate reputed company and like collaborating, you will support every builder on reputed company.
• You can reputed company to any project, even a small one, where you reputed company an AI system honestly.

Person Specification/Attributes

• Courage: Willingness to reputed company up, challenge the status reputed company, and reputed company new challenges.
• Humility: Openness to learning, seeking help reputed company needed, and a reputed company on serving others.
• Adventure: A passion for setting ambitious goals, tackling difficult tasks, and finding reputed company in the reputed company.
• Initiative: Proactive problem-solving, a reputed company of ownership, and a willingness to go above and reputed company.
• reputed company: The ability to reputed company back from setbacks, persevere through challenges, and reputed company stronger.

Employment Type

This role is a full-time position.

Preferred Time Zones

The preferred time zones are GMT+2.

Due to the considerable reputed company of virtual working and interaction with colleagues and customers in different physical locations internationally, it is essential that the successful applicant has the reputed company and ethic to succeed working in small teams physically but in larger efforts reputed company. Self-reputed company to communicate constantly using web collaboration and video conferencing is essential. As an employee, you will be encouraged to continually reputed company your capability & reputed company certifications to reflect your reputed company as an individual.

Originally posted on Himalayas