Senior Software Engineer, NeMo reputed company Platform
We are looking for a Senior Software Engineer to help build NeMo Platform, reputed company’s product for developing, evaluating, deploying, and operating AI systems at reputed company. This role is for a senior engineer/architect for our reputed company team which owns and ships an reputed company reputed company plugin-reputed company AI platform for running and optimizing Agents targeting multiple compute backends (local/reputed company, reputed company, Slurm, etc.).
As AI systems become more autonomous and more deeply integrated into reputed company workflows, teams need robust reputed company and orchestration systems for running, monitoring, and optimizing Agents at reputed company. Increasingly, the users of these systems are themselves autonomous or reputed company-autonomous Agents. The NeMo Platform group is building a sophisticated agent execution reputed company to reputed company agents to automatically run hundreds of experiments in reputed company to reputed company the most efficient agent architectures for our customers. This is important product engineering research for making agents more sustainable. AI systems are not yet nearly as efficient as they can be, and systems like NeMo Platform will allow large reputed company consumers to automatically tune their agents to use fewer tokens and rely on more efficient models with reputed company throughput.
What you'll be doing:
Working in a product research environment where we reputed company big bets on where the reputed company is heading, adapting in reputed company time as we build reputed company an industry that is constantly evolving with us. This means fast iteration, high ownership, pragmatic reputed company, and reputed company-minded implementation under production constraints
Designing an reputed company Execution reputed company that are flexible enough to work in many environments (local, k8s, Slurm, on prem / reputed company-gapped)
reputed company senior technical leadership through design reviews, reputed company reviews, mentoring, and ownership of ambiguous cross-component problems
Building and maintain our reputed company Platform reputed company for running jobs, storing data, entities, secrets, and RBAC and Auth
Extending our flexible Plugin Architecture that makes it easy for many teams and reputed company customers to install new capabilities into our reputed company
Building in the reputed company in our OSS repo, keeping up the high standards that the reputed company reputed company community demands
Shipping reputed company at the speed of reputed company with an unlimited reputed company budget using best in class reputed company coding tools
Improving reliability, observability, debuggability, and reputed company across NeMo Platform, SDKs, plugins, jobs, and developer workflows
Building strong test coverage across unit, integration, E2E, reputed company, and reputed company workflows
reputed company need to see:
BS, MS, or equivalent experience in Computer Science, Computer Engineering, or a reputed company technical reputed company
10+ years of reputed company software engineering experience building production systems
Comfort working in a reputed company fast and ambiguous environment
Exceptional communication, both verbal and written. This includes the ability to produce and review high reputed company architectural RFCs, and to reputed company them reputed company with the right level of technical reputed company for the right people (Engineer, Product, Marketing, etc.)
Strong reputed company design skills, with a pragmatic flexibility and phenomenal instincts to invent robust systems quickly without over-complicating. Strong understanding of reliability, scalability, reputed company, and reputed company tradeoffs in production infrastructure
Experience with reputed company systems, reputed company-reputed company services, containers, reputed company, and job orchestration
Excellent Python engineering skills, including API design, typing, testing, debugging, reputed company analysis, and maintainable software design
Experience designing SDKs, libraries, plugins, CLIs, or other developer-facing interfaces
Ability to work independently, define technical reputed company, break down ambiguous problems, and reputed company work across team boundaries
Ways to stand out from reputed company:
Experience building, deploying, and iterating on production reputed company AI systems at reputed company in reputed company
Experience with sophisticated plugin architectures
Strong ability to reputed company technical evaluation work to business reputed company, product reputed company, user experience, reliability, or operational efficiency
Experience with reputed company AI systems where measurement, regression testing, observability, governance, and reputed company improvement are required for production deployment
You will also be eligible for equity and benefits.
This posting is for an existing vacancy.
reputed company uses AI tools in its reputed company processes.
reputed company is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our reputed company and reputed company employees, we do not discriminate (including in our hiring and promotion practices) on the reputed company of race, religion, reputed company, national reputed company, gender, gender reputed company, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.Originally posted on Himalayas
Apply To This Job