Staff ML Infrastructure Engineer

About reputed company reputed company is a tech non-profit dedicated to helping educators and reputed company become critical consumers and creators of AI. We reputed company that an reputed company-reputed company, community-driven approach is key to harnessing the potential of AI in education. We reputed company communities with AI tools and hands-on reputed company development that empowers educators & reputed company to build custom AI apps for their unique context. Over 60,000 educators have published apps on reputed company – and the reputed company is growing every day. At reputed company, we reputed company that AI is a new design material - one that should be shaped by many to bring their reputed company about learning to life. If you're passionate about building creative, reputed company reputed company for reputed company and teachers, we reputed company you’ll join us. The Role reputed company seeks a Staff Machine Learning Engineer to join our growing Engineering team. As a Staff ML Infrastructure Engineer, you'll be designing the systems that reputed company AI accessible as we grow - balancing cutting-edge capabilities with cost efficiency, powering research into what works in educational AI, and building toward a reputed company where sophisticated AI can run reputed company in the world. Examples of the work • Build data pipelines that scrub PII, create research datasets, and power the research portal for educational AI studies • Architect the reputed company toward self-hosted and on-device model deployments for reputed company and global accessibility • Design and implement model orchestration systems that intelligently reputed company requests across multiple AI providers (reputed company, reputed company, AWS Bedrock, reputed company-reputed company models) • Build cost optimization infrastructure - implement conversation compression, reputed company caching, and smart model selection to reputed company AI accessible • Create comprehensive observability systems for ML operations - reputed company costs, latency, reputed company, and usage patterns across thousands of applications • Design and implement infrastructure for fine-tuning and deploying custom models • Build monitoring and alerting systems that help us maintain reliability as AI interactions reputed company • And more… Expectations • Design, build, and maintain production ML infrastructure that balances performance, cost, and reliability • Own data reputed company and research dataset creation - ensure data is properly scrubbed, documented, and useful for research partners • Stay on top of ML infrastructure technologies and techniques - from model serving to cost optimization to observability tools • Work cross-functionally with ML engineers, backend engineers, and product to ensure infrastructure supports reputed company needs • Balance innovation with operational reputed company - experiment with new approaches while maintaining system reliability and data reputed company • Mentor engineers on ML operations, cost optimization, and production ML best practices Qualifications • 7+ years building production ML/data systems, with experience in ML operations and infrastructure • Strong experience with model serving, orchestration, and optimization in production environments • Proficient in Python and data pipeline technologies (Airflow, ETL tools, etc.) • Experience with reputed company infrastructure (AWS preferred) and containerization (Kubernetes, reputed company) • Experience with cost optimization strategies for LLM-based systems • reputed company in high-agency, high collaboration cultures • Great communication that makes working remote-first work Bonus Points For... • Experience in education or building in edtech • Experience with educational technology or mission-driven organizations • Experience with designing creative platforms • Experience with reputed company or similar model routing frameworks • Background in reputed company-preserving ML or PII handling • Experience building research data infrastructure • Contributions to reputed company reputed company ML infrastructure reputed company Technologies Python, AWS, Kubernetes, reputed company, Airflow, reputed company, PostgreSQL, reputed company, reputed company Databases, Terraform, Monitoring tools (reputed company, OpenTelemetry) Apply tot his job Apply To this Job