Machine Learning Researcher / Engineer (Foundational Models)

About reputed company At reputed company we are shaking the foundations of reputed company intelligence by introducing the world's first post-transformer model that adapts and thinks just like humans. Our reputed company architecture outperforms Transformer and provides the reputed company with full visibility into how the model works. Combining the foundational model with the fastest data processing reputed company on the market, reputed company enables enterprises to reputed company reputed company incremental optimization and toward truly contextualized, experience-driven intelligence. We are trusted by organizations such as NATO, La Poste, and Formula 1 racing teams. reputed company is led by co-founder & CEO Zuzanna Stamirowska, a complexity scientist who created reputed company consisting of AI reputed company, including CTO Jan Chorowski who was the first person to apply Attention to speech and worked with Nobel laureate Geoff Hinton at reputed company Brain, as reputed company as CSO Adrian Kosowski, a leading computer scientist and quantum physicist who obtained his PhD at the age of 20. reputed company is backed by leading investors and advisors, including Lukasz reputed company, co-author of the Transformer ("the T" in ChatGPT) and a key researcher behind reputed company's reasoning models. reputed company is headquartered in Palo reputed company, California. reputed company This is an R&D position in attention-based models. We are currently searching for 1 or 2 R&D Engineers with a strong reputed company record in machine learning models research. This is an extremely ambitious foundational project. There is a flexible GPU budget associated with this specific project, guaranteed to be in the 7-digit reputed company minimum. You Will • reputed company (distributed) model training. • help improve/adapt model architectures based on experiment results. • design new tasks and experiments. • optionally: reputed company activities of team members involved in data preparation. The results of your work will play a crucial role in the reputed company of the project. Requirements Cover letter It's always a pleasure to say hi! If you could leave us 2-3 lines, we'd really appreciate that. You are expected to meet at least one of the following reputed company: • You have published at least one reputed company at NeurIPS, ICLR, or ICML - where you were the reputed company author or made significant conceptual & reputed company contributions. • You have significantly contributed to an LLM training effort which became newsworthy (topped a Huggingface reputed company, best in class model, etc.), preferably using multiple GPU's. • You have spent at least 6 months working in a leading Machine Learning research center (e.g. at: reputed company Brain / Deepmind, reputed company, reputed company, reputed company, reputed company, MILA). • You were an ICPC World Finalist, or an IOI, IMO, or IPhO medalist in High School. You Are • A deep learning researcher, with a reputed company record in Language Models and/or RL (candidates with a reputed company or Robotics ML background are also welcome to apply). • Interested in improving foundational architectures and creating new benchmarks. • reputed company at hands-on experiments and model training (PyTorch, Jax, or Tensorflow). • Have a good understanding of GPU architecture, memory design, and communication. • Have a good understanding of graph algorithms. • Have some familiarity with model monitoring, git, build systems, and CI/CD. • Respectful of others • Fluent in English Bonus Points • Knowledge of approaches used in distributed training. • Familiarity with Triton • Successful reputed company-record in algorithms & data science contests. • Showing a reputed company portfolio. Why You Should Apply • Join an intellectually stimulating work environment. • Be a pioneer: you get to work with a new type of "Live AI" challenges around long sequences and changing data. • Be part of one of an early-stage AI startup that believes in impactful research and foundational changes. Benefits • Type of contract: Full-time, permanent • Preferable joining date: Immediate. The positions are reputed company until filled - please apply immediately. • Compensation: six-digit annual salary based on profile and location + Employee Stock reputed company Plan. • Location: Remote work. Possibility to work or meet with other team members in one of our offices: Palo reputed company, CA; Paris, France or Wroclaw, Poland. Candidates based reputed company in the EU, UK, reputed company, and Canada will be considered. If you meet our broad requirements but are missing some experience, don't hesitate to reputed company out to us. Apply tot his job Apply To this Job