Member of Technical Staff, Pre-training Scaling, Data and Eval at xAI
Location: San Francisco Employment Type: Full-time Salary: Not specified
About the Role
About the Role The pre-training team at xAI aims to provide an omni model that can understand the universe through text, image, video and audio. To accomplish this, we are looking for expert engineers in multimodal pre-training. Tech Stack Python JAX and XLA Rust / C++ Spark Location The role is based in the Bay Area [San Francisco and Palo Alto]. Candidates are expected to be located near the Bay Area or open to relocation. Focus Training trillion parameter neural networks at scale, as well as a variety of smaller specialized models. Rapidly implementing the latest state-of-the-art methods from the deep learning literature. Innovating new ideas for pretraining and new scaling paradigm. Improving pretraining data quality at scale across different modalities. Ideal Experience Strong engineering skills with passion to improve different aspects of data and model. Expert in ML and large model scaling, familiar with all kinds of scaling laws. Familiar with distributed training, multi-GPU neural network training and experience on optimizing ML training efficiency. Familiar with state-of-the-art techniques for preparing AI training data. Good at organizing and meticulously bookkeeping data across multiple clouds, of multiple modalities, and from many sources Benefits Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.
About xAI:
xAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge.
- 🚀 Building Grok - advanced AI assistant
- 💻 Operating world-class AI supercomputing clusters
- 🎯 Small, highly motivated team focused on engineering excellence
- 🏢 Flat organizational structure with hands-on leadership
Founded by Elon Musk
Contact
Apply on Greenhouse
Apply: https://job-boards.greenhouse.io/xai/jobs/4684643007