TAG
#gb200
Stories connected through a shared idea, actor, technology or theme.
Microsoft completes pre-training of 2.8-trillion-parameter MAI-Base-2MAI-Base-2 contains 2.8 trillion total parameters and activates 80 billion per token. Microsoft says it outperformed the open-weight models tested on held-out evaluations and achieved substantially better pre-training compute efficiency, but the model remains in post-training and is not yet generally available.→Marin begins a publicly tracked 535B-parameter open training runThe announced run uses 80% pretraining and 20% midtraining across an 18.75T-token mixture over roughly three months, with estimated compute of 2.7e24 FLOPs. Marin says its data mixture, sampled documents and live training loss will be available through GitHub and Weights & Biases.→