TAG

#training efficiency

Stories connected through a shared idea, actor, technology or theme.

17 OctMicrosoft completes pre-training of 2.8-trillion-parameter MAI-Base-2MAI-Base-2 contains 2.8 trillion total parameters and activates 80 billion per token. Microsoft says it outperformed the open-weight models tested on held-out evaluations and achieved substantially better pre-training compute efficiency, but the model remains in post-training and is not yet generally available.→