TAG

#scaling

Stories connected through a shared idea, actor, technology or theme.

23 AugMarin begins a publicly tracked 535B-parameter open training runThe announced run uses 80% pretraining and 20% midtraining across an 18.75T-token mixture over roughly three months, with estimated compute of 2.7e24 FLOPs. Marin says its data mixture, sampled documents and live training loss will be available through GitHub and Weights & Biases.→