K2-Horizon: six fully open language models, with data and training code released
The team released six language models from 0.9B to 375B parameters, along with checkpoints, pre-training data, logs and all training code. They also add new attention ideas and a way to speed up text generation.
Why it matters: Few releases share everything needed to rebuild a model. This lets researchers study how scale and data choices really affect results.