The BigScience RAIL License

May 20, 2022 – Developing a Responsible AI License ("RAIL") for the use the BigScience LLM

Le projet BigScience lance l’entraînement de son modèle multilingue

March 15, 2022 – Lancement de l’entrainement du modèle multilingue de BigScience

BigScience Model Training Launched

March 15, 2022 – Kicking off the BigScience Large Language Model training

Which hardware do you need to train a 176B parameters model?

March 15, 2022 – Training a massive-scale language model

Building a TB Scale Multilingual Dataset for Language Modeling

March 15, 2022 – Developing a 350 billion token (1.5 TB of text data) multilingual dataset

What Language Model to Train if You Have One Million GPU Hours?

March 14, 2022 – Deciding on the final model size, shape, and pretraining duration

The Tale of T0

December 20, 2021 – Using T0 for cooking recommendation and answering world knowledge.