Popular repositories

1. petals Public

   🌸 Run large language models at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

   Python 6.2k 270

2. promptsource Public

   Toolkit for creating, sharing and using natural language prompts.

   Python 2k 280

3. Megatron-DeepSpeed Public

   Ongoing research training transformer language models at scale, including: BERT & GPT-2

   Python 941 177

4. bigscience Public

   Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.

   Shell 814 80

5. xmtf Public

   Crosslingual Generalization through Multitask Finetuning

   Jupyter Notebook 436 33

6. t-zero Public

   Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)

   Python 411 52