MMODELYST
Models/bloom-560m
MDL

bloom-560m

bigscience

Hugging Face ↗
Parameters
560M
Downloads
493.7K
on HF
Likes
373
Avg score
—
Weights
Open
Released
May 19, 2022
About

bloom-560m is a 560M-parameter open-weights model in the bloom family from bigscience.

bigscience-bloom-rail-1.0text-generation
Benchmark scores · 0
No benchmark scores yet.
The research behind this model
all papers mentioning it →
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism8-bit Optimizers via Block-wise QuantizationTrain Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation
Details
Publisherbigscience
Familybloom
Parameters560M
Licensebigscience-bloom-rail-1.0
WeightsOpen
ReleasedMay 19, 2022