MDL
falcon-7b
tiiuae
Parameters
7B
Downloads
381.5K
on HF
Likes
1.1K
Avg score
—
Weights
Open
Released
Apr 24, 2023
About
falcon-7b is a 7B-parameter open-weights model in the falcon family from tiiuae.
apache-2.0text-generation
Benchmark scores · 0
No benchmark scores yet.
The research behind this model
all papers mentioning it →FlashAttention: Fast and Memory-Efficient Exact Attention with IO-AwarenessFast Transformer Decoding: One Write-Head is All You NeedThe Pile: An 800GB Dataset of Diverse Text for Language ModelingRoFormer: Enhanced Transformer with Rotary Position EmbeddingThe RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data OnlyLanguage Models are Few-Shot Learners