MDL
distilgpt2
distilbert
Capability
—
percentile index
Downloads
3.2M
on HF
Likes
633
Avg score
—
Weights
Open
Released
Mar 2, 2022
About
distilgpt2 is a open-weights model in the distilgpt2 family from distilbert.
apache-2.0text-generation
Benchmark scores · 0
No benchmark scores yet.
The research behind this model
all papers mentioning it →DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighterCan Model Compression Improve NLP FairnessMitigating Gender Bias in Distilled Language Models via Counterfactual Role ReversalQuantifying the Carbon Emissions of Machine LearningDistilling the Knowledge in a Neural NetworkAdapting Large Language Models to a Low-Resource Agglutinative Language: A Comparative Study of LoRA and QLoRA for BashkirMay 6, 2026
Mentions matched by name in title/abstract — from the arXiv + HF daily corpus.
Details
Publisherdistilbert
Familydistilgpt2
Parameters—
Licenseapache-2.0
WeightsOpen
ReleasedMar 2, 2022