MDL
gemma-2-27b-it
Parameters
27B
Downloads
133.5K
on HF
Likes
567
Avg score
52.4
10 benchmarks
Weights
Open
Released
Jun 24, 2024
About
gemma-2-27b-it is a 27B-parameter open-weights model from google. Benchmarked on 10 evals, averaging 52.4.
gemmatext-generation
Benchmark scores · 10
avg 52.4 — higher is betterThe research behind this model
all papers mentioning it →Measuring Massive Multitask Language UnderstandingHellaSwag: Can a Machine Really Finish Your Sentence?PIQA: Reasoning about Physical Commonsense in Natural LanguageSocialIQA: Commonsense Reasoning about Social InteractionsBoolQ: Exploring the Surprising Difficulty of Natural Yes/No QuestionsWinoGrande: An Adversarial Winograd Schema Challenge at ScaleCommonsenseQA: A Question Answering Challenge Targeting Commonsense KnowledgeCan a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question AnsweringOn the Measure of IntelligenceTriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading ComprehensionEvaluating Large Language Models Trained on CodeProgram Synthesis with Large Language ModelsTraining Verifiers to Solve Math Word ProblemsRealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language ModelsBOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language GenerationBBQ: A Hand-Built Bias Benchmark for Question AnsweringGender Bias in Coreference ResolutionTruthfulQA: Measuring How Models Mimic Human FalsehoodsGender Bias in Coreference Resolution: Evaluation and Debiasing MethodsMeasuring Mathematical Problem Solving With the MATH DatasetAGIEval: A Human-Centric Benchmark for Evaluating Foundation ModelsBeyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelsToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detection
History
full ledger →Capability over time
Append-only ledger — every observed change to this model's numbers.