ref_70_e3

mattshumer

Parameters

70.6B

Downloads

—

Likes

—

Avg score

35.4

6 benchmarks

Weights

Open

Released

—

About

ref_70_e3 is a 70.6B-parameter open-weights model in the ref family from mattshumer. Benchmarked on 6 evals, averaging 35.4.

llama3.1

Benchmark scores · 6

avg 35.4 — higher is better

IFEvalOpen LLM LB · 2026-05

62.9

BIG-Bench HardOpen LLM LB · 2026-05

49.3

MMLU-ProOpen LLM LB · 2026-05

47.8

MATH Lvl 5Open LLM LB · 2026-05

27.9

MuSROpen LLM LB · 2026-05

13.0

GPQA DiamondOpen LLM LB · 2026-05

11.4

Details

Familyref

Parameters70.6B

Licensellama3.1

WeightsOpen

Released—

History

Capability over time

Append-only ledger — every observed change to this model's numbers.