MMODELYST
Decision engine

What lifts a score

The one question every model-builder asks: to improve a benchmark, what actually works — and by how much? Pick a target and see the datasets, RL environments, and methods shown to raise it, ranked by effect size, each linked to its evidence. Effect sizes are representative deltas from the cited work — they vary with base model and setup.

+5.0
methodInstruction tuning (Flan / scaling)
lifts MMLU · Knowledge & QAChung et al. 2022 — scaling instruction-finetuning lifts held-out knowledge tasks. paper ↗
+4.0
lifts MMLU · Knowledge & QAEducational-quality pretraining filter. paper ↗
+2.5
lifts MMLU · Knowledge & QAGPT-4-style instruction SFT.
+2.0
lifts MMLU · Knowledge & QABroad SFT. paper ↗
+1.5
lifts MMLU · Knowledge & QASmall knowledge transfer. paper ↗