MMODELYST
Decision engine

What lifts a score

The one question every model-builder asks: to improve a benchmark, what actually works — and by how much? Pick a target and see the datasets, RL environments, and methods shown to raise it, ranked by effect size, each linked to its evidence. Effect sizes are representative deltas from the cited work — they vary with base model and setup.

+30.0
methodLong reasoning + RL (R1-style test-time compute)
lifts AIME · MathDeepSeek-R1 2025 — long chains-of-thought trained with RL dramatically raise competition-math accuracy. paper ↗
+17.0
methodChain-of-thought prompting
lifts GSM8K · MathWei et al. 2022 — eliciting step-by-step reasoning sharply raises math word-problem accuracy in large models. paper ↗
+15.0
lifts SWE-bench Verified · AgentsDirect SWE-agent training environment. paper ↗
+14.0
lifts MATH · MathCompetition math with CoT solutions.
+12.5
lifts GSM8K · MathSynthetic grade-school math SFT. paper ↗
+12.0
methodLong reasoning + RL (R1-style test-time compute)
lifts GPQA Diamond · ReasoningDeepSeek-R1 2025 — reasoning RL transfers to graduate-level QA. paper ↗
+10.0
methodRLHF (InstructGPT)
lifts IFEval · Language & InstructionOuyang et al. 2022 — RL from human feedback greatly improves instruction following. paper ↗
+10.0
methodVerifier-based best-of-N
lifts GSM8K · MathCobbe et al. 2021 — train a verifier to rerank sampled solutions. paper ↗
+9.0
lifts IFEval · Language & InstructionBroad open instruction mixture. paper ↗
+9.0
lifts MATH · MathBootstrapped/rewritten math reasoning. paper ↗
+8.0
methodProcess reward models (Let's Verify Step by Step)
lifts MATH · MathLightman et al. 2023 — step-level verifiers beat outcome-only reward on MATH. paper ↗
+8.0
methodChain-of-thought prompting
lifts MATH · MathWei et al. 2022 — step-by-step reasoning transfers to harder math. paper ↗
+8.0
lifts GSM8K · MathBroad math SFT.
+8.0
lifts HumanEval · CodeCode instruction tuning.
+8.0
methodSTaR (rationale bootstrapping)
lifts GSM8K · MathZelikman et al. 2022 — bootstrap reasoning from self-generated rationales. paper ↗
+7.0
lifts MBPP · CodeCode instruction tuning.
+7.0
lifts GSM8K · MathIncludes math SFT. paper ↗
+7.0
methodInstruction tuning (Flan / scaling)
lifts BIG-Bench Hard · ReasoningChung et al. 2022 — strong gains on BIG-Bench Hard. paper ↗
+7.0
lifts LiveCodeBench · CodeAgentic coding transfer. paper ↗
+7.0
methodSelf-consistency (sample + vote)
lifts GSM8K · MathWang et al. 2022 — sample multiple CoT paths and majority-vote the answer. paper ↗
+6.5
lifts AIME · MathOlympiad-style transfer.
+6.0
methodReAct (reason + act with tools)
lifts WebArena · AgentsYao et al. 2022 — interleave reasoning and tool actions for agents. paper ↗
+6.0
lifts GSM8K · MathQuestion-bootstrapped SFT. paper ↗
+6.0
lifts MBPP · CodeCode pretraining. paper ↗
+6.0
lifts LiveCodeBench · CodeCode pretraining. paper ↗
+6.0
lifts IFEval · Language & InstructionPreference data improves instruction following. paper ↗
+6.0
methodDirect Preference Optimization (DPO)
lifts IFEval · Language & InstructionRafailov et al. 2023 — preference optimization without a separate reward model. paper ↗
+5.0
methodInstruction tuning (Flan / scaling)
lifts MMLU · Knowledge & QAChung et al. 2022 — scaling instruction-finetuning lifts held-out knowledge tasks. paper ↗
+5.0
lifts MBPP · CodeCoding transfer. paper ↗
+5.0
lifts HumanEval · CodeLarge permissively-licensed code pretraining corpus. paper ↗
+5.0
lifts MATH · MathTransfers partially to competition math. paper ↗
+4.0
lifts MMLU · Knowledge & QAEducational-quality pretraining filter. paper ↗
+4.0
lifts SWE-bench Verified · AgentsWeb-agent skills transfer to tool use. paper ↗
+3.5
lifts HumanEval · CodeIncludes coding instructions.
+3.0
lifts IFEval · Language & InstructionReal-world conversational data. paper ↗
+3.0
lifts BIG-Bench Hard · ReasoningHigher-quality pretraining. paper ↗
+3.0
lifts BIG-Bench Hard · ReasoningEmbodied planning transfer. paper ↗
+2.5
lifts MMLU · Knowledge & QAGPT-4-style instruction SFT.
+2.5
lifts BIG-Bench Hard · ReasoningAlignment helps reasoning formatting. paper ↗
+2.0
lifts BIG-Bench Hard · ReasoningGrounded instruction following. paper ↗
+2.0
lifts MMLU · Knowledge & QABroad SFT. paper ↗
+1.5
lifts MMLU · Knowledge & QASmall knowledge transfer. paper ↗
+1.5
lifts IFEval · Language & InstructionTool-following overlap. paper ↗