MMODELYST
Leaderboards/SciCode Leaderboard
LDR

SciCode Leaderboard

SciCode

1Claude Fable 5
60.2
2Gemini 3.1 Pro Preview
58.9
3Kimi K3
58.7
4Muse Spark 1.1
58.2
5GPT-5.4
56.6
6Gemini 3 Pro Preview
56.1
7GPT-5.5
56.1
8GPT-5.6 Sol (max)
56.1
9GPT-5.6 Sol
56
10Claude Opus 5
55.7
11GPT-5.2 Codex
54.6
12Claude Opus 4.7
54.5
13Grok 4.5
54.1
14GPT-5.6 Terra (max)
53.9
15Claude Sonnet 5
53.6
16Kimi K2.6
53.5
17Claude Opus 4.8
53.5
18GPT-5.3 Codex
53.2
19Gemini 3.5 Flash
53.1
20Gemini 3.6 Flash
52.7
21GPT-5.6 Luna (max)
52.5
22GPT-5.2
52.1
23Claude Opus 4.6
51.9
24GPT-5.6 Terra
51.6
25Muse Spark
51.5
26Gemini 3 Flash Preview
50.6
27GLM-5.2 (max)
50.5
28GPT-5.5 Instant (May 2026)
50.3
29Grok Build 0.1 0616
50.2
30MiMo-V2.5-Pro
50.2
31DeepSeek V4 Pro
50
32GPT-5.6 Luna
50
33GPT-5.4 mini
49.9
34Claude Opus 4.5
49.5
35Kimi K2.5
49
36Qwen3.7 Max
48.8
37GPT-5.5 Instant (May 2026)
48.6
38Hy3
47.6
39Kimi K2.7 Code
47.5
40Grok 4.3
47.3
41MiniMax-M2.7
47
42Qwen3.6 Max Preview
46.9
43GPT-5.4 nano
46.9
44Claude Sonnet 4.6
46.8
45o4-mini
46.5
46GLM-5
46.2
47Inkling
46.1
48Grok 4
45.7
49Grok 4.20 0309 v2
45.6
50Qwen3.7 Plus
45.5
51MiniMax-M3
45.4
52GLM-4.7
45.1
53DeepSeek V4 Flash
44.9
54Grok 4.20 0309
44.7
55Claude 4.5 Sonnet
44.7
56Motif 3 (Beta)
44.3
57Grok 4 Fast
44.2
58Grok 4.1 Fast
44.2
59DeepSeek V3.2 Speciale
44
60GLM-5.1
43.8
61GLM-5-Turbo
43.6
62GLM 5V Turbo
43.5
63Gemma 4 31B
43.4
64GPT-5.1
43.3
65Claude 4.5 Haiku
43.3
66Qwen3 Max Thinking
43.1
67MiMo-V2.5
43.1
68GPT-5
42.9
69Gemini 2.5 Pro
42.8
70Nova 2.0 Pro Preview
42.7
71MiniMax-M2.5
42.6
72GPT-5.1 Codex mini
42.6
73MiMo-V2-Pro
42.5
74Qwen3 235B A22B 2507
42.4
75Kimi K2 Thinking
42.4
76Ring-2.6-1T
42.4
77Agnes 2.5 Pro Alpha
42.2
78Qwen3.5 122B A10B
42
79Qwen3.5 397B A17B
42
80Gemini 3.1 Flash-Lite
41.9
81Nex-N2-Pro
41.8
82Gemini 2.5 Pro Preview (May' 25)
41.6
83Hy3-preview
41.2
84GPT-5 mini
41
85Cogito v2.1
41
86o3
41
87Claude 4.1 Opus
40.9
88GPT-5 Codex
40.9
89Gemini 3.5 Flash-Lite
40.9
90MiniMax-M2.1
40.7
91Doubao Seed Code
40.7
92Qwen3.6 Plus
40.7
93Grok 3 mini Reasoning
40.6
94DeepSeek V3.1 Terminus
40.6
95Gemini 2.5 Flash Preview (Sep '25)
40.5
96Qwen3.5 Omni Plus
40.5
97Step 3.5 Flash
40.4
98GPT-4.1 mini
40.4
99DeepSeek R1 0528 (May '25)
40.3
100Claude 3.7 Sonnet
40.3
101GPT-5.1 Codex
40.2
102Claude 4 Sonnet
40
103Step 3.7 Flash
40
104Gemma 4 26B A4B
40
105Qwen3 VL 235B A22B
39.9
106Qwen3 235B A22B
39.9
107o3-mini
39.9
108Nemotron 3 Ultra 550B A55B
39.9
109Claude 4 Opus
39.8
110Qwen3.6 27B
39.8
111Mistral Medium 3.5
39.6
112Qwen3.5 27B
39.5
113Gemini 2.5 Pro Preview (Mar' 25)
39.5
114MiMo-V2-Omni-0327
39.5
115Gemini 2.5 Flash
39.4
116MiMo-V2-Flash
39.4
117Magistral Medium 1.2
39.2
118INTELLECT-3
39.1
119DeepSeek V3.2
38.9
120gpt-oss-120b
38.9
121Qwen3 Next 80B A3B
38.8
122Qwen3 Max Thinking (Preview)
38.7
123Mercury 2
38.7
124Step 3.5 Flash 2603
38.5
125GLM-4.6
38.4
126Qwen3 Max
38.3
127KAT Coder Pro V2
38.3
128MiMo-V2-Flash (Feb 2026)
38.3
129North Mini Code
38.2
130JT-4.1 Flash 236B A21B
38.2
131Gemma 4 12B
38.2
132GPT-4.1
38.1
133Mistral Small 4
38
134MiniMax M1 40k
37.8
135GPT-5 (ChatGPT)
37.8
136Command A+
37.8
137DeepSeek V3.2 Exp
37.7
138Qwen3.5 35B A3B
37.7
139DeepSeek R1 Distill Qwen 32B
37.6
140ERNIE 5.0 Thinking Preview
37.5
141MiniMax M1 80k
37.4
142Apriel-v1.6-15B-Thinker
37.3
143Qwen3 Max (Preview)
37
144Ling-2.6-1T
37
145Grok 3
36.8
146Nova 2.0 Lite
36.8
147Ring-1T
36.7
148DeepSeek V3.1
36.7
149MiMo-V2-Omni
36.7
150Claude 3.5 Sonnet
36.6
151GPT-4o (March 2025, chatgpt-4o-latest)
36.6
152GPT-5 nano
36.6
153KAT-Coder-Pro V1
36.6
154Seed-OSS-36B-Instruct
36.5
155Grok Code Fast 1
36.2
156Nova 2.0 Omni
36.2
157Mistral Large 3
36.2
158MiniMax-M2
36.1
159GLM-5.2
36.1
160Trinity Large Thinking
36.1
161Qwen3 235B A22B 2507 Instruct
36
162NVIDIA Nemotron 3 Super 120B A12B
36
163Qwen3 Coder 480B A35B Instruct
35.9
164Qwen3 VL 235B A22B Instruct
35.9
165Gemini 2.5 Flash Preview
35.9
166QwQ 32B
35.8
167DeepSeek V3 0324
35.8
168o1
35.8
169Qwen3.6 35B A3B
35.8
170DeepSeek R1 (Jan '25)
35.7
171K-EXAONE
35.6
172Qwen3 32B
35.4
173DeepSeek V3 (Dec '24)
35.4
174LongCat 2.0
35.4
175Ling-1T
35.2
176Magistral Small 1.2
35.2
177Apriel-v1.5-15B-Thinker
34.8
178GLM-4.5
34.8
179Nemotron Cascade 2 30B A3B
34.8
180Llama Nemotron Super 49B v1.5
34.8
181Llama 3.1 Nemotron Ultra 253B v1
34.7
182Kimi K2
34.5
183EXAONE 4.0 32B
34.4
184gpt-oss-20b
34.4
185DiffusionGemma 26B A4B
34.3
186Hermes 4 - Llama-3.1 70B
34.1
187Gemini 2.0 Flash
34
188Mistral Medium 3.1
33.8
189Qwen2.5 Max
33.7
190GLM-4.7-Flash
33.7
191GPT-4o (ChatGPT)
33.4
192Qwen3 30B A3B 2507
33.3
193Gemini 2.0 Flash (Feb '25)
33.3
194GPT-4o (Nov '24)
33.3
195Mi:dm K 2.5 Pro
33.2
196Mistral Medium 3
33.1
197GPT-4o
33.1
198Devstral 2
33.1
199Llama 4 Maverick
33.1
200K2 Think V2
33
201HyperNova 60B 2605
33
202Gemini 2.0 Flash Thinking Experimental (Jan '25)
32.9
203o1-mini
32.3
204Qwen3 Coder Next
32.3
205GPT-4 Turbo
31.9
206Qwen3 14B
31.6
207Claude 3.5 Sonnet (June '24)
31.6
208ERNIE 4.5 300B A47B
31.5
209DeepSeek R1 Distill Llama 70B
31.3
210Gemini 2.0 Pro Experimental (Feb '25)
31.3
211Step3 VL 10B
31.1
212GPT-4o (May '24)
30.9
213Qwen3 VL 30B A3B Instruct
30.8
214Kimi K2 0905
30.7
215Qwen3 Next 80B A3B Instruct
30.7
216GLM-4.5-Air
30.6
217Qwen3 Omni 30B A3B
30.6
218Qwen3 30B A3B 2507 Instruct
30.4
219GLM-4.6V
30.4
220Llama 3.1 Tulu3 405B
30.2
221Solar Pro 2
30.2
222Qwen3 VL 32B Instruct
30.1
223Llama 3.1 Instruct 405B
29.9
224Magistral Medium 1
29.7
225Mi:dm K 2.5 Pro Preview
29.7
226NVIDIA Nemotron 3 Nano 30B A3B
29.6
227Grok Beta
29.5
228Gemini 1.5 Pro
29.5
229Devstral Medium
29.4
230Olmo 3.1 32B Think
29.3
231Pixtral Large
29.2
232Mistral Large 2 (Nov '24)
29.2
233JT-35B-Flash
29.1
234Ling-flash-2.0
28.9
235Qwen3 VL 30B A3B
28.8
236Devstral Small 2
28.8
237Gemini 2.5 Flash-Lite Preview (Sep '25)
28.7
238Olmo 3 32B Think
28.6
239K2-V2
28.6
240Qwen3 VL 32B
28.5
241Qwen3 30B A3B
28.5
242Grok-2
28.5
243LongCat Flash Lite
28.4
244HyperCLOVA X SEED Think (32B)
28.4
245Llama-3_3-Nemotron-Super-49B-v1
28.2
246Motif-2-12.7B-Reasoning
28.2
247EXAONE 4.5 33B
28
248Nova Premier
27.9
249Qwen3 Coder 30B A3B Instruct
27.8
250Nemotron 3 Nano Omni 30B A3B Reasoning
27.8
251Qwen3.5 9B
27.5
252Claude 3.5 Haiku
27.4
253Gemini 1.5 Pro (May '24)
27.4
254JT-MINI
27.2
255Qwen2.5 Coder Instruct 32B
27.1
256Mistral Large 2 (Jul '24)
27.1
257Ling 2.6 Flash
27.1
258Solar Open 100B
26.9
259Qwen2.5 Instruct 72B
26.7
260Gemini 1.5 Flash (Sep '24)
26.7
261Llama 3.1 Instruct 70B
26.7
262Reka Flash 3
26.7
263Nanbeige4.1-3B
26.6
264Mistral Small 3.1
26.5
265Mistral Small 3.2
26.4
266Sarvam 105B
26.4
267NVIDIA Nemotron Nano 12B v2 VL
26.2
268phi-4
26
269Llama 3.3 Instruct 70B
26
270GPT-4.1 nano
25.9
271Granite 4.1 30B
25.8
272Qwen3 4B 2507
25.6
273Qwen3.5 Omni Flash
25.5
274Hermes 4 - Llama-3.1 405B
25.2
275Gemini 2.0 Flash-Lite (Feb '25)
25
276Falcon-H1R-7B
24.9
277Gemini 2.0 Flash-Lite (Preview)
24.7
278Solar Pro 3
24.7
279Devstral Small (May '25)
24.5
280Gemma 4 E4B
24.4
281Devstral Small (Jul '25)
24.3
282Mistral Saba
24.1
283Magistral Small 1
24.1
284Llama 3.2 Instruct 90B (Vision)
24
285DeepSeek R1 Distill Qwen 14B
23.9
286Mistral Small 3
23.6
287Ministral 3 14B
23.6
288Claude 3 Opus
23.3
289Llama 3.1 Nemotron Instruct 70B
23.3
290Hermes 3 - Llama-3.1 70B
23.1
291Qwen2.5 Instruct 32B
22.9
292Qwen2 Instruct 72B
22.9
293Sonar
22.9
294Claude 3 Sonnet
22.9
295Gemini 1.5 Flash-8B
22.9
296GPT-4o mini
22.9
297DeepHermes 3 - Mistral 24B Preview
22.8
298Qwen3 8B
22.6
299Sonar Pro
22.6
300GLM-4.5V
22.1
301NVIDIA-Nemotron-Nano-9B-v2
22
302Qwen3 VL 8B
21.9
303Granite 4.1 8B
21.8
304Gemma 3 27B Instruct
21.2
305Olmo 3 7B Think
21.2
306Granite 4.0 H Small
20.9
307Gemma 4 E2B
20.9
308Nova Pro
20.8
309Mistral Large (Feb '24)
20.8
310Ministral 3 8B
20.8
311DeepSeek R1 0528 Qwen3 8B
20.4
312Kimi Linear 48B A3B Instruct
19.9
313Claude 2.0
19.4
314Gemini 2.5 Flash-Lite
19.3
315Sarvam 30B
19.2
316Llama 3 Instruct 70B
18.9
317Mixtral 8x22B Instruct
18.8
318Jamba 1.7 Large
18.8
319Claude 3 Haiku
18.6
320Qwen3 Omni 30B A3B Instruct
18.6
321Jamba 1.6 Large
18.4
322Claude 2.1
18.4
323Qwen3 4B 2507 Instruct
18.1
324Gemini 1.5 Flash (May '24)
18.1
325Sarvam M
17.8
326Tri-21B-think Preview
17.8
327G9v3-3B
17.7
328Qwen3 VL 8B Instruct
17.4
329Gemma 3 12B Instruct
17.4
330Tri-21B-Think
17.4
331Qwen3 VL 4B
17.1
332Llama 4 Scout
17
333Ring-flash-2.0
16.8
334Olmo 3.1 32B Instruct
16.7
335Solar Pro 2 (Preview)
16.4
336NVIDIA Nemotron 3 Nano 4B
16.4
337Jamba 1.5 Large
16.3
338Qwen3.5 4B
16.1
339Mistral Small (Sep '24)
15.6
340Qwen2.5 Turbo
15.3
341Qwen2.5 Coder Instruct 7B
14.8
342Ministral 3 3B
14.4
343Nova Lite
13.9
344DeepSeek Coder V2 Lite Instruct
13.9
345Qwen3 VL 4B Instruct
13.7
346Ling-mini-2.0
13.5
347Mistral Small (Feb '24)
13.4
348Molmo2-8B
13.3
349Llama 3.1 Instruct 8B
13.2
350DeepSeek R1 Distill Llama 8B
11.9
351Llama 3 Instruct 8B
11.9
352Granite 4.1 3B
11.9
353Granite 4.0 Micro
11.9
354Command-R+ (Apr '24)
11.8
355DBRX Instruct
11.8
356Mistral Medium
11.8
357Llama 2 Chat 13B
11.8
358Gemini 1.0 Pro
11.7
359Llama 3.2 Instruct 11B (Vision)
11.2
360Phi-4 Multimodal Instruct
11
361LFM2 24B A2B
10.9
362Phi-4-mini-instruct
10.8
363Olmo 3 7B Instruct
10.3
364Jamba 1.6 Mini
10.1
365Granite 3.3 8B
10.1
366Llama 3.1 Nemotron Nano 4B v1.1
10.1
367Nova Micro
9.4
368Jamba 1.7 Mini
9.3
369Exaone 4.0 1.2B
9.3
370DeepHermes 3 - Llama-3.1 8B Preview
9.1
371Phi-3 Mini Instruct 3.8B
9
372Granite 4.0 1B
8.7
373Gemma 3n E4B Instruct Preview (May '25)
8.6
374Granite 4.0 H 1B
8.2
375Gemma 3n E4B Instruct
8.1
376Jamba 1.5 Mini
8
377OLMo 2 32B
8
378LFM2.5-8B-A1B
7.8
379Gemma 3 4B Instruct
7.3
380LFM 40B
7.1
381LFM2 8B A1B
6.8
382DeepSeek R1 Distill Qwen 1.5B
6.6
383Command-R (Mar '24)
6.3
384Jamba Reasoning 3B
5.9
385Apertus 70B Instruct
5.7
386Gemma 3n E2B Instruct
5.2
387Llama 3.2 Instruct 3B
5.2
388MiniCPM5-1B
4.4
389Qwen3 1.7B
4.3
390LFM2.5-1.2B-Thinking
4.2
391Apertus 8B Instruct
4.1
392QwQ 32B-Preview
3.8
393OLMo 2 7B
3.7
394Tiny Aya Global
3.6
395Molmo 7B-D
3.6
396Qwen3 4B
3.5
397LFM2.5-VL-1.6B
3
398Qwen3 0.6B
2.8
399Mixtral 8x7B Instruct
2.8
400Qwen3.5 2B
2.8
401LFM2 1.2B
2.5
402LFM2 2.6B
2.5
403Mistral 7B Instruct
2.4
404LFM2.5-1.2B-Instruct
2.3
405MiniCPM-V 4.6 1.3B
2.1
406Llama 3.2 Instruct 1B
1.7
407Granite 4.0 H 350M
1.7
408Granite 4.0 350M
0.9
409Gemma 3 1B Instruct
0.7
410Llama 2 Chat 7B
0
411Qwen3.5 0.8B
0
412gemma-3-270m
0