MMODELYST
Leaderboards/SciCode Leaderboard
LDR

SciCode Leaderboard

SciCode

1Claude Fable 5
60.2
2Gemini 3.1 Pro Preview
58.9
3Muse Spark 1.1
58.2
4GPT-5.4
56.6
5Gemini 3 Pro Preview
56.1
6GPT-5.6 Sol (max)
56.1
7GPT-5.5
56.1
8GPT-5.6 Sol
56
9GPT-5.2 Codex
54.6
10Claude Opus 4.7
54.5
11Grok 4.5
54.1
12GPT-5.6 Terra (max)
53.9
13Claude Sonnet 5
53.6
14Kimi K2.6
53.5
15Claude Opus 4.8
53.5
16GPT-5.3 Codex
53.2
17Gemini 3.5 Flash
53.1
18GPT-5.6 Luna (max)
52.5
19GPT-5.2
52.1
20Claude Opus 4.6
51.9
21GPT-5.6 Terra
51.6
22Muse Spark
51.5
23Gemini 3 Flash Preview
50.6
24GLM-5.2 (max)
50.5
25GPT-5.5 Instant (May 2026)
50.3
26MiMo-V2.5-Pro
50.2
27Grok Build 0.1 0616
50.2
28DeepSeek V4 Pro
50
29GPT-5.6 Luna
50
30GPT-5.4 mini
49.9
31Claude Opus 4.5
49.5
32Kimi K2.5
49
33Qwen3.7 Max
48.8
34GPT-5.5 Instant (May 2026)
48.6
35Kimi K2.7 Code
47.5
36Grok 4.3
47.3
37MiniMax-M2.7
47
38Qwen3.6 Max Preview
46.9
39GPT-5.4 nano
46.9
40Claude Sonnet 4.6
46.8
41o4-mini
46.5
42GLM-5
46.2
43Grok 4
45.7
44Grok 4.20 0309 v2
45.6
45Qwen3.7 Plus
45.5
46MiniMax-M3
45.4
47GLM-4.7
45.1
48DeepSeek V4 Flash
44.9
49Grok 4.20 0309
44.7
50Claude 4.5 Sonnet
44.7
51Grok 4.1 Fast
44.2
52Grok 4 Fast
44.2
53DeepSeek V3.2 Speciale
44
54GLM-5.1
43.8
55GLM-5-Turbo
43.6
56GLM 5V Turbo
43.5
57Gemma 4 31B
43.4
58GPT-5.1
43.3
59Claude 4.5 Haiku
43.3
60Qwen3 Max Thinking
43.1
61MiMo-V2.5
43.1
62GPT-5
42.9
63Gemini 2.5 Pro
42.8
64Nova 2.0 Pro Preview
42.7
65MiniMax-M2.5
42.6
66GPT-5.1 Codex mini
42.6
67MiMo-V2-Pro
42.5
68Qwen3 235B A22B 2507
42.4
69Kimi K2 Thinking
42.4
70Ring-2.6-1T
42.4
71Qwen3.5 122B A10B
42
72Qwen3.5 397B A17B
42
73Gemini 3.1 Flash-Lite
41.9
74Nex-N2-Pro
41.8
75Gemini 2.5 Pro Preview (May' 25)
41.6
76Hy3-preview
41.2
77GPT-5 mini
41
78Cogito v2.1
41
79o3
41
80Claude 4.1 Opus
40.9
81GPT-5 Codex
40.9
82MiniMax-M2.1
40.7
83Doubao Seed Code
40.7
84Qwen3.6 Plus
40.7
85Grok 3 mini Reasoning
40.6
86DeepSeek V3.1 Terminus
40.6
87Gemini 2.5 Flash Preview (Sep '25)
40.5
88Qwen3.5 Omni Plus
40.5
89Step 3.5 Flash
40.4
90GPT-4.1 mini
40.4
91DeepSeek R1 0528 (May '25)
40.3
92Claude 3.7 Sonnet
40.3
93GPT-5.1 Codex
40.2
94Claude 4 Sonnet
40
95Step 3.7 Flash
40
96Gemma 4 26B A4B
40
97Qwen3 VL 235B A22B
39.9
98Qwen3 235B A22B
39.9
99o3-mini
39.9
100Nemotron 3 Ultra 550B A55B
39.9
101Claude 4 Opus
39.8
102Qwen3.6 27B
39.8
103Mistral Medium 3.5
39.6
104Qwen3.5 27B
39.5
105Gemini 2.5 Pro Preview (Mar' 25)
39.5
106MiMo-V2-Omni-0327
39.5
107Gemini 2.5 Flash
39.4
108MiMo-V2-Flash
39.4
109Magistral Medium 1.2
39.2
110INTELLECT-3
39.1
111DeepSeek V3.2
38.9
112gpt-oss-120b
38.9
113Qwen3 Next 80B A3B
38.8
114Qwen3 Max Thinking (Preview)
38.7
115Mercury 2
38.7
116Step 3.5 Flash 2603
38.5
117GLM-4.6
38.4
118Qwen3 Max
38.3
119KAT Coder Pro V2
38.3
120MiMo-V2-Flash (Feb 2026)
38.3
121North Mini Code
38.2
122JT-4.1 Flash 236B A21B
38.2
123Gemma 4 12B
38.2
124GPT-4.1
38.1
125Mistral Small 4
38
126MiniMax M1 40k
37.8
127GPT-5 (ChatGPT)
37.8
128Command A+
37.8
129DeepSeek V3.2 Exp
37.7
130Qwen3.5 35B A3B
37.7
131DeepSeek R1 Distill Qwen 32B
37.6
132ERNIE 5.0 Thinking Preview
37.5
133MiniMax M1 80k
37.4
134Apriel-v1.6-15B-Thinker
37.3
135Qwen3 Max (Preview)
37
136Ling-2.6-1T
37
137Grok 3
36.8
138Nova 2.0 Lite
36.8
139Ring-1T
36.7
140DeepSeek V3.1
36.7
141MiMo-V2-Omni
36.7
142Claude 3.5 Sonnet
36.6
143GPT-4o (March 2025, chatgpt-4o-latest)
36.6
144GPT-5 nano
36.6
145KAT-Coder-Pro V1
36.6
146Seed-OSS-36B-Instruct
36.5
147Grok Code Fast 1
36.2
148Nova 2.0 Omni
36.2
149Mistral Large 3
36.2
150MiniMax-M2
36.1
151GLM-5.2
36.1
152Trinity Large Thinking
36.1
153Qwen3 235B A22B 2507 Instruct
36
154NVIDIA Nemotron 3 Super 120B A12B
36
155Qwen3 VL 235B A22B Instruct
35.9
156Qwen3 Coder 480B A35B Instruct
35.9
157Gemini 2.5 Flash Preview
35.9
158QwQ 32B
35.8
159DeepSeek V3 0324
35.8
160o1
35.8
161Qwen3.6 35B A3B
35.8
162DeepSeek R1 (Jan '25)
35.7
163K-EXAONE
35.6
164Qwen3 32B
35.4
165DeepSeek V3 (Dec '24)
35.4
166Ling-1T
35.2
167Magistral Small 1.2
35.2
168Apriel-v1.5-15B-Thinker
34.8
169GLM-4.5
34.8
170Llama Nemotron Super 49B v1.5
34.8
171Nemotron Cascade 2 30B A3B
34.8
172Llama 3.1 Nemotron Ultra 253B v1
34.7
173Kimi K2
34.5
174EXAONE 4.0 32B
34.4
175gpt-oss-20b
34.4
176DiffusionGemma 26B A4B
34.3
177Hermes 4 - Llama-3.1 70B
34.1
178Gemini 2.0 Flash
34
179Mistral Medium 3.1
33.8
180Qwen2.5 Max
33.7
181GLM-4.7-Flash
33.7
182GPT-4o (ChatGPT)
33.4
183Qwen3 30B A3B 2507
33.3
184Gemini 2.0 Flash (Feb '25)
33.3
185GPT-4o (Nov '24)
33.3
186Mi:dm K 2.5 Pro
33.2
187Mistral Medium 3
33.1
188GPT-4o
33.1
189Devstral 2
33.1
190Llama 4 Maverick
33.1
191K2 Think V2
33
192HyperNova 60B 2605
33
193Gemini 2.0 Flash Thinking Experimental (Jan '25)
32.9
194o1-mini
32.3
195Qwen3 Coder Next
32.3
196GPT-4 Turbo
31.9
197Qwen3 14B
31.6
198Claude 3.5 Sonnet (June '24)
31.6
199ERNIE 4.5 300B A47B
31.5
200DeepSeek R1 Distill Llama 70B
31.3
201Gemini 2.0 Pro Experimental (Feb '25)
31.3
202Step3 VL 10B
31.1
203GPT-4o (May '24)
30.9
204Qwen3 VL 30B A3B Instruct
30.8
205Kimi K2 0905
30.7
206Qwen3 Next 80B A3B Instruct
30.7
207GLM-4.5-Air
30.6
208Qwen3 Omni 30B A3B
30.6
209Qwen3 30B A3B 2507 Instruct
30.4
210GLM-4.6V
30.4
211Llama 3.1 Tulu3 405B
30.2
212Solar Pro 2
30.2
213Qwen3 VL 32B Instruct
30.1
214Llama 3.1 Instruct 405B
29.9
215Magistral Medium 1
29.7
216Mi:dm K 2.5 Pro Preview
29.7
217NVIDIA Nemotron 3 Nano 30B A3B
29.6
218Grok Beta
29.5
219Gemini 1.5 Pro
29.5
220Devstral Medium
29.4
221Olmo 3.1 32B Think
29.3
222Pixtral Large
29.2
223Mistral Large 2 (Nov '24)
29.2
224JT-35B-Flash
29.1
225Ling-flash-2.0
28.9
226Qwen3 VL 30B A3B
28.8
227Devstral Small 2
28.8
228Gemini 2.5 Flash-Lite Preview (Sep '25)
28.7
229Olmo 3 32B Think
28.6
230K2-V2
28.6
231Qwen3 VL 32B
28.5
232Qwen3 30B A3B
28.5
233Grok-2
28.5
234LongCat Flash Lite
28.4
235HyperCLOVA X SEED Think (32B)
28.4
236Llama-3_3-Nemotron-Super-49B-v1
28.2
237Motif-2-12.7B-Reasoning
28.2
238EXAONE 4.5 33B
28
239Nova Premier
27.9
240Qwen3 Coder 30B A3B Instruct
27.8
241Nemotron 3 Nano Omni 30B A3B Reasoning
27.8
242Qwen3.5 9B
27.5
243Claude 3.5 Haiku
27.4
244Gemini 1.5 Pro (May '24)
27.4
245JT-MINI
27.2
246Qwen2.5 Coder Instruct 32B
27.1
247Mistral Large 2 (Jul '24)
27.1
248Ling 2.6 Flash
27.1
249Solar Open 100B
26.9
250Qwen2.5 Instruct 72B
26.7
251Gemini 1.5 Flash (Sep '24)
26.7
252Llama 3.1 Instruct 70B
26.7
253Reka Flash 3
26.7
254Nanbeige4.1-3B
26.6
255Mistral Small 3.1
26.5
256Mistral Small 3.2
26.4
257Sarvam 105B
26.4
258NVIDIA Nemotron Nano 12B v2 VL
26.2
259phi-4
26
260Llama 3.3 Instruct 70B
26
261GPT-4.1 nano
25.9
262Granite 4.1 30B
25.8
263Qwen3 4B 2507
25.6
264Qwen3.5 Omni Flash
25.5
265Hermes 4 - Llama-3.1 405B
25.2
266Gemini 2.0 Flash-Lite (Feb '25)
25
267Falcon-H1R-7B
24.9
268Gemini 2.0 Flash-Lite (Preview)
24.7
269Solar Pro 3
24.7
270Devstral Small (May '25)
24.5
271Gemma 4 E4B
24.4
272Devstral Small (Jul '25)
24.3
273Mistral Saba
24.1
274Magistral Small 1
24.1
275Llama 3.2 Instruct 90B (Vision)
24
276DeepSeek R1 Distill Qwen 14B
23.9
277Mistral Small 3
23.6
278Ministral 3 14B
23.6
279Claude 3 Opus
23.3
280Llama 3.1 Nemotron Instruct 70B
23.3
281Hermes 3 - Llama-3.1 70B
23.1
282Qwen2.5 Instruct 32B
22.9
283Qwen2 Instruct 72B
22.9
284Sonar
22.9
285Claude 3 Sonnet
22.9
286Gemini 1.5 Flash-8B
22.9
287GPT-4o mini
22.9
288DeepHermes 3 - Mistral 24B Preview
22.8
289Qwen3 8B
22.6
290Sonar Pro
22.6
291GLM-4.5V
22.1
292NVIDIA-Nemotron-Nano-9B-v2
22
293Qwen3 VL 8B
21.9
294Granite 4.1 8B
21.8
295Gemma 3 27B Instruct
21.2
296Olmo 3 7B Think
21.2
297Granite 4.0 H Small
20.9
298Gemma 4 E2B
20.9
299Nova Pro
20.8
300Mistral Large (Feb '24)
20.8
301Ministral 3 8B
20.8
302DeepSeek R1 0528 Qwen3 8B
20.4
303Kimi Linear 48B A3B Instruct
19.9
304Claude 2.0
19.4
305Gemini 2.5 Flash-Lite
19.3
306Sarvam 30B
19.2
307Llama 3 Instruct 70B
18.9
308Mixtral 8x22B Instruct
18.8
309Jamba 1.7 Large
18.8
310Claude 3 Haiku
18.6
311Qwen3 Omni 30B A3B Instruct
18.6
312Jamba 1.6 Large
18.4
313Claude 2.1
18.4
314Qwen3 4B 2507 Instruct
18.1
315Gemini 1.5 Flash (May '24)
18.1
316Sarvam M
17.8
317Tri-21B-think Preview
17.8
318Qwen3 VL 8B Instruct
17.4
319Gemma 3 12B Instruct
17.4
320Tri-21B-Think
17.4
321Qwen3 VL 4B
17.1
322Llama 4 Scout
17
323Ring-flash-2.0
16.8
324Olmo 3.1 32B Instruct
16.7
325Solar Pro 2 (Preview)
16.4
326NVIDIA Nemotron 3 Nano 4B
16.4
327Jamba 1.5 Large
16.3
328Qwen3.5 4B
16.1
329Mistral Small (Sep '24)
15.6
330Qwen2.5 Turbo
15.3
331Qwen2.5 Coder Instruct 7B
14.8
332Ministral 3 3B
14.4
333Nova Lite
13.9
334DeepSeek Coder V2 Lite Instruct
13.9
335Qwen3 VL 4B Instruct
13.7
336Ling-mini-2.0
13.5
337Mistral Small (Feb '24)
13.4
338Molmo2-8B
13.3
339Llama 3.1 Instruct 8B
13.2
340DeepSeek R1 Distill Llama 8B
11.9
341Llama 3 Instruct 8B
11.9
342Granite 4.1 3B
11.9
343Granite 4.0 Micro
11.9
344Command-R+ (Apr '24)
11.8
345DBRX Instruct
11.8
346Mistral Medium
11.8
347Llama 2 Chat 13B
11.8
348Gemini 1.0 Pro
11.7
349Llama 3.2 Instruct 11B (Vision)
11.2
350Phi-4 Multimodal Instruct
11
351LFM2 24B A2B
10.9
352Phi-4-mini-instruct
10.8
353Olmo 3 7B Instruct
10.3
354Jamba 1.6 Mini
10.1
355Granite 3.3 8B
10.1
356Llama 3.1 Nemotron Nano 4B v1.1
10.1
357Nova Micro
9.4
358Jamba 1.7 Mini
9.3
359Exaone 4.0 1.2B
9.3
360DeepHermes 3 - Llama-3.1 8B Preview
9.1
361Phi-3 Mini Instruct 3.8B
9
362Granite 4.0 1B
8.7
363Gemma 3n E4B Instruct Preview (May '25)
8.6
364Granite 4.0 H 1B
8.2
365Gemma 3n E4B Instruct
8.1
366Jamba 1.5 Mini
8
367OLMo 2 32B
8
368LFM2.5-8B-A1B
7.8
369Gemma 3 4B Instruct
7.3
370LFM 40B
7.1
371LFM2 8B A1B
6.8
372DeepSeek R1 Distill Qwen 1.5B
6.6
373Command-R (Mar '24)
6.3
374Jamba Reasoning 3B
5.9
375Apertus 70B Instruct
5.7
376Gemma 3n E2B Instruct
5.2
377Llama 3.2 Instruct 3B
5.2
378MiniCPM5-1B
4.4
379Qwen3 1.7B
4.3
380LFM2.5-1.2B-Thinking
4.2
381Apertus 8B Instruct
4.1
382QwQ 32B-Preview
3.8
383OLMo 2 7B
3.7
384Tiny Aya Global
3.6
385Molmo 7B-D
3.6
386Qwen3 4B
3.5
387LFM2.5-VL-1.6B
3
388Qwen3 0.6B
2.8
389Mixtral 8x7B Instruct
2.8
390Qwen3.5 2B
2.8
391LFM2 1.2B
2.5
392LFM2 2.6B
2.5
393Mistral 7B Instruct
2.4
394LFM2.5-1.2B-Instruct
2.3
395MiniCPM-V 4.6 1.3B
2.1
396Llama 3.2 Instruct 1B
1.7
397Granite 4.0 H 350M
1.7
398Granite 4.0 350M
0.9
399Gemma 3 1B Instruct
0.7
400Llama 2 Chat 7B
0
401Qwen3.5 0.8B
0
402gemma-3-270m
0