MMODELYST
Leaderboards/HumanEval Leaderboard
LDR

HumanEval Leaderboard

HumanEval

Code synthesis pass@1 ranking.

1Claude 3.5 Sonnet
92
2GPT-4o
90.2
3Grok-2
88.4
4Llama-3.3-70B-Instruct
88.4
5Claude 3.5 Haiku
88.1
6GPT-4o mini
87.2
7Qwen2.5-72B-Instruct
86.6
8Claude 3 Opus
84.9
9Qwen2.5-7B-Instruct
84.8
10DeepSeek-V3
82.6
11Llama-3.1-70B-Instruct
80.5
12Llama-3.1-8B-Instruct
72.6
13gemma-2-27b-it
71
14Phi-3.5-mini-instruct
62
15gemma-2-9b-it
60
16Mistral-7B-Instruct-v0.3
39