热度61.5▼ 0.3
HumanEval
evalplus / pass@1 · 125 行结果
| 排名 | 模型 | 子项 | 分数 | Metric | 时间 |
|---|---|---|---|---|---|
| #1 | O1 Preview (Sept 2024) | HumanEval evalplus | 96.3% | pass@1 | 2026-08-28 |
| #2 | O1 Mini (Sept 2024) | HumanEval evalplus | 96.3% | pass@1 | 2026-08-28 |
| #3 | GPT 4o (Aug 2024) | HumanEval evalplus | 92.7% | pass@1 | 2026-08-28 |
| #4 | Qwen2.5-Coder-32B-Instruct Qwen | HumanEval evalplus | 92.1% | pass@1 | 2026-08-28 |
| #5 | DeepSeek-V3 (Nov 2024) deepseek-ai | HumanEval evalplus | 91.5% | pass@1 | 2026-08-28 |
| #6 | DeepSeek-V2.5 (Nov 2024) deepseek-ai | HumanEval evalplus | 90.2% | pass@1 | 2026-08-28 |
| #7 | GPT-4-Turbo (April 2024) | HumanEval evalplus | 90.2% | pass@1 | 2026-08-28 |
| #8 | Gemini 1.5 Pro 002 | HumanEval evalplus | 89% | pass@1 | 2026-08-28 |
| #9 | Grok Beta | HumanEval evalplus | 88.4% | pass@1 | 2026-08-28 |
| #10 | GPT 4o Mini (July 2024) | HumanEval evalplus | 88.4% | pass@1 | 2026-08-28 |
| #11 | GPT-4 (May 2023) | HumanEval evalplus | 88.4% | pass@1 | 2026-08-28 |
| #12 | Claude Sonnet 3.5 (June 2024) | HumanEval evalplus | 87.2% | pass@1 | 2026-08-28 |
| #13 | DeepSeek-Coder-V2-Instruct deepseek-ai | HumanEval evalplus | 85.4% | pass@1 | 2026-08-28 |
| #14 | GPT-4-Turbo (Nov 2023) | HumanEval evalplus | 85.4% | pass@1 | 2026-08-28 |
| #15 | CodeQwen1.5-7B-Chat Qwen | HumanEval evalplus | 83.5% | pass@1 | 2026-08-28 |
| #16 | claude-3-opus (Mar 2024) | HumanEval evalplus | 82.9% | pass@1 | 2026-08-28 |
| #17 | Gemini 1.5 Flash 002 | HumanEval evalplus | 82.3% | pass@1 | 2026-08-28 |
| #18 | OpenCoder-8B-Instruct infly | HumanEval evalplus | 81.7% | pass@1 | 2026-08-28 |
| #19 | DeepSeek-Coder-33B-instruct deepseek-ai | HumanEval evalplus | 81.1% | pass@1 | 2026-08-28 |
| #20 | Codestral-22B-v0.1 mistralai | HumanEval evalplus | 79.9% | pass@1 | 2026-08-28 |
| #21 | WizardCoder-33B-V1.1 WizardLM | HumanEval evalplus | 79.9% | pass@1 | 2026-08-28 |
| #22 | OpenCodeInterpreter-DS-33B m-a-p | HumanEval evalplus | 79.3% | pass@1 | 2026-08-28 |
| #23 | Llama3-70B-instruct meta-llama | HumanEval evalplus | 77.4% | pass@1 | 2026-08-28 |
| #24 | OpenCodeInterpreter-DS-6.7B m-a-p | HumanEval evalplus | 77.4% | pass@1 | 2026-08-28 |
| #25 | speechless-codellama-34B-v2.0 uukuguy | HumanEval evalplus | 77.4% | pass@1 | 2026-08-28 |
125 条结果 · 当前 1-25
1 / 5