BenchMark·Hub

SWE-bench Lite

B待确认Variant
代码代码生成SWE-bench 家族开放

发布方:princeton-nlp

热度49.9▼ 0.1

SWE-bench Lite

swe-bench / resolved · 84 行结果

排名模型子项分数Metric时间
#1Claude 4 Sonnet
AnthropicExpeRepair-v1.0 + Claude 4 Sonnet
SWE-bench Lite
swe-bench
60.3%resolved2025-06-25
#2Multiple
AnthropicRefact.ai Agent
SWE-bench Lite
swe-bench
60%resolved2025-04-25
#3Claude 4 Sonnet
AnthropicKGCompass + Claude 4 Sonnet (20250514)
SWE-bench Lite
swe-bench
58.3%resolved2025-09-06
#4Claude 4 Sonnet
AnthropicSWE-agent + Claude 4 Sonnet
SWE-bench Lite
swe-bench
56.7%resolved2025-05-26
#5Undisclosed
Isoform
SWE-bench Lite
swe-bench
55%resolved2025-01-14
#6Multiple
AnthropicSemAgent_Multi-v1.0
SWE-bench Lite
swe-bench
51.7%resolved2025-06-25
#7Claude 3.5 Sonnet
AnthropicIsea
SWE-bench Lite
swe-bench
51.3%resolved2025-09-11
#8Qwen3-Coder-30B-A3B-Instruct
QwenEntroPO + R2E + Qwen3-Coder-30B-A3B-Instruct
SWE-bench Lite
swe-bench
49.7%resolved2025-09-01
#9Undisclosed
Blackbox AI Agent
SWE-bench Lite
swe-bench
49%resolved2024-12-20
#10Multiple
AnthropicCodev
SWE-bench Lite
swe-bench
49%resolved2025-05-28
#11Undisclosed
Gru(2024-12-08)
SWE-bench Lite
swe-bench
48.7%resolved2024-12-08
#12Multiple
AnthropicExpeRepair-v1.0
SWE-bench Lite
swe-bench
48.3%resolved2025-06-13
#13Undisclosed
Globant Code Fixer Agent
SWE-bench Lite
swe-bench
48.3%resolved2024-11-27
#14Claude 3.7 Sonnet
AnthropicSWE-agent + Claude 3.7 Sonnet
SWE-bench Lite
swe-bench
48%resolved2025-02-26
#15Claude 3.5 Sonnet
Anthropicdevlo
SWE-bench Lite
swe-bench
47.3%resolved2024-11-22
#16Multiple
AnthropicDARS Agent
SWE-bench Lite
swe-bench
47%resolved2025-02-05
#17Claude 3.5 Sonnet
AnthropicKGCompass + Claude 3.5 Sonnet (20241022)
SWE-bench Lite
swe-bench
46%resolved2025-06-19
#18Qwen3-Coder-30B-A3B-Instruct
QwenEntroPO + R2E + Qwen3-Coder-30B-A3B-Instruct
SWE-bench Lite
swe-bench
45%resolved2025-09-01
#19Claude 3.5 Sonnet
AnthropicKodu-v1 + Claude-3.5 Sonnet (20241022)
SWE-bench Lite
swe-bench
44.7%resolved2024-12-07
#20Undisclosed
CodeFuse-CGM
SWE-bench Lite
swe-bench
44%resolved2025-03-10
#21Mixed Models
CodeStory Aide + Mixed Models
SWE-bench Lite
swe-bench
43%resolved2024-07-02
#22Claude 3.5 Sonnet
AnthropicLingxi
SWE-bench Lite
swe-bench
42.7%resolved2025-05-09
#23CodeAct v2.1 (claude-3-5-sonnet-20241022)
AnthropicOpenHands + CodeAct v2.1 (claude-3-5-sonnet-20241022)
SWE-bench Lite
swe-bench
41.7%resolved2024-10-25
#24Multiple
AnthropicCodart AI
SWE-bench Lite
swe-bench
41.7%resolved2025-05-15
#25Claude 3.5 Sonnet
AnthropicPatchKitty-0.9 + Claude-3.5 Sonnet (20241022)
SWE-bench Lite
swe-bench
41.3%resolved2024-12-20
84 条结果 · 当前 1-25
1 / 4