BenchMark·Hub

SWE-bench Multimodal

B待确认Variant
代码代码生成SWE-bench 家族开放

发布方:princeton-nlp

热度25.4▼ 0.5

SWE-bench Multimodal

swe-bench / resolved · 22 行结果

排名模型子项分数Metric时间
#1o3
OpenAIGUIRepair + o3 (2025-04-16)
SWE-bench Multimodal
swe-bench
36%resolved2025-07-01
#2o3
OpenAICodefuse_Pycfuse_SVR
SWE-bench Multimodal
swe-bench
36%resolved2025-11-17
#3Claude 4 Sonnet
AnthropicRefact.ai Agent
SWE-bench Multimodal
swe-bench
35.6%resolved2025-06-11
#4Claude Sonnet 4
AnthropicOpenHands-Versa (Claude-Sonnet 4)
SWE-bench Multimodal
swe-bench
34.4%resolved2025-05-28
#5o4-mini
OpenAIGUIRepair + o4-mini (2025-04-16)
SWE-bench Multimodal
swe-bench
33.9%resolved2025-05-31
#6Claude 3.7 Sonnet
AnthropicOpenHands-Versa (Claude-3.7 Sonnet)
SWE-bench Multimodal
swe-bench
31.3%resolved2025-05-09
#7GPT-4.1
OpenAIGUIRepair + GPT 4.1 (2025-04-14)
SWE-bench Multimodal
swe-bench
31.1%resolved2025-05-31
#8Claude 3.7 Sonnet
AnthropicZencoder (2025-04-01)
SWE-bench Multimodal
swe-bench
30.6%resolved2025-04-01
#9GPT-4o
OpenAIGUIRepair + GPT 4o (2024-08-06)
SWE-bench Multimodal
swe-bench
30.4%resolved2025-05-31
#10Undisclosed
Globant Code Fixer Agent
SWE-bench Multimodal
swe-bench
29.6%resolved2025-03-25
#11Undisclosed
Zencoder (2025-03-10)
SWE-bench Multimodal
swe-bench
27.1%resolved2025-03-11
#12Claude 3.5 Sonnet
AnthropicAgentless Lite + Claude-3.5 Sonnet
SWE-bench Multimodal
swe-bench
25.3%resolved2025-02-26
#13GPT-4o
OpenAISWE-agent Multimodal + GPT 4o (2024-08-06)
SWE-bench Multimodal
swe-bench
12.2%resolved2024-10-06
#14Claude Sonnet 3.5
AnthropicSWE-agent + Claude Sonnet 3.5
SWE-bench Multimodal
swe-bench
12.2%resolved2024-10-06
#15Claude Sonnet 3.5
AnthropicSWE-agent JavaScript + Claude Sonnet 3.5
SWE-bench Multimodal
swe-bench
12%resolved2024-10-06
#16GPT-4o
OpenAISWE-agent + GPT 4o (2024-08-06)
SWE-bench Multimodal
swe-bench
12%resolved2024-10-06
#17Claude 3.5 Sonnet
AnthropicSWE-agent Multimodal + Claude 3.5 Sonnet
SWE-bench Multimodal
swe-bench
11.4%resolved2024-10-06
#18GPT-4o
OpenAISWE-agent JavaScript + GPT 4o (2024-08-06)
SWE-bench Multimodal
swe-bench
9.3%resolved2024-10-06
#19Claude 3.5 Sonnet
AnthropicAgentless + Claude 3.5 Sonnet
SWE-bench Multimodal
swe-bench
6.2%resolved2024-10-06
#20GPT-4o
OpenAIRAG + GPT 4o (2024-08-06)
SWE-bench Multimodal
swe-bench
6%resolved2024-10-06
#21Claude 3.5 Sonnet
AnthropicRAG + Claude 3.5 Sonnet
SWE-bench Multimodal
swe-bench
5%resolved2024-10-06
#22GPT-4o
OpenAIAgentless + GPT 4o (2024-08-06)
SWE-bench Multimodal
swe-bench
3.1%resolved2024-10-06
22 条结果 · 当前 1-22
1 / 1