BenchMark·Hub

Aider Refactor

A已审核Benchmark
代码代码生成Aider 家族开放

发布方:Aider

热度5.1▼ 0.3

Aider Refactor

aider / pass_rate_1 · 14 行结果

排名模型子项分数Metric时间
#1claude-3-5-sonnet-20241022
Anthropicaider --sonnet
Aider Refactor
aider
92.1%pass_rate_12024-10-22
#2o1-preview
OpenAIaider --model o1-preview
Aider Refactor
aider
75.3%pass_rate_12024-10-22
#3claude-3-opus-20240229
Anthropicaider --opus
Aider Refactor
aider
72.3%pass_rate_12024-05-04
#4claude-3.5-sonnet-20240620
Anthropicaider --sonnet
Aider Refactor
aider
64%pass_rate_12024-07-01
#5gpt-4o
OpenAIaider
Aider Refactor
aider
62.9%pass_rate_12024-05-13
#6gpt-4-1106-preview
OpenAIaider --model gpt-4-1106-preview
Aider Refactor
aider
50.6%pass_rate_12024-05-08
#7gemini/gemini-1.5-pro-latest
Googleaider --model gemini/gemini-1.5-pro-latest
Aider Refactor
aider
49.4%pass_rate_12024-05-04
#8gpt-4o-2024-08-06
OpenAIaider --model openai/gpt-4o-2024-08-06
Aider Refactor
aider
49.4%pass_rate_12024-08-06
#9o1-mini
OpenAIaider --model o1-mini
Aider Refactor
aider
44.9%pass_rate_12024-10-22
#10gpt-4-turbo-2024-04-09 (udiff)
OpenAIaider --gpt-4-turbo
Aider Refactor
aider
34.1%pass_rate_12024-04-09
#11gpt-4-0125-preview
OpenAIaider --model gpt-4-0125-preview
Aider Refactor
aider
33.7%pass_rate_12024-05-08
#12DeepSeek Coder V2 0724 (deprecated)
DeepSeekaider --model deepseek/deepseek-coder
Aider Refactor
aider
32.6%pass_rate_12024-07-24
#13DeepSeek Chat V2.5
DeepSeekaider --deepseek
Aider Refactor
aider
31.5%pass_rate_12024-09-05
#14gpt-4-turbo-2024-04-09 (diff)
OpenAIaider --model gpt-4-turbo-2024-04-09
Aider Refactor
aider
21.4%pass_rate_12024-04-10
14 条结果 · 当前 1-14
1 / 1