BenchMark·Hub

HumanEval

S高可信Benchmark
代码代码生成HumanEval 家族开放mit

发布方:OpenAI

热度61.5▼ 0.3
下载量 · 30天
302,869
Hugging Face
GitHub Stars
代码仓库
论文被引
11,205
Semantic Scholar
跑分模型 · 30天
125
Leaderboard results

简介

Dataset Card for OpenAI HumanEval Dataset Summary The HumanEval dataset released by OpenAI includes 164 programming problems with a function sig- nature, docstring, body, and several unit tests. They were handwritten to ensure not to be included in the training set of code generation models. Supported Tasks and Leaderboards Languages The programming problems are written in Python and contain English natural text in comments and… See the full description on the dataset page: https://huggingface.co/datasets/openai/openai_humaneval.