humanevalpack

B待确认Benchmark

代码代码生成开放mit

发布方：bigcode

热度33.8▼ 0.1

Hugging Face 论文 arXiv

下载量 · 30天

9,304

Hugging Face

GitHub Stars

—

代码仓库

论文被引

223

Semantic Scholar

跑分模型 · 30天

—

Leaderboard results

简介

Dataset Card for HumanEvalPack Dataset Summary HumanEvalPack is an extension of OpenAI's HumanEval to cover 6 total languages across 3 tasks. The Python split is exactly the same as OpenAI's Python HumanEval. The other splits are translated by humans (similar to HumanEval-X but with additional cleaning, see here). Refer to the OctoPack paper for more details. Languages: Python, JavaScript, Java, Go, C++, Rust OctoPack🐙🎒: Data CommitPack 4TB of GitHub commits… See the full description on the dataset page: https://huggingface.co/datasets/bigcode/humanevalpack.