BenchMark·Hub

MBPP

S高可信Benchmark
代码代码生成MBPP 家族开放cc-by-4.0

发布方:Google

热度56.1▲ 1.0
下载量 · 30天
324,267
Hugging Face
GitHub Stars
代码仓库
论文被引
4,345
Semantic Scholar
跑分模型 · 30天
89
Leaderboard results

简介

Dataset Card for Mostly Basic Python Problems (mbpp) Dataset Summary The benchmark consists of around 1,000 crowd-sourced Python programming problems, designed to be solvable by entry level programmers, covering programming fundamentals, standard library functionality, and so on. Each problem consists of a task description, code solution and 3 automated test cases. As described in the paper, a subset of the data has been hand-verified by us. Released here as part… See the full description on the dataset page: https://huggingface.co/datasets/google-research-datasets/mbpp.