BenchMark·Hub

GPQA Diamond

S高可信Benchmark
知识问答考试问答GPQA 家族申请cc-by-4.0

发布方:NYU 等

热度46.0▼ 0.1
下载量 · 30天
117,207
Hugging Face
GitHub Stars
代码仓库
论文被引
3,206
Semantic Scholar
跑分模型 · 30天
Leaderboard results

简介

Dataset Card for GPQA GPQA is a multiple-choice, Q&A dataset of very hard questions written and validated by experts in biology, physics, and chemistry. When attempting questions out of their own domain (e.g., a physicist answers a chemistry question), these experts get only 34% accuracy, despite spending >30m with full access to Google. We request that you do not reveal examples from this dataset in plain text or images online, to reduce the risk of leakage into foundation… See the full description on the dataset page: https://huggingface.co/datasets/Idavidrein/gpqa.