BenchMark·Hub

WikiProfile

B待确认Benchmark
知识问答事实性开放cc-by-sa-4.0

发布方:google

热度20.5▲ 0.7
下载量 · 30天
176
Hugging Face
GitHub Stars
代码仓库
论文被引
8
Semantic Scholar
跑分模型 · 30天
Leaderboard results

简介

WikiProfile WikiProfile is a factual knowledge benchmark for evaluating how well language models encode and recall factual knowledge. It comprises 2,150 facts, each paired with 10 questions, for a total of 21,500 question instances. Each fact is grounded in the first paragraph (summary) of an English Wikipedia page and is defined as a proposition between two entities, a subject and an object (e.g., "Oasis played their first gig at the Boardwalk club" → subject: Oasis, object:… See the full description on the dataset page: https://huggingface.co/datasets/google/WikiProfile.