WikiProfile
B待确认Benchmark知识问答事实性开放cc-by-sa-4.0
发布方:google
热度20.5▲ 0.7
下载量 · 30天
176
Hugging Face
GitHub Stars
—
代码仓库
论文被引
8
Semantic Scholar
跑分模型 · 30天
—
Leaderboard results
简介
WikiProfile WikiProfile is a factual knowledge benchmark for evaluating how well language models encode and recall factual knowledge. It comprises 2,150 facts, each paired with 10 questions, for a total of 21,500 question instances. Each fact is grounded in the first paragraph (summary) of an English Wikipedia page and is defined as a proposition between two entities, a subject and an object (e.g., "Oasis played their first gig at the Boardwalk club" → subject: Oasis, object:… See the full description on the dataset page: https://huggingface.co/datasets/google/WikiProfile.