BenchMark·Hub

MPB_Missing-Premise-Benchmark

B待确认Benchmark
推理通用推理开放apache-2.0

发布方:ant-intl

热度17.1▼ 0.1
下载量 · 30天
98
Hugging Face
GitHub Stars
代码仓库
论文被引
0
Semantic Scholar
跑分模型 · 30天
Leaderboard results

简介

HRB: Missing-Premise Reasoning Benchmark HRB is the Hugging Face release of the Missing-Premise Benchmark (MPB) introduced in Ask, Condition or Abstain: Reinforcement Learning for Missing-Premise Reasoning. The benchmark contains 274 human-verified instances designed to evaluate whether a language model can recognize when a problem is underdetermined and respond constructively—by asking for the missing premise, conditioning its answer on an unknown variable, or… See the full description on the dataset page: https://huggingface.co/datasets/ant-intl/MPB_Missing-Premise-Benchmark.