BenchMark·Hub

narrativeqa_manual

B待确认Benchmark
知识问答通用问答开放apache-2.0

发布方:deepmind

热度25.8▼ 0.2
下载量 · 30天
168
Hugging Face
GitHub Stars
代码仓库
论文被引
1,081
Semantic Scholar
跑分模型 · 30天
Leaderboard results

简介

The Narrative QA Manual dataset is a reading comprehension dataset, in which the reader must answer questions about stories by reading entire books or movie scripts. The QA tasks are designed so that successfully answering their questions requires understanding the underlying narrative rather than relying on shallow pattern matching or salience.\THIS DATASET REQUIRES A MANUALLY DOWNLOADED FILE! Because of a script in the original repository which downloads the stories from original URLs everytime, The links are sometimes broken or invalid. Therefore, you need to manually download the stories for this dataset using the script provided by the authors (https://github.com/deepmind/narrativeqa/blob/master/download_stories.sh). Running the shell script creates a folder named "tmp" in the root directory and downloads the stories there. This folder containing the storiescan be used to load the dataset via `datasets.load_dataset("narrativeqa_manual", data_dir="<path/to/folder>")`.