BenchMark·Hub

graphwalks

B待确认Benchmark
推理通用推理开放mit

发布方:openai

热度20.2▼ 0.3
下载量 · 30天
1,658
Hugging Face
GitHub Stars
代码仓库
论文被引
Semantic Scholar
跑分模型 · 30天
Leaderboard results

简介

GraphWalks: a multi hop reasoning long context benchmark In Graphwalks, the model is given a graph represented by its edge list and asked to perform an operation. Example prompt: You will be given a graph as a list of directed edges. All nodes are at least degree 1. You will also get a description of an operation to perform on the graph. Your job is to execute the operation on the graph and return the set of nodes that the operation results in. If asked for a breadth-first search… See the full description on the dataset page: https://huggingface.co/datasets/openai/graphwalks.