vizdoom-llm-inverse-dynamics-benchmark

简介

VizDoom LLM Inverse Dynamics Benchmark Dataset Summary This dataset is a small, manually inspectable benchmark for evaluating how well large language models and vision-language models can act as inverse dynamics models in a first-person game environment. Each example contains a 9-frame temporal window centered on a labeled timestep t: [x_(t-4), x_(t-3), x_(t-2), x_(t-1), x_t, x_(t+1), x_(t+2), x_(t+3), x_(t+4)] -> a_t where a_t is the action taken at time t. The benchmark… See the full description on the dataset page: https://huggingface.co/datasets/HiggsBoson/vizdoom-llm-inverse-dynamics-benchmark.