MMIU-Benchmark
B待确认Benchmark多模态视觉语言开放
发布方：FanqingM
热度26.9▼ 0.0
下载量 · 30天
3,158
Hugging Face
GitHub Stars
—
代码仓库
论文被引
67
Semantic Scholar
跑分模型 · 30天
—
Leaderboard results
简介
Dataset Card for MMIU Repository: https://github.com/OpenGVLab/MMIU Paper: https://arxiv.org/abs/2408.02718 Project Page: https://mmiu-bench.github.io/ Point of Contact: Fanqing Meng Introduction MMIU encompasses 7 types of multi-image relationships, 52 tasks, 77K images, and 11K meticulously curated multiple-choice questions, making it the most extensive benchmark of its kind. Our evaluation of 24 popular MLLMs, including both open-source and proprietary models… See the full description on the dataset page: https://huggingface.co/datasets/FanqingM/MMIU-Benchmark.