image_gen_ocr_evaluation_data
B待确认Benchmark多模态文生图开放apache-2.0
发布方:pbevan11
热度6.8▼ 0.1
下载量 · 30天
32
Hugging Face
GitHub Stars
—
代码仓库
论文被引
—
Semantic Scholar
跑分模型 · 30天
—
Leaderboard results
简介
image_gen_ocr_eval Author: Peter J. Bevan Date: 15/12/23 github: https://github.com/pbevan1/image-gen-spelling-eval Table 1: Normalised Levenshtein similarity scores between instructed text and text present in image (as identified by OCR) Model object signage natural long Overall DALLE3 0.62 0.62 0.62 0.58 0.61 DeepFloydIF 0.57 0.56 0.66 0.39 0.54 DALLE2 0.44 0.35 0.42 0.22 0.36 SDXL 0.3 0.33 0.4 0.21 0.31 SD 0.28 0.26 0.32 0.22 0.27 PlayGroundV2 0.19 0.23 0.17… See the full description on the dataset page: https://huggingface.co/datasets/pbevan11/image_gen_ocr_evaluation_data.