BenchMark·Hub

mittens

B待确认Benchmark
安全对齐偏见公平开放cc-by-4.0

发布方:google

热度10.9▼ 0.4
下载量 · 30天
68
Hugging Face
GitHub Stars
代码仓库
论文被引
Semantic Scholar
跑分模型 · 30天
Leaderboard results

简介

MiTTenS: A Dataset for Evaluating Misgendering in Translation Misgendering is the act of referring to someone in a way that does not reflect their gender identity. Translation systems, including foundation models capable of translation, can produce errors that result in misgendering harms. To measure the extent of such potential harms when translating into and out of English, we introduce a dataset, MiTTenS, covering 26 languages from a variety of language families and scripts… See the full description on the dataset page: https://huggingface.co/datasets/google/mittens.