SWE-MERA

B待确认Benchmark

代码仓库级代码开放mit

发布方：MERA-evaluation

热度15.1▲ 0.0

Hugging Face

下载量 · 30天

491

Hugging Face

GitHub Stars

—

代码仓库

论文被引

—

Semantic Scholar

跑分模型 · 30天

—

Leaderboard results

简介

SWE-MERA Continuously updated SWE-MERA dataset SWE-MERA splits: dev: for testing (10 samples) lite: presented at the leaderboard here (750 samples) full: continuously updated to collect more data (2738 samples) Load dataset from datasets import load_dataset ds = load_dataset("MERA-evaluation/SWE-MERA", split='dev') Evaluation Description The main tool to validate tasks is repotest (available at PyPI or GitHub) data.jsonl -… See the full description on the dataset page: https://huggingface.co/datasets/MERA-evaluation/SWE-MERA.