llm-speed-benchmarks

简介

llm-speed: signed LLM inference-speed benchmarks Crowdsourced, cryptographically signed measurements of how fast large language models actually run: decode tokens per second, time to first token, and latency, across consumer GPUs, Apple Silicon, and hosted APIs, under one reproducible workload suite (suite-v1). Live data and bulk downloads: https://llm-speed.com/data Per-run permalink: https://llm-speed.com/r/<id> Methodology: https://llm-speed.com/methodology DOI:… See the full description on the dataset page: https://huggingface.co/datasets/llmspeed/llm-speed-benchmarks.