coffee/DeepInfer
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepInfer.git synced 2026-10-30 07:47:10 +08:00
Code Issues Packages Projects Releases Wiki Activity

docs: clarify benchmark token accounting

Browse Source
This commit is contained in:
ledd 2026-10-21 10:27:09 +08:00
parent 774ce244b8
commit 0f48b6130e
1 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@ -82,6 +82,8 @@ See [examples](examples/README.md) for details.
Measured on 4 SM100 GPUs for prefill and 64 for decode — each within one scale-up domain. To reproduce the benchmarks, see [run_sweep.sh](examples/sweep/run_sweep.sh).
These are offline engine sweeps, not end-to-end serving measurements. Prefill throughput counts only non-cached input tokens. The decode plot measures steps per second, then converts both axes to tokens per second using an assumed draft acceptance of 75% with `nextn=3` (`1 + 3 × 0.75 = 3.25` tokens per step per request). The 75% value is supplied to the plotting script, not inferred from the sweep. See [benchmark methodology](examples/README.md#benchmark) for the measurement windows and token accounting.
## Evaluation benchmarks
See [eval/README.md](eval/README.md).