mirror of
https://github.com/deepseek-ai/DeepInfer.git
synced 2026-10-29 07:17:08 +08:00
The overflow decision was rank-local, and the dense rerun has collectives of its own: one rank rerunning left the others waiting in its all-gather (NRT 'Collective operation pending'). The flag is now max-all-reduced over the EP group. The bench gave every rank the same prompt, which routes 64 copies of each token to the same experts (overflow on every layer); real requests differ, so the prompts now take the rank in their seed. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| DeepEP@93eb6eb238 | ||
| DeepEP-Ascend@3b25377d04 | ||
| DeepGEMM@1fc9c66975 | ||
| DeepGEMM-Ascend@3a35326271 | ||
| DeepSelect@bfa4507d93 | ||
| FlashMLA@2e5429fc56 | ||