mirror of
https://github.com/deepseek-ai/DeepInfer.git
synced 2026-10-28 14:57:09 +08:00
Attention half and MoE as one region graph per decoder layer: half the NEFF launches a step (the attention lane all-reduce did not move the decode step, 447.8 ms, so per-launch overhead is the next suspect). Host tiny cp=8 matches. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| mtp | ||
| v4_modules | ||
| vision_encoder | ||
| __init__.py | ||
| decoder_layer.py | ||
| deepseek_vl.py | ||
| deepseek.py | ||