mirror of
https://github.com/deepseek-ai/DeepInfer.git
synced 2026-10-28 14:57:09 +08:00
neuronx-cc segfaults (LegalizeSundaAccess) when the 6-row projections are merged with the indexer, so that boundary stays; the other fine splits are prompt-only. bench28 (512 in, 128 out, TP=64, nextn=5): TPOT 277.4 -> 272.6 ms, 3.85 tokens a step. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| mtp | ||
| v4_modules | ||
| vision_encoder | ||
| __init__.py | ||
| decoder_layer.py | ||
| deepseek_vl.py | ||
| deepseek.py | ||