mirror of
https://github.com/deepseek-ai/DeepInfer.git
synced 2026-10-28 23:07:09 +08:00
With runtime_max_model_len <= candidate_topk_blocks * candidate_block_size every consumer already skips the candidate filter, so the source layer's block top-k feeds nothing; below 16384 positions it is not even defined (fewer blocks than candidate_topk_blocks, assert in _topk_candidate_block). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| eplb | ||
| input_metadata | ||
| layers | ||
| models | ||
| parallel_utils | ||
| __init__.py | ||
| layer_utils.py | ||
| model_loader.py | ||
| model_metadata_utils.py | ||
| model_output.py | ||
| sampling_inputs.py | ||
| utils.py | ||