mirror of
https://github.com/deepseek-ai/DeepInfer.git
synced 2026-11-01 09:16:20 +08:00
No behaviour change. `CONTRIBUTING.md` requires `ruff check --no-cache` and `ruff format --check --no-cache` to pass, and the SM90 branch predates that requirement: 72 findings, all in the files added here. Most of it is mechanical (`ruff format`), plus: - annotations for the helper signatures (`torch.Tensor` / `int` / `Generator` / return types); hooks are typed as `Callable[[nn.Module, tuple, object], None]` rather than left bare; - two `if`/`else` assignments become ternaries (SIM108), and the index read in `h20_real_requant_check.py` uses a context manager (SIM115). Also corrects the `sparse_mla_fwd` docstring, which still described the old `0 <= idx <= q_position` masking contract. Passing `is_causal=True` there is what produced the all-NaN layer 0: indices address the assembled `[swa cache | current swa | compressed]` buffer, so the row number is not a valid causal bound and the engine must pass False. |
||
|---|---|---|
| .. | ||
| __init__.py | ||
| attn.py | ||
| builder.py | ||
| compress.py | ||
| containers.py | ||
| cross_layer.py | ||
| engram_metadata.py | ||
| engram_parameters.py | ||
| engram.py | ||
| hc_blocks.py | ||
| hc_lazy.py | ||
| hc.py | ||
| heads.py | ||
| index_attn.py | ||
| linear.py | ||
| mhc_modeling.py | ||
| mhc_ops.py | ||
| mla_attn.py | ||
| mlp.py | ||
| moe.py | ||
| norm.py | ||
| rope.py | ||
| utils.py | ||
| yoco.py | ||