mirror of
https://github.com/deepseek-ai/DeepInfer.git
synced 2026-10-31 08:46:21 +08:00
`h20_quant_check.py` cast to `torch.float4_e2m1fn_x2` to cross-check the code table, nibble order and quantize/dequantize round trip. That cast kernel exists neither on SM90 nor on the CPU -- it raises a device-side assert on H20 and `copy_kernel not implemented` on CPU -- so the check could not run at all on the hardware it is meant for. The E2M1 table and the unpack order now come from `inference/convert.py` (inlined, with the source noted), and quantization picks the nearest table entry instead of casting. Still pure integer/table work, so it runs anywhere and the round trip reports the same 2.77e-2 that the expert-weight diff attributes to the per-32 -> per-128 requantization. |
||
|---|---|---|
| .. | ||
| build_vendor.sh | ||
| build.sh | ||
| compare_layers.py | ||
| format_csrc.sh | ||
| gen_stub.sh | ||
| h20_ask.py | ||
| h20_attn_check.py | ||
| h20_engram_check.py | ||
| h20_expert_weight_check.py | ||
| h20_quant_check.py | ||
| h20_real_requant_check.py | ||
| h20_smoke_check.py | ||
| h20_topk_check.py | ||
| ref_layer_dump.py | ||
| ref_next_token.py | ||