mirror of
https://github.com/deepseek-ai/DeepInfer.git
synced 2026-10-31 00:36:20 +08:00
dacffdd431
`h20_quant_check.py` cast to `torch.float4_e2m1fn_x2` to cross-check the code table, nibble order and quantize/dequantize round trip. That cast kernel exists neither on SM90 nor on the CPU -- it raises a device-side assert on H20 and `copy_kernel not implemented` on CPU -- so the check could not run at all on the hardware it is meant for. The E2M1 table and the unpack order now come from `inference/convert.py` (inlined, with the source noted), and quantization picks the nearest table entry instead of casting. Still pure integer/table work, so it runs anywhere and the round trip reports the same 2.77e-2 that the expert-weight diff attributes to the per-32 -> per-128 requantization.
104 lines
1.4 KiB
Plaintext
104 lines
1.4 KiB
Plaintext
watch_*
|
|
deepinfer.tar.gz
|
|
tracing/
|
|
sweeps/
|
|
# Cross-node lock and temp files written when refreshing the golden on multiple nodes
|
|
tests/models/offline_decode_ppl.json.lock
|
|
tests/models/offline_decode_ppl.json.tmp
|
|
export_only_prof_dir/
|
|
benchmark_results*.jsonl
|
|
# Byte-compiled / optimized / DLL files
|
|
__pycache__/
|
|
*.py[cod]
|
|
*$py.class
|
|
|
|
# C extensions
|
|
*.so
|
|
|
|
# Distribution / packaging
|
|
.Python
|
|
/build/
|
|
develop-eggs/
|
|
dist/
|
|
downloads/
|
|
eggs/
|
|
.eggs/
|
|
lib/
|
|
lib64/
|
|
parts/
|
|
sdist/
|
|
var/
|
|
wheels/
|
|
share/python-wheels/
|
|
*.egg-info/
|
|
.installed.cfg
|
|
*.egg
|
|
MANIFEST
|
|
|
|
# Installer logs
|
|
pip-log.txt
|
|
pip-delete-this-directory.txt
|
|
|
|
# Unit test / coverage reports
|
|
htmlcov/
|
|
.tox/
|
|
.nox/
|
|
.coverage
|
|
.coverage.*
|
|
.cache
|
|
nosetests.xml
|
|
coverage.xml
|
|
*.cover
|
|
*.py,cover
|
|
.hypothesis/
|
|
.pytest_cache/
|
|
cover/
|
|
|
|
# Logs
|
|
*.log
|
|
|
|
# clangd
|
|
compile_commands.json
|
|
.clangd
|
|
|
|
# Environments
|
|
.env
|
|
.venv
|
|
env/
|
|
venv/
|
|
|
|
# IDE
|
|
.idea/
|
|
.vscode/
|
|
.DS_Store
|
|
|
|
# Linter / type checker caches
|
|
.mypy_cache/
|
|
.dmypy.json
|
|
dmypy.json
|
|
.ruff_cache/
|
|
.pkl_memoize_py3/
|
|
.pyre/
|
|
.pytype/
|
|
|
|
# Results
|
|
*.csv
|
|
|
|
# Python pickle files
|
|
*.pkl
|
|
|
|
# vim swap files
|
|
*.swo
|
|
*.swp
|
|
|
|
# Platform extension module artifacts (deepinfer._C); the directory currently holds only .so
|
|
# symlinks (already covered by *.so above) and is ignored explicitly so that non-.so files
|
|
# cannot slip in later
|
|
/deepinfer/_so/
|
|
|
|
# Generated patch + local debug dumps
|
|
h20-sm90.diff
|
|
*.npy
|
|
dump_debug/
|
|
.github-pr-body-*.md
|