mirror of
https://github.com/deepseek-ai/DeepInfer.git
synced 2026-10-31 08:46:21 +08:00
Two files claimed that importing `flag_gems` registers ATen implementations process-wide, and used that to justify vendoring. The conclusion was right for the wrong reason, and the reason was wrong enough to distort planning: it made any broader FlagGems integration look reckless. Measured instead of assumed. Hashing `torch._C._dispatch_dump_table` for `aten::rms_norm`, `aten::silu`, `aten::softmax`, `aten::topk`, `aten::lerp` before and after `import flag_gems`: every table unchanged. The package `__init__` creates the `aten_lib` handle and imports the op modules; registration happens only when `enable()` or `only_enable(include=[...])` is called. And `only_enable(include=["rms_norm"])` changes exactly `aten::rms_norm` and nothing else. So the blast radius lives in `enable()`, not in the import -- which is what makes a wider integration tractable rather than risky. Vendoring still stands, for two reasons that survive the correction: the package root star-imports every op module and loads Triton TLE, which dlopen's `libflagcx` (a native dependency this deployment does not otherwise need); and the released kernel file has no internal imports, so the package bought nothing for that operator. Both files now say this, and say that it is a correction, so the next reader does not rediscover it. |
||
|---|---|---|
| .. | ||
| simulate_no_tilelang | ||
| sparse_mla_port | ||
| tile_kernels_patch | ||
| ab_cases.py | ||
| build_vendor.sh | ||
| build.sh | ||
| compare_layers.py | ||
| copy_site_packages.py | ||
| enable_torch_kernel_refs.sh | ||
| flagtree_triton_probe.py | ||
| format_csrc.sh | ||
| gen_stub.sh | ||
| h20_ask.py | ||
| h20_attn_check.py | ||
| h20_e2e_report.sh | ||
| h20_engram_check.py | ||
| h20_expert_weight_check.py | ||
| h20_index_decode_check.py | ||
| h20_kv_roundtrip.py | ||
| h20_ops_ab.py | ||
| h20_philox_check.py | ||
| h20_quant_check.py | ||
| h20_real_requant_check.py | ||
| h20_recipe_probe.py | ||
| h20_rng_dump.py | ||
| h20_smoke_check.py | ||
| h20_state_check.py | ||
| h20_topk_check.py | ||
| ref_layer_dump.py | ||
| ref_next_token.py | ||
| setup_flagtree_image.sh | ||
| verify_tile_kernels_patch.py | ||