loopyt 4f3edbf604 feat(triton): complete P1 with norm, lookup and metadata kernels ... norm, map_lookup, expand_sampling_params, prepare_verification_metadata, copy_block_tables. Plus the measured parameterisation that made the port tractable: `DEEPINFER_TRACE_KERNEL_ARGS=1` records each factory's construction arguments, which showed that e.g. `norm_tl` is only ever built as one combination on this path (d=5120, bf16 source, fp8 out, per-128 fp32 scales, col-major, round_sf, no residual) rather than the dozen the signature allows. Three findings worth keeping: `norm` has to round the fp32 normalised value back to bf16 *before* computing the per-block amax and the scale. That is what makes its fp8 output bit-identical to quantising the bf16 result separately, which is how the engine defines the reference. Without it the fp8 bytes scatter by an ulp wherever a value lands on a rounding boundary -- which looked like a scale bug at first (224 vs 240) and was not. With `round_sf=True`, which is the production setting, fp8 output and every scale factor come out byte-identical. With `round_sf=False` 240 of 327680 bytes differ by one ulp, because `amax/448` depends on the order of a 5120-element reduction and two compilers will not agree on that order. For the same reason the bf16 output differs on 10 of 655360 elements by one ulp. Both are documented, and the A/B harness now picks its tolerance from the dtype instead of one global pair. `map_lookup` resolves duplicate keys by taking the last match, not the maximum: the TileLang kernel overwrites on every hit while its own Python reference uses `max`, and the two agree only when keys are unique. Top-k indices always are, so the Triton version matches the kernel -- and the case generator now produces unique keys, with a comment saying why. 13 kernels and 53 cases now agree with the baseline.		2026-10-22 00:28:38 +08:00
..
_C	initial commit	2026-10-20 12:09:42 +08:00
distributed	initial commit	2026-10-20 12:09:42 +08:00
engine	initial commit	2026-10-20 12:09:42 +08:00
entrypoints	initial commit	2026-10-20 12:09:42 +08:00
h20_ops	fix(debug): move debug_dump out of h20_ops so other platforms can import it	2026-10-21 22:37:49 +08:00
hugging_face	style(sm90): satisfy ruff and add the missing type annotations	2026-10-21 17:09:08 +08:00
model_executor	feat(triton): complete P1 with norm, lookup and metadata kernels	2026-10-22 00:28:38 +08:00
npu_ops	feat: add SM90 (Hopper) support for DeepSeek-V4.1 inference	2026-10-21 15:18:56 +08:00
structure_output	initial commit	2026-10-20 12:09:42 +08:00
ve	initial commit	2026-10-20 12:09:42 +08:00
worker	fix(debug): move debug_dump out of h20_ops so other platforms can import it	2026-10-21 22:37:49 +08:00
__init__.py	initial commit	2026-10-20 12:09:42 +08:00
attrdict.py	initial commit	2026-10-20 12:09:42 +08:00
config.py	initial commit	2026-10-20 12:09:42 +08:00
debug_dump.py	fix(debug): move debug_dump out of h20_ops so other platforms can import it	2026-10-21 22:37:49 +08:00
environ.py	initial commit	2026-10-20 12:09:42 +08:00
load_class.py	initial commit	2026-10-20 12:09:42 +08:00
logger.py	initial commit	2026-10-20 12:09:42 +08:00
model_config_loader.py	initial commit	2026-10-20 12:09:42 +08:00
multimodal_tokens.py	initial commit	2026-10-20 12:09:42 +08:00
platform.py	feat: add SM90 (Hopper) support for DeepSeek-V4.1 inference	2026-10-21 15:18:56 +08:00
py.typed	initial commit	2026-10-20 12:09:42 +08:00
sampling_params.py	initial commit	2026-10-20 12:09:42 +08:00
sequence.py	initial commit	2026-10-20 12:09:42 +08:00
shared_memory.py	initial commit	2026-10-20 12:09:42 +08:00
testing.py	initial commit	2026-10-20 12:09:42 +08:00
timer.py	initial commit	2026-10-20 12:09:42 +08:00
utils.py	initial commit	2026-10-20 12:09:42 +08:00