loopyt 283ff893d5 debug: capture final logits, and keep the profile forward out of the dumps ... Comparing final logits was impossible before: `ref_layer_dump.py` read `logits[0, -1]`, but the head already collapsed the sequence axis (`x = x[:, -1]`), so logits are `[b, vocab]` and that index silently stored a 0-dimensional scalar. Every earlier dump had an unusable `final_row_logits`. With that fixed, the comparison reframes the remaining drift. On the same 14 tokens: prefill top-1 = 6127 (北京) margin(6127 - 666) = +0.256 reference top-1 = 6127 (北京) margin = +3.112 Our prefill picks the right token; the error only compresses the margin, by ~12x. But the end-to-end run, which reaches that context via decode steps, picks 666 (`**`) instead. Same context, different path, different answer -- so the remaining drift is in **decode**, not in the per-128 quantization. The quantization floor is still 2.7e-2 and still irreducible (`H20-DRIFT-ANALYSIS.md` has the DeepGEMM assertion that forces `gran_k == 128` on SM90), but it is not what flips the token. Two traps had to be handled to get numbers that mean anything: - `execute_model_profile_run` runs a full forward + sampler on synthetic tokens. The layer dumps were filtered by their prompt-length gate; logits are not, because their row count is the number of *selected* tokens (1). The first attempt captured that step and produced cos = 0.34. `debug_dump.profiling()` now suspends capture for the whole profile step. - With `max_tokens=1` both a prompt and a decode step run, and only the prompt one is comparable with a prefill-only reference. They are dumped as `logits_prompt` / `logits_decode`. Also re-runs the layer comparison now that the expert-scale fix has landed: layer 0 went from 1.27e-1 to 2.88e-2 and layer 39 sits at 2.00e-1, so the error curve flattened by an order of magnitude.		2026-10-21 17:44:21 +08:00
..
build_vendor.sh	initial commit	2026-10-20 12:09:42 +08:00
build.sh	initial commit	2026-10-20 12:09:42 +08:00
compare_layers.py	fix(sm90): expand expert scales on the contraction axis only	2026-10-21 16:50:31 +08:00
format_csrc.sh	initial commit	2026-10-20 12:09:42 +08:00
gen_stub.sh	initial commit	2026-10-20 12:09:42 +08:00
h20_ask.py	style(sm90): satisfy ruff and add the missing type annotations	2026-10-21 17:09:08 +08:00
h20_attn_check.py	style(sm90): satisfy ruff and add the missing type annotations	2026-10-21 17:09:08 +08:00
h20_engram_check.py	style(sm90): satisfy ruff and add the missing type annotations	2026-10-21 17:09:08 +08:00
h20_expert_weight_check.py	style(sm90): satisfy ruff and add the missing type annotations	2026-10-21 17:09:08 +08:00
h20_quant_check.py	test(sm90): decode FP4 by table lookup in the quant check	2026-10-21 17:15:16 +08:00
h20_real_requant_check.py	style(sm90): satisfy ruff and add the missing type annotations	2026-10-21 17:09:08 +08:00
h20_recipe_probe.py	debug: capture final logits, and keep the profile forward out of the dumps	2026-10-21 17:44:21 +08:00
h20_smoke_check.py	style(sm90): satisfy ruff and add the missing type annotations	2026-10-21 17:09:08 +08:00
h20_topk_check.py	style(sm90): satisfy ruff and add the missing type annotations	2026-10-21 17:09:08 +08:00
ref_layer_dump.py	debug: capture final logits, and keep the profile forward out of the dumps	2026-10-21 17:44:21 +08:00
ref_next_token.py	style(sm90): satisfy ruff and add the missing type annotations	2026-10-21 17:09:08 +08:00