loopyt 07229fab31 feat(triton): start on the MTP path with three draft kernels ... compute_seqlens_k_zos, confidence_head_fused and dflash_input_store, all identical to the baseline: 15 cases across the three. `compute_seqlens_k_zos` masks the remap lookup rather than clamping it: `-1` marks a fresh request, and an unmasked `PREV_ACCEPTED + (-1)` would read the element before the buffer. `confidence_head_fused` reads the weight as one flat vector and splits it at `n_embed`, so the hidden and Markov halves are one accumulation instead of two passes. Without a Markov embedding the second pointer is filled with the first tensor rather than left null, since the read is compiled out but the argument still has to be a pointer. The scaled logit is clamped to +-60 before the sigmoid, as the baseline does, so a small temperature cannot produce inf through `exp`. `dflash_input_store` accumulates in fp32 even though both sides are bf16: the baseline sums into an fp32 fragment, and a bf16 accumulator would round differently for hc_mult > 1. One trap: `tl.next_power_of_2` inside a kernel body is not a compile-time constant, so the Markov block size is resolved in the factory and passed as a constexpr.		2026-10-22 09:02:22 +08:00
..
ab_cases.py	feat(triton): start on the MTP path with three draft kernels	2026-10-22 09:02:22 +08:00
build_vendor.sh	initial commit	2026-10-20 12:09:42 +08:00
build.sh	initial commit	2026-10-20 12:09:42 +08:00
compare_layers.py	fix(sm90): expand expert scales on the contraction axis only	2026-10-21 16:50:31 +08:00
format_csrc.sh	initial commit	2026-10-20 12:09:42 +08:00
gen_stub.sh	initial commit	2026-10-20 12:09:42 +08:00
h20_ask.py	style(sm90): satisfy ruff and add the missing type annotations	2026-10-21 17:09:08 +08:00
h20_attn_check.py	style(sm90): satisfy ruff and add the missing type annotations	2026-10-21 17:09:08 +08:00
h20_engram_check.py	style(sm90): satisfy ruff and add the missing type annotations	2026-10-21 17:09:08 +08:00
h20_expert_weight_check.py	style(sm90): satisfy ruff and add the missing type annotations	2026-10-21 17:09:08 +08:00
h20_index_decode_check.py	test(sm90): rule out the KV cache and the decode indexer	2026-10-21 20:02:19 +08:00
h20_kv_roundtrip.py	test(sm90): rule out the KV cache and the decode indexer	2026-10-21 20:02:19 +08:00
h20_ops_ab.py	feat(triton): port the sampler, bit-exact on the draw and honest about the rest	2026-10-22 08:55:10 +08:00
h20_philox_check.py	feat(triton): reproduce cuRAND's Philox stream, so the sampler can be ported	2026-10-22 08:37:08 +08:00
h20_quant_check.py	test(sm90): decode FP4 by table lookup in the quant check	2026-10-21 17:15:16 +08:00
h20_real_requant_check.py	style(sm90): satisfy ruff and add the missing type annotations	2026-10-21 17:09:08 +08:00
h20_recipe_probe.py	debug: capture final logits, and keep the profile forward out of the dumps	2026-10-21 17:44:21 +08:00
h20_rng_dump.py	feat(triton): reproduce cuRAND's Philox stream, so the sampler can be ported	2026-10-22 08:37:08 +08:00
h20_smoke_check.py	style(sm90): satisfy ruff and add the missing type annotations	2026-10-21 17:09:08 +08:00
h20_topk_check.py	style(sm90): satisfy ruff and add the missing type annotations	2026-10-21 17:09:08 +08:00
ref_layer_dump.py	debug: capture final logits, and keep the profile forward out of the dumps	2026-10-21 17:44:21 +08:00
ref_next_token.py	debug: per-step decode dumps, and prove the flip is decode-only	2026-10-21 19:07:49 +08:00