loopyt fd96b77e53 feat(triton): port fused_transform, compress, prepare_v4 and both metadata kernels ... Four more kernels, and with them the non-speculative path no longer touches TileLang: - `fused_norm_rope_hadamard_cast_store_kvcache` -- all the forms the engine builds: bf16 out, bf16 out after dequantising (cast_back), quantised out with scales, and the main/index KV-cache write with a bf16 stage of `norm`. 18 cases. - `compress_and_update_state_{prefill,decode}` -- the ring-cache state machine, two launches each. - `prepare_v4_decode_metadata` -- one program per sequence, every output including the ratio-bucketed ones. Details that were not obvious and are now pinned by cases: RoPE pairs differ per layout: interleaved pairs `(2k, 2k+1)`, Neox pairs `(k, k + rotary/2)`. Both reduce to "is this the first element of its pair" plus a partner offset, so the lane vector is gathered once with `tl.gather` instead of two code paths. That also fixed a real bug: the first version paired adjacent lanes for both layouts, which is only correct for interleaved. `bf16_stage="norm"` means the post-normalisation *pre-RoPE* row -- the indexer consumes it. It has to be stored before the rotation overwrites the row; storing it afterwards produced a wrong value only when RoPE was enabled, which is exactly the case the engine uses. Scales come in two storages for the same rounded power-of-two value: a ue8m0 byte for the main KV, an fp32 for the index KV. Both are now covered, in the standalone output and in the cache write. `compress` needed its tail-copy grid bounded by the *query token* count, not the compressed-row count; and `_enable_fast_math` mutates `pass_configs` on the factory, a TileLang concept, so the Triton factories expose an inert dict to keep that call working. Several case bugs of the same shape were found and fixed along the way -- a sentinel that was never required to be overwritten, a `total_q` that did not match the actual prefix sum, two tokens mapped to one cache slot or one state slot so the winner depended on CTA order. Each of them made the two backends agree for the wrong reason, which is worth more than the kernels themselves: a comparison that can pass without testing anything is worse than no comparison.		2026-10-22 07:47:24 +08:00
..
ab_cases.py	feat(triton): port fused_transform, compress, prepare_v4 and both metadata kernels	2026-10-22 07:47:24 +08:00
build_vendor.sh	initial commit	2026-10-20 12:09:42 +08:00
build.sh	initial commit	2026-10-20 12:09:42 +08:00
compare_layers.py	fix(sm90): expand expert scales on the contraction axis only	2026-10-21 16:50:31 +08:00
format_csrc.sh	initial commit	2026-10-20 12:09:42 +08:00
gen_stub.sh	initial commit	2026-10-20 12:09:42 +08:00
h20_ask.py	style(sm90): satisfy ruff and add the missing type annotations	2026-10-21 17:09:08 +08:00
h20_attn_check.py	style(sm90): satisfy ruff and add the missing type annotations	2026-10-21 17:09:08 +08:00
h20_engram_check.py	style(sm90): satisfy ruff and add the missing type annotations	2026-10-21 17:09:08 +08:00
h20_expert_weight_check.py	style(sm90): satisfy ruff and add the missing type annotations	2026-10-21 17:09:08 +08:00
h20_index_decode_check.py	test(sm90): rule out the KV cache and the decode indexer	2026-10-21 20:02:19 +08:00
h20_kv_roundtrip.py	test(sm90): rule out the KV cache and the decode indexer	2026-10-21 20:02:19 +08:00
h20_ops_ab.py	feat(triton): complete P1 with norm, lookup and metadata kernels	2026-10-22 00:28:38 +08:00
h20_quant_check.py	test(sm90): decode FP4 by table lookup in the quant check	2026-10-21 17:15:16 +08:00
h20_real_requant_check.py	style(sm90): satisfy ruff and add the missing type annotations	2026-10-21 17:09:08 +08:00
h20_recipe_probe.py	debug: capture final logits, and keep the profile forward out of the dumps	2026-10-21 17:44:21 +08:00
h20_smoke_check.py	style(sm90): satisfy ruff and add the missing type annotations	2026-10-21 17:09:08 +08:00
h20_topk_check.py	style(sm90): satisfy ruff and add the missing type annotations	2026-10-21 17:09:08 +08:00
ref_layer_dump.py	debug: capture final logits, and keep the profile forward out of the dumps	2026-10-21 17:44:21 +08:00
ref_next_token.py	debug: per-step decode dumps, and prove the flip is decode-only	2026-10-21 19:07:49 +08:00