loopyt 615664e772 fix(triton): delegate the sampler's verify variant instead of asserting ... With MTP on (the default), the sampler is built with rejection sampling for the draft-verification rows, which this backend does not implement. It asserted, so the whole MTP path failed with the triton backend even though 16 of its 20 kernels were ported. It now hands that variant to the default backend and says so once. That is a deliberate delegation rather than a silent fallback: `fused_sample` is exported by this module, so the per-kernel `_FallbackNotice` cannot cover it, and the note has to come from the factory. Verified both ways on 8xH20, same tokens as the pure TileLang run either way: MTP off 20/20 kernels Triton, no fallback notice at all MTP on 16/20 kernels Triton, and exactly five notices -- the four unported MTP kernels plus this delegation, with nothing unaccounted for The remaining MTP work is `remap_draft_topk`, `get_accept_result`, `finalize_verification`, `get_fused_dflash_get_input`, and this rejection variant.		2026-10-22 09:10:45 +08:00
..
_C	initial commit	2026-10-20 12:09:42 +08:00
distributed	initial commit	2026-10-20 12:09:42 +08:00
engine	initial commit	2026-10-20 12:09:42 +08:00
entrypoints	initial commit	2026-10-20 12:09:42 +08:00
h20_ops	fix(debug): move debug_dump out of h20_ops so other platforms can import it	2026-10-21 22:37:49 +08:00
hugging_face	style(sm90): satisfy ruff and add the missing type annotations	2026-10-21 17:09:08 +08:00
model_executor	fix(triton): delegate the sampler's verify variant instead of asserting	2026-10-22 09:10:45 +08:00
npu_ops	feat: add SM90 (Hopper) support for DeepSeek-V4.1 inference	2026-10-21 15:18:56 +08:00
structure_output	initial commit	2026-10-20 12:09:42 +08:00
ve	initial commit	2026-10-20 12:09:42 +08:00
worker	fix(debug): move debug_dump out of h20_ops so other platforms can import it	2026-10-21 22:37:49 +08:00
__init__.py	initial commit	2026-10-20 12:09:42 +08:00
attrdict.py	initial commit	2026-10-20 12:09:42 +08:00
config.py	initial commit	2026-10-20 12:09:42 +08:00
debug_dump.py	fix(debug): move debug_dump out of h20_ops so other platforms can import it	2026-10-21 22:37:49 +08:00
environ.py	initial commit	2026-10-20 12:09:42 +08:00
load_class.py	initial commit	2026-10-20 12:09:42 +08:00
logger.py	initial commit	2026-10-20 12:09:42 +08:00
model_config_loader.py	initial commit	2026-10-20 12:09:42 +08:00
multimodal_tokens.py	initial commit	2026-10-20 12:09:42 +08:00
platform.py	feat: add SM90 (Hopper) support for DeepSeek-V4.1 inference	2026-10-21 15:18:56 +08:00
py.typed	initial commit	2026-10-20 12:09:42 +08:00
sampling_params.py	initial commit	2026-10-20 12:09:42 +08:00
sequence.py	initial commit	2026-10-20 12:09:42 +08:00
shared_memory.py	initial commit	2026-10-20 12:09:42 +08:00
testing.py	initial commit	2026-10-20 12:09:42 +08:00
timer.py	initial commit	2026-10-20 12:09:42 +08:00
utils.py	initial commit	2026-10-20 12:09:42 +08:00