whn09 b2d94e16b2 Neuron DSpark (#15): greedy verification and MTP ops, CP followers run the drafts ... - fused_sample reject mode for greedy rows (accept iff the draft is the argmax), get_accept_result / finalize_verification (static final rows), store_mtp_info (static pool writes, slot 0 kept), confidence_head_fused, dflash_input_store, get_fused_dflash_get_input: the frontend refs with the kernels' argument lists. - CP followers run the draft forward (its MoE has collectives); the driver's accepted offsets reach them through one all-reduce on Neuron (no eager broadcast), the request first rows through the graph metadata. - run_deepinfer_tiny.py --nextn: free-running greedy with drafts. Host tiny, nextn=5, eager: short 9/9 golden tokens; long matches up to its known near tie at step 5. - bench17: the two-level MoE all-reduce does not move TPOT (433 ms). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>		2026-10-24 11:31:59 +08:00
..
__init__.py	initial commit	2026-10-20 12:09:42 +08:00
dflash.py	Neuron DSpark (#15): greedy verification and MTP ops, CP followers run the drafts	2026-10-24 11:31:59 +08:00