whn09 ab74c46389 neuron: dense prefill attention over small KV tables and prefill table bounds (both opt-in / dormant by default) ... _dense_attention matches gathered_attn_idx to ~1 bf16 ulp (same error vs an fp64 reference). It only applies to tables <= DEEPINFER_NEURON_DENSE_ATTN_MAX_KV rows, which a prefill chunk's whole-pool table exceeds; bounding that table (DEEPINFER_NEURON_PREFILL_TABLE_BOUNDS) went through the compacting gather and doubled TTFT, so it is off. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>		2026-10-27 14:11:06 +08:00
..
__init__.py	initial commit	2026-10-20 12:09:42 +08:00
base.py	neuron: sampling flags per request batch, NUMA-local CPU binding, sync/op-site tracing	2026-10-26 19:04:53 +08:00
cache_engine.py	Neuron: separate state regions, chunk-wide indexer context (issue #26)	2026-10-23 03:46:56 +08:00
cuda_graph_runner.py	initial commit	2026-10-20 12:09:42 +08:00
decode_perf_cache.py	initial commit	2026-10-20 12:09:42 +08:00
dflash_cuda_graph_runner.py	initial commit	2026-10-20 12:09:42 +08:00
model_runner.py	neuron: sampling flags per request batch, NUMA-local CPU binding, sync/op-site tracing	2026-10-26 19:04:53 +08:00
neuron_graph_runner.py	neuron: dense prefill attention over small KV tables and prefill table bounds (both opt-in / dormant by default)	2026-10-27 14:11:06 +08:00
runtime_config.py	initial commit	2026-10-20 12:09:42 +08:00
worker.py	initial commit	2026-10-20 12:09:42 +08:00
zos_status.py	initial commit	2026-10-20 12:09:42 +08:00