zhaozhuoliang 0e36d808b5 perf: decouple the Engram buffer size from max_num_batched_tokens ... The number of RDMA QPs DeepEP allocates for the Engram buffer is derived from its max_num_tokens, which in turn comes from max_num_batched_tokens (model_loader.py). Raising the QP count therefore required raising the global batched-token budget, which also inflates the EP/MoE/CP buffers. Add DEEPINFER_ENGRAM_MIN_PREFILLING_TOKENS as a lower bound applied only to the Engram buffer, so a deployment can give Engram more QPs without resizing the other buffers. Default 0 keeps the current behavior.		2026-10-27 20:37:03 +08:00
..
__init__.py	initial commit	2026-10-20 12:09:42 +08:00
attn.py	initial commit	2026-10-20 12:09:42 +08:00
builder.py	initial commit	2026-10-20 12:09:42 +08:00
compress.py	initial commit	2026-10-20 12:09:42 +08:00
containers.py	initial commit	2026-10-20 12:09:42 +08:00
cross_layer.py	initial commit	2026-10-20 12:09:42 +08:00
engram_metadata.py	initial commit	2026-10-20 12:09:42 +08:00
engram_parameters.py	initial commit	2026-10-20 12:09:42 +08:00
engram.py	perf: decouple the Engram buffer size from max_num_batched_tokens	2026-10-27 20:37:03 +08:00
hc_blocks.py	initial commit	2026-10-20 12:09:42 +08:00
hc_lazy.py	initial commit	2026-10-20 12:09:42 +08:00
hc.py	initial commit	2026-10-20 12:09:42 +08:00
heads.py	initial commit	2026-10-20 12:09:42 +08:00
index_attn.py	initial commit	2026-10-20 12:09:42 +08:00
linear.py	initial commit	2026-10-20 12:09:42 +08:00
mhc_modeling.py	initial commit	2026-10-20 12:09:42 +08:00
mhc_ops.py	initial commit	2026-10-20 12:09:42 +08:00
mla_attn.py	initial commit	2026-10-20 12:09:42 +08:00
mlp.py	initial commit	2026-10-20 12:09:42 +08:00
moe.py	initial commit	2026-10-20 12:09:42 +08:00
norm.py	initial commit	2026-10-20 12:09:42 +08:00
rope.py	initial commit	2026-10-20 12:09:42 +08:00
utils.py	initial commit	2026-10-20 12:09:42 +08:00
yoco.py	initial commit	2026-10-20 12:09:42 +08:00