6 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
zhaozhuoliang	0e36d808b5	perf: decouple the Engram buffer size from max_num_batched_tokens ... The number of RDMA QPs DeepEP allocates for the Engram buffer is derived from its max_num_tokens, which in turn comes from max_num_batched_tokens (model_loader.py). Raising the QP count therefore required raising the global batched-token budget, which also inflates the EP/MoE/CP buffers. Add DEEPINFER_ENGRAM_MIN_PREFILLING_TOKENS as a lower bound applied only to the Engram buffer, so a deployment can give Engram more QPs without resizing the other buffers. Default 0 keeps the current behavior.	2026-10-27 20:37:03 +08:00
Inference_	553741557a	fix: validate boolean environment variables with strict parsing (#218)	2026-10-25 19:59:27 +08:00
Shaoyuan CHEN	9bd9cf243f	Bump DeepEP to f6aa38fe and drop the SSH->HTTPS rewrite (#157) ... DeepEP now records an HTTPS DeepJIT URL, so build_vendor no longer needs the git@github.com rewrite. Co-authored-by: Shaoyuan Chen <chensy@deepseek.com>	2026-10-21 12:55:43 +08:00
hkeee21	774ce244b8	update Q&A EN doc	2026-10-20 19:03:13 +08:00
Jiashi Li	8b16149741	update Q&A documentation	2026-10-20 17:06:57 +08:00
Jiashi Li	d585e6542c	initial commit	2026-10-20 12:09:42 +08:00