whn09 3657e00592 hicache L3: circuit breaker for Store transfer failures, TCP queue limits for Mooncake <= 0.3.13 ... A Store transfer that cannot complete blocks for Mooncake's fixed 60 s timeout. Open a breaker on the first transfer failure or a get slower than DEEPINFER_HICACHE_L3_SLOW_S (5 s); while open, skip reads and drop queued puts; close after DEEPINFER_HICACHE_L3_COOLDOWN_S (30 s, doubling on consecutive trips, capped at 10 min). Mooncake <= 0.3.13 queues at most 1024 TCP transfers per peer, fewer than one long prompt's batch put; default MC_TCP_MAX_QUEUED_TRANSFERS_PER_PEER / MC_TCP_MAX_PENDING_ADMISSIONS_PER_PEER to 65535 (the default since kvcache-ai/Mooncake#3710) unless set. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>		2026-10-23 21:56:26 +08:00
..
test_host_cache_l3.py	hicache L3: circuit breaker for Store transfer failures, TCP queue limits for Mooncake <= 0.3.13	2026-10-23 21:56:26 +08:00
test_host_cache.py	Add a host-memory prefix cache (HiCache-style) for the offline engine	2026-10-21 03:10:50 +00:00