whn09 625606db4e hicache L3: retry failed Store objects once before tripping the breaker ... Sporadic EFA transfer errors (~0.015% of puts with Mooncake 83f8f877) tripped the breaker on the first failure and dropped every queued put for 30 s. Retry the failed objects once (puts and gets); only a failure that persists counts and trips the breaker. New counters: l3_put_retried, l3_get_retried. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>		2026-10-26 19:23:33 +08:00
..
_C	Add a host-memory prefix cache (HiCache-style) for the offline engine	2026-10-21 03:10:50 +00:00
distributed	initial commit	2026-10-20 12:09:42 +08:00
engine	initial commit	2026-10-20 12:09:42 +08:00
entrypoints	initial commit	2026-10-20 12:09:42 +08:00
hicache	hicache L3: retry failed Store objects once before tripping the breaker	2026-10-26 19:23:33 +08:00
hugging_face	initial commit	2026-10-20 12:09:42 +08:00
model_executor	initial commit	2026-10-20 12:09:42 +08:00
npu_ops	initial commit	2026-10-20 12:09:42 +08:00
structure_output	initial commit	2026-10-20 12:09:42 +08:00
ve	initial commit	2026-10-20 12:09:42 +08:00
worker	initial commit	2026-10-20 12:09:42 +08:00
__init__.py	initial commit	2026-10-20 12:09:42 +08:00
attrdict.py	initial commit	2026-10-20 12:09:42 +08:00
config.py	initial commit	2026-10-20 12:09:42 +08:00
environ.py	initial commit	2026-10-20 12:09:42 +08:00
load_class.py	initial commit	2026-10-20 12:09:42 +08:00
logger.py	initial commit	2026-10-20 12:09:42 +08:00
model_config_loader.py	initial commit	2026-10-20 12:09:42 +08:00
multimodal_tokens.py	initial commit	2026-10-20 12:09:42 +08:00
platform.py	initial commit	2026-10-20 12:09:42 +08:00
py.typed	initial commit	2026-10-20 12:09:42 +08:00
sampling_params.py	initial commit	2026-10-20 12:09:42 +08:00
sequence.py	initial commit	2026-10-20 12:09:42 +08:00
shared_memory.py	initial commit	2026-10-20 12:09:42 +08:00
testing.py	initial commit	2026-10-20 12:09:42 +08:00
timer.py	initial commit	2026-10-20 12:09:42 +08:00
utils.py	initial commit	2026-10-20 12:09:42 +08:00