Jiejing 57f206a8d5 engine: expose Scheduler.add_prompted_sequence and free_finished_seqs ... Two bindings a prefill/decode split needs from the scheduler: - add_prompted_sequence(seq): put a sequence whose KV blocks and state were filled by the caller (received from a prompt-only engine) straight into the prompted queue, without cloning. The sequence holds prompt + first generated token, with everything but the last token computed; the checks assert that layout. - free_finished_seqs(): expose the existing helper that moves finished sequences out of running and returns them without freeing blocks or state, so a prompt-only engine can export the prefilled KV first and free the sequence itself afterwards. No scheduling behaviour changes for engines that do not call them. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01LFPG29daR1FhchJBTjiEKr		2026-10-21 22:26:29 +00:00
..
_C	engine: expose Scheduler.add_prompted_sequence and free_finished_seqs	2026-10-21 22:26:29 +00:00
distributed	initial commit	2026-10-20 12:09:42 +08:00
engine	initial commit	2026-10-20 12:09:42 +08:00
entrypoints	initial commit	2026-10-20 12:09:42 +08:00
hicache	hicache: type annotations for ruff ANN rules	2026-10-21 22:26:29 +00:00
hugging_face	initial commit	2026-10-20 12:09:42 +08:00
model_executor	initial commit	2026-10-20 12:09:42 +08:00
npu_ops	initial commit	2026-10-20 12:09:42 +08:00
structure_output	initial commit	2026-10-20 12:09:42 +08:00
ve	initial commit	2026-10-20 12:09:42 +08:00
worker	initial commit	2026-10-20 12:09:42 +08:00
__init__.py	initial commit	2026-10-20 12:09:42 +08:00
attrdict.py	initial commit	2026-10-20 12:09:42 +08:00
config.py	initial commit	2026-10-20 12:09:42 +08:00
environ.py	initial commit	2026-10-20 12:09:42 +08:00
load_class.py	initial commit	2026-10-20 12:09:42 +08:00
logger.py	initial commit	2026-10-20 12:09:42 +08:00
model_config_loader.py	initial commit	2026-10-20 12:09:42 +08:00
multimodal_tokens.py	initial commit	2026-10-20 12:09:42 +08:00
platform.py	initial commit	2026-10-20 12:09:42 +08:00
py.typed	initial commit	2026-10-20 12:09:42 +08:00
sampling_params.py	initial commit	2026-10-20 12:09:42 +08:00
sequence.py	initial commit	2026-10-20 12:09:42 +08:00
shared_memory.py	initial commit	2026-10-20 12:09:42 +08:00
testing.py	initial commit	2026-10-20 12:09:42 +08:00
timer.py	initial commit	2026-10-20 12:09:42 +08:00
utils.py	initial commit	2026-10-20 12:09:42 +08:00