Jiejing 57f206a8d5 engine: expose Scheduler.add_prompted_sequence and free_finished_seqs ... Two bindings a prefill/decode split needs from the scheduler: - add_prompted_sequence(seq): put a sequence whose KV blocks and state were filled by the caller (received from a prompt-only engine) straight into the prompted queue, without cloning. The sequence holds prompt + first generated token, with everything but the last token computed; the checks assert that layout. - free_finished_seqs(): expose the existing helper that moves finished sequences out of running and returns them without freeing blocks or state, so a prompt-only engine can export the prefilled KV first and free the sequence itself afterwards. No scheduling behaviour changes for engines that do not call them. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01LFPG29daR1FhchJBTjiEKr		2026-10-21 22:26:29 +00:00
..
input_metadata	initial commit	2026-10-20 12:09:42 +08:00
block_manager.hpp	initial commit	2026-10-20 12:09:42 +08:00
flops_estimator.hpp	initial commit	2026-10-20 12:09:42 +08:00
mtp_varlen.hpp	initial commit	2026-10-20 12:09:42 +08:00
outputs.hpp	initial commit	2026-10-20 12:09:42 +08:00
prepare_sample.cpp	initial commit	2026-10-20 12:09:42 +08:00
prepare_sample.hpp	initial commit	2026-10-20 12:09:42 +08:00
process_output.hpp	initial commit	2026-10-20 12:09:42 +08:00
pybind_output.cpp	initial commit	2026-10-20 12:09:42 +08:00
pybind_scheduler.cpp	engine: expose Scheduler.add_prompted_sequence and free_finished_seqs	2026-10-21 22:26:29 +00:00
pybind_sequence.cpp	Add a host-memory prefix cache (HiCache-style) for the offline engine	2026-10-21 22:26:29 +00:00
pybind.cpp	initial commit	2026-10-20 12:09:42 +08:00
pybind.hpp	initial commit	2026-10-20 12:09:42 +08:00
scheduler.hpp	engine: expose Scheduler.add_prompted_sequence and free_finished_seqs	2026-10-21 22:26:29 +00:00
sequence.hpp	initial commit	2026-10-20 12:09:42 +08:00
utils.hpp	initial commit	2026-10-20 12:09:42 +08:00
zos.cpp	initial commit	2026-10-20 12:09:42 +08:00
zos.hpp	initial commit	2026-10-20 12:09:42 +08:00