w_wangchi bf92779eaa fix: fail loudly on per-prompt list length mismatch in generate()
generate() silently misaligned results[i] with prompts[i] when
sampling_params / multi_modal_data list lengths did not match the number
of prompts: extra entries were silently dropped, missing entries raised
an uninformative IndexError, and a bare multi_modal_data dict paired with
several prompts raised an obscure TypeError/KeyError deep inside the
request loop.

Now the mismatches raise a clear ValueError up front (matching vLLM
upstream behavior), and a bare multi_modal_data dict is only accepted
for a single prompt. Also fixes the hidden nesting bug where a str
prompt + list multi_modal_data became [[...]].
2026-10-28 17:24:50 +08:00
..
distributed initial commit 2026-10-20 12:09:42 +08:00
engine initial commit 2026-10-20 12:09:42 +08:00
entrypoints fix: fail loudly on per-prompt list length mismatch in generate() 2026-10-28 17:24:50 +08:00
models initial commit 2026-10-20 12:09:42 +08:00
ve initial commit 2026-10-20 12:09:42 +08:00
worker initial commit 2026-10-20 12:09:42 +08:00
__init__.py initial commit 2026-10-20 12:09:42 +08:00
conftest.py initial commit 2026-10-20 12:09:42 +08:00
test_cuda_sync_guards.py initial commit 2026-10-20 12:09:42 +08:00