w_lihongyan f03f3b0899 fix: raise when the engine rejects a request in LLM.generate
add_request() returns None when it drops a request with invalid token
ids, but LLM._add_request() ignored the return value, so generate()
could return fewer results than the input prompts — silently misaligning
results[i] with prompts[i]. Fail loudly with a clear error instead.

Co-Authored-By: Kscc <noreply@owtffssent.com>
2026-10-27 11:30:43 +08:00
..
_C initial commit 2026-10-20 12:09:42 +08:00
distributed initial commit 2026-10-20 12:09:42 +08:00
engine initial commit 2026-10-20 12:09:42 +08:00
entrypoints fix: raise when the engine rejects a request in LLM.generate 2026-10-27 11:30:43 +08:00
hugging_face initial commit 2026-10-20 12:09:42 +08:00
model_executor initial commit 2026-10-20 12:09:42 +08:00
npu_ops initial commit 2026-10-20 12:09:42 +08:00
structure_output initial commit 2026-10-20 12:09:42 +08:00
ve initial commit 2026-10-20 12:09:42 +08:00
worker initial commit 2026-10-20 12:09:42 +08:00
__init__.py initial commit 2026-10-20 12:09:42 +08:00
attrdict.py initial commit 2026-10-20 12:09:42 +08:00
config.py initial commit 2026-10-20 12:09:42 +08:00
environ.py fix: validate boolean environment variables with strict parsing (#218) 2026-10-25 19:59:27 +08:00
load_class.py initial commit 2026-10-20 12:09:42 +08:00
logger.py initial commit 2026-10-20 12:09:42 +08:00
model_config_loader.py initial commit 2026-10-20 12:09:42 +08:00
multimodal_tokens.py initial commit 2026-10-20 12:09:42 +08:00
platform.py initial commit 2026-10-20 12:09:42 +08:00
py.typed initial commit 2026-10-20 12:09:42 +08:00
sampling_params.py initial commit 2026-10-20 12:09:42 +08:00
sequence.py initial commit 2026-10-20 12:09:42 +08:00
shared_memory.py initial commit 2026-10-20 12:09:42 +08:00
testing.py initial commit 2026-10-20 12:09:42 +08:00
timer.py initial commit 2026-10-20 12:09:42 +08:00
utils.py initial commit 2026-10-20 12:09:42 +08:00