mirror of
https://github.com/deepseek-ai/DeepInfer.git
synced 2026-10-29 23:37:28 +08:00
add_request() returns None when it drops a request with invalid token ids, but LLM._add_request() ignored the return value, so generate() could return fewer results than the input prompts — silently misaligning results[i] with prompts[i]. Fail loudly with a clear error instead. Co-Authored-By: Kscc <noreply@owtffssent.com> |
||
|---|---|---|
| .. | ||
| test_llm_add_request.py | ||