mirror of
https://github.com/deepseek-ai/DeepInfer.git
synced 2026-10-30 07:47:10 +08:00
add_request() returns None when it drops a request with invalid token ids, but LLM._add_request() ignored the return value, so generate() could return fewer results than the input prompts — silently misaligning results[i] with prompts[i]. Fail loudly with a clear error instead. Co-Authored-By: Kscc <noreply@owtffssent.com> |
||
|---|---|---|
| .. | ||
| distributed | ||
| engine | ||
| entrypoints | ||
| models | ||
| ve | ||
| worker | ||
| __init__.py | ||
| conftest.py | ||
| test_cuda_sync_guards.py | ||