mirror of
https://github.com/deepseek-ai/DeepInfer.git
synced 2026-11-01 09:16:20 +08:00
generate() silently misaligned results[i] with prompts[i] when sampling_params / multi_modal_data list lengths did not match the number of prompts: extra entries were silently dropped, missing entries raised an uninformative IndexError, and a bare multi_modal_data dict paired with several prompts raised an obscure TypeError/KeyError deep inside the request loop. Now the mismatches raise a clear ValueError up front (matching vLLM upstream behavior), and a bare multi_modal_data dict is only accepted for a single prompt. Also fixes the hidden nesting bug where a str prompt + list multi_modal_data became [[...]]. |
||
|---|---|---|
| .. | ||
| _C | ||
| distributed | ||
| engine | ||
| entrypoints | ||
| hugging_face | ||
| model_executor | ||
| npu_ops | ||
| structure_output | ||
| ve | ||
| worker | ||
| __init__.py | ||
| attrdict.py | ||
| config.py | ||
| environ.py | ||
| load_class.py | ||
| logger.py | ||
| model_config_loader.py | ||
| multimodal_tokens.py | ||
| platform.py | ||
| py.typed | ||
| sampling_params.py | ||
| sequence.py | ||
| shared_memory.py | ||
| testing.py | ||
| timer.py | ||
| utils.py | ||