mirror of
https://github.com/deepseek-ai/DeepInfer.git
synced 2026-10-28 23:07:09 +08:00
- vendor/deep_ep: EPBuffer dispatch/combine with torch.distributed uneven all_to_all (host-synced split sizes), EngramBuffer sharded lookup, BucketBuffer all_gather (CP-only reduce paths stubbed); verified against the DeepEP-Ascend references at world size 1/2/4. - tilelang_ops/neuron sampling: random_sampling (asc two-level fixed-point sampler, Philox), fused_sample (logprobs / do_sample), sampler metadata, sum_smaller_probs, structured-output bitmask; DSpark/MTP/varlen kernels raise NotImplementedError. All 42 asc *_tl factories now have a Neuron counterpart. - vendor/flash_attn: SDPA varlen stand-in for the ViT (mirrors npu_ops). - transfer_to_neuron: keep `with torch.device(...)` working on patched factories; fix manual_seed recursion in host mode. - engram: gather the packed ue8m0 sf as bytes on Neuron. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| _C | ||
| distributed | ||
| engine | ||
| entrypoints | ||
| hugging_face | ||
| model_executor | ||
| neuron_ops | ||
| npu_ops | ||
| structure_output | ||
| ve | ||
| worker | ||
| __init__.py | ||
| attrdict.py | ||
| config.py | ||
| environ.py | ||
| load_class.py | ||
| logger.py | ||
| model_config_loader.py | ||
| multimodal_tokens.py | ||
| platform.py | ||
| py.typed | ||
| sampling_params.py | ||
| sequence.py | ||
| shared_memory.py | ||
| testing.py | ||
| timer.py | ||
| utils.py | ||