mirror of
https://github.com/deepseek-ai/DeepInfer.git
synced 2026-10-28 23:07:09 +08:00
Both drain the device stream in torch-neuronx (a cast round-trips through the host, a scalar operand is a host->device copy): int32 ids index directly and out-of-range rows are cleared with masked_fill. Tiny cp=2 nextn=5 on device: 9/9 golden tokens. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| tilelang_ops | ||
| __init__.py | ||
| attention_backend.py | ||
| layernorm.py | ||
| linear.py | ||
| mtp_info_pool.py | ||
| rotary_embedding.py | ||
| sampler_utils.py | ||
| sampler.py | ||
| vocab_parallel_embedding.py | ||