| .. |
|
_C
|
initial commit
|
2026-10-20 12:09:42 +08:00 |
|
distributed
|
initial commit
|
2026-10-20 12:09:42 +08:00 |
|
engine
|
Neuron: CP group as a replicated-decode group; MoE all-reduce mode (#28)
|
2026-10-23 22:46:04 +08:00 |
|
entrypoints
|
initial commit
|
2026-10-20 12:09:42 +08:00 |
|
hugging_face
|
Neuron: concatenate FP8 checkpoint tensors as bytes (fixes MoE on device)
|
2026-10-21 11:46:58 +08:00 |
|
model_executor
|
Neuron: optional whole-layer region graph (DEEPINFER_NEURON_REGION_LAYER)
|
2026-10-24 09:51:01 +08:00 |
|
neuron_ops
|
Neuron chunk attention: decode the cache once, gathered_attn_idx (the #71 way) (#26)
|
2026-10-24 07:29:00 +08:00 |
|
npu_ops
|
initial commit
|
2026-10-20 12:09:42 +08:00 |
|
structure_output
|
initial commit
|
2026-10-20 12:09:42 +08:00 |
|
ve
|
initial commit
|
2026-10-20 12:09:42 +08:00 |
|
worker
|
Neuron CP followers: keep the EPLB step when skipping the sampler (#28)
|
2026-10-24 00:04:02 +08:00 |
|
__init__.py
|
Neuron basic mode: try prefill on every step
|
2026-10-21 21:00:54 +08:00 |
|
attrdict.py
|
initial commit
|
2026-10-20 12:09:42 +08:00 |
|
config.py
|
initial commit
|
2026-10-20 12:09:42 +08:00 |
|
environ.py
|
Neuron: whole-layer region graphs by default (TPOT 447.8 -> 430.3 ms at TP=64)
|
2026-10-24 10:15:43 +08:00 |
|
load_class.py
|
initial commit
|
2026-10-20 12:09:42 +08:00 |
|
logger.py
|
initial commit
|
2026-10-20 12:09:42 +08:00 |
|
model_config_loader.py
|
initial commit
|
2026-10-20 12:09:42 +08:00 |
|
multimodal_tokens.py
|
initial commit
|
2026-10-20 12:09:42 +08:00 |
|
platform.py
|
Neuron: static decode graphs, static-shape MoE, trn2 e4m3 fp8 (issues #9, #12, #24)
|
2026-10-22 11:59:37 +08:00 |
|
py.typed
|
initial commit
|
2026-10-20 12:09:42 +08:00 |
|
sampling_params.py
|
initial commit
|
2026-10-20 12:09:42 +08:00 |
|
sequence.py
|
initial commit
|
2026-10-20 12:09:42 +08:00 |
|
shared_memory.py
|
initial commit
|
2026-10-20 12:09:42 +08:00 |
|
testing.py
|
initial commit
|
2026-10-20 12:09:42 +08:00 |
|
timer.py
|
initial commit
|
2026-10-20 12:09:42 +08:00 |
|
utils.py
|
Neuron basic mode — part 3: end-to-end check vs the official reference
|
2026-10-20 20:20:02 +08:00 |
