coffee/DeepInfer
1
0
Fork 0
mirror of https://github.com/deepseek-ai/DeepInfer.git synced 2026-11-10 07:09:42 +08:00
Code Issues Packages Projects Releases Wiki Activity

examples/benchmark: keep profile traces inside --tracing_path

Browse Source 
The trace file name starts with --model_name. The default is an HF id
(deepseek-ai/...), so the path gets an extra directory that is never
created and the export fails with FileNotFoundError after the run.
An absolute checkpoint path replaces --tracing_path altogether.

Use only the last path component of the model name.
This commit is contained in:
Yinfang Chen 2026-10-20 17:47:34 -07:00
parent 774ce244b8
commit 777bd89ff8
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
examples/benchmark.py
View File

@ -560,7 +560,7 @@ def main(dp_size: int, dp_rank: int) -> None:
if profiling_enabled: if profiling_enabled:
trace_stem = ( trace_stem = (
f"{args.model_name}-ep{ep_size}-cp{cp_size}" f"{Path(args.model_name).name}-ep{ep_size}-cp{cp_size}"
f"-prefillbsz{args.prefill_batch_size}-noncached{args.non_cached_tokens}" f"-prefillbsz{args.prefill_batch_size}-noncached{args.non_cached_tokens}"
f"-input{args.context_length}-bs{args.decode_num_requests}" f"-input{args.context_length}-bs{args.decode_num_requests}"
f"-nextn{envs.DEEPINFER_USE_NEXTN_DECODE}-force_topk{args.sampler_force_topk}" f"-nextn{envs.DEEPINFER_USE_NEXTN_DECODE}-force_topk{args.sampler_force_topk}"