Skip to content
PyTorch Kineto & HTA DiagnosticsFSDP / DDP Collective Overlap & Idle Bubble Triage

PyTorch Profiler (Kineto) & HTA GPU Bubble & Overlap Inspector

Stop zooming into millions of tiny boxes in Perfetto. Paste a PyTorch Kineto trace snippet below to measure Pure Compute vs. Exposed NCCL Collectives vs. Idle GPU Bubbles and get the exact FSDP prefetch or CUDA Graph fix.

Have a >500MB to 2GB trace or CUDA memory snapshot? Drop or select it below to stream in 2 MB chunks without crashing Chrome.

100% client-side evaluation in your browser. For multi-gigabyte traces, run python3 denpex.py --kineto-trace trace.json on the cluster node.

Holistic Trace Analysis (HTA) Breakdown

Step Time & Collective Overlap Verdict

Pure Compute
54%
GEMM + FlashAttention
Exposed Comm
22%
Un-overlapped ReduceScatter
Idle GPU Bubbles
24%
cuda_stream_synchronize
Communication Overlap Score:31.3% hidden

Only 31.3% of your ReduceScatter is hidden behind backward compute; setting backward_prefetch=BACKWARD_PRE will recover ~26.3% step speed.

Recommended Fix: Enable FSDP backward_prefetch=BackwardPrefetch.BACKWARD_PRE (or DDP bucket_cap_mb=50 with gradient_as_bucket_view=True) and remove per-step .item() / torch.cuda.synchronize() host waits.

Correlate GPU Bubbles with Multi-Rank Stragglers & MoE Hot Experts

Stream live step telemetry into the Fleet Training tab or unlock 50 cloud diagnoses/day for 30 days with your work email.

Try Denpex for 30 days. FREE.

No credit card. No automatic subscription. See whether Denpex helps with an incident you already understand.

Start your free 30-day Team evaluation

Up to 50 diagnoses a day for 30 days. Verify your work email to activate an eligible company evaluation, then replay a resolved incident and compare the evidence and next steps with your team's confirmed cause.

Use your company email, for example alex@yourcompany.com.

Who qualifies?

Company email domains activate the free 30-day Team evaluation (up to 50 diagnoses a day) after an email and domain check, whatever mail provider you use. If we cannot verify your domain automatically, support reviews it: write to support@denpex.com. Free local diagnosis in the editor extension needs no account.

Using a personal email (Gmail, Outlook, Naver, QQ) or solo cluster? Create a free $0 account (no work email required) to save 7-day history and unlock AI fallback, or send a cluster crash log for a live walkthrough.