pass 49 · kind decode timing correlation · token index 48 timing correlation · period 39.747 ms measured · GPU busy 3.344 ms measured · 13.025 ms measured · 0.945 ms measured · 20.458 ms measured · 0.005 ms measured → 37.78 ms inferred Σ GPU time over the pass's buffers; ÷ period · 95.04 % inferred Σ GPU time over the pass's buffers; ÷ period · coverage of the token under test 9.290 % inferred Σ shader-row durations ÷ Σ GPU time over the pass's compute buffers · 36 intervals
| interval | H1 token | H2 buffer | H3 node set | H4 kernel | H5 candidates | H8 layers | H7 components | verdict |
enc(49,0) | 48 timing correlation | 0x234d5d883 measured | 0…93 inferred | each node's kernel inferred | 94 inferred | 0…4 inferred | 10 components · 47 read no weight
attn_k.bias attn_k.weight attn_output.weight attn_q.bias attn_q.weight attn_v.bias attn_v.weight ffn_down.weight ffn_gate.weight ffn_up.weight 47 read no weight tensor of their layer | resolved |
enc(49,1) | 48 timing correlation | 0x234d5d885 measured | 94…963 inferred | each node's kernel inferred | 870 inferred | 4…47 inferred outside every block · 2962 absent — outside every block 963 absent — outside every block | 10 components · 435 read no weight
attn_k.bias attn_k.weight attn_output.weight attn_q.bias attn_q.weight attn_v.bias attn_v.weight ffn_down.weight ffn_gate.weight ffn_up.weight 435 read no weight tensor of their layer | resolved |
enc(49,2) | 48 timing correlation | 0x234d5d887 measured | blit — the logits copy; no graph nodes measured | | | | | resolved |
gpu(49,0,0) | 48 timing correlation | the buffer's own record measured | 0…93 inferred | each node's kernel inferred | 94 inferred | 0…4 inferred | 10 components · 47 read no weight
attn_k.bias attn_k.weight attn_output.weight attn_q.bias attn_q.weight attn_v.bias attn_v.weight ffn_down.weight ffn_gate.weight ffn_up.weight 47 read no weight tensor of their layer | resolved |
gpu(49,1,0) | 48 timing correlation | the buffer's own record measured | 94…963 inferred | each node's kernel inferred | 870 inferred | 4…47 inferred outside every block · 2962 absent — outside every block 963 absent — outside every block | 10 components · 435 read no weight
attn_k.bias attn_k.weight attn_output.weight attn_q.bias attn_q.weight attn_v.bias attn_v.weight ffn_down.weight ffn_gate.weight ffn_up.weight 435 read no weight tensor of their layer | resolved |
gpu(49,1,1) | 48 timing correlation | the buffer's own record measured | 94…963 inferred | each node's kernel inferred | 870 inferred | 4…47 inferred outside every block · 2962 absent — outside every block 963 absent — outside every block | 10 components · 435 read no weight
attn_k.bias attn_k.weight attn_output.weight attn_q.bias attn_q.weight attn_v.bias attn_v.weight ffn_down.weight ffn_gate.weight ffn_up.weight 435 read no weight tensor of their layer | resolved |
gpu(49,1,2) | 48 timing correlation | the buffer's own record measured | 94…963 inferred | each node's kernel inferred | 870 inferred | 4…47 inferred outside every block · 2962 absent — outside every block 963 absent — outside every block | 10 components · 435 read no weight
attn_k.bias attn_k.weight attn_output.weight attn_q.bias attn_q.weight attn_v.bias attn_v.weight ffn_down.weight ffn_gate.weight ffn_up.weight 435 read no weight tensor of their layer | resolved |
gpu(49,2,0) | 48 timing correlation | the buffer's own record measured | blit — the logits copy; no graph nodes measured | | | | | resolved |
row(49,0) | 48 timing correlation | through its node set | 0…93 inferred | kernel_swiglu_f32 measured | 4 inferred | 0…3 inferred | 4 read no weight
4 read no weight tensor of their layer | resolved |
row(49,1) | 48 timing correlation | through its node set | 0…93 inferred | kernel_mul_mv_q6_K_f32 measured | 9 inferred | 0…4 inferred | 2 components
attn_v.weight ffn_down.weight | resolved |
row(49,2) | 48 timing correlation | through its node set | 0…93 inferred | kernel_rms_norm_mul_f32_4 measured | 9 inferred | 0…4 inferred | 9 read no weight
9 read no weight tensor of their layer | resolved |
row(49,3) | 48 timing correlation | through its node set | 0…93 inferred | kernel_rope_neox_f32 measured | 10 inferred | 0…4 inferred | 10 read no weight
10 read no weight tensor of their layer | resolved |
row(49,4) | 48 timing correlation | through its node set | 0…93 inferred | kernel_set_rows_f16_i64 measured | 10 inferred | 0…4 inferred | 10 read no weight
10 read no weight tensor of their layer | resolved |
row(49,5) | 48 timing correlation | through its node set | 0…93 inferred | kernel_flash_attn_ext_vec_f16_dk128_dv128 measured | 5 inferred | 0…4 inferred | 5 read no weight
5 read no weight tensor of their layer | resolved |
row(49,6) | 48 timing correlation | through its node set | 0…93 inferred | kernel_flash_attn_ext_vec_reduce measured | 94 inferred unjoined — no node of the graph names this kernel | 0…4 inferred | 10 components · 47 read no weight
attn_k.bias attn_k.weight attn_output.weight attn_q.bias attn_q.weight attn_v.bias attn_v.weight ffn_down.weight ffn_gate.weight ffn_up.weight 47 read no weight tensor of their layer | resolved |
row(49,7) | 48 timing correlation | through its node set | 0…93 inferred | kernel_mul_mv_q4_K_f32 measured | 23 inferred | 0…4 inferred | 5 components
attn_k.weight attn_output.weight attn_q.weight ffn_gate.weight ffn_up.weight | resolved |
row(49,8) | 48 timing correlation | through its node set | 0…93 inferred | kernel_bin_fuse_f32_f32_f32_4 measured | 24 inferred | 0…4 inferred | 3 components · 9 read no weight
attn_k.bias attn_q.bias attn_v.bias 9 read no weight tensor of their layer | resolved |
row(49,9) | 48 timing correlation | through its node set | 94…963 inferred | kernel_mul_mv_q6_K_f32 measured | 40 inferred | 4…47 inferred outside every block · 1963 absent — outside every block | 2 components
attn_v.weight ffn_down.weight | resolved |
row(49,10) | 48 timing correlation | through its node set | 94…963 inferred | kernel_swiglu_f32 measured | 44 inferred | 4…47 inferred | 44 read no weight
44 read no weight tensor of their layer | resolved |
row(49,11) | 48 timing correlation | through its node set | 94…963 inferred | kernel_rope_neox_f32 measured | 86 inferred | 5…47 inferred | 86 read no weight
86 read no weight tensor of their layer | resolved |
row(49,12) | 48 timing correlation | through its node set | 94…963 inferred | kernel_set_rows_f16_i64 measured | 86 inferred | 5…47 inferred | 86 read no weight
86 read no weight tensor of their layer | resolved |
row(49,13) | 48 timing correlation | through its node set | 94…963 inferred | kernel_flash_attn_ext_vec_f16_dk128_dv128 measured | 43 inferred | 5…47 inferred | 43 read no weight
43 read no weight tensor of their layer | resolved |
row(49,14) | 48 timing correlation | through its node set | 94…963 inferred | kernel_flash_attn_ext_vec_reduce measured | 870 inferred unjoined — no node of the graph names this kernel | 4…47 inferred outside every block · 2962 absent — outside every block 963 absent — outside every block | 10 components · 435 read no weight
attn_k.bias attn_k.weight attn_output.weight attn_q.bias attn_q.weight attn_v.bias attn_v.weight ffn_down.weight ffn_gate.weight ffn_up.weight 435 read no weight tensor of their layer | resolved |
row(49,15) | 48 timing correlation | through its node set | 94…963 inferred | kernel_bin_fuse_f32_f32_f32_4 measured | 216 inferred | 4…47 inferred | 3 components · 87 read no weight
attn_k.bias attn_q.bias attn_v.bias 87 read no weight tensor of their layer | resolved |
row(49,16) | 48 timing correlation | through its node set | 94…963 inferred | kernel_rms_norm_mul_f32_4 measured | 88 inferred | 4…47 inferred outside every block · 1962 absent — outside every block | 87 read no weight
87 read no weight tensor of their layer | resolved |
row(49,17) | 48 timing correlation | through its node set | 94…963 inferred | kernel_mul_mv_q4_K_f32 measured | 265 inferred | 4…47 inferred | 7 components
attn_k.weight attn_output.weight attn_q.weight attn_v.weight ffn_down.weight ffn_gate.weight ffn_up.weight | resolved |
row(49,18) | 48 timing correlation | through its node set | 94…963 inferred | kernel_rope_neox_f32 measured | 86 inferred | 5…47 inferred | 86 read no weight
86 read no weight tensor of their layer | resolved |
row(49,19) | 48 timing correlation | through its node set | 94…963 inferred | kernel_set_rows_f16_i64 measured | 86 inferred | 5…47 inferred | 86 read no weight
86 read no weight tensor of their layer | resolved |
row(49,20) | 48 timing correlation | through its node set | 94…963 inferred | kernel_flash_attn_ext_vec_f16_dk128_dv128 measured | 43 inferred | 5…47 inferred | 43 read no weight
43 read no weight tensor of their layer | resolved |
row(49,21) | 48 timing correlation | through its node set | 94…963 inferred | kernel_flash_attn_ext_vec_reduce measured | 870 inferred unjoined — no node of the graph names this kernel | 4…47 inferred outside every block · 2962 absent — outside every block 963 absent — outside every block | 10 components · 435 read no weight
attn_k.bias attn_k.weight attn_output.weight attn_q.bias attn_q.weight attn_v.bias attn_v.weight ffn_down.weight ffn_gate.weight ffn_up.weight 435 read no weight tensor of their layer | resolved |
row(49,22) | 48 timing correlation | through its node set | 94…963 inferred | kernel_get_rows_f32 measured | 2 inferred | 47 inferred | 2 read no weight
2 read no weight tensor of their layer | resolved |
row(49,23) | 48 timing correlation | through its node set | 94…963 inferred | kernel_mul_mv_q4_K_f32 measured | 265 inferred | 4…47 inferred | 7 components
attn_k.weight attn_output.weight attn_q.weight attn_v.weight ffn_down.weight ffn_gate.weight ffn_up.weight | resolved |
row(49,24) | 48 timing correlation | through its node set | 94…963 inferred | kernel_swiglu_f32 measured | 44 inferred | 4…47 inferred | 44 read no weight
44 read no weight tensor of their layer | resolved |
row(49,25) | 48 timing correlation | through its node set | 94…963 inferred | kernel_bin_fuse_f32_f32_f32_4 measured | 216 inferred | 4…47 inferred | 3 components · 87 read no weight
attn_k.bias attn_q.bias attn_v.bias 87 read no weight tensor of their layer | resolved |
row(49,26) | 48 timing correlation | through its node set | 94…963 inferred | kernel_rms_norm_mul_f32_4 measured | 88 inferred | 4…47 inferred outside every block · 1962 absent — outside every block | 87 read no weight
87 read no weight tensor of their layer | resolved |
row(49,27) | 48 timing correlation | through its node set | 94…963 inferred | kernel_mul_mv_q6_K_f32 measured | 40 inferred | 4…47 inferred outside every block · 1963 absent — outside every block | 2 components
attn_v.weight ffn_down.weight | resolved |