gemm: honor func_prefix for kernel object and symbols (enables fusion) by atassis · Pull Request #123 · amd/IRON

atassis · 2026-06-18T15:57:59Z

GEMV, softmax, and binary_elementwise already apply func_prefix to both the kernel object filename and the kernel symbols, so FusedMLIROperator can place several of them in one design. GEMM only applied func_prefix to the fallback generated-object name, leaving the supplied kernel_object name and the zero_/matmul_/convert_copy_ symbols unprefixed — so fusing any GEMM via FusedMLIROperator failed with object-copy and undefined-symbol errors. (The in-tree llama_3.2_1b example builds a FusedMLIROperator.)

Changed

my_matmul now applies func_prefix to the gemm and convert_copy object filenames and to the zero_/matmul_/convert_copy_ kernel symbols.

Added / Removed

None.

No-op when func_prefix="" (the non-fused default), so existing callers are byte-identical. Exercised in our own batched decode, which fuses GEMM via FusedMLIROperator.

andrej · 2026-06-22T17:58:52Z

Note the CI failures we're seeing should disappear after a rebase. :)

GEMV, softmax, and binary_elementwise already apply func_prefix to both the kernel object filename and the kernel symbols, so FusedMLIROperator can place several of them in one design. GEMM only applied func_prefix to the fallback generated-object name, leaving the supplied kernel_object name and the zero_/ matmul_/convert_copy_ symbols unprefixed -- so fusing any GEMM via FusedMLIROperator failed with object-copy and undefined-symbol errors. Prefix the gemm/convert_copy object names and the zero_/matmul_/convert_copy symbols. No-op when func_prefix is empty (the non-fused default).

github-actions · 2026-06-23T15:23:10Z

CI Test Results

5f943a9 (2026_06_23_15_55_28)

IRON - CI Summary

Examples

iron/applications/llama_3.2_1b

Test	Krackan Status	Krackan	Phoenix Status	Phoenix
test_llama_3_2_1b[llama_3.2_1b_prompt_1024_tokens_1]	✅	-	-	-
test_llama_3_2_1b[llama_3.2_1b_prompt_1024_tokens_40]	✅	-	-	-
test_llama_3_2_1b[llama_3.2_1b_prompt_13_tokens_1]	✅	-	-	-
test_llama_3_2_1b[llama_3.2_1b_prompt_13_tokens_40]	✅	-	-	-

Small

iron/operators/axpy

Test	Krackan Status	Krackan Latency (mean)	Phoenix Status	Phoenix Latency (mean)
test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]	✅	171.84	✅	277.26
test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]	✅	186.82	✅	375.34
test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]	✅	211.36	✅	401.70
test_axpy[input_length_2048-num_aie_columns_8-tile_size_256-scalar_factor_3.0]	✅	242.30	-	-

iron/operators/dequant

Test	Krackan Status	Krackan Latency (mean)	Phoenix Status	Phoenix Latency (mean)
test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]	✅	163.16	✅	323.86
test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]	✅	175.34	✅	699.52
test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]	✅	221.36	✅	310.90
test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]	✅	188.68	✅	356.56
test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]	✅	198.98	✅	514.32
test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]	✅	196.22	✅	430.66
test_dequant[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256-group_size_32]	✅	209.76	-	-
test_dequant[input_length_2048-num_aie_columns_8-num_channels_2-tile_size_128-group_size_32]	✅	218.46	-	-

iron/operators/elementwise_add

Test	Krackan Status	Krackan Latency (mean)	Phoenix Status	Phoenix Latency (mean)
test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]	✅	165.04	✅	368.78
test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]	✅	163.96	✅	445.46
test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]	✅	192.32	✅	532.68
test_elementwise_add[input_length_2048-num_aie_columns_8-tile_size_256]	✅	204.64	-	-

iron/operators/elementwise_mul

Test	Krackan Status	Krackan Latency (mean)	Phoenix Status	Phoenix Latency (mean)
test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]	✅	248.18	✅	295.54
test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]	✅	185.80	✅	445.60
test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]	✅	187.54	✅	423.92
test_elementwise_mul[input_length_2048-num_aie_columns_8-tile_size_256]	✅	166.24	-	-

iron/operators/gelu

Test	Krackan Status	Krackan Latency (mean)	Phoenix Status	Phoenix Latency (mean)
test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅	167.90	✅	283.42
test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅	148.10	✅	422.78
test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅	161.56	✅	326.46
test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅	158.78	✅	452.02
test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅	170.66	✅	371.38
test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅	176.32	✅	399.72
test_gelu[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256]	✅	181.24	-	-
test_gelu[input_length_2048-num_aie_columns_8-num_channels_2-tile_size_128]	✅	205.98	-	-

iron/operators/gemm

Test	Krackan Status	Krackan Latency (mean)	Phoenix Status	Phoenix Latency (mean)
test_gemm[M_1792-K_896-N_1152-num_aie_columns_8-b_col_maj_False-c_col_maj_True-m_64-k_32-n_48-trace_size_0-partition_N_1]	✅	2357.50	-	-
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]	✅	216.94	✅	700.00
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]	✅	231.94	✅	520.82
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]	✅	48584.86	✅	82039.74
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]	✅	28547.08	✅	24793.78
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_8-b_col_maj_True-c_col_maj_True-m_64-k_64-n_64-trace_size_0-partition_N_1]	✅	7774.68	-	-
test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]	✅	2437.32	✅	3803.54
test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]	✅	3482.46	✅	6253.22
test_gemm[M_896-K_1792-N_640-num_aie_columns_8-b_col_maj_False-c_col_maj_True-m_32-k_64-n_80-trace_size_0-partition_N_1]	✅	1610.26	-	-

iron/operators/gemv

Test	Krackan Status	Krackan Latency (mean)	Phoenix Status	Phoenix Latency (mean)
test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]	✅	0.20	✅	0.10
test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]	✅	12.75	✅	3.68
test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]	✅	24.51	✅	6.26
test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]	✅	38.36	✅	8.91
test_gemv[M_2048-K_8192-num_aie_columns_8-tile_size_input_1-tile_size_output_256]	✅	42.59	-	-
test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]	✅	12.74	✅	3.57
test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]	✅	24.13	✅	6.32
test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]	✅	40.62	✅	10.36
test_gemv[M_8192-K_2048-num_aie_columns_8-tile_size_input_4-tile_size_output_1024]	✅	38.51	-	-

iron/operators/layer_norm

Test	Krackan Status	Krackan Latency (mean)	Phoenix Status	Phoenix Latency (mean)
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅	178.94	✅	270.86
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅	188.12	✅	379.98
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅	187.54	✅	464.90
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅	205.82	✅	361.42
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅	165.52	✅	398.72
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅	163.12	✅	423.90
test_layer_norm[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256]	✅	205.18	-	-
test_layer_norm[input_length_2048-num_aie_columns_8-num_channels_2-tile_size_128]	✅	229.02	-	-

iron/operators/mem_copy

Test	Krackan Status	Krackan Latency (mean)	Phoenix Status	Phoenix Latency (mean)
test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048]	✅	158.28	✅	363.22
test_mem_copy[input_length_2048-num_cores_16-num_channels_2-bypass_False-tile_size_128]	✅	191.38	-	-
test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024]	✅	147.04	✅	391.50
test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024]	✅	157.78	✅	607.10
test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512]	✅	162.06	✅	386.74
test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512]	✅	179.78	✅	468.12
test_mem_copy[input_length_2048-num_cores_8-num_channels_1-bypass_False-tile_size_256]	✅	164.12	-	-
test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256]	✅	151.26	✅	503.50

iron/operators/mha

Test	Krackan Status	Krackan Latency (mean)	Phoenix Status	Phoenix Latency (mean)
test_mha[seq_len_16384-dim_64-num_heads_1-num_pipelines_8-num_kv_heads_0]	✅	40946.18	-	-

iron/operators/relu

Test	Krackan Status	Krackan Latency (mean)	Phoenix Status	Phoenix Latency (mean)
test_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅	154.36	✅	389.10
test_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅	146.72	✅	526.00
test_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅	171.24	✅	349.74
test_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅	161.50	✅	364.42
test_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅	176.14	✅	366.02
test_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅	153.66	✅	400.48
test_relu[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256]	✅	182.84	-	-
test_relu[input_length_2048-num_aie_columns_8-num_channels_2-tile_size_128]	✅	203.04	-	-

iron/operators/rms_norm

Test	Krackan Status	Krackan Latency (mean)	Phoenix Status	Phoenix Latency (mean)
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False]	✅	148.32	✅	720.68
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True]	✅	162.16	✅	268.02
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False]	✅	150.12	✅	687.66
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True]	✅	149.40	✅	463.42
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False]	✅	157.10	✅	396.52
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True]	✅	157.72	✅	316.92
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False]	✅	179.62	✅	461.76
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True]	✅	173.48	✅	543.36
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False]	✅	163.94	✅	460.88
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True]	✅	176.60	✅	423.12
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False]	✅	212.90	✅	382.50
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_True]	✅	165.96	-	-
test_rms_norm[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256-weighted_False]	✅	170.56	-	-
test_rms_norm[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256-weighted_True]	✅	178.80	-	-
test_rms_norm[input_length_2048-num_aie_columns_8-num_channels_2-tile_size_128-weighted_False]	✅	209.72	-	-

iron/operators/rope

Test	Krackan Status	Krackan Latency (mean)	Phoenix Status	Phoenix Latency (mean)
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0]	✅	159.76	✅	385.42
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0]	✅	168.18	✅	426.98
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0]	✅	178.60	✅	418.48
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_8-method_type_0]	✅	167.62	-	-
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0]	✅	155.42	✅	400.22
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0]	✅	152.16	✅	379.20
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0]	✅	189.06	✅	457.10
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_8-method_type_0]	✅	187.96	-	-

iron/operators/sigmoid

Test	Krackan Status	Krackan Latency (mean)	Phoenix Status	Phoenix Latency (mean)
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅	149.52	✅	361.18
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅	185.14	✅	864.58
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅	168.16	✅	323.70
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅	172.64	✅	437.52
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅	162.60	✅	449.88
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅	152.32	✅	384.40
test_sigmoid[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256]	✅	163.02	-	-
test_sigmoid[input_length_2048-num_aie_columns_8-num_channels_2-tile_size_128]	✅	189.22	-	-

iron/operators/silu

Test	Krackan Status	Krackan Latency (mean)	Phoenix Status	Phoenix Latency (mean)
test_silu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅	163.40	✅	400.00
test_silu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅	171.64	✅	473.58
test_silu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅	172.30	✅	605.86
test_silu[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256]	✅	184.32	-	-

iron/operators/softmax

Test	Krackan Status	Krackan Latency (mean)	Phoenix Status	Phoenix Latency (mean)
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024]	✅	161.06	✅	561.56
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048]	✅	177.20	✅	451.12
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512]	✅	158.14	✅	453.02

iron/operators/swiglu_decode

Test	Krackan Status	Krackan Latency (mean)	Phoenix Status	Phoenix Latency (mean)
test_swiglu_decode[embedding_dim_1024-hidden_dim_3584]	✅	3899.73	✅	17024.41
test_swiglu_decode[embedding_dim_2048-hidden_dim_2048]	✅	4138.88	✅	7619.61

iron/operators/swiglu_prefill

Test	Krackan Status	Krackan Latency (mean)	Phoenix Status	Phoenix Latency (mean)
test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False]	✅	12390.95	✅	24265.70

iron/operators/tanh

Test	Krackan Status	Krackan Latency (mean)	Phoenix Status	Phoenix Latency (mean)
test_tanh[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅	174.86	✅	307.52
test_tanh[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅	179.16	✅	438.34
test_tanh[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅	187.18	✅	367.66
test_tanh[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅	184.54	✅	374.46
test_tanh[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅	215.08	✅	376.24
test_tanh[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅	200.14	✅	440.92
test_tanh[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256]	✅	221.34	-	-
test_tanh[input_length_2048-num_aie_columns_8-num_channels_2-tile_size_128]	✅	238.20	-	-

iron/operators/transpose

Test	Krackan Status	Krackan Latency (mean)	Phoenix Status	Phoenix Latency (mean)
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8]	✅	175.00	✅	952.66
test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8]	✅	194.90	✅	695.12

Krackan - Small

IRON

Tested on 2026_06_23_15_55_28 at commit 5f943a9.

iron/operators/axpy

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]	✅ 5/5	171.84	0.07	n/a
test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]	✅ 5/5	186.82	0.07	n/a
test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]	✅ 5/5	211.36	0.06	n/a
test_axpy[input_length_2048-num_aie_columns_8-tile_size_256-scalar_factor_3.0]	✅ 5/5	242.30	0.06	n/a

iron/operators/dequant

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]	✅ 5/5	163.16	0.03	n/a
test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]	✅ 5/5	175.34	0.03	n/a
test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]	✅ 5/5	221.36	0.03	n/a
test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]	✅ 5/5	188.68	0.03	n/a
test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]	✅ 5/5	198.98	0.03	n/a
test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]	✅ 5/5	196.22	0.03	n/a
test_dequant[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256-group_size_32]	✅ 5/5	209.76	0.03	n/a
test_dequant[input_length_2048-num_aie_columns_8-num_channels_2-tile_size_128-group_size_32]	✅ 5/5	218.46	0.02	n/a

iron/operators/elementwise_add

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]	✅ 5/5	165.04	0.08	n/a
test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]	✅ 5/5	163.96	0.08	n/a
test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]	✅ 5/5	192.32	0.07	n/a
test_elementwise_add[input_length_2048-num_aie_columns_8-tile_size_256]	✅ 5/5	204.64	0.06	n/a

iron/operators/elementwise_mul

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]	✅ 5/5	248.18	0.06	n/a
test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]	✅ 5/5	185.80	0.07	n/a
test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]	✅ 5/5	187.54	0.07	n/a
test_elementwise_mul[input_length_2048-num_aie_columns_8-tile_size_256]	✅ 5/5	166.24	0.08	n/a

iron/operators/gelu

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅ 5/5	167.90	0.05	n/a
test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅ 5/5	148.10	0.06	n/a
test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅ 5/5	161.56	0.05	n/a
test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅ 5/5	158.78	0.05	n/a
test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅ 5/5	170.66	0.05	n/a
test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅ 5/5	176.32	0.05	n/a
test_gelu[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256]	✅ 5/5	181.24	0.05	n/a
test_gelu[input_length_2048-num_aie_columns_8-num_channels_2-tile_size_128]	✅ 5/5	205.98	0.04	n/a

iron/operators/gemm

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_gemm[M_1792-K_896-N_1152-num_aie_columns_8-b_col_maj_False-c_col_maj_True-m_64-k_32-n_48-trace_size_0-partition_N_1]	✅ 5/5	2357.50	4.01	1577.37
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]	✅ 5/5	216.94	1.06	45.38
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]	✅ 5/5	231.94	1.00	42.71
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]	✅ 5/5	48584.86	0.52	353.61
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]	✅ 5/5	28547.08	0.88	601.82
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_8-b_col_maj_True-c_col_maj_True-m_64-k_64-n_64-trace_size_0-partition_N_1]	✅ 5/5	7774.68	3.24	2210.58
test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]	✅ 5/5	2437.32	3.38	885.30
test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]	✅ 5/5	3482.46	0.37	19.91
test_gemm[M_896-K_1792-N_640-num_aie_columns_8-b_col_maj_False-c_col_maj_True-m_32-k_64-n_80-trace_size_0-partition_N_1]	✅ 5/5	1610.26	4.37	1350.43

iron/operators/gemv

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]	✅ 5/5	n/a	0.20	0.20
test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]	✅ 5/5	n/a	12.75	12.74
test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]	✅ 5/5	n/a	24.51	24.49
test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]	✅ 5/5	n/a	38.36	38.33
test_gemv[M_2048-K_8192-num_aie_columns_8-tile_size_input_1-tile_size_output_256]	✅ 5/5	n/a	42.59	42.56
test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]	✅ 5/5	n/a	12.74	12.73
test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]	✅ 5/5	n/a	24.13	24.12
test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]	✅ 5/5	n/a	40.62	40.59
test_gemv[M_8192-K_2048-num_aie_columns_8-tile_size_input_4-tile_size_output_1024]	✅ 5/5	n/a	38.51	38.48

iron/operators/layer_norm

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅ 5/5	178.94	0.05	n/a
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅ 5/5	188.12	0.05	n/a
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅ 5/5	187.54	0.04	n/a
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅ 5/5	205.82	0.04	n/a
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅ 5/5	165.52	0.05	n/a
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅ 5/5	163.12	0.05	n/a
test_layer_norm[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256]	✅ 5/5	205.18	0.04	n/a
test_layer_norm[input_length_2048-num_aie_columns_8-num_channels_2-tile_size_128]	✅ 5/5	229.02	0.04	n/a

iron/operators/mem_copy

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048]	✅ 5/5	158.28	0.05	n/a
test_mem_copy[input_length_2048-num_cores_16-num_channels_2-bypass_False-tile_size_128]	✅ 5/5	191.38	0.04	n/a
test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024]	✅ 5/5	147.04	0.06	n/a
test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024]	✅ 5/5	157.78	0.05	n/a
test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512]	✅ 5/5	162.06	0.05	n/a
test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512]	✅ 5/5	179.78	0.05	n/a
test_mem_copy[input_length_2048-num_cores_8-num_channels_1-bypass_False-tile_size_256]	✅ 5/5	164.12	0.05	n/a
test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256]	✅ 5/5	151.26	0.06	n/a

iron/operators/mha

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_mha[seq_len_16384-dim_64-num_heads_1-num_pipelines_8-num_kv_heads_0]	✅ 5/5	40946.18	0.20	n/a

iron/operators/relu

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅ 5/5	154.36	0.05	n/a
test_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅ 5/5	146.72	0.06	n/a
test_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅ 5/5	171.24	0.05	n/a
test_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅ 5/5	161.50	0.06	n/a
test_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅ 5/5	176.14	0.05	n/a
test_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅ 5/5	153.66	0.05	n/a
test_relu[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256]	✅ 5/5	182.84	0.05	n/a
test_relu[input_length_2048-num_aie_columns_8-num_channels_2-tile_size_128]	✅ 5/5	203.04	0.04	n/a

iron/operators/rms_norm

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False]	✅ 5/5	148.32	0.06	n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True]	✅ 5/5	162.16	0.08	n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False]	✅ 5/5	150.12	0.06	n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True]	✅ 5/5	149.40	0.07	n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False]	✅ 5/5	157.10	0.05	n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True]	✅ 5/5	157.72	0.07	n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False]	✅ 5/5	179.62	0.05	n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True]	✅ 5/5	173.48	0.05	n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False]	✅ 5/5	163.94	0.05	n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True]	✅ 5/5	176.60	0.05	n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False]	✅ 5/5	212.90	0.04	n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_True]	✅ 5/5	165.96	0.05	n/a
test_rms_norm[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256-weighted_False]	✅ 5/5	170.56	0.05	n/a
test_rms_norm[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256-weighted_True]	✅ 5/5	178.80	0.05	n/a
test_rms_norm[input_length_2048-num_aie_columns_8-num_channels_2-tile_size_128-weighted_False]	✅ 5/5	209.72	0.04	n/a

iron/operators/rope

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0]	✅ 5/5	159.76	0.65	n/a
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0]	✅ 5/5	168.18	0.60	n/a
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0]	✅ 5/5	178.60	0.57	n/a
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_8-method_type_0]	✅ 5/5	167.62	0.63	n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0]	✅ 5/5	155.42	0.48	n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0]	✅ 5/5	152.16	0.49	n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0]	✅ 5/5	189.06	0.41	n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_8-method_type_0]	✅ 5/5	187.96	0.40	n/a

iron/operators/sigmoid

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅ 5/5	149.52	0.06	n/a
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅ 5/5	185.14	0.05	n/a
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅ 5/5	168.16	0.05	n/a
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅ 5/5	172.64	0.05	n/a
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅ 5/5	162.60	0.05	n/a
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅ 5/5	152.32	0.06	n/a
test_sigmoid[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256]	✅ 5/5	163.02	0.05	n/a
test_sigmoid[input_length_2048-num_aie_columns_8-num_channels_2-tile_size_128]	✅ 5/5	189.22	0.04	n/a

iron/operators/silu

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_silu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅ 5/5	163.40	0.05	n/a
test_silu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅ 5/5	171.64	0.05	n/a
test_silu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅ 5/5	172.30	0.05	n/a
test_silu[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256]	✅ 5/5	184.32	0.05	n/a

iron/operators/softmax

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024]	✅ 5/5	161.06	0.84	n/a
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048]	✅ 5/5	177.20	0.75	n/a
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512]	✅ 5/5	158.14	0.87	n/a

iron/operators/swiglu_decode

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_swiglu_decode[embedding_dim_1024-hidden_dim_3584]	✅ 5/5	3899.73	0.00	n/a
test_swiglu_decode[embedding_dim_2048-hidden_dim_2048]	✅ 5/5	4138.88	0.00	n/a

iron/operators/swiglu_prefill

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False]	✅ 5/5	12390.95	0.18	n/a

iron/operators/tanh

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_tanh[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅ 5/5	174.86	0.05	n/a
test_tanh[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅ 5/5	179.16	0.05	n/a
test_tanh[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅ 5/5	187.18	0.04	n/a
test_tanh[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅ 5/5	184.54	0.04	n/a
test_tanh[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅ 5/5	215.08	0.04	n/a
test_tanh[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅ 5/5	200.14	0.04	n/a
test_tanh[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256]	✅ 5/5	221.34	0.04	n/a
test_tanh[input_length_2048-num_aie_columns_8-num_channels_2-tile_size_128]	✅ 5/5	238.20	0.04	n/a

iron/operators/transpose

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8]	✅ 5/5	175.00	3.02	n/a
test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8]	✅ 5/5	194.90	2.76	n/a

Trends:

IRON Trends

iron/operators/axpy

test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.09 (-13.77%)	0.07 (-14.83%)	0.07 (-15.38%)	0.06 (-20.21%)	0.01 (+15.45%)	214.20 (+25.26%)	171.84 (+19.13%)	164.40 (+18.19%)	137.80 (+15.99%)	33.83 (+66.09%)
`4d4b803` — 2026-06-22 17:54:57	0.10 (n/a)	0.09 (n/a)	0.09 (n/a)	0.07 (n/a)	0.01 (n/a)	171.00 (n/a)	144.24 (n/a)	139.10 (n/a)	118.80 (n/a)	20.37 (n/a)

test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.10 (+11.13%)	0.07 (-7.12%)	0.07 (-14.08%)	0.05 (-22.63%)	0.02 (+80.01%)	269.40 (+29.27%)	186.82 (+13.09%)	182.90 (+16.35%)	127.40 (-10.03%)	55.73 (+107.25%)
`4d4b803` — 2026-06-22 17:54:57	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	208.40 (n/a)	165.20 (n/a)	157.20 (n/a)	141.60 (n/a)	26.89 (n/a)

test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.07 (-31.25%)	0.06 (-20.22%)	0.07 (-10.37%)	0.05 (-11.25%)	0.01 (-44.34%)	259.30 (+12.64%)	211.36 (+21.77%)	185.20 (+11.57%)	170.90 (+45.45%)	43.78 (-7.24%)
`4d4b803` — 2026-06-22 17:54:57	0.10 (n/a)	0.08 (n/a)	0.07 (n/a)	0.05 (n/a)	0.02 (n/a)	230.20 (n/a)	173.58 (n/a)	166.00 (n/a)	117.50 (n/a)	47.20 (n/a)

test_axpy[input_length_2048-num_aie_columns_8-tile_size_256-scalar_factor_3.0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.09 (+10.77%)	0.06 (-0.11%)	0.05 (-0.43%)	0.03 (-17.42%)	0.02 (+56.95%)	355.70 (+21.11%)	242.30 (+8.63%)	226.30 (+0.40%)	135.30 (-9.74%)	93.82 (+81.32%)
`4d4b803` — 2026-06-22 17:54:57	0.08 (n/a)	0.06 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	293.70 (n/a)	223.06 (n/a)	225.40 (n/a)	149.90 (n/a)	51.74 (n/a)

iron/operators/dequant

test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.04 (-15.15%)	0.03 (+0.63%)	0.03 (+3.48%)	0.03 (+16.23%)	0.00 (-67.84%)	168.70 (-13.93%)	163.16 (-2.60%)	166.80 (-3.36%)	147.80 (+17.86%)	8.80 (-66.43%)
`4d4b803` — 2026-06-22 17:54:57	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.03 (n/a)	0.01 (n/a)	196.00 (n/a)	167.52 (n/a)	172.60 (n/a)	125.40 (n/a)	26.23 (n/a)

test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.03 (-29.41%)	0.03 (-15.87%)	0.03 (-5.73%)	0.03 (+20.44%)	0.00 (-77.69%)	194.10 (-16.98%)	175.34 (+10.22%)	179.10 (+6.04%)	156.60 (+41.72%)	14.21 (-72.17%)
`4d4b803` — 2026-06-22 17:54:57	0.05 (n/a)	0.04 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	233.80 (n/a)	159.08 (n/a)	168.90 (n/a)	110.50 (n/a)	51.06 (n/a)

test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.03 (-26.29%)	0.03 (-25.55%)	0.03 (-14.56%)	0.01 (-53.29%)	0.01 (+12.92%)	395.70 (+114.12%)	221.36 (+45.54%)	189.90 (+17.01%)	161.30 (+35.66%)	98.75 (+246.83%)
`4d4b803` — 2026-06-22 17:54:57	0.04 (n/a)	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.01 (n/a)	184.80 (n/a)	152.10 (n/a)	162.30 (n/a)	118.90 (n/a)	28.47 (n/a)

test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.04 (-1.16%)	0.03 (-6.50%)	0.03 (-11.12%)	0.02 (+4.42%)	0.01 (-2.91%)	217.80 (-4.26%)	188.68 (+6.70%)	199.60 (+12.51%)	140.60 (+1.22%)	31.52 (-6.61%)
`4d4b803` — 2026-06-22 17:54:57	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	227.50 (n/a)	176.84 (n/a)	177.40 (n/a)	138.90 (n/a)	33.75 (n/a)

test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.03 (-31.81%)	0.03 (-28.91%)	0.03 (-32.78%)	0.02 (-20.29%)	0.00 (-59.30%)	219.30 (+25.46%)	198.98 (+38.91%)	198.20 (+48.80%)	175.50 (+46.62%)	16.21 (-26.29%)
`4d4b803` — 2026-06-22 17:54:57	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.03 (n/a)	0.01 (n/a)	174.80 (n/a)	143.24 (n/a)	133.20 (n/a)	119.70 (n/a)	21.99 (n/a)

test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.04 (+4.62%)	0.03 (-11.22%)	0.03 (-21.33%)	0.02 (-6.47%)	0.01 (+14.21%)	227.20 (+6.97%)	196.22 (+13.34%)	202.00 (+27.12%)	143.70 (-4.39%)	32.40 (+15.59%)
`4d4b803` — 2026-06-22 17:54:57	0.03 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.00 (n/a)	212.40 (n/a)	173.12 (n/a)	158.90 (n/a)	150.30 (n/a)	28.03 (n/a)

test_dequant[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.04 (-9.86%)	0.03 (-10.70%)	0.03 (-3.55%)	0.02 (-25.61%)	0.01 (-5.23%)	298.90 (+34.46%)	209.76 (+13.46%)	202.60 (+3.68%)	137.10 (+10.92%)	58.54 (+38.46%)
`4d4b803` — 2026-06-22 17:54:57	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	222.30 (n/a)	184.88 (n/a)	195.40 (n/a)	123.60 (n/a)	42.28 (n/a)

test_dequant[input_length_2048-num_aie_columns_8-num_channels_2-tile_size_128-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.03 (+13.24%)	0.02 (-2.10%)	0.02 (-7.02%)	0.02 (-8.14%)	0.01 (+60.32%)	282.40 (+8.87%)	218.46 (+4.44%)	222.30 (+7.60%)	158.10 (-11.68%)	46.86 (+50.86%)
`4d4b803` — 2026-06-22 17:54:57	0.03 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.00 (n/a)	259.40 (n/a)	209.18 (n/a)	206.60 (n/a)	179.00 (n/a)	31.06 (n/a)

iron/operators/elementwise_add

test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.09 (n/a)	0.08 (n/a)	0.07 (n/a)	0.07 (n/a)	0.01 (n/a)	185.20 (n/a)	165.04 (n/a)	174.50 (n/a)	132.70 (n/a)	21.14 (n/a)

test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.06 (n/a)	0.01 (n/a)	214.80 (n/a)	163.96 (n/a)	151.30 (n/a)	135.60 (n/a)	31.66 (n/a)

test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.10 (n/a)	0.07 (n/a)	0.06 (n/a)	0.05 (n/a)	0.02 (n/a)	251.60 (n/a)	192.32 (n/a)	204.30 (n/a)	127.90 (n/a)	48.95 (n/a)

test_elementwise_add[input_length_2048-num_aie_columns_8-tile_size_256]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.07 (n/a)	0.06 (n/a)	0.06 (n/a)	0.05 (n/a)	0.01 (n/a)	232.00 (n/a)	204.64 (n/a)	198.20 (n/a)	174.50 (n/a)	24.31 (n/a)

iron/operators/elementwise_mul

test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.09 (n/a)	0.06 (n/a)	0.07 (n/a)	0.03 (n/a)	0.02 (n/a)	374.70 (n/a)	248.18 (n/a)	181.80 (n/a)	142.10 (n/a)	113.45 (n/a)

test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.09 (n/a)	0.07 (n/a)	0.07 (n/a)	0.05 (n/a)	0.02 (n/a)	243.00 (n/a)	185.80 (n/a)	182.70 (n/a)	131.80 (n/a)	40.29 (n/a)

test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.10 (n/a)	0.07 (n/a)	0.07 (n/a)	0.05 (n/a)	0.02 (n/a)	242.30 (n/a)	187.54 (n/a)	186.20 (n/a)	128.90 (n/a)	41.68 (n/a)

test_elementwise_mul[input_length_2048-num_aie_columns_8-tile_size_256]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.10 (n/a)	0.08 (n/a)	0.07 (n/a)	0.06 (n/a)	0.02 (n/a)	214.60 (n/a)	166.24 (n/a)	176.80 (n/a)	119.10 (n/a)	37.26 (n/a)

iron/operators/gelu

test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	200.90 (n/a)	167.90 (n/a)	166.20 (n/a)	138.70 (n/a)	22.07 (n/a)

test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.07 (n/a)	0.06 (n/a)	0.06 (n/a)	0.04 (n/a)	0.01 (n/a)	221.30 (n/a)	148.10 (n/a)	127.00 (n/a)	120.90 (n/a)	41.96 (n/a)

test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.05 (n/a)	0.01 (n/a)	178.90 (n/a)	161.56 (n/a)	175.30 (n/a)	131.70 (n/a)	21.78 (n/a)

test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	185.60 (n/a)	158.78 (n/a)	149.90 (n/a)	136.90 (n/a)	23.57 (n/a)

test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.07 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	222.30 (n/a)	170.66 (n/a)	175.60 (n/a)	120.40 (n/a)	37.17 (n/a)

test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	215.20 (n/a)	176.32 (n/a)	177.20 (n/a)	145.40 (n/a)	29.59 (n/a)

test_gelu[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.04 (n/a)	0.00 (n/a)	205.20 (n/a)	181.24 (n/a)	184.80 (n/a)	159.90 (n/a)	19.42 (n/a)

test_gelu[input_length_2048-num_aie_columns_8-num_channels_2-tile_size_128]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.05 (n/a)	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.00 (n/a)	223.70 (n/a)	205.98 (n/a)	208.80 (n/a)	169.90 (n/a)	21.26 (n/a)

iron/operators/gemm

test_gemm[M_1792-K_896-N_1152-num_aie_columns_8-b_col_maj_False-c_col_maj_True-m_64-k_32-n_48-trace_size_0-partition_N_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:50:03	4.29 (-14.09%)	4.01 (-5.52%)	4.11 (+1.72%)	3.49 (-12.09%)	0.31 (-27.46%)	2698.20 (+13.76%)	2357.50 (+5.62%)	2287.30 (-1.68%)	2193.20 (+16.40%)	197.99 (-1.26%)	1686.77 (-14.09%)	1577.37 (-5.52%)	1617.36 (+1.72%)	1371.03 (-12.09%)	121.76 (-27.46%)
`4d4b803` — 2026-06-22 17:54:57	4.99 (n/a)	4.24 (n/a)	4.04 (n/a)	3.96 (n/a)	0.43 (n/a)	2371.90 (n/a)	2232.02 (n/a)	2326.50 (n/a)	1884.20 (n/a)	200.51 (n/a)	1963.40 (n/a)	1669.47 (n/a)	1590.09 (n/a)	1559.66 (n/a)	167.85 (n/a)

test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:50:03	1.35 (-13.23%)	1.06 (+14.39%)	1.09 (+41.40%)	0.72 (+11.49%)	0.23 (-40.60%)	308.10 (-10.31%)	216.94 (-18.06%)	203.10 (-29.26%)	164.00 (+15.25%)	53.92 (-36.20%)	57.56 (-13.23%)	45.38 (+14.39%)	46.47 (+41.40%)	30.63 (+11.49%)	9.61 (-40.60%)
`4d4b803` — 2026-06-22 17:54:57	1.55 (n/a)	0.93 (n/a)	0.77 (n/a)	0.64 (n/a)	0.38 (n/a)	343.50 (n/a)	264.76 (n/a)	287.10 (n/a)	142.30 (n/a)	84.51 (n/a)	66.33 (n/a)	39.67 (n/a)	32.87 (n/a)	27.47 (n/a)	16.19 (n/a)

test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:50:03	1.15 (+16.15%)	1.00 (+19.91%)	1.07 (+21.94%)	0.63 (-4.46%)	0.21 (+64.58%)	349.40 (+4.67%)	231.94 (-14.15%)	207.60 (-17.98%)	192.30 (-13.92%)	65.97 (+52.70%)	49.07 (+16.15%)	42.71 (+19.91%)	45.47 (+21.94%)	27.01 (-4.46%)	8.90 (+64.58%)
`4d4b803` — 2026-06-22 17:54:57	0.99 (n/a)	0.83 (n/a)	0.87 (n/a)	0.66 (n/a)	0.13 (n/a)	333.80 (n/a)	270.16 (n/a)	253.10 (n/a)	223.40 (n/a)	43.20 (n/a)	42.24 (n/a)	35.62 (n/a)	37.28 (n/a)	28.27 (n/a)	5.41 (n/a)

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.52 (-0.19%)	0.52 (-0.03%)	0.52 (-0.01%)	0.52 (+0.02%)	0.00 (-25.69%)	48659.30 (-0.02%)	48584.86 (+0.03%)	48631.70 (+0.01%)	48365.60 (+0.19%)	124.14 (-25.57%)	355.21 (-0.19%)	353.61 (-0.03%)	353.26 (-0.01%)	353.06 (+0.02%)	0.91 (-25.69%)
`4d4b803` — 2026-06-22 17:54:57	0.52 (n/a)	0.52 (n/a)	0.52 (n/a)	0.52 (n/a)	0.00 (n/a)	48670.60 (n/a)	48570.74 (n/a)	48627.00 (n/a)	48274.70 (n/a)	166.79 (n/a)	355.88 (n/a)	353.71 (n/a)	353.30 (n/a)	352.98 (n/a)	1.22 (n/a)

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.89 (-0.32%)	0.88 (+0.13%)	0.88 (-0.11%)	0.88 (+0.85%)	0.00 (-34.23%)	28688.20 (-0.85%)	28547.08 (-0.14%)	28632.00 (+0.11%)	28363.80 (+0.32%)	159.97 (-34.61%)	605.70 (-0.32%)	601.82 (+0.13%)	600.02 (-0.11%)	598.85 (+0.85%)	3.38 (-34.23%)
`4d4b803` — 2026-06-22 17:54:57	0.89 (n/a)	0.88 (n/a)	0.88 (n/a)	0.87 (n/a)	0.01 (n/a)	28932.90 (n/a)	28586.36 (n/a)	28600.70 (n/a)	28274.00 (n/a)	244.64 (n/a)	607.62 (n/a)	601.02 (n/a)	600.68 (n/a)	593.78 (n/a)	5.14 (n/a)

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_8-b_col_maj_True-c_col_maj_True-m_64-k_64-n_64-trace_size_0-partition_N_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:50:03	3.30 (+0.94%)	3.24 (+2.31%)	3.28 (+3.76%)	3.16 (+2.46%)	0.07 (+4.07%)	7962.00 (-2.40%)	7774.68 (-2.26%)	7677.30 (-3.63%)	7618.30 (-0.93%)	172.19 (+1.30%)	2255.07 (+0.94%)	2210.58 (+2.31%)	2237.74 (+3.76%)	2157.72 (+2.46%)	48.61 (+4.07%)
`4d4b803` — 2026-06-22 17:54:57	3.27 (n/a)	3.16 (n/a)	3.16 (n/a)	3.08 (n/a)	0.07 (n/a)	8158.20 (n/a)	7954.42 (n/a)	7966.10 (n/a)	7689.80 (n/a)	169.99 (n/a)	2234.13 (n/a)	2160.59 (n/a)	2156.62 (n/a)	2105.84 (n/a)	46.71 (n/a)

test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:50:03	4.22 (-2.83%)	3.38 (-11.03%)	3.45 (-6.89%)	2.80 (-11.72%)	0.56 (+17.94%)	2875.90 (+13.28%)	2437.32 (+13.30%)	2338.30 (+7.40%)	1908.30 (+2.91%)	379.41 (+39.13%)	1107.73 (-2.83%)	885.30 (-11.03%)	904.05 (-6.89%)	735.05 (-11.72%)	145.67 (+17.94%)
`4d4b803` — 2026-06-22 17:54:57	4.35 (n/a)	3.79 (n/a)	3.70 (n/a)	3.18 (n/a)	0.47 (n/a)	2538.80 (n/a)	2151.30 (n/a)	2177.10 (n/a)	1854.30 (n/a)	272.71 (n/a)	1140.03 (n/a)	995.10 (n/a)	970.97 (n/a)	832.66 (n/a)	123.51 (n/a)

test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.51 (+44.13%)	0.37 (+16.86%)	0.34 (+5.11%)	0.31 (+13.36%)	0.08 (+156.88%)	4034.60 (-11.79%)	3482.46 (-12.33%)	3638.50 (-4.87%)	2432.10 (-30.62%)	632.03 (+51.91%)	27.59 (+44.13%)	19.91 (+16.86%)	18.44 (+5.11%)	16.63 (+13.36%)	4.44 (+156.88%)
`4d4b803` — 2026-06-22 17:54:57	0.36 (n/a)	0.32 (n/a)	0.33 (n/a)	0.27 (n/a)	0.03 (n/a)	4573.70 (n/a)	3972.46 (n/a)	3824.60 (n/a)	3505.50 (n/a)	416.07 (n/a)	19.14 (n/a)	17.04 (n/a)	17.55 (n/a)	14.67 (n/a)	1.73 (n/a)

test_gemm[M_896-K_1792-N_640-num_aie_columns_8-b_col_maj_False-c_col_maj_True-m_32-k_64-n_80-trace_size_0-partition_N_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:50:03	6.38 (-2.83%)	4.37 (-4.53%)	3.70 (-17.50%)	3.32 (-7.35%)	1.26 (+4.15%)	2005.30 (+7.94%)	1610.26 (+5.69%)	1799.50 (+21.21%)	1042.10 (+2.91%)	389.91 (+14.16%)	1972.20 (-2.83%)	1350.43 (-4.53%)	1142.12 (-17.50%)	1024.89 (-7.35%)	387.90 (+4.15%)
`4d4b803` — 2026-06-22 17:54:57	6.57 (n/a)	4.58 (n/a)	4.48 (n/a)	3.58 (n/a)	1.21 (n/a)	1857.80 (n/a)	1523.60 (n/a)	1484.60 (n/a)	1012.60 (n/a)	341.54 (n/a)	2029.68 (n/a)	1414.56 (n/a)	1384.37 (n/a)	1106.25 (n/a)	372.43 (n/a)

iron/operators/gemv

test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.23 (+5.94%)	0.20 (+3.33%)	0.19 (-2.75%)	0.19 (+20.72%)	0.02 (-30.66%)	0.22 (+5.94%)	0.20 (+3.33%)	0.19 (-2.75%)	0.18 (+20.72%)	0.02 (-30.66%)
`4d4b803` — 2026-06-22 17:54:57	0.21 (n/a)	0.19 (n/a)	0.20 (n/a)	0.15 (n/a)	0.02 (n/a)	0.21 (n/a)	0.19 (n/a)	0.20 (n/a)	0.15 (n/a)	0.02 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:50:03	13.55 (+1.12%)	12.75 (-3.63%)	13.41 (+1.38%)	10.03 (-23.23%)	1.52 (+1019.32%)	13.54 (+1.12%)	12.74 (-3.63%)	13.40 (+1.38%)	10.02 (-23.23%)	1.52 (+1019.32%)
`4d4b803` — 2026-06-22 17:54:57	13.40 (n/a)	13.23 (n/a)	13.22 (n/a)	13.06 (n/a)	0.14 (n/a)	13.39 (n/a)	13.22 (n/a)	13.21 (n/a)	13.05 (n/a)	0.14 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:50:03	25.28 (-0.25%)	24.51 (-1.71%)	24.45 (-2.20%)	23.76 (-2.83%)	0.62 (+68.92%)	25.26 (-0.25%)	24.49 (-1.71%)	24.43 (-2.20%)	23.74 (-2.83%)	0.62 (+68.92%)
`4d4b803` — 2026-06-22 17:54:57	25.34 (n/a)	24.94 (n/a)	25.00 (n/a)	24.45 (n/a)	0.37 (n/a)	25.33 (n/a)	24.92 (n/a)	24.98 (n/a)	24.43 (n/a)	0.37 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:50:03	42.64 (-4.67%)	38.36 (-7.95%)	39.67 (-4.96%)	33.54 (-13.98%)	3.52 (+71.22%)	42.61 (-4.67%)	38.33 (-7.95%)	39.64 (-4.96%)	33.51 (-13.98%)	3.52 (+71.22%)
`4d4b803` — 2026-06-22 17:54:57	44.73 (n/a)	41.67 (n/a)	41.73 (n/a)	38.99 (n/a)	2.06 (n/a)	44.70 (n/a)	41.65 (n/a)	41.71 (n/a)	38.96 (n/a)	2.06 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_8-tile_size_input_1-tile_size_output_256]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:50:03	44.10 (-0.69%)	42.59 (-0.31%)	42.54 (-0.45%)	40.80 (+0.91%)	1.42 (-4.86%)	44.08 (-0.69%)	42.56 (-0.31%)	42.51 (-0.45%)	40.78 (+0.90%)	1.42 (-4.86%)
`4d4b803` — 2026-06-22 17:54:57	44.41 (n/a)	42.73 (n/a)	42.73 (n/a)	40.44 (n/a)	1.49 (n/a)	44.38 (n/a)	42.70 (n/a)	42.71 (n/a)	40.41 (n/a)	1.49 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:50:03	13.49 (+1.52%)	12.74 (-2.06%)	13.20 (-0.29%)	11.69 (-3.81%)	0.81 (+66.75%)	13.49 (+1.52%)	12.73 (-2.06%)	13.20 (-0.29%)	11.68 (-3.81%)	0.81 (+66.75%)
`4d4b803` — 2026-06-22 17:54:57	13.29 (n/a)	13.01 (n/a)	13.24 (n/a)	12.15 (n/a)	0.48 (n/a)	13.28 (n/a)	13.00 (n/a)	13.23 (n/a)	12.14 (n/a)	0.48 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:50:03	24.42 (-1.27%)	24.13 (-0.95%)	24.14 (-0.75%)	23.89 (-1.13%)	0.21 (-7.90%)	24.40 (-1.27%)	24.12 (-0.95%)	24.12 (-0.75%)	23.88 (-1.13%)	0.21 (-7.89%)
`4d4b803` — 2026-06-22 17:54:57	24.73 (n/a)	24.37 (n/a)	24.32 (n/a)	24.16 (n/a)	0.23 (n/a)	24.71 (n/a)	24.35 (n/a)	24.30 (n/a)	24.15 (n/a)	0.23 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:50:03	41.78 (-1.67%)	40.62 (+0.50%)	41.47 (+4.20%)	38.85 (-0.05%)	1.36 (-4.19%)	41.76 (-1.67%)	40.59 (+0.50%)	41.45 (+4.20%)	38.83 (-0.05%)	1.36 (-4.19%)
`4d4b803` — 2026-06-22 17:54:57	42.49 (n/a)	40.41 (n/a)	39.80 (n/a)	38.87 (n/a)	1.42 (n/a)	42.47 (n/a)	40.39 (n/a)	39.77 (n/a)	38.85 (n/a)	1.42 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_8-tile_size_input_4-tile_size_output_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:50:03	44.17 (+0.83%)	38.51 (-8.18%)	41.56 (-4.84%)	25.74 (-31.85%)	7.54 (+182.23%)	44.14 (+0.83%)	38.48 (-8.18%)	41.54 (-4.84%)	25.72 (-31.85%)	7.54 (+182.23%)
`4d4b803` — 2026-06-22 17:54:57	43.81 (n/a)	41.94 (n/a)	43.68 (n/a)	37.77 (n/a)	2.67 (n/a)	43.78 (n/a)	41.91 (n/a)	43.65 (n/a)	37.75 (n/a)	2.67 (n/a)

iron/operators/layer_norm

test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	200.70 (n/a)	178.94 (n/a)	181.00 (n/a)	147.30 (n/a)	19.64 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	228.60 (n/a)	188.12 (n/a)	177.30 (n/a)	136.00 (n/a)	37.83 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.05 (n/a)	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.01 (n/a)	219.40 (n/a)	187.54 (n/a)	182.70 (n/a)	156.90 (n/a)	30.30 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.06 (n/a)	0.04 (n/a)	0.04 (n/a)	0.03 (n/a)	0.01 (n/a)	320.90 (n/a)	205.82 (n/a)	186.90 (n/a)	143.80 (n/a)	67.53 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	211.10 (n/a)	165.52 (n/a)	167.00 (n/a)	136.80 (n/a)	29.71 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.07 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	222.70 (n/a)	163.12 (n/a)	159.10 (n/a)	125.90 (n/a)	37.32 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.05 (n/a)	0.04 (n/a)	0.04 (n/a)	0.03 (n/a)	0.01 (n/a)	268.60 (n/a)	205.18 (n/a)	202.90 (n/a)	150.90 (n/a)	46.88 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_8-num_channels_2-tile_size_128]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.05 (n/a)	0.04 (n/a)	0.04 (n/a)	0.02 (n/a)	0.01 (n/a)	331.70 (n/a)	229.02 (n/a)	186.50 (n/a)	153.60 (n/a)	79.56 (n/a)

iron/operators/mem_copy

test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.06 (-18.54%)	0.05 (-0.62%)	0.05 (-0.31%)	0.05 (+18.96%)	0.00 (-66.24%)	166.50 (-15.95%)	158.28 (-2.48%)	165.10 (+0.30%)	140.10 (+22.79%)	11.43 (-64.25%)
`4d4b803` — 2026-06-22 17:54:57	0.07 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	198.10 (n/a)	162.30 (n/a)	164.60 (n/a)	114.10 (n/a)	31.98 (n/a)

test_mem_copy[input_length_2048-num_cores_16-num_channels_2-bypass_False-tile_size_128]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.05 (-8.29%)	0.04 (+35.44%)	0.04 (+60.84%)	0.04 (+59.15%)	0.00 (-80.48%)	200.80 (-37.17%)	191.38 (-30.35%)	189.60 (-37.84%)	180.30 (+9.07%)	8.77 (-86.09%)
`4d4b803` — 2026-06-22 17:54:57	0.05 (n/a)	0.03 (n/a)	0.03 (n/a)	0.03 (n/a)	0.01 (n/a)	319.60 (n/a)	274.78 (n/a)	305.00 (n/a)	165.30 (n/a)	63.06 (n/a)

test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.06 (+3.16%)	0.06 (+7.56%)	0.05 (+3.01%)	0.05 (+15.13%)	0.01 (-9.03%)	163.10 (-13.15%)	147.04 (-7.38%)	151.50 (-2.88%)	131.60 (-3.09%)	14.59 (-25.26%)
`4d4b803` — 2026-06-22 17:54:57	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	187.80 (n/a)	158.76 (n/a)	156.00 (n/a)	135.80 (n/a)	19.52 (n/a)

test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.07 (-7.13%)	0.05 (-4.67%)	0.05 (-0.64%)	0.04 (-12.02%)	0.01 (-1.19%)	204.90 (+13.64%)	157.78 (+5.40%)	158.60 (+0.63%)	125.20 (+7.65%)	32.78 (+18.94%)
`4d4b803` — 2026-06-22 17:54:57	0.07 (n/a)	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.01 (n/a)	180.30 (n/a)	149.70 (n/a)	157.60 (n/a)	116.30 (n/a)	27.56 (n/a)

test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.06 (-19.72%)	0.05 (-1.87%)	0.05 (+6.57%)	0.04 (-8.42%)	0.01 (-39.93%)	204.20 (+9.20%)	162.06 (+0.25%)	158.30 (-6.16%)	137.70 (+24.62%)	25.73 (-13.19%)
`4d4b803` — 2026-06-22 17:54:57	0.07 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	187.00 (n/a)	161.66 (n/a)	168.70 (n/a)	110.50 (n/a)	29.64 (n/a)

test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.06 (-18.94%)	0.05 (-7.60%)	0.04 (+3.27%)	0.04 (+1.50%)	0.01 (-45.74%)	231.40 (-1.49%)	179.78 (+3.73%)	182.30 (-3.19%)	146.50 (+23.32%)	33.40 (-31.73%)
`4d4b803` — 2026-06-22 17:54:57	0.07 (n/a)	0.05 (n/a)	0.04 (n/a)	0.03 (n/a)	0.01 (n/a)	234.90 (n/a)	173.32 (n/a)	188.30 (n/a)	118.80 (n/a)	48.92 (n/a)

test_mem_copy[input_length_2048-num_cores_8-num_channels_1-bypass_False-tile_size_256]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.06 (+0.01%)	0.05 (+17.90%)	0.05 (+22.24%)	0.04 (+21.38%)	0.01 (-33.26%)	191.70 (-17.62%)	164.12 (-16.73%)	158.60 (-18.16%)	142.00 (+0.00%)	19.85 (-43.90%)
`4d4b803` — 2026-06-22 17:54:57	0.06 (n/a)	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.01 (n/a)	232.70 (n/a)	197.10 (n/a)	193.80 (n/a)	142.00 (n/a)	35.38 (n/a)

test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.07 (+12.62%)	0.06 (+10.13%)	0.06 (+21.36%)	0.05 (+17.56%)	0.01 (-5.62%)	178.30 (-14.93%)	151.26 (-9.98%)	144.70 (-17.64%)	119.50 (-11.15%)	23.99 (-24.96%)
`4d4b803` — 2026-06-22 17:54:57	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	209.60 (n/a)	168.02 (n/a)	175.70 (n/a)	134.50 (n/a)	31.97 (n/a)

iron/operators/mha

test_mha[seq_len_16384-dim_64-num_heads_1-num_pipelines_8-num_kv_heads_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.21 (-0.15%)	0.20 (-0.25%)	0.21 (-0.17%)	0.20 (-0.58%)	0.00 (+203.50%)	41122.20 (+0.59%)	40946.18 (+0.25%)	40914.10 (+0.17%)	40852.30 (+0.15%)	106.67 (+205.89%)
`4d4b803` — 2026-06-22 17:54:57	0.21 (n/a)	0.21 (n/a)	0.21 (n/a)	0.21 (n/a)	0.00 (n/a)	40882.90 (n/a)	40842.88 (n/a)	40843.80 (n/a)	40791.90 (n/a)	34.87 (n/a)

iron/operators/rms_norm

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.08 (+15.11%)	0.06 (+20.82%)	0.06 (+18.74%)	0.04 (+1.47%)	0.02 (+39.76%)	219.70 (-1.44%)	148.32 (-15.19%)	144.40 (-15.75%)	109.10 (-13.14%)	44.52 (+18.09%)
`4d4b803` — 2026-06-22 17:54:57	0.07 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	222.90 (n/a)	174.88 (n/a)	171.40 (n/a)	125.60 (n/a)	37.70 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.11 (+5.67%)	0.08 (-4.68%)	0.07 (-9.56%)	0.06 (-14.34%)	0.02 (+61.70%)	203.50 (+16.75%)	162.16 (+7.60%)	168.30 (+10.58%)	115.80 (-5.39%)	34.35 (+79.45%)
`4d4b803` — 2026-06-22 17:54:57	0.10 (n/a)	0.08 (n/a)	0.08 (n/a)	0.07 (n/a)	0.01 (n/a)	174.30 (n/a)	150.70 (n/a)	152.20 (n/a)	122.40 (n/a)	19.14 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.07 (-7.92%)	0.06 (-7.43%)	0.06 (-11.32%)	0.04 (-2.78%)	0.01 (-31.72%)	193.00 (+2.88%)	150.12 (+5.61%)	142.30 (+12.76%)	118.30 (+8.63%)	27.36 (-23.22%)
`4d4b803` — 2026-06-22 17:54:57	0.08 (n/a)	0.06 (n/a)	0.06 (n/a)	0.04 (n/a)	0.01 (n/a)	187.60 (n/a)	142.14 (n/a)	126.20 (n/a)	108.90 (n/a)	35.64 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.08 (+14.18%)	0.07 (+26.22%)	0.07 (+25.22%)	0.06 (+65.00%)	0.01 (-18.11%)	173.80 (-39.40%)	149.40 (-23.38%)	147.20 (-20.13%)	126.70 (-12.44%)	22.56 (-58.44%)
`4d4b803` — 2026-06-22 17:54:57	0.07 (n/a)	0.06 (n/a)	0.06 (n/a)	0.04 (n/a)	0.01 (n/a)	286.80 (n/a)	195.00 (n/a)	184.30 (n/a)	144.70 (n/a)	54.29 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.06 (-6.37%)	0.05 (-0.71%)	0.05 (+0.40%)	0.05 (+15.94%)	0.01 (-44.32%)	175.40 (-13.77%)	157.10 (-1.62%)	160.90 (-0.37%)	135.10 (+6.80%)	17.32 (-46.99%)
`4d4b803` — 2026-06-22 17:54:57	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	203.40 (n/a)	159.68 (n/a)	161.50 (n/a)	126.50 (n/a)	32.68 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.08 (-5.72%)	0.07 (+15.33%)	0.07 (+19.86%)	0.05 (+34.21%)	0.01 (-26.15%)	216.50 (-25.47%)	157.72 (-17.28%)	145.20 (-16.60%)	126.50 (+6.12%)	36.87 (-42.53%)
`4d4b803` — 2026-06-22 17:54:57	0.09 (n/a)	0.06 (n/a)	0.06 (n/a)	0.04 (n/a)	0.02 (n/a)	290.50 (n/a)	190.66 (n/a)	174.10 (n/a)	119.20 (n/a)	64.15 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.06 (-18.62%)	0.05 (-9.78%)	0.05 (+1.48%)	0.04 (-6.49%)	0.01 (-27.20%)	233.00 (+6.93%)	179.62 (+9.62%)	164.50 (-1.44%)	146.80 (+22.95%)	35.22 (-3.67%)
`4d4b803` — 2026-06-22 17:54:57	0.07 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	217.90 (n/a)	163.86 (n/a)	166.90 (n/a)	119.40 (n/a)	36.56 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.06 (+4.22%)	0.05 (-4.23%)	0.06 (+0.72%)	0.04 (-18.27%)	0.01 (+117.66%)	225.20 (+22.32%)	173.48 (+6.72%)	156.70 (-0.70%)	144.10 (-4.06%)	33.35 (+153.78%)
`4d4b803` — 2026-06-22 17:54:57	0.06 (n/a)	0.06 (n/a)	0.06 (n/a)	0.05 (n/a)	0.00 (n/a)	184.10 (n/a)	162.56 (n/a)	157.80 (n/a)	150.20 (n/a)	13.14 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.07 (-3.69%)	0.05 (-2.80%)	0.05 (+1.94%)	0.03 (-12.50%)	0.01 (+12.98%)	242.70 (+14.27%)	163.94 (+4.70%)	150.40 (-1.89%)	125.30 (+3.81%)	46.11 (+35.69%)
`4d4b803` — 2026-06-22 17:54:57	0.07 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	212.40 (n/a)	156.58 (n/a)	153.30 (n/a)	120.70 (n/a)	33.98 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.08 (+2.40%)	0.05 (-3.02%)	0.05 (-5.10%)	0.04 (-14.14%)	0.01 (+33.50%)	221.80 (+16.43%)	176.60 (+5.51%)	183.30 (+5.41%)	121.20 (-2.34%)	39.45 (+55.95%)
`4d4b803` — 2026-06-22 17:54:57	0.07 (n/a)	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.01 (n/a)	190.50 (n/a)	167.38 (n/a)	173.90 (n/a)	124.10 (n/a)	25.30 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.07 (+48.48%)	0.04 (-4.91%)	0.04 (-16.27%)	0.03 (-35.61%)	0.02 (+619.66%)	303.80 (+55.32%)	212.90 (+15.03%)	215.00 (+19.38%)	119.50 (-32.68%)	66.03 (+616.74%)
`4d4b803` — 2026-06-22 17:54:57	0.05 (n/a)	0.04 (n/a)	0.05 (n/a)	0.04 (n/a)	0.00 (n/a)	195.60 (n/a)	185.08 (n/a)	180.10 (n/a)	177.50 (n/a)	9.21 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_True]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.06 (+1.74%)	0.05 (+28.83%)	0.05 (+30.56%)	0.05 (+52.30%)	0.00 (-57.05%)	191.20 (-34.36%)	165.96 (-25.92%)	160.70 (-23.40%)	151.40 (-1.75%)	15.45 (-72.59%)
`4d4b803` — 2026-06-22 17:54:57	0.06 (n/a)	0.04 (n/a)	0.04 (n/a)	0.03 (n/a)	0.01 (n/a)	291.30 (n/a)	224.02 (n/a)	209.80 (n/a)	154.10 (n/a)	56.38 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.06 (-1.16%)	0.05 (-4.21%)	0.04 (-11.72%)	0.04 (-10.42%)	0.01 (+49.13%)	196.40 (+11.65%)	170.56 (+5.68%)	186.10 (+13.27%)	139.40 (+1.16%)	26.47 (+65.43%)
`4d4b803` — 2026-06-22 17:54:57	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.05 (n/a)	0.01 (n/a)	175.90 (n/a)	161.40 (n/a)	164.30 (n/a)	137.80 (n/a)	16.00 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256-weighted_True]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.06 (-1.17%)	0.05 (+2.01%)	0.05 (+2.99%)	0.04 (+7.41%)	0.01 (-22.96%)	205.30 (-6.89%)	178.80 (-2.75%)	178.80 (-2.88%)	157.30 (+1.16%)	20.55 (-26.69%)
`4d4b803` — 2026-06-22 17:54:57	0.06 (n/a)	0.05 (n/a)	0.05 (n/a)	0.04 (n/a)	0.01 (n/a)	220.50 (n/a)	183.86 (n/a)	184.10 (n/a)	155.50 (n/a)	28.03 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_8-num_channels_2-tile_size_128-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.05 (+0.74%)	0.04 (+6.16%)	0.04 (+17.20%)	0.02 (-12.62%)	0.01 (+23.68%)	330.90 (+14.46%)	209.72 (-3.01%)	183.60 (-14.68%)	159.50 (-0.75%)	69.06 (+47.51%)
`4d4b803` — 2026-06-22 17:54:57	0.05 (n/a)	0.04 (n/a)	0.04 (n/a)	0.03 (n/a)	0.01 (n/a)	289.10 (n/a)	216.22 (n/a)	215.20 (n/a)	160.70 (n/a)	46.82 (n/a)

iron/operators/rope

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.90 (+29.46%)	0.65 (+17.89%)	0.65 (+25.10%)	0.43 (-2.32%)	0.17 (+53.25%)	229.00 (+2.37%)	159.76 (-12.86%)	151.40 (-20.06%)	108.80 (-22.73%)	44.77 (+23.46%)
`4d4b803` — 2026-06-22 17:54:57	0.70 (n/a)	0.55 (n/a)	0.52 (n/a)	0.44 (n/a)	0.11 (n/a)	223.70 (n/a)	183.34 (n/a)	189.40 (n/a)	140.80 (n/a)	36.26 (n/a)

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.73 (+13.91%)	0.60 (+10.40%)	0.61 (+8.73%)	0.49 (+10.27%)	0.09 (+17.31%)	200.50 (-9.32%)	168.18 (-9.29%)	161.10 (-8.05%)	134.90 (-12.23%)	25.94 (-6.98%)
`4d4b803` — 2026-06-22 17:54:57	0.64 (n/a)	0.54 (n/a)	0.56 (n/a)	0.44 (n/a)	0.08 (n/a)	221.10 (n/a)	185.40 (n/a)	175.20 (n/a)	153.70 (n/a)	27.88 (n/a)

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.73 (+18.54%)	0.57 (+10.63%)	0.56 (+11.10%)	0.42 (-4.45%)	0.13 (+95.72%)	232.50 (+4.64%)	178.60 (-6.84%)	175.80 (-9.98%)	134.80 (-15.64%)	41.53 (+71.27%)
`4d4b803` — 2026-06-22 17:54:57	0.62 (n/a)	0.52 (n/a)	0.50 (n/a)	0.44 (n/a)	0.07 (n/a)	222.20 (n/a)	191.72 (n/a)	195.30 (n/a)	159.80 (n/a)	24.25 (n/a)

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_8-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.85 (+47.23%)	0.63 (+27.81%)	0.61 (+30.90%)	0.39 (-8.58%)	0.17 (+177.04%)	252.90 (+9.39%)	167.62 (-17.50%)	161.20 (-23.60%)	116.10 (-32.07%)	51.31 (+115.66%)
`4d4b803` — 2026-06-22 17:54:57	0.58 (n/a)	0.49 (n/a)	0.47 (n/a)	0.43 (n/a)	0.06 (n/a)	231.20 (n/a)	203.18 (n/a)	211.00 (n/a)	170.90 (n/a)	23.79 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.58 (-5.03%)	0.48 (-4.55%)	0.47 (-4.51%)	0.39 (+4.54%)	0.08 (-21.80%)	189.20 (-4.35%)	155.42 (+3.54%)	155.50 (+4.71%)	127.10 (+5.30%)	24.49 (-20.77%)
`4d4b803` — 2026-06-22 17:54:57	0.61 (n/a)	0.51 (n/a)	0.50 (n/a)	0.37 (n/a)	0.10 (n/a)	197.80 (n/a)	150.10 (n/a)	148.50 (n/a)	120.70 (n/a)	30.91 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.55 (-4.25%)	0.49 (+3.65%)	0.51 (+17.30%)	0.42 (+9.19%)	0.06 (-25.93%)	175.10 (-8.42%)	152.16 (-4.66%)	143.80 (-14.76%)	134.10 (+4.44%)	20.50 (-26.88%)
`4d4b803` — 2026-06-22 17:54:57	0.57 (n/a)	0.47 (n/a)	0.44 (n/a)	0.39 (n/a)	0.09 (n/a)	191.20 (n/a)	159.60 (n/a)	168.70 (n/a)	128.40 (n/a)	28.04 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.54 (+3.97%)	0.41 (-4.47%)	0.37 (-12.36%)	0.29 (-20.61%)	0.11 (+60.78%)	257.20 (+25.95%)	189.06 (+8.84%)	200.40 (+14.06%)	135.90 (-3.82%)	51.01 (+85.11%)
`4d4b803` — 2026-06-22 17:54:57	0.52 (n/a)	0.43 (n/a)	0.42 (n/a)	0.36 (n/a)	0.07 (n/a)	204.20 (n/a)	173.70 (n/a)	175.70 (n/a)	141.30 (n/a)	27.56 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_8-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.51 (+13.39%)	0.40 (+4.82%)	0.40 (+13.31%)	0.29 (-12.30%)	0.08 (+38.85%)	250.10 (+13.99%)	187.96 (-3.11%)	183.60 (-11.77%)	144.10 (-11.81%)	38.96 (+44.19%)
`4d4b803` — 2026-06-22 17:54:57	0.45 (n/a)	0.39 (n/a)	0.35 (n/a)	0.34 (n/a)	0.06 (n/a)	219.40 (n/a)	194.00 (n/a)	208.10 (n/a)	163.40 (n/a)	27.02 (n/a)

iron/operators/softmax

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	1.08 (+14.62%)	0.84 (+3.68%)	0.77 (-7.31%)	0.64 (-6.77%)	0.18 (+61.66%)	206.30 (+7.28%)	161.06 (-1.54%)	170.20 (+7.93%)	121.90 (-12.74%)	33.82 (+47.87%)
`4d4b803` — 2026-06-22 17:54:57	0.94 (n/a)	0.81 (n/a)	0.83 (n/a)	0.68 (n/a)	0.11 (n/a)	192.30 (n/a)	163.58 (n/a)	157.70 (n/a)	139.70 (n/a)	22.87 (n/a)

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.91 (-18.86%)	0.75 (-3.92%)	0.71 (+5.41%)	0.67 (+5.62%)	0.10 (-51.02%)	196.40 (-5.35%)	177.20 (+0.93%)	184.60 (-5.14%)	144.60 (+23.27%)	21.11 (-42.16%)
`4d4b803` — 2026-06-22 17:54:57	1.12 (n/a)	0.78 (n/a)	0.67 (n/a)	0.63 (n/a)	0.20 (n/a)	207.50 (n/a)	175.56 (n/a)	194.60 (n/a)	117.30 (n/a)	36.50 (n/a)

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	1.13 (-2.25%)	0.87 (+2.50%)	0.87 (+3.18%)	0.60 (-1.00%)	0.20 (-10.06%)	219.80 (+1.01%)	158.14 (-3.23%)	150.60 (-3.09%)	115.50 (+2.30%)	38.96 (-6.01%)
`4d4b803` — 2026-06-22 17:54:57	1.16 (n/a)	0.85 (n/a)	0.84 (n/a)	0.60 (n/a)	0.22 (n/a)	217.60 (n/a)	163.42 (n/a)	155.40 (n/a)	112.90 (n/a)	41.45 (n/a)

iron/operators/swiglu_decode

test_swiglu_decode[embedding_dim_1024-hidden_dim_3584]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.00 (+9.09%)	0.00 (+17.39%)	0.00 (+22.22%)	0.00 (+12.50%)	0.00 (+19.02%)	4407.94 (-14.71%)	3899.73 (-12.00%)	3776.27 (-15.95%)	3497.03 (-2.23%)	435.00 (-24.12%)
`4d4b803` — 2026-06-22 17:54:57	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	5168.09 (n/a)	4431.69 (n/a)	4492.92 (n/a)	3576.64 (n/a)	573.28 (n/a)

test_swiglu_decode[embedding_dim_2048-hidden_dim_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.00 (+4.55%)	0.00 (+1.00%)	0.00 (+5.00%)	0.00 (-11.11%)	0.00 (+96.98%)	4971.16 (+9.21%)	4138.88 (-0.28%)	3955.99 (-4.04%)	3560.04 (-6.48%)	617.57 (+98.30%)
`4d4b803` — 2026-06-22 17:54:57	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	4552.05 (n/a)	4150.54 (n/a)	4122.63 (n/a)	3806.88 (n/a)	311.43 (n/a)

iron/operators/swiglu_prefill

test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	0.27 (-0.47%)	0.18 (-25.87%)	0.15 (-37.67%)	0.15 (-22.19%)	0.05 (+71.15%)	14210.43 (+28.53%)	12390.95 (+40.14%)	13625.34 (+60.40%)	7673.61 (+0.49%)	2695.86 (+107.69%)
`4d4b803` — 2026-06-22 17:54:57	0.27 (n/a)	0.24 (n/a)	0.25 (n/a)	0.19 (n/a)	0.03 (n/a)	11055.95 (n/a)	8841.86 (n/a)	8494.64 (n/a)	7636.48 (n/a)	1298.01 (n/a)

iron/operators/transpose

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	3.52 (+13.86%)	3.02 (+12.32%)	2.83 (-1.11%)	2.75 (+33.32%)	0.34 (-15.31%)	190.40 (-25.01%)	175.00 (-11.90%)	185.50 (+1.15%)	149.00 (-12.15%)	18.36 (-44.93%)
`4d4b803` — 2026-06-22 17:54:57	3.09 (n/a)	2.69 (n/a)	2.86 (n/a)	2.07 (n/a)	0.40 (n/a)	253.90 (n/a)	198.64 (n/a)	183.40 (n/a)	169.60 (n/a)	33.34 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:50:03	3.16 (-21.76%)	2.76 (-4.50%)	2.83 (+3.92%)	2.04 (+2.29%)	0.45 (-51.58%)	256.70 (-2.25%)	194.90 (-1.26%)	185.40 (-3.74%)	166.00 (+27.79%)	36.89 (-40.62%)
`4d4b803` — 2026-06-22 17:54:57	4.04 (n/a)	2.89 (n/a)	2.72 (n/a)	2.00 (n/a)	0.93 (n/a)	262.60 (n/a)	197.38 (n/a)	192.60 (n/a)	129.90 (n/a)	62.14 (n/a)

Krackan - Examples

IRON

Tested on 2026_06_23_15_28_12 at commit 5f943a9.

iron/applications/llama_3.2_1b

Test	Checks	TTFT (mean)	TPS (mean)
test_llama_3_2_1b[llama_3.2_1b_prompt_1024_tokens_1]	✅ 5/5	2.12	n/a
test_llama_3_2_1b[llama_3.2_1b_prompt_1024_tokens_40]	✅ 5/5	2.15	4.17
test_llama_3_2_1b[llama_3.2_1b_prompt_13_tokens_1]	✅ 5/5	2.10	n/a
test_llama_3_2_1b[llama_3.2_1b_prompt_13_tokens_40]	✅ 5/5	2.09	4.17

Trends:

IRON Trends

iron/applications/llama_3.2_1b

test_llama_3_2_1b[llama_3.2_1b_prompt_1024_tokens_1]

Commit/Date	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`5f943a9` — 2026-06-23 15:22:26	2.13 (-0.75%)	2.12 (-0.30%)	2.12 (-0.52%)	2.11 (+0.05%)	0.01 (-47.73%)
`4d4b803` — 2026-06-22 18:03:47	2.15 (n/a)	2.12 (n/a)	2.13 (n/a)	2.10 (n/a)	0.02 (n/a)

test_llama_3_2_1b[llama_3.2_1b_prompt_1024_tokens_40]

Commit/Date	TPS (max)	TPS (mean)	TPS (median)	TPS (min)	TPS (stddev)	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`5f943a9` — 2026-06-23 15:22:26	4.18 (-0.17%)	4.17 (+0.06%)	4.17 (-0.02%)	4.15 (+0.24%)	0.01 (-41.34%)	2.26 (+0.04%)	2.15 (-0.26%)	2.13 (-0.19%)	2.11 (-0.38%)	0.06 (+6.38%)
`4d4b803` — 2026-06-22 18:03:47	4.19 (n/a)	4.17 (n/a)	4.17 (n/a)	4.14 (n/a)	0.02 (n/a)	2.26 (n/a)	2.16 (n/a)	2.13 (n/a)	2.12 (n/a)	0.06 (n/a)

test_llama_3_2_1b[llama_3.2_1b_prompt_13_tokens_1]

Commit/Date	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`5f943a9` — 2026-06-23 15:22:26	2.10 (+0.24%)	2.10 (+0.69%)	2.10 (+0.62%)	2.08 (+1.12%)	0.01 (-43.28%)
`4d4b803` — 2026-06-22 18:03:47	2.10 (n/a)	2.08 (n/a)	2.08 (n/a)	2.06 (n/a)	0.02 (n/a)

test_llama_3_2_1b[llama_3.2_1b_prompt_13_tokens_40]

Commit/Date	TPS (max)	TPS (mean)	TPS (median)	TPS (min)	TPS (stddev)	TTFT (max)	TTFT (mean)	TTFT (median)	TTFT (min)	TTFT (stddev)
`5f943a9` — 2026-06-23 15:22:26	4.19 (+0.24%)	4.17 (+0.06%)	4.16 (+0.17%)	4.14 (-0.17%)	0.02 (+28.55%)	2.10 (+0.24%)	2.09 (-0.03%)	2.09 (-0.24%)	2.07 (+0.34%)	0.01 (-4.31%)
`4d4b803` — 2026-06-22 18:03:47	4.18 (n/a)	4.16 (n/a)	4.16 (n/a)	4.15 (n/a)	0.01 (n/a)	2.10 (n/a)	2.09 (n/a)	2.10 (n/a)	2.06 (n/a)	0.01 (n/a)

Phoenix - Small

IRON

Tested on 2026_06_23_15_28_25 at commit 5f943a9.

iron/operators/axpy

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]	✅ 5/5	277.26	0.05	n/a
test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]	✅ 5/5	375.34	0.04	n/a
test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]	✅ 5/5	401.70	0.04	n/a

iron/operators/dequant

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]	✅ 5/5	323.86	0.02	n/a
test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]	✅ 5/5	699.52	0.01	n/a
test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]	✅ 5/5	310.90	0.02	n/a
test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]	✅ 5/5	356.56	0.02	n/a
test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]	✅ 5/5	514.32	0.01	n/a
test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]	✅ 5/5	430.66	0.01	n/a

iron/operators/elementwise_add

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]	✅ 5/5	368.78	0.04	n/a
test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]	✅ 5/5	445.46	0.03	n/a
test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]	✅ 5/5	532.68	0.02	n/a

iron/operators/elementwise_mul

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]	✅ 5/5	295.54	0.04	n/a
test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]	✅ 5/5	445.60	0.03	n/a
test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]	✅ 5/5	423.92	0.03	n/a

iron/operators/gelu

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅ 5/5	283.42	0.03	n/a
test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅ 5/5	422.78	0.03	n/a
test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅ 5/5	326.46	0.03	n/a
test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅ 5/5	452.02	0.02	n/a
test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅ 5/5	371.38	0.02	n/a
test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅ 5/5	399.72	0.03	n/a

iron/operators/gemm

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]	✅ 5/5	700.00	0.34	14.39
test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]	✅ 5/5	520.82	0.44	18.62
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]	✅ 5/5	82039.74	0.31	209.46
test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]	✅ 5/5	24793.78	1.02	693.13
test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]	✅ 5/5	3803.54	2.46	645.45
test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]	✅ 5/5	6253.22	0.20	10.81

iron/operators/gemv

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]	✅ 5/5	n/a	0.10	0.10
test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]	✅ 5/5	n/a	3.68	3.68
test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]	✅ 5/5	n/a	6.26	6.25
test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]	✅ 5/5	n/a	8.91	8.90
test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]	✅ 5/5	n/a	3.57	3.57
test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]	✅ 5/5	n/a	6.32	6.31
test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]	✅ 5/5	n/a	10.36	10.35

iron/operators/layer_norm

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅ 5/5	270.86	0.03	n/a
test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅ 5/5	379.98	0.02	n/a
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅ 5/5	464.90	0.02	n/a
test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅ 5/5	361.42	0.02	n/a
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅ 5/5	398.72	0.02	n/a
test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅ 5/5	423.90	0.02	n/a

iron/operators/mem_copy

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048]	✅ 5/5	363.22	0.02	n/a
test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024]	✅ 5/5	391.50	0.02	n/a
test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024]	✅ 5/5	607.10	0.02	n/a
test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512]	✅ 5/5	386.74	0.03	n/a
test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512]	✅ 5/5	468.12	0.02	n/a
test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256]	✅ 5/5	503.50	0.02	n/a

iron/operators/relu

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_relu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅ 5/5	389.10	0.02	n/a
test_relu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅ 5/5	526.00	0.02	n/a
test_relu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅ 5/5	349.74	0.03	n/a
test_relu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅ 5/5	364.42	0.02	n/a
test_relu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅ 5/5	366.02	0.03	n/a
test_relu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅ 5/5	400.48	0.02	n/a

iron/operators/rms_norm

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False]	✅ 5/5	720.68	0.02	n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True]	✅ 5/5	268.02	0.05	n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False]	✅ 5/5	687.66	0.02	n/a
test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True]	✅ 5/5	463.42	0.02	n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False]	✅ 5/5	396.52	0.02	n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True]	✅ 5/5	316.92	0.03	n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False]	✅ 5/5	461.76	0.02	n/a
test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True]	✅ 5/5	543.36	0.02	n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False]	✅ 5/5	460.88	0.02	n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True]	✅ 5/5	423.12	0.03	n/a
test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False]	✅ 5/5	382.50	0.02	n/a

iron/operators/rope

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0]	✅ 5/5	385.42	0.28	n/a
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0]	✅ 5/5	426.98	0.25	n/a
test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0]	✅ 5/5	418.48	0.25	n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0]	✅ 5/5	400.22	0.21	n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0]	✅ 5/5	379.20	0.22	n/a
test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0]	✅ 5/5	457.10	0.18	n/a

iron/operators/sigmoid

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅ 5/5	361.18	0.02	n/a
test_sigmoid[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅ 5/5	864.58	0.01	n/a
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅ 5/5	323.70	0.03	n/a
test_sigmoid[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅ 5/5	437.52	0.02	n/a
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅ 5/5	449.88	0.02	n/a
test_sigmoid[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅ 5/5	384.40	0.02	n/a

iron/operators/silu

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_silu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅ 5/5	400.00	0.02	n/a
test_silu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅ 5/5	473.58	0.02	n/a
test_silu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅ 5/5	605.86	0.02	n/a

iron/operators/softmax

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024]	✅ 5/5	561.56	0.26	n/a
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048]	✅ 5/5	451.12	0.32	n/a
test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512]	✅ 5/5	453.02	0.32	n/a

iron/operators/swiglu_decode

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_swiglu_decode[embedding_dim_1024-hidden_dim_3584]	✅ 5/5	17024.41	0.00	n/a
test_swiglu_decode[embedding_dim_2048-hidden_dim_2048]	✅ 5/5	7619.61	0.00	n/a

iron/operators/swiglu_prefill

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False]	✅ 5/5	24265.70	0.09	n/a

iron/operators/tanh

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_tanh[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]	✅ 5/5	307.52	0.03	n/a
test_tanh[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]	✅ 5/5	438.34	0.03	n/a
test_tanh[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]	✅ 5/5	367.66	0.02	n/a
test_tanh[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]	✅ 5/5	374.46	0.02	n/a
test_tanh[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]	✅ 5/5	376.24	0.02	n/a
test_tanh[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]	✅ 5/5	440.92	0.02	n/a

iron/operators/transpose

Test	Checks	Latency (mean)	Bandwidth (mean)	Throughput (mean)
test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8]	✅ 5/5	952.66	1.26	n/a
test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8]	✅ 5/5	695.12	1.30	n/a

Trends:

IRON Trends

iron/operators/axpy

test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.08 (+66.26%)	0.05 (+34.54%)	0.04 (-2.81%)	0.03 (+12.62%)	0.02 (+58.43%)	466.00 (-11.22%)	277.26 (-24.01%)	273.60 (+2.90%)	148.40 (-39.87%)	119.08 (-18.28%)
`4d4b803` — 2026-06-22 18:12:43	0.05 (n/a)	0.04 (n/a)	0.05 (n/a)	0.02 (n/a)	0.01 (n/a)	524.90 (n/a)	364.88 (n/a)	265.90 (n/a)	246.80 (n/a)	145.71 (n/a)

test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.05 (-24.77%)	0.04 (-1.81%)	0.04 (+39.14%)	0.02 (-11.30%)	0.01 (-41.26%)	596.60 (+12.74%)	375.34 (-5.25%)	343.40 (-28.14%)	263.60 (+32.93%)	131.96 (-12.51%)
`4d4b803` — 2026-06-22 18:12:43	0.06 (n/a)	0.04 (n/a)	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	529.20 (n/a)	396.12 (n/a)	477.90 (n/a)	198.30 (n/a)	150.84 (n/a)

test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.07 (+30.89%)	0.04 (+16.26%)	0.02 (-11.06%)	0.02 (+21.05%)	0.02 (+47.53%)	558.90 (-17.38%)	401.70 (-7.27%)	520.70 (+12.44%)	172.30 (-23.59%)	185.35 (+0.91%)
`4d4b803` — 2026-06-22 18:12:43	0.05 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	676.50 (n/a)	433.18 (n/a)	463.10 (n/a)	225.50 (n/a)	183.68 (n/a)

iron/operators/dequant

test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.02 (+9.98%)	0.02 (+4.05%)	0.02 (+4.68%)	0.01 (-21.03%)	0.00 (+57.32%)	558.10 (+26.61%)	323.86 (+2.00%)	274.50 (-4.49%)	240.30 (-9.05%)	131.98 (+86.02%)
`4d4b803` — 2026-06-22 18:12:43	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.00 (n/a)	440.80 (n/a)	317.50 (n/a)	287.40 (n/a)	264.20 (n/a)	70.95 (n/a)

test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.02 (+6.38%)	0.01 (-21.28%)	0.01 (-35.14%)	0.00 (-77.68%)	0.01 (+99.54%)	2003.30 (+347.97%)	699.52 (+111.99%)	439.50 (+54.16%)	245.70 (-6.01%)	739.99 (+766.82%)
`4d4b803` — 2026-06-22 18:12:43	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.00 (n/a)	447.20 (n/a)	329.98 (n/a)	285.10 (n/a)	261.40 (n/a)	85.37 (n/a)

test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.03 (+25.25%)	0.02 (+40.99%)	0.02 (+83.07%)	0.01 (-6.48%)	0.01 (+19.31%)	618.30 (+6.92%)	310.90 (-26.50%)	239.70 (-45.37%)	209.00 (-20.17%)	173.10 (+10.69%)
`4d4b803` — 2026-06-22 18:12:43	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	578.30 (n/a)	423.02 (n/a)	438.80 (n/a)	261.80 (n/a)	156.39 (n/a)

test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.02 (+44.25%)	0.02 (+65.21%)	0.02 (+72.53%)	0.01 (+279.26%)	0.01 (+23.28%)	542.40 (-73.63%)	356.56 (-54.11%)	273.80 (-42.03%)	230.20 (-30.68%)	146.79 (-79.67%)
`4d4b803` — 2026-06-22 18:12:43	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	0.00 (n/a)	0.00 (n/a)	2057.20 (n/a)	777.02 (n/a)	472.30 (n/a)	332.10 (n/a)	721.88 (n/a)

test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.01 (-32.54%)	0.01 (-40.45%)	0.01 (-45.02%)	0.01 (-10.82%)	0.00 (-53.90%)	709.00 (+12.13%)	514.32 (+54.25%)	494.60 (+81.91%)	361.90 (+48.26%)	124.63 (-25.65%)
`4d4b803` — 2026-06-22 18:12:43	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	632.30 (n/a)	333.44 (n/a)	271.90 (n/a)	244.10 (n/a)	167.63 (n/a)

test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.02 (+23.16%)	0.01 (-2.88%)	0.01 (-25.30%)	0.01 (-8.22%)	0.01 (+65.95%)	655.80 (+8.95%)	430.66 (+10.45%)	478.40 (+33.86%)	248.20 (-18.81%)	167.11 (+36.81%)
`4d4b803` — 2026-06-22 18:12:43	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.00 (n/a)	601.90 (n/a)	389.90 (n/a)	357.40 (n/a)	305.70 (n/a)	122.15 (n/a)

iron/operators/elementwise_add

test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.02 (n/a)	0.01 (n/a)	512.70 (n/a)	368.78 (n/a)	297.50 (n/a)	280.20 (n/a)	113.63 (n/a)

test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.05 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	646.50 (n/a)	445.46 (n/a)	443.20 (n/a)	246.10 (n/a)	193.60 (n/a)

test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.04 (n/a)	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	686.00 (n/a)	532.68 (n/a)	560.40 (n/a)	345.70 (n/a)	136.65 (n/a)

iron/operators/elementwise_mul

test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.05 (n/a)	0.04 (n/a)	0.04 (n/a)	0.04 (n/a)	0.00 (n/a)	324.30 (n/a)	295.54 (n/a)	295.80 (n/a)	259.90 (n/a)	23.41 (n/a)

test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	632.40 (n/a)	445.60 (n/a)	484.70 (n/a)	275.90 (n/a)	140.70 (n/a)

test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.05 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	624.80 (n/a)	423.92 (n/a)	431.90 (n/a)	248.10 (n/a)	147.05 (n/a)

iron/operators/gelu

test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	464.80 (n/a)	283.42 (n/a)	241.00 (n/a)	227.70 (n/a)	101.80 (n/a)

test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.01 (n/a)	0.01 (n/a)	828.00 (n/a)	422.78 (n/a)	280.20 (n/a)	195.00 (n/a)	269.62 (n/a)

test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	433.00 (n/a)	326.46 (n/a)	292.90 (n/a)	225.80 (n/a)	98.80 (n/a)

test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.04 (n/a)	0.02 (n/a)	0.03 (n/a)	0.01 (n/a)	0.01 (n/a)	1040.80 (n/a)	452.02 (n/a)	280.20 (n/a)	230.40 (n/a)	339.55 (n/a)

test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	518.30 (n/a)	371.38 (n/a)	353.00 (n/a)	270.70 (n/a)	100.69 (n/a)

test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.05 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	0.02 (n/a)	623.50 (n/a)	399.72 (n/a)	432.00 (n/a)	169.20 (n/a)	193.36 (n/a)

iron/operators/gemm

test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.41 (-38.61%)	0.34 (-27.05%)	0.38 (-16.52%)	0.20 (-38.48%)	0.08 (-33.18%)	1089.60 (+62.55%)	700.00 (+38.81%)	587.60 (+19.80%)	545.20 (+62.89%)	226.70 (+83.76%)	17.31 (-38.61%)	14.39 (-27.05%)	16.06 (-16.52%)	8.66 (-38.48%)	3.54 (-33.18%)
`4d4b803` — 2026-06-22 18:12:43	0.66 (n/a)	0.46 (n/a)	0.45 (n/a)	0.33 (n/a)	0.12 (n/a)	670.30 (n/a)	504.30 (n/a)	490.50 (n/a)	334.70 (n/a)	123.36 (n/a)	28.19 (n/a)	19.72 (n/a)	19.24 (n/a)	14.08 (n/a)	5.29 (n/a)

test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.56 (+39.15%)	0.44 (+21.55%)	0.42 (+19.28%)	0.33 (+4.94%)	0.08 (+161.55%)	662.40 (-4.70%)	520.82 (-15.96%)	520.90 (-16.16%)	393.10 (-28.14%)	95.60 (+78.31%)	24.01 (+39.15%)	18.62 (+21.55%)	18.12 (+19.28%)	14.25 (+4.94%)	3.49 (+161.55%)
`4d4b803` — 2026-06-22 18:12:43	0.40 (n/a)	0.36 (n/a)	0.36 (n/a)	0.32 (n/a)	0.03 (n/a)	695.10 (n/a)	619.70 (n/a)	621.30 (n/a)	547.00 (n/a)	53.61 (n/a)	17.25 (n/a)	15.32 (n/a)	15.19 (n/a)	13.58 (n/a)	1.33 (n/a)

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.31 (-0.52%)	0.31 (-0.02%)	0.31 (+0.82%)	0.30 (-0.87%)	0.01 (-3.69%)	84333.20 (+0.87%)	82039.74 (+0.02%)	81235.50 (-0.82%)	80874.80 (+0.52%)	1469.58 (-2.49%)	212.43 (-0.52%)	209.46 (-0.02%)	211.48 (+0.82%)	203.71 (-0.87%)	3.70 (-3.69%)
`4d4b803` — 2026-06-22 18:12:43	0.31 (n/a)	0.31 (n/a)	0.31 (n/a)	0.30 (n/a)	0.01 (n/a)	83603.40 (n/a)	82023.64 (n/a)	81903.40 (n/a)	80454.70 (n/a)	1507.16 (n/a)	213.53 (n/a)	209.51 (n/a)	209.76 (n/a)	205.49 (n/a)	3.85 (n/a)

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:25:33	1.04 (+1.30%)	1.02 (-0.47%)	1.01 (-1.07%)	0.99 (-1.23%)	0.02 (+114.53%)	25369.80 (+1.25%)	24793.78 (+0.50%)	24892.10 (+1.08%)	24123.50 (-1.28%)	493.14 (+113.75%)	712.16 (+1.30%)	693.13 (-0.47%)	690.17 (-1.07%)	677.18 (-1.23%)	13.85 (+114.53%)
`4d4b803` — 2026-06-22 18:12:43	1.03 (n/a)	1.02 (n/a)	1.02 (n/a)	1.00 (n/a)	0.01 (n/a)	25057.80 (n/a)	24670.26 (n/a)	24626.20 (n/a)	24437.30 (n/a)	230.71 (n/a)	703.02 (n/a)	696.43 (n/a)	697.63 (n/a)	685.61 (n/a)	6.46 (n/a)

test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:25:33	3.90 (+12.08%)	2.46 (+20.70%)	1.77 (+5.25%)	1.53 (+15.08%)	1.11 (+31.35%)	5267.60 (-13.10%)	3803.54 (-13.43%)	4558.50 (-4.99%)	2065.10 (-10.78%)	1477.77 (+6.87%)	1023.63 (+12.08%)	645.45 (+20.70%)	463.74 (+5.25%)	401.31 (+15.08%)	290.92 (+31.35%)
`4d4b803` — 2026-06-22 18:12:43	3.48 (n/a)	2.04 (n/a)	1.68 (n/a)	1.33 (n/a)	0.84 (n/a)	6061.80 (n/a)	4393.58 (n/a)	4798.00 (n/a)	2314.70 (n/a)	1382.73 (n/a)	913.28 (n/a)	534.74 (n/a)	440.59 (n/a)	348.73 (n/a)	221.49 (n/a)

test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.21 (-33.65%)	0.20 (-12.61%)	0.21 (-1.04%)	0.17 (-4.77%)	0.02 (-67.19%)	7340.80 (+5.01%)	6253.22 (+10.50%)	5931.30 (+1.05%)	5817.80 (+50.70%)	641.23 (-46.88%)	11.54 (-33.65%)	10.81 (-12.61%)	11.31 (-1.04%)	9.14 (-4.77%)	1.01 (-67.19%)
`4d4b803` — 2026-06-22 18:12:43	0.32 (n/a)	0.23 (n/a)	0.21 (n/a)	0.18 (n/a)	0.06 (n/a)	6990.80 (n/a)	5658.88 (n/a)	5869.50 (n/a)	3860.40 (n/a)	1207.19 (n/a)	17.38 (n/a)	12.37 (n/a)	11.43 (n/a)	9.60 (n/a)	3.06 (n/a)

iron/operators/gemv

test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.14 (+10.17%)	0.10 (+17.77%)	0.11 (+29.39%)	0.07 (+13.77%)	0.04 (+34.44%)	0.14 (+10.17%)	0.10 (+17.77%)	0.11 (+29.39%)	0.06 (+13.77%)	0.04 (+34.44%)
`4d4b803` — 2026-06-22 18:12:43	0.13 (n/a)	0.09 (n/a)	0.09 (n/a)	0.06 (n/a)	0.03 (n/a)	0.13 (n/a)	0.09 (n/a)	0.09 (n/a)	0.06 (n/a)	0.03 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:25:33	3.79 (-3.05%)	3.68 (+2.00%)	3.66 (-2.19%)	3.58 (+7.90%)	0.10 (-64.10%)	3.79 (-3.05%)	3.68 (+2.00%)	3.66 (-2.19%)	3.57 (+7.90%)	0.10 (-64.10%)
`4d4b803` — 2026-06-22 18:12:43	3.91 (n/a)	3.61 (n/a)	3.75 (n/a)	3.31 (n/a)	0.27 (n/a)	3.91 (n/a)	3.61 (n/a)	3.74 (n/a)	3.31 (n/a)	0.27 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:25:33	7.07 (-2.77%)	6.26 (-1.32%)	6.69 (+6.14%)	5.26 (-7.76%)	0.81 (+40.13%)	7.06 (-2.77%)	6.25 (-1.32%)	6.69 (+6.14%)	5.25 (-7.76%)	0.81 (+40.13%)
`4d4b803` — 2026-06-22 18:12:43	7.27 (n/a)	6.34 (n/a)	6.31 (n/a)	5.70 (n/a)	0.58 (n/a)	7.27 (n/a)	6.34 (n/a)	6.30 (n/a)	5.70 (n/a)	0.58 (n/a)

test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:25:33	11.80 (+23.82%)	8.91 (+5.55%)	8.47 (-1.04%)	7.50 (+3.36%)	1.67 (+70.28%)	11.80 (+23.82%)	8.90 (+5.55%)	8.46 (-1.04%)	7.50 (+3.36%)	1.67 (+70.28%)
`4d4b803` — 2026-06-22 18:12:43	9.53 (n/a)	8.44 (n/a)	8.56 (n/a)	7.26 (n/a)	0.98 (n/a)	9.53 (n/a)	8.43 (n/a)	8.55 (n/a)	7.25 (n/a)	0.98 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:25:33	3.77 (-3.77%)	3.57 (-5.02%)	3.52 (-6.75%)	3.38 (-7.30%)	0.16 (+49.50%)	3.77 (-3.77%)	3.57 (-5.02%)	3.52 (-6.75%)	3.38 (-7.30%)	0.16 (+49.50%)
`4d4b803` — 2026-06-22 18:12:43	3.92 (n/a)	3.76 (n/a)	3.77 (n/a)	3.64 (n/a)	0.11 (n/a)	3.92 (n/a)	3.76 (n/a)	3.77 (n/a)	3.64 (n/a)	0.11 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:25:33	6.90 (-0.24%)	6.32 (+1.10%)	6.61 (+8.82%)	5.53 (-2.36%)	0.61 (+1.33%)	6.90 (-0.24%)	6.31 (+1.10%)	6.60 (+8.82%)	5.53 (-2.36%)	0.61 (+1.33%)
`4d4b803` — 2026-06-22 18:12:43	6.92 (n/a)	6.25 (n/a)	6.07 (n/a)	5.66 (n/a)	0.60 (n/a)	6.91 (n/a)	6.24 (n/a)	6.07 (n/a)	5.66 (n/a)	0.60 (n/a)

test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Throughput (max)	Throughput (mean)	Throughput (median)	Throughput (min)	Throughput (stddev)
`5f943a9` — 2026-06-23 15:25:33	13.12 (-7.08%)	10.36 (-4.83%)	9.92 (-14.55%)	7.64 (+3.49%)	2.18 (-34.28%)	13.11 (-7.08%)	10.35 (-4.83%)	9.92 (-14.55%)	7.64 (+3.49%)	2.18 (-34.28%)
`4d4b803` — 2026-06-22 18:12:43	14.12 (n/a)	10.88 (n/a)	11.61 (n/a)	7.39 (n/a)	3.32 (n/a)	14.11 (n/a)	10.88 (n/a)	11.60 (n/a)	7.38 (n/a)	3.32 (n/a)

iron/operators/layer_norm

test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.03 (n/a)	0.03 (n/a)	0.03 (n/a)	0.03 (n/a)	0.00 (n/a)	300.90 (n/a)	270.86 (n/a)	278.80 (n/a)	238.70 (n/a)	27.34 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	546.90 (n/a)	379.98 (n/a)	366.10 (n/a)	238.30 (n/a)	127.63 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	757.40 (n/a)	464.90 (n/a)	449.00 (n/a)	265.50 (n/a)	188.37 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.03 (n/a)	0.02 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	483.90 (n/a)	361.42 (n/a)	323.30 (n/a)	273.10 (n/a)	95.23 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	497.10 (n/a)	398.72 (n/a)	452.40 (n/a)	272.70 (n/a)	109.31 (n/a)

test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	651.00 (n/a)	423.90 (n/a)	372.30 (n/a)	259.90 (n/a)	148.47 (n/a)

iron/operators/mem_copy

test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.04 (+10.92%)	0.02 (+30.42%)	0.02 (+34.73%)	0.02 (+14.05%)	0.01 (+9.00%)	518.90 (-12.33%)	363.22 (-24.05%)	397.20 (-25.77%)	232.50 (-9.85%)	117.08 (-17.56%)
`4d4b803` — 2026-06-22 18:12:43	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	591.90 (n/a)	478.24 (n/a)	535.10 (n/a)	257.90 (n/a)	142.02 (n/a)

test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.04 (+21.71%)	0.02 (+19.78%)	0.03 (+49.81%)	0.01 (-10.22%)	0.01 (+69.46%)	582.20 (+11.40%)	391.50 (-8.02%)	311.20 (-33.26%)	223.50 (-17.86%)	172.41 (+70.91%)
`4d4b803` — 2026-06-22 18:12:43	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	522.60 (n/a)	425.62 (n/a)	466.30 (n/a)	272.10 (n/a)	100.88 (n/a)

test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.02 (-31.47%)	0.02 (-31.28%)	0.02 (-19.34%)	0.01 (-53.10%)	0.00 (-27.56%)	1074.90 (+113.19%)	607.10 (+52.25%)	514.60 (+24.00%)	416.30 (+45.92%)	266.60 (+145.41%)
`4d4b803` — 2026-06-22 18:12:43	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	504.20 (n/a)	398.76 (n/a)	415.00 (n/a)	285.30 (n/a)	108.64 (n/a)

test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.04 (+19.81%)	0.03 (+44.12%)	0.03 (+77.39%)	0.01 (+10.57%)	0.01 (+50.83%)	627.70 (-9.55%)	386.74 (-24.76%)	294.90 (-43.62%)	225.50 (-16.51%)	189.58 (+21.65%)
`4d4b803` — 2026-06-22 18:12:43	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	694.00 (n/a)	514.00 (n/a)	523.10 (n/a)	270.10 (n/a)	155.85 (n/a)

test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.04 (+13.89%)	0.02 (-27.73%)	0.02 (-48.66%)	0.01 (-12.95%)	0.01 (+35.91%)	641.50 (+14.86%)	468.12 (+46.60%)	492.50 (+94.82%)	200.80 (-12.20%)	163.55 (+19.48%)
`4d4b803` — 2026-06-22 18:12:43	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.01 (n/a)	0.01 (n/a)	558.50 (n/a)	319.32 (n/a)	252.80 (n/a)	228.70 (n/a)	136.88 (n/a)

test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.03 (+51.73%)	0.02 (+24.52%)	0.01 (+3.57%)	0.01 (+51.43%)	0.01 (+60.20%)	655.60 (-33.96%)	503.50 (-19.14%)	553.50 (-3.45%)	251.30 (-34.08%)	156.52 (-34.55%)
`4d4b803` — 2026-06-22 18:12:43	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	0.01 (n/a)	992.80 (n/a)	622.66 (n/a)	573.30 (n/a)	381.20 (n/a)	239.16 (n/a)

iron/operators/rms_norm

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.03 (+4.98%)	0.02 (+8.13%)	0.02 (+39.36%)	0.00 (-55.58%)	0.01 (+26.38%)	2085.60 (+125.11%)	720.68 (+34.39%)	385.60 (-28.25%)	239.80 (-4.73%)	775.53 (+194.86%)
`4d4b803` — 2026-06-22 18:12:43	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	926.50 (n/a)	536.26 (n/a)	537.40 (n/a)	251.70 (n/a)	263.01 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.05 (-1.45%)	0.05 (+36.58%)	0.05 (+41.51%)	0.04 (+167.24%)	0.00 (-67.70%)	302.70 (-62.58%)	268.02 (-39.23%)	254.80 (-29.32%)	236.50 (+1.46%)	28.83 (-87.64%)
`4d4b803` — 2026-06-22 18:12:43	0.05 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	809.00 (n/a)	441.06 (n/a)	360.50 (n/a)	233.10 (n/a)	233.25 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.03 (-2.72%)	0.02 (+3.93%)	0.02 (+1.40%)	0.00 (-57.90%)	0.01 (+40.58%)	1838.00 (+137.53%)	687.66 (+37.64%)	490.30 (-1.39%)	262.80 (+2.82%)	657.23 (+254.85%)
`4d4b803` — 2026-06-22 18:12:43	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	773.80 (n/a)	499.60 (n/a)	497.20 (n/a)	255.60 (n/a)	185.21 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_True]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.04 (+9.45%)	0.02 (+14.20%)	0.02 (-5.87%)	0.02 (+240.44%)	0.01 (-14.07%)	543.90 (-70.63%)	463.42 (-35.88%)	508.20 (+6.23%)	239.70 (-8.62%)	126.32 (-80.28%)
`4d4b803` — 2026-06-22 18:12:43	0.04 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	1851.60 (n/a)	722.74 (n/a)	478.40 (n/a)	262.30 (n/a)	640.71 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.03 (+12.21%)	0.02 (-0.44%)	0.02 (-25.50%)	0.02 (+26.79%)	0.01 (-8.88%)	475.00 (-21.14%)	396.52 (-3.91%)	445.10 (+34.23%)	245.60 (-10.89%)	98.97 (-36.49%)
`4d4b803` — 2026-06-22 18:12:43	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	602.30 (n/a)	412.64 (n/a)	331.60 (n/a)	275.60 (n/a)	155.83 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-weighted_True]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.04 (+12.00%)	0.03 (+27.28%)	0.04 (+52.33%)	0.02 (+18.43%)	0.01 (-5.13%)	469.60 (-15.57%)	316.92 (-22.93%)	291.00 (-34.34%)	241.00 (-10.71%)	89.51 (-23.72%)
`4d4b803` — 2026-06-22 18:12:43	0.04 (n/a)	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	556.20 (n/a)	411.20 (n/a)	443.20 (n/a)	269.90 (n/a)	117.35 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.03 (-12.51%)	0.02 (-16.20%)	0.02 (-31.32%)	0.01 (-7.83%)	0.01 (-0.72%)	676.90 (+8.49%)	461.76 (+22.33%)	445.00 (+45.57%)	262.10 (+14.30%)	189.84 (+20.59%)
`4d4b803` — 2026-06-22 18:12:43	0.04 (n/a)	0.02 (n/a)	0.03 (n/a)	0.01 (n/a)	0.01 (n/a)	623.90 (n/a)	377.46 (n/a)	305.70 (n/a)	229.30 (n/a)	157.43 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-weighted_True]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.04 (+100.35%)	0.02 (+38.02%)	0.02 (+19.01%)	0.01 (-39.90%)	0.01 (+868.03%)	1073.30 (+66.38%)	543.36 (-6.17%)	488.20 (-15.97%)	262.90 (-50.09%)	329.95 (+654.60%)
`4d4b803` — 2026-06-22 18:12:43	0.02 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.00 (n/a)	645.10 (n/a)	579.08 (n/a)	581.00 (n/a)	526.70 (n/a)	43.73 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.03 (-25.04%)	0.02 (-5.54%)	0.02 (+4.98%)	0.01 (+318.98%)	0.01 (-59.02%)	566.20 (-76.13%)	460.88 (-41.64%)	476.40 (-4.76%)	294.50 (+33.38%)	101.52 (-88.66%)
`4d4b803` — 2026-06-22 18:12:43	0.04 (n/a)	0.02 (n/a)	0.02 (n/a)	0.00 (n/a)	0.01 (n/a)	2372.10 (n/a)	789.76 (n/a)	500.20 (n/a)	220.80 (n/a)	895.19 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-weighted_True]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.04 (-0.39%)	0.03 (-21.87%)	0.02 (-37.95%)	0.02 (-29.76%)	0.01 (+72.76%)	613.10 (+42.35%)	423.12 (+44.35%)	428.90 (+61.18%)	239.40 (+0.42%)	180.24 (+130.00%)
`4d4b803` — 2026-06-22 18:12:43	0.04 (n/a)	0.03 (n/a)	0.03 (n/a)	0.02 (n/a)	0.01 (n/a)	430.70 (n/a)	293.12 (n/a)	266.10 (n/a)	238.40 (n/a)	78.37 (n/a)

test_rms_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-weighted_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.03 (-17.12%)	0.02 (+18.90%)	0.02 (+37.45%)	0.02 (+32.34%)	0.01 (-39.35%)	492.10 (-24.44%)	382.50 (-22.23%)	361.80 (-27.23%)	284.80 (+20.68%)	94.83 (-40.46%)
`4d4b803` — 2026-06-22 18:12:43	0.03 (n/a)	0.02 (n/a)	0.02 (n/a)	0.01 (n/a)	0.01 (n/a)	651.30 (n/a)	491.86 (n/a)	497.20 (n/a)	236.00 (n/a)	159.27 (n/a)

iron/operators/rope

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_1-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.40 (-6.75%)	0.28 (+8.11%)	0.24 (+8.35%)	0.19 (+48.69%)	0.09 (-27.03%)	522.30 (-32.75%)	385.42 (-17.07%)	405.70 (-7.71%)	248.40 (+7.25%)	116.17 (-47.39%)
`4d4b803` — 2026-06-22 18:12:43	0.42 (n/a)	0.26 (n/a)	0.22 (n/a)	0.13 (n/a)	0.12 (n/a)	776.70 (n/a)	464.78 (n/a)	439.60 (n/a)	231.60 (n/a)	220.81 (n/a)

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_2-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.34 (+18.12%)	0.25 (+38.27%)	0.22 (+15.11%)	0.17 (+235.45%)	0.07 (-14.35%)	580.60 (-70.19%)	426.98 (-45.30%)	436.90 (-13.12%)	290.20 (-15.34%)	123.34 (-81.31%)
`4d4b803` — 2026-06-22 18:12:43	0.29 (n/a)	0.18 (n/a)	0.20 (n/a)	0.05 (n/a)	0.09 (n/a)	1947.60 (n/a)	780.52 (n/a)	502.90 (n/a)	342.80 (n/a)	660.10 (n/a)

test_rope[rows_32-cols_512-angle_rows_32-aie_columns_4-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.34 (+27.03%)	0.25 (+35.19%)	0.26 (+48.05%)	0.15 (-1.32%)	0.07 (+58.36%)	650.60 (+1.34%)	418.48 (-23.02%)	384.80 (-32.46%)	289.30 (-21.28%)	141.29 (+36.43%)
`4d4b803` — 2026-06-22 18:12:43	0.27 (n/a)	0.19 (n/a)	0.17 (n/a)	0.15 (n/a)	0.05 (n/a)	642.00 (n/a)	543.60 (n/a)	569.70 (n/a)	367.50 (n/a)	103.56 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_1-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.31 (+63.24%)	0.21 (+24.82%)	0.17 (-2.39%)	0.13 (-7.39%)	0.08 (+296.03%)	554.60 (+7.96%)	400.22 (-11.55%)	442.00 (+2.46%)	237.30 (-38.75%)	138.51 (+151.12%)
`4d4b803` — 2026-06-22 18:12:43	0.19 (n/a)	0.16 (n/a)	0.17 (n/a)	0.14 (n/a)	0.02 (n/a)	513.70 (n/a)	452.50 (n/a)	431.40 (n/a)	387.40 (n/a)	55.16 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_2-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.32 (+25.65%)	0.22 (+47.47%)	0.18 (+37.04%)	0.14 (+271.25%)	0.08 (-2.04%)	524.60 (-73.07%)	379.20 (-50.31%)	406.80 (-27.02%)	229.20 (-20.42%)	128.62 (-80.97%)
`4d4b803` — 2026-06-22 18:12:43	0.26 (n/a)	0.15 (n/a)	0.13 (n/a)	0.04 (n/a)	0.08 (n/a)	1947.80 (n/a)	763.12 (n/a)	557.40 (n/a)	288.00 (n/a)	675.98 (n/a)

test_rope[rows_32-cols_512-angle_rows_8-aie_columns_4-method_type_0]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.30 (+26.56%)	0.18 (+1.15%)	0.16 (+12.68%)	0.11 (-13.77%)	0.07 (+40.07%)	653.40 (+15.95%)	457.10 (+2.98%)	452.20 (-11.26%)	244.50 (-21.00%)	148.27 (+25.23%)
`4d4b803` — 2026-06-22 18:12:43	0.24 (n/a)	0.18 (n/a)	0.14 (n/a)	0.13 (n/a)	0.05 (n/a)	563.50 (n/a)	443.88 (n/a)	509.60 (n/a)	309.50 (n/a)	118.40 (n/a)

iron/operators/softmax

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_1024]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.39 (+0.45%)	0.26 (+7.69%)	0.26 (-1.42%)	0.15 (+129.52%)	0.09 (-38.05%)	882.70 (-56.43%)	561.56 (-34.84%)	508.50 (+1.44%)	334.20 (-0.48%)	201.61 (-71.85%)
`4d4b803` — 2026-06-22 18:12:43	0.39 (n/a)	0.24 (n/a)	0.26 (n/a)	0.06 (n/a)	0.14 (n/a)	2025.90 (n/a)	861.80 (n/a)	501.30 (n/a)	335.80 (n/a)	716.33 (n/a)

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.47 (+8.23%)	0.32 (+11.05%)	0.31 (+12.18%)	0.19 (+0.35%)	0.11 (+20.70%)	686.50 (-0.35%)	451.12 (-7.52%)	420.90 (-10.86%)	277.20 (-7.63%)	165.86 (+11.62%)
`4d4b803` — 2026-06-22 18:12:43	0.44 (n/a)	0.29 (n/a)	0.28 (n/a)	0.19 (n/a)	0.09 (n/a)	688.90 (n/a)	487.82 (n/a)	472.20 (n/a)	300.10 (n/a)	148.59 (n/a)

test_softmax[input_length_32768-num_aie_columns_2-num_channels_2-tile_size_512]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.48 (-6.36%)	0.32 (+4.41%)	0.24 (-3.77%)	0.23 (+45.65%)	0.11 (-21.40%)	565.70 (-31.35%)	453.02 (-12.06%)	537.70 (+3.92%)	275.00 (+6.80%)	140.33 (-39.11%)
`4d4b803` — 2026-06-22 18:12:43	0.51 (n/a)	0.30 (n/a)	0.25 (n/a)	0.16 (n/a)	0.15 (n/a)	824.00 (n/a)	515.14 (n/a)	517.40 (n/a)	257.50 (n/a)	230.46 (n/a)

iron/operators/swiglu_decode

test_swiglu_decode[embedding_dim_1024-hidden_dim_3584]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.00 (-12.50%)	0.00 (-31.82%)	0.00 (-33.33%)	0.00 (+0.00%)	0.00 (-10.91%)	22314.67 (+25.49%)	17024.41 (+45.19%)	17865.23 (+29.69%)	5747.81 (+11.04%)	6674.06 (+26.41%)
`4d4b803` — 2026-06-22 18:12:43	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	17782.11 (n/a)	11725.34 (n/a)	13775.42 (n/a)	5176.26 (n/a)	5279.68 (n/a)

test_swiglu_decode[embedding_dim_2048-hidden_dim_2048]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.00 (-7.14%)	0.00 (+14.29%)	0.00 (+0.00%)	0.00 (+100.00%)	0.00 (-57.20%)	10616.04 (-44.12%)	7619.61 (-25.43%)	7069.93 (+0.80%)	6094.99 (+1.84%)	1743.78 (-69.12%)
`4d4b803` — 2026-06-22 18:12:43	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	0.00 (n/a)	18997.36 (n/a)	10218.74 (n/a)	7013.58 (n/a)	5985.05 (n/a)	5646.66 (n/a)

iron/operators/swiglu_prefill

test_swiglu_prefill[seq_len_256-embedding_dim_2048-hidden_dim_2048-prio_accuracy_False]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	0.13 (+3.27%)	0.09 (+0.35%)	0.09 (+5.32%)	0.07 (-11.54%)	0.03 (+19.59%)	30733.24 (+12.99%)	24265.70 (+1.57%)	24653.44 (-5.01%)	15823.55 (-3.22%)	5829.47 (+32.74%)
`4d4b803` — 2026-06-22 18:12:43	0.13 (n/a)	0.09 (n/a)	0.08 (n/a)	0.08 (n/a)	0.02 (n/a)	27199.35 (n/a)	23890.15 (n/a)	25953.98 (n/a)	16350.74 (n/a)	4391.76 (n/a)

iron/operators/transpose

test_transpose[M_2048-N_64-aie_columns_1-channels_1-m_64-n_64-s_8]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	1.78 (+63.99%)	1.26 (+22.39%)	1.68 (+60.45%)	0.16 (-83.59%)	0.70 (+1285.51%)	3302.20 (+509.49%)	952.66 (+86.05%)	312.90 (-37.68%)	293.80 (-39.01%)	1317.58 (+5123.37%)
`4d4b803` — 2026-06-22 18:12:43	1.09 (n/a)	1.03 (n/a)	1.04 (n/a)	0.97 (n/a)	0.05 (n/a)	541.80 (n/a)	512.04 (n/a)	502.10 (n/a)	481.70 (n/a)	25.22 (n/a)

test_transpose[M_2048-N_64-aie_columns_1-channels_2-m_64-n_64-s_8]

Commit/Date	Bandwidth (max)	Bandwidth (mean)	Bandwidth (median)	Bandwidth (min)	Bandwidth (stddev)	Latency (max)	Latency (mean)	Latency (median)	Latency (min)	Latency (stddev)
`5f943a9` — 2026-06-23 15:25:33	2.00 (-4.18%)	1.30 (+6.04%)	1.60 (+53.75%)	0.27 (-47.66%)	0.73 (+24.75%)	1946.10 (+91.08%)	695.12 (+31.20%)	327.80 (-34.96%)	262.30 (+4.34%)	716.58 (+143.51%)
`4d4b803` — 2026-06-22 18:12:43	2.09 (n/a)	1.22 (n/a)	1.04 (n/a)	0.51 (n/a)	0.59 (n/a)	1018.50 (n/a)	529.80 (n/a)	504.00 (n/a)	251.40 (n/a)	294.28 (n/a)

Phoenix - Examples

IRON

Tested on 2026_06_23_15_22_27 at commit 5f943a9.

Trends:

IRON Trends

atassis requested review from andrej, hunhoffe and jgmelber as code owners June 18, 2026 15:58

jgmelber approved these changes Jun 22, 2026

View reviewed changes

atassis force-pushed the iron-gemm-fusion branch from f713a91 to b674afe Compare June 22, 2026 18:48

andrej merged commit 4bb8427 into amd:devel Jun 23, 2026
5 checks passed

atassis deleted the iron-gemm-fusion branch June 23, 2026 22:47

atassis mentioned this pull request Jul 10, 2026

gemv: add optional fused GELU epilogue (NPU2) #135

Open

Uh oh!

Conversation

atassis commented Jun 18, 2026

Uh oh!

andrej commented Jun 22, 2026

Uh oh!

github-actions Bot commented Jun 23, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

CI Test Results

IRON - CI Summary

Examples

Small

IRON

IRON Trends

test_axpy[input_length_2048-num_aie_columns_1-tile_size_2048-scalar_factor_3.0]

test_axpy[input_length_2048-num_aie_columns_2-tile_size_1024-scalar_factor_3.0]

test_axpy[input_length_2048-num_aie_columns_4-tile_size_512-scalar_factor_3.0]

test_axpy[input_length_2048-num_aie_columns_8-tile_size_256-scalar_factor_3.0]

test_dequant[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-group_size_32]

test_dequant[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-group_size_32]

test_dequant[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024-group_size_32]

test_dequant[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512-group_size_32]

test_dequant[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512-group_size_32]

test_dequant[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256-group_size_32]

test_dequant[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256-group_size_32]

test_dequant[input_length_2048-num_aie_columns_8-num_channels_2-tile_size_128-group_size_32]

test_elementwise_add[input_length_2048-num_aie_columns_1-tile_size_2048]

test_elementwise_add[input_length_2048-num_aie_columns_2-tile_size_1024]

test_elementwise_add[input_length_2048-num_aie_columns_4-tile_size_512]

test_elementwise_add[input_length_2048-num_aie_columns_8-tile_size_256]

test_elementwise_mul[input_length_2048-num_aie_columns_1-tile_size_2048]

test_elementwise_mul[input_length_2048-num_aie_columns_2-tile_size_1024]

test_elementwise_mul[input_length_2048-num_aie_columns_4-tile_size_512]

test_elementwise_mul[input_length_2048-num_aie_columns_8-tile_size_256]

test_gelu[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]

test_gelu[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]

test_gelu[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]

test_gelu[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]

test_gelu[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]

test_gelu[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]

test_gelu[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256]

test_gelu[input_length_2048-num_aie_columns_8-num_channels_2-tile_size_128]

test_gemm[M_1792-K_896-N_1152-num_aie_columns_8-b_col_maj_False-c_col_maj_True-m_64-k_32-n_48-trace_size_0-partition_N_1]

test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_False-c_col_maj_False-m_48-k_96-n_16-trace_size_0-partition_N_1]

test_gemm[M_192-K_384-N_64-num_aie_columns_4-b_col_maj_True-c_col_maj_True-m_48-k_96-n_16-trace_size_0-partition_N_1]

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_1-b_col_maj_False-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_2-b_col_maj_True-c_col_maj_False-m_64-k_64-n_64-trace_size_0-partition_N_1]

test_gemm[M_2048-K_2048-N_2048-num_aie_columns_8-b_col_maj_True-c_col_maj_True-m_64-k_64-n_64-trace_size_0-partition_N_1]

test_gemm[M_384-K_1536-N_1792-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_32-k_48-n_64-trace_size_0-partition_N_1]

test_gemm[M_64-K_512-N_256-num_aie_columns_4-b_col_maj_True-c_col_maj_False-m_16-k_64-n_64-trace_size_0-partition_N_4]

test_gemm[M_896-K_1792-N_640-num_aie_columns_8-b_col_maj_False-c_col_maj_True-m_32-k_64-n_80-trace_size_0-partition_N_1]

test_gemv[M_128-K_128-num_aie_columns_1-tile_size_input_32-tile_size_output_128]

test_gemv[M_2048-K_8192-num_aie_columns_1-tile_size_input_1-tile_size_output_2048]

test_gemv[M_2048-K_8192-num_aie_columns_2-tile_size_input_1-tile_size_output_1024]

test_gemv[M_2048-K_8192-num_aie_columns_4-tile_size_input_1-tile_size_output_512]

test_gemv[M_2048-K_8192-num_aie_columns_8-tile_size_input_1-tile_size_output_256]

test_gemv[M_8192-K_2048-num_aie_columns_1-tile_size_input_4-tile_size_output_1024]

test_gemv[M_8192-K_2048-num_aie_columns_2-tile_size_input_4-tile_size_output_1024]

test_gemv[M_8192-K_2048-num_aie_columns_4-tile_size_input_4-tile_size_output_1024]

test_gemv[M_8192-K_2048-num_aie_columns_8-tile_size_input_4-tile_size_output_1024]

test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048]

test_layer_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024]

test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_1-tile_size_1024]

test_layer_norm[input_length_2048-num_aie_columns_2-num_channels_2-tile_size_512]

test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_1-tile_size_512]

test_layer_norm[input_length_2048-num_aie_columns_4-num_channels_2-tile_size_256]

test_layer_norm[input_length_2048-num_aie_columns_8-num_channels_1-tile_size_256]

test_layer_norm[input_length_2048-num_aie_columns_8-num_channels_2-tile_size_128]

test_mem_copy[input_length_2048-num_cores_1-num_channels_1-bypass_False-tile_size_2048]

test_mem_copy[input_length_2048-num_cores_16-num_channels_2-bypass_False-tile_size_128]

test_mem_copy[input_length_2048-num_cores_2-num_channels_1-bypass_False-tile_size_1024]

test_mem_copy[input_length_2048-num_cores_2-num_channels_2-bypass_False-tile_size_1024]

test_mem_copy[input_length_2048-num_cores_4-num_channels_1-bypass_False-tile_size_512]

test_mem_copy[input_length_2048-num_cores_4-num_channels_2-bypass_False-tile_size_512]

test_mem_copy[input_length_2048-num_cores_8-num_channels_1-bypass_False-tile_size_256]

test_mem_copy[input_length_2048-num_cores_8-num_channels_2-bypass_False-tile_size_256]

test_mha[seq_len_16384-dim_64-num_heads_1-num_pipelines_8-num_kv_heads_0]

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_False]

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_1-tile_size_2048-weighted_True]

test_rms_norm[input_length_2048-num_aie_columns_1-num_channels_2-tile_size_1024-weighted_False]

github-actions Bot commented Jun 23, 2026 •

edited

Loading