--use_ssta_sparse_text_to_image |
False |
Use sparse attention for text-to-image attention path in SSTA. |
--spargeattn_simthreshold FLOAT |
0.3 |
Similarity threshold for sparge attention. |
--spargeattn_cdfthreshold FLOAT |
0.92 |
CDF threshold for sparge attention. |
--spargeattn_reorder_sequence
--no-spargeattn_reorder_sequence |
True |
Reorder image tokens via the gilbert space-filling curve before Sparge attention. Use --no-spargeattn_reorder_sequence to disable. |
--use_spargeattn_static_block_mask
--no-use_spargeattn_static_block_mask |
True |
OR a static gilbert block-neighbor mask into the dynamic Sparge block mask. Only meaningful when --spargeattn_reorder_sequence is set. Use --no-use_spargeattn_static_block_mask to disable. |
--use_sparseattn_head_balance |
False |
Balance per-rank attention work across Ulysses ranks by permuting heads (block-sparse load balancing). Only has an effect with ulysses_degree>1, equal query and KV head counts, and a block-sparse attention backend that publishes a per-head cost (the Sparge backends or the AITER Sol backends). |
--use_spargeattn_head_balance |
False |
Deprecated, use --use_sparseattn_head_balance. |
--sparseattn_block_size QxKV |
None |
Block-sparse tile as QxKV, e.g. 64x64: the query rows and keys one mask entry covers. Omit to use each recipe's default tile. Honoured by the AITER MHA v4 Sparge and AITER Sol backends; the run is refused at startup if this GPU has no kernel at that tile for the selected recipe. |
--solattn_beta FLOAT |
0.5 |
Routing threshold for the AITER Sol backends. A KV block is computed exactly when its pooled proxy score exceeds mean + beta*std over the blocks of that query tile, so larger beta keeps fewer blocks. |
--solattn_beta_schedule SCHEDULE |
None |
Vary --solattn_beta across denoising steps, since steps are not equally approximable. Either 'first:last' for a linear ramp over the run, e.g. '1.0:-0.25' to start aggressive and end exact, or one beta per step as '0.5,0.5,0.25,...' -- per DENOISING STEP, so a 40-step run takes 40 whether or not guidance is on: a guided step's conditional and unconditional forward share the step's beta. Overrides --solattn_beta when set. A spec starting with a negative beta needs the --solattn_beta_schedule=-0.5:0.0 form, or argparse reads the leading minus as another option. |
--solattn_tilt_rank RANK |
0 |
Correct each pooled block of the AITER Sol backends with its leading RANK terms of Cov(v, k) q, on top of a second-order term on its logit, so a skipped block stands in for its keys more closely. 0 (default) keeps the block means. Not served by aiter_mxfp6_sol. |
--sol_attn_tau FLOAT |
0.2 |
NVIDIA Sol-Attn (SOL_ATTN backend) routing temperature. Higher values keep fewer KV blocks exact. |
--sol_attn_thresh_type {diag,exact} |
'exact' |
NVIDIA Sol-Attn routing threshold. 'diag' uses the diagonal covariance; 'exact' uses the full covariance. |
--sol_attn_kv_splits {auto,1,2,4} |
'auto' |
KV splits for the SM90 Sol-Attn kernel. 'auto' uses 4 on SM90 CuTe when the sequence is at least 65536 tokens. |
--sol_attn_sink_tokens INT |
0 |
NVIDIA Sol-Attn: number of tokens whose KV blocks stay exact for every query. 0 disables the sink. |
--sol_attn_sink_start INT |
None |
NVIDIA Sol-Attn: first token of the exact KV sink. Omit to place the sink on the token suffix. |
--vsa_block_size INT |
128 |
Query/KV block size for the AITER CK-Tile VSA backend. |
--vsa_top_k INT |
1 |
Minimum KV blocks selected per query block by AITER VSA. |
--vsa_top_k_ratio FLOAT |
0.0 |
Minimum selected KV-block fraction for AITER VSA. For Jenga drop rate r, set this to 1-r. |
--vsa_drop_rates FLOAT [FLOAT ...] |
None |
Enable Jenga's per-step sparse schedule. One value applies to all steps; two values switch after the midpoint. Drop rates <=0.25 use dense AITER attention. |
--vsa_prob_threshold FLOAT |
0.9 |
Jenga cumulative probability threshold for AITER VSA. |
--bsa_sparsity FLOAT |
0.75 |
TRITON_BSA: fraction of key blocks each query block skips (top-k). |
--bsa_cdf_threshold FLOAT |
0.2 |
TRITON_BSA: also keep the key blocks holding this much attention weight (top-p); 0 disables. |
--vsa_reorder_sequence
--no-vsa_reorder_sequence |
True |
Reorder Wan video tokens with the sliced Gilbert curve before VSA. |
--use_vsa_static_block_mask
--no-use_vsa_static_block_mask |
True |
Union Gilbert physical-neighbor blocks into the dynamic VSA mask. |
--use_vsa_first_frame_mask
--no-use_vsa_first_frame_mask |
True |
Preserve first-frame block relations in the VSA mask. |
--vsa_collect_density |
False |
Record the selected VSA block density for profiling. |