2606.18525

Explore local-only, coarse-only, and two-level attention, with an optional nearest-parameter global low-rank baseline.

Local overlapping attention blocks

Coarse attention block

Train nearest-parameter global low-rank baseline

Subdomains

2 16

Overlap

0 8

Local attention rank

1 24

Coarse attention rank

1 16

Training steps

Plot

Plot