No article text was recorded for this version.
hybrid local-global attention (multi-axis blocked self-attention)
Version 1 of 119 papers22 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Factorization Vision Transformer: Modeling Long-Range Dependency With Local Window Cost
- Blog: SeaDATE: Remedy Dual-Attention Transformer with Semantic Alignment via Contrast Learning for Multimodal Object Detection
- Blog: Sparse self-attention aggregation networks for neural sequence slice interpolation
- Blog: HResFormer: Hybrid Residual Transformer for Volumetric Medical Image Segmentation
- Blog: 2D-WinSpatt-Net: A Dual Spatial Self-Attention Vision Transformer Boosts Classification of Tetanus Severity for Patients Wearing ECG Sensors in Low- and Middle-Income Countries
- Blog: CrossFormer: A Versatile Vision Transformer Hinging on Cross-scale Attention
- Blog: CoLT5: Faster Long-Range Transformers with Conditional Computation
- Blog: Dual-stream Network for Visual Recognition
- Blog: HySparse: A Hybrid Sparse Attention Architecture with Oracle Token Selection and KV Cache Sharing
- Blog: Glance-and-Gaze Vision Transformer
- Blog: AnchorGT: Efficient and Flexible Attention Architecture for Scalable Graph Transformers
- Blog: SBCFormer: Lightweight Network Capable of Full-size ImageNet Classification at 1 FPS on Single Board Computers
- Blog: Scalable High-Resolution Pixel-Space Image Synthesis with Hourglass Diffusion Transformers
- Blog: Lightweight Dynamic Sparse Transformer for Monaural Speech Enhancement
- Blog: Improved Transformer for High-Resolution GANs
- Blog: CCNet: Criss-Cross Attention for Semantic Segmentation
- Blog: CrossFormer++: A Versatile Vision Transformer Hinging on Cross-scale Attention
- Blog: GRiT: A Generative Region-to-Text Transformer for Object Understanding
- Blog: Transformer-based Detection of Microorganisms on High-Resolution Petri Dish Images
History & citation
Current · Permanent link
- This direction split from Hybrid Architectures for Efficient Long Context Modeling (53% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_hybrid_local_global_attention_multi_axis_6650b47f,
title = {hybrid local-global attention (multi-axis blocked self-attention)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/hybrid-local-global-attention-multi-axis-blocked-self-attention/rdr_6650b47f52e741a09070c76ffa03d43b},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_hybrid_local_global_attention_multi_axis_6650b47f_v1,
title = {hybrid local-global attention (multi-axis blocked self-attention)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/hybrid-local-global-attention-multi-axis-blocked-self-attention/rdr_6650b47f52e741a09070c76ffa03d43b/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}