No article text was recorded for this version.
symmetry-preserving attention
Version 1 of 159 papers83 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Co-Attentive Equivariant Neural Networks: Focusing Equivariance On Transformations Co-Occurring in Data
- Blog: ReAFFPN: Rotation-equivariant Attention Feature Fusion Pyramid Networks for Aerial Object Detection
- Blog: E(2)-Equivariant Vision Transformer
- Blog: Group Equivariant Stand-Alone Self-Attention For Vision
- Blog: Co-Attentive Equivariant Neural Networks: Focusing Equivariance On Transformations Co-Occurring In Data
- Blog: LieTransformer: Equivariant Self-Attention for Lie Groups
- Blog: Functional Equivalence in Attention: A Comprehensive Study with Applications to Linear Mode Connectivity
- Blog: Beyond the Permutation Symmetry of Transformers: The Role of Rotation for Model Fusion
- Blog: $SE(3)$ Equivariant Convolution and Transformer in Ray Space
- Blog: Beyond the Permutation Symmetry of Transformers: The Role of Rotation for Model Fusion
- Blog: Measuring the Impact of Rotation Equivariance on Aerial Object Detection
- Blog: Steerable Transformers for Volumetric Data
- Blog: Translution: Unifying Self-Attention and Convolution for Adaptive and Relative Modelling
- Blog: Stand-Alone Self-Attention in Vision Models
- Blog: Subequivariant Graph Reinforcement Learning in 3D Environments
- Blog: Scalable Spatiotemporal Inference with Biased Scan Attention Transformer Neural Processes
- Blog: $SE(3)$ Equivariant Ray Embeddings for Implicit Multi-View Depth Estimation
- Blog: Attentive Group Equivariant Convolutional Networks
- Blog: Sumformer: Universal Approximation for Efficient Transformers
- Blog: Permutation Equivariant Models for Compositional Generalization in Language
- Blog: Translution: Unifying Self-attention and Convolution for Adaptive and Relative Modeling
- Blog: A case for using rotation invariant features in state of the art feature matchers
- Blog: Identifiable Equivariant Networks are Layerwise Equivariant
- Blog: Why self-attention is Natural for Sequence-to-Sequence Problems? A Perspective from Symmetries
- Blog: Astroformer: More Data might not be all you need for Classification
- Blog: Alias-Free Latent Diffusion Models: Improving Fractional Shift Equivariance of Diffusion Latent Space
- Blog: E(2)-Equivariant Vision Transformer
- Blog: Alias-Free ViT: Fractional Shift Invariance via Linear Attention
- Blog: On the Relationship between Self-Attention and Convolutional Layers
- Blog: Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models
- Blog: Space-Time Continuous PDE Forecasting using Equivariant Neural Fields
- Blog: Infusing Lattice Symmetry Priors in Attention Mechanisms for Sample-Efficient Abstract Geometric Reasoning
- Blog: Flopping for FLOPs: Leveraging Equivariance for Computational Efficiency
- Blog: Functional Invariants to Watermark Large Transformers
- Blog: Rotation Equivariant Proximal Operator for Deep Unfolding Methods in Image Restoration
- Blog: CAT: Circular-Convolutional Attention for Sub-Quadratic Transformers
- Blog: Geometric Algebra Transformer
- Blog: QPoint: End-to-End Lightweight Point Cloud Processing via Robust Quaternion Feature Learning
- Blog: Understanding the Reversal Curse Mitigation in Masked Diffusion Models through Attention and Training Dynamics
- Blog: Unfolding Framework with Complex-Valued Deformable Attention for High-Quality Computer-Generated Hologram Generation
- Blog: HPE Transformer: Learning to Optimize Multi-Group Multicast Beamforming Under Nonconvex QoS Constraints
- Blog: Translation Equivariant Transformer Neural Processes
- Blog: Space-Time Continuous PDE Forecasting using Equivariant Neural Fields
- Blog: Universal materials model of deep-learning density functional theory Hamiltonian
- Blog: LieTransformer: Equivariant Self-Attention for Lie Groups
- Blog: Transformer variational wave functions for frustrated quantum spin systems
- Blog: Equivariant Spatio-Temporal Attentive Graph Networks to Simulate Physical Dynamics
- Blog: FPTQuant: Function-Preserving Transforms for LLM Quantization
- Blog: Why Self Attention is Natural for Sequence-to-Sequence Problems? A Perspective from Symmetries
- Blog: Beyond the Permutation Symmetry of Transformers: The Role of Rotation for Model Fusion
- Blog: Rotation Equivariant Arbitrary-scale Image Super-Resolution
- Blog: Spatial Attention Kinetic Networks with E(n)-Equivariance
- Blog: Gridded Transformer Neural Processes for Spatio-Temporal Data
- Blog: SphereUFormer: A U-Shaped Transformer for Spherical 360 Perception
- Blog: LookHere: Vision Transformers with Directed Attention Generalize and Extrapolate
- Blog: SE3ET: SE(3)-Equivariant Transformer for Low-Overlap Point Cloud Registration
- Blog: Doubly Stochastic Graph-based Non-autoregressive Reaction Prediction
- Blog: Attentive Group Equivariant Convolutional Networks
- Blog: REViT: Roto-reflection Equivariant Convolutional Vision Transformer
History & citation
Current · Permanent link
- This direction split from Group Equivariant Self-Attention Mechanisms (63% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_symmetry_preserving_attention_da27474f,
title = {symmetry-preserving attention},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/symmetry-preserving-attention/rdr_da27474f68344c2dba713e8979fd37fa},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_symmetry_preserving_attention_da27474f_v1,
title = {symmetry-preserving attention},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/symmetry-preserving-attention/rdr_da27474f68344c2dba713e8979fd37fa/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}