No article text was recorded for this version.
computational cost of attention mechanisms
Version 1 of 11,057 papers1,093 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Visual attention methods in deep learning: An in-depth survey
- Blog: Unified Data Management and Comprehensive Performance Evaluation for Urban Spatial-Temporal Prediction [Experiment, Analysis & Benchmark]
- Blog: ParaFormer: Parallel Attention Transformer for Efficient Feature Matching
- Blog: Visual attention methods in deep learning: An in-depth survey
- Blog: FMDConv: Fast multi-attention dynamic convolution via speed-accuracy trade-off
- Blog: Contextformer: A Transformer with Spatio-Channel Attention for Context Modeling in Learned Image Compression
- Blog: Adaptive Split-Fusion Transformer
- Blog: An Image Enhancement Method for Side-Scan Sonar Images Based on Multi-Stage Repairing Image Fusion
- Blog: LightFormer: A lightweight and efficient decoder for remote sensing image segmentation
- Blog: Diagnosis of colorectal cancer using residual transformer with mixed attention and explainable AI
- Blog: Dynamic Head: Unifying Object Detection Heads with Attentions
- Blog: RCSANet: A Full Convolutional Network for Extracting Inland Aquaculture Ponds from High-Spatial-Resolution Images
- Blog: Hard-Coded Gaussian Attention for Neural Machine Translation
- Blog: SA-Net: Shuffle Attention for Deep Convolutional Neural Networks
- Blog: Unsupervised Co-Generation of Foreground-Background Segmentation From Text-to-Image Synthesis
- Blog: Do End-to-End Speech Recognition Models Care About Context?
- Blog: DeFT-AN: Dense Frequency-Time Attentive Network for Multichannel Speech Enhancement
- Blog: Shift-and-Balance Attention
- Blog: CTooth: A Fully Annotated 3D Dataset and Benchmark for Tooth Volume Segmentation on Cone Beam Computed Tomography Images
- Blog: An Empirical Study of Adequate Vision Span for Attention-Based Neural Machine Translation
- Blog: SA-Net: Shuffle Attention for Deep Convolutional Neural Networks
- Blog: Hard-Coded Gaussian Attention for Neural Machine Translation
- Blog: UMD-TTIC-UW at SemEval-2016 Task 1: Attention-Based Multi-Perspective Convolutional Neural Networks for Textual Similarity Measurement
- Blog: Learning Mask-Aware Offsets: Two-branch Deformable Attention Networks for Inpainting with Masked Region Avoidance
- Blog: Towards Efficient Detection for Small Objects via Attention-Guided Detection Network and Data Augmentation
- Blog: HAtt-Flow: Hierarchical Attention-Flow Mechanism for Group Activity Scene Graph Generation in Videos
- Blog: On Computational Limits of FlowAR Models: Expressivity and Efficiency
- Blog: Deep Learning for Lung Disease Classification Using Transfer Learning and a Customized CNN Architecture with Attention
- Blog: SFusion: Self-attention Based N-to-One Multimodal Fusion Block
- Blog: A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Time
- Blog: Attentive Group Equivariant Convolutional Networks
- Blog: EL-Attention: Memory Efficient Lossless Attention for Generation
- Blog: The Stability Optimization of Indoor Visible 3D Positioning Algorithms Based on Single-Light Imaging Using Attention Mechanism Convolutional Neural Networks
- Blog: Implémentation d'un mécanisme de "covert attention" avec un réseau de neurones impulsionnels
- Blog: Pruning by Active Attention Manipulation
- Blog: DLF: Enhancing Explicit-Implicit Interaction via Dynamic Low-Order-Aware Fusion for CTR Prediction
- Blog: Enhancing Zero-Shot Black-Box Optimization via Pretrained Models with Efficient Population Modeling, Interaction, and Stable Gradient Approximation
- Blog: Gumbel-Attention for Multi-modal Machine Translation
- Blog: Bidding-Aware Retrieval for Multi-Stage Consistency in Online Advertising
- Blog: Online and Linear-Time Attention by Enforcing Monotonic Alignments
- Blog: OpenNMT: Open-Source Toolkit for Neural Machine Translation
- Blog: Boosting Value Decomposition via Unit-Wise Attentive State Representation for Cooperative Multi-Agent Reinforcement Learning
- Blog: Information Bottleneck Approach to Spatial Attention Learning
- Blog: Imbalanced Underwater Acoustic Target Recognition with Trigonometric Loss and Attention Mechanism Convolutional Network
- Blog: Decision ConvFormer: Local Filtering in MetaFormer is Sufficient for Decision Making
- Blog: Chinese Event Extraction Based on Attention and Semantic Features: A Bidirectional Circular Neural Network
- Blog: Dora: Sampling and Benchmarking for 3D Shape Variational Auto-Encoders
- Blog: GenAD: General Representations of Multivariate Time Series for Anomaly Detection
- Blog: Internet of Things Meets Brain-Computer Interface: A Unified Deep Learning Framework for Enabling Human-Thing Cognitive Interactivity.
- Blog: Multi-Interactive Attention Network for Fine-grained Feature Learning in CTR Prediction
- Blog: AttentionGS: Towards Initialization-Free 3D Gaussian Splatting via Structural Attention
- Blog: Context-Aware Multimodal Pretraining
- Blog: TiVaT: A transformer with a single unified mechanism for capturing asynchronous dependencies in multivariate time series forecasting
- Blog: Attention-aware Inference: Generating Summarization Texts According to Attention Distributions
- Blog: FFA-Net: Feature Fusion Attention Network for Single Image Dehazing
- Blog: 3DMODT: Attention-Guided Affinities for Joint Detection & Tracking in 3D Point Clouds
- Blog: Dynamic Differential Linear Attention: Enhancing Linear Diffusion Transformer for High-Quality Image Generation
- Blog: SimAM: A Simple, Parameter-Free Attention Module for Convolutional Neural Networks
- Blog: SEA-NET: Medical image segmentation network based on spiral squeeze-and-excitation and attention modules
- Blog: HAtt-Flow: Hierarchical Attention-Flow Mechanism for Group-Activity Scene Graph Generation in Videos
Showing 60 of 1,057 papers.
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_computational_cost_of_attention_mechanis_eaf6857d,
title = {computational cost of attention mechanisms},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/computational-cost-of-attention-mechanisms/rdr_eaf6857d9dab44f4a422f165d94378ad},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_computational_cost_of_attention_mechanis_eaf6857d_v1,
title = {computational cost of attention mechanisms},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/computational-cost-of-attention-mechanisms/rdr_eaf6857d9dab44f4a422f165d94378ad/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}