No article text was recorded for this version.
quadratic attention complexity (quadratic attention scaling)
Version 1 of 156 papers57 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Read and Comprehend by Gated-Attention Reader with More Belief
- Blog: MUSTIE: Multimodal Structural Transformer for Web Information Extraction
- Blog: Exploring the Effect of Frequency Resolution in FNet
- Blog: Towards Understanding Large-Scale Discourse Structures in Pre-Trained and Fine-Tuned Language Models
- Blog: IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs
- Blog: FNet: Mixing Tokens with Fourier Transforms
- Blog: Taipan: Efficient and Expressive State Space Language Models with Selective Attention
- Blog: Long-Short Transformer: Efficient Transformers for Language and Vision
- Blog: Dynamic Chunking and Selection for Reading Comprehension of Ultra-Long Context in Large Language Models
- Blog: SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognition
- Blog: Single Document Summarization as Tree Induction
- Blog: Extending Context Window of Large Language Models via Semantic Compression
- Blog: Ranking and Sampling in Open-Domain Question Answering
- Blog: Learning Structured Text Representations
- Blog: Random Feature Attention
- Blog: HETFORMER: Heterogeneous Transformer with Sparse Attention for Long-Text Extractive Summarization
- Blog: Fusion-in-T5: Unifying Variant Signals for Simple and Effective Document Ranking with Attention Fusion
- Blog: LongHeads: Multi-Head Attention is Secretly a Long Context Processor
- Blog: MaTOS: Traduction automatique pour la science ouverte
- Blog: Improving Faithfulness of Large Language Models in Summarization via Sliding Generation and Self-Consistency
- Blog: Multi Resolution Analysis (MRA) for Approximate Self-Attention
- Blog: LLoCO: Learning Long Contexts Offline
- Blog: FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
- Blog: PECAN: LLM-Guided Dynamic Progress Control with Attention-Guided Hierarchical Weighted Graph for Long-Document QA
- Blog: Improving Span Representation by Efficient Span-Level Attention
- Blog: SIRE: Separate Intra- and Inter-sentential Reasoning for Document-level Relation Extraction
- Blog: LLM×MapReduce: Simplified Long-Sequence Processing using Large Language Models
- Blog: Scenario-based Question Answering with Interacting Contextual Properties
- Blog: A Survey of RWKV
- Blog: Gradual Forgetting: Logarithmic Compression for Extending Transformer Context Windows
- Blog: Efficient Content-Based Sparse Attention with Routing Transformers
- Blog: Pretrained Language Models for Sequential Sentence Classification
- Blog: Smooth Reading: Bridging the Gap of Recurrent LLM to Self-Attention LLM on Long-Context Understanding
- Blog: FiE: Building a Global Probability Space by Leveraging Early Fusion in Encoder for Open-Domain Question Answering
- Blog: What Dense Graph Do You Need for Self-Attention?
- Blog: Transformer-VQ: Linear-Time Transformers via Vector Quantization
- Blog: Bridging the Gap between Relevance Matching and Semantic Matching for Short Text Similarity Modeling
- Blog: Attributable and Scalable Opinion Summarization
- Blog: SALO: An Efficient Spatial Accelerator Enabling Hybrid Sparse Attention Mechanisms for Long Sequences
- Blog: Token-level Dynamic Self-Attention Network for Multi-Passage Reading Comprehension
- Blog: Attending to Long-Distance Document Context for Sequence Labeling
- Blog: Named Entity Recognition in Multi-level Contexts
- Blog: How Effective Are State Space Models for Machine Translation?
- Blog: Learning to Truncate Ranked Lists for Information Retrieval
- Blog: Time-aware Large Kernel Convolutions
- Blog: ECPE-2D: Emotion-Cause Pair Extraction based on Joint Two-Dimensional Representation, Interaction and Prediction
- Blog: Fusion: Towards Automated ICD Coding via Feature Compression
- Blog: What Dense Graph Do You Need for Self-Attention?
- Blog: How Well Can a Long Sequence Model Model Long Sequences? Comparing Architectural Inductive Biases on Long-Context Abilities
- Blog: Human Guided Exploitation of Interpretable Attention Patterns in Summarization and Topic Segmentation
- Blog: LIFT: A Novel Framework for Enhancing Long-Context Understanding of LLMs via Long Input Fine-Tuning
- Blog: Long Document Summarization with Top-down and Bottom-up Inference
- Blog: Effective Approaches to Attention-based Neural Machine Translation
- Blog: Test-Time Training on Nearest Neighbors for Large Language Models
- Blog: Multi Resolution Analysis (MRA) for Approximate Self-Attention
- Blog: User Rating Prediction Method Based on Fine-tuning of Large Language Models
History & citation
Current · Permanent link
- This direction split from Linear and Sparse Attention for Long Contexts (93% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_quadratic_attention_complexity_quadratic_6cf25e4e,
title = {quadratic attention complexity (quadratic attention scaling)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/quadratic-attention-complexity-quadratic-attention-scaling/rdr_6cf25e4efac84fb68b9ac4e0cfe7317f},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_quadratic_attention_complexity_quadratic_6cf25e4e_v1,
title = {quadratic attention complexity (quadratic attention scaling)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/quadratic-attention-complexity-quadratic-attention-scaling/rdr_6cf25e4efac84fb68b9ac4e0cfe7317f/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}