No article text was recorded for this version.
quadratic attention complexity (quadratic attention scaling)
Version 1 of 1229 papers233 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Improving Long Context Document-Level Machine Translation
- Blog: Long-Span Summarization via Local Attention and Content Selection
- Blog: Efficient Attentions for Long Document Summarization
- Blog: Text Segmentation by Cross Segment Attention
- Blog: A Survey on Transformer Context Extension: Approaches and Evaluation
- Blog: Z-Code++: A Pre-trained Language Model Optimized for Abstractive Summarization
- Blog: Chunk, Align, Select: A Simple Long-sequence Processing Method for Transformers
- Blog: Multimodal Pre-training Based on Graph Attention Network for Document Understanding
- Blog: The CAP Principle for LLM Serving: A Survey of Long-Context Large Language Model Serving
- Blog: Extending Context Window of Large Language Models from a Distributional Perspective
- Blog: LOCOST: Modèles Espace-État pour le Résumé Abstractif de Documents Longs
- Blog: Comparative Study of Long Document Classification
- Blog: Two Heads are Better than One: Simulating Large Transformers with Small Ones
- Blog: CipherPrune: Efficient and Scalable Private Transformer Inference
- Blog: Global Relational Models of Source Code
- Blog: Zamba: A Compact 7B SSM Hybrid Model
- Blog: ChuLo: Chunk-Level Key Information Representation for Long Document Processing
- Blog: Only 5% Attention Is All You Need: Efficient Long-range Document-level Neural Machine Translation
- Blog: HETFORMER: Heterogeneous Transformer with Sparse Attention for Long-Text Extractive Summarization
- Blog: Superposition Prompting: Improving and Accelerating Retrieval-Augmented Generation
- Blog: SepLLM: Accelerate Large Language Models by Compressing One Segment into One Separator
- Blog: GRAM: Global Reasoning for Multi-Page VQA
- Blog: A Review-based Transformer Model for Personalized Product Search
- Blog: HDT: Hierarchical Document Transformer
- Blog: A Length Adaptive Algorithm-Hardware Co-design of Transformer on FPGA Through Sparse Attention and Dynamic Pipelining
- Blog: Text or Pixels? It Takes Half: On the Token Efficiency of Visual Text Inputs in Multimodal LLMs
- Blog: Input-length-shortening and text generation via attention values
- Blog: NFLAT: Non-Flat-Lattice Transformer for Chinese Named Entity Recognition
- Blog: Hierarchical Context Merging: Better Long Context Understanding for Pre-trained LLMs
- Blog: Large-scale chemical language representations capture molecular structure and properties
- Blog: Hierarchical Neural Network Approaches for Long Document Classification
- Blog: Generating a Structured Summary of Numerous Academic Papers: Dataset and Method
- Blog: Accelerating Vision Diffusion Transformers with Skip Branches
- Blog: Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language Models
- Blog: Marian: Cost-effective High-Quality Neural Machine Translation in C++
- Blog: SEAL: Segment-wise Extractive-Abstractive Long-form Text Summarization
- Blog: DSAS: A Universal Plug-and-Play Framework for Attention Optimization in Multi-Document Question Answering
- Blog: Mnemosyne: Parallelization Strategies for Efficiently Serving Multi-Million Context Length LLM Inference Requests Without Approximations
- Blog: SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Acceleration
- Blog: Reasoning over Logically Interacted Conditions for Question Answering
- Blog: GMAT: Global Memory Augmentation for Transformers
- Blog: Softplus Attention with Re-weighting Boosts Length Extrapolation in Large Language Models
- Blog: Hi-Transformer: Hierarchical Interactive Transformer for Efficient and Effective Long Document Modeling
- Blog: Beyond pairwise relationships: a transformer-based hypergraph learning approach for fraud detection
- Blog: Dynamic Context Pruning for Efficient and Interpretable Autoregressive Transformers
- Blog: Generative Retrieval for Book search
- Blog: Sparse Attention-Based Neural Networks for Code Classification
- Blog: Hi-Transformer: Hierarchical Interactive Transformer for Efficient and Effective Long Document Modeling
- Blog: An Exploration of Hierarchical Attention Transformers for Efficient Long Document Classification
- Blog: NoMAD-Attention: Efficient LLM Inference on CPUs Through Multiply-add-free Attention
- Blog: Conformer-Kernel with Query Term Independence at TREC 2020 Deep Learning Track
- Blog: Transformer Acceleration with Dynamic Sparse Attention
- Blog: Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers
- Blog: Amortized Probabilistic Conditioning for Optimization, Simulation and Inference
- Blog: Adapting Pretrained Text-to-Text Models for Long Text Sequences
- Blog: FastFiD: Improve Inference Efficiency of Open Domain Question Answering via Sentence Selection
- Blog: ReSSFormer: A Recursive Sparse Structured Transformer for Scalable and Long-Context Reasoning
- Blog: ARC-Encoder: learning compressed text representations for large language models
- Blog: Long Context Compression with Activation Beacon
- Blog: In-Context Former: Lightning-fast Compressing Context for Large Language Model
Showing 60 of 229 papers.
History & citation
Current · Permanent link
- This direction split from Overcoming the Quadratic Bottleneck in Self Attention (92% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_quadratic_attention_complexity_quadratic_c77fda80,
title = {quadratic attention complexity (quadratic attention scaling)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/quadratic-attention-complexity-quadratic-attention-scaling/rdr_c77fda8050f44563ab2cde1562537f05},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_quadratic_attention_complexity_quadratic_c77fda80_v1,
title = {quadratic attention complexity (quadratic attention scaling)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/quadratic-attention-complexity-quadratic-attention-scaling/rdr_c77fda8050f44563ab2cde1562537f05/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}