No article text was recorded for this version.
causal masking constraints
Version 1 of 118 papers21 conceptsfrozen 2026-10-04
Papers in this version
- Blog: CAT: Circular-Convolutional Attention for Sub-Quadratic Transformers
- Blog: MonarchAttention: Zero-Shot Conversion to Fast, Hardware-Aware Structured Attention
- Blog: Sublinear Time Quantum Algorithm for Attention Approximation
- Blog: PolySketchFormer: Fast Transformers via Sketching Polynomial Kernels
- Blog: OmniNet: Omnidirectional Representations from Transformers
- Blog: Nyströmformer: A Nyström-based Algorithm for Approximating Self-Attention
- Blog: LittleBird: Efficient Faster & Longer Transformer for Question Answering
- Blog: Re-ttention: Ultra Sparse Visual Generation via Attention Statistical Reshape
- Blog: Multi-Layer Transformers Gradient Can be Approximated in Almost Linear Time
- Blog: Linear Complexity Randomized Self-attention Mechanism
- Blog: Chain and Causal Attention for Efficient Entity Tracking
- Blog: WildCat: Near-Linear Attention in Theory and Practice
- Blog: Higher Order Transformers: Efficient Attention Mechanism for Tensor Structured Data
- Blog: Choose a Transformer: Fourier or Galerkin
- Blog: Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture
- Blog: Efficient Attention: Attention with Linear Complexities
- Blog: Dynamic N: M Fine-grained Structured Sparse Attention Mechanism
- Blog: Sparse Attention with Learning to Hash
History & citation
Current · Permanent link
- This direction split from Efficient Attention Mechanisms for Autoregressive Decoders (56% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_causal_masking_constraints_ac81cd52,
title = {causal masking constraints},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/causal-masking-constraints/rdr_ac81cd52fc9846999378957fff6f1d21},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_causal_masking_constraints_ac81cd52_v1,
title = {causal masking constraints},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/causal-masking-constraints/rdr_ac81cd52fc9846999378957fff6f1d21/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}