No article text was recorded for this version.
linear task simplification
Version 1 of 130 papers31 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Transformers Learn Nonlinear Features In Context
- Blog: Superiority of Multi-Head Attention: A Theoretical Study in Shallow Transformers in In-Context Linear Regression
- Blog: Towards Better Understanding of In-Context Learning Ability from In-Context Uncertainty Quantification
- Blog: Can a Large Language Model Learn Matrix Functions In Context?
- Blog: In-context Learning on Function Classes Unveiled for Transformers
- Blog: Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Models
- Blog: How Do Transformers Learn In-Context Beyond Simple Functions? A Case Study on Learning with Representations
- Blog: On the Role of Depth and Looping for In-Context Learning with Task Diversity
- Blog: Pretrain–Test Task Alignment Governs Generalization in In-Context Learning
- Blog: What and How does In-Context Learning Learn? Bayesian Model Averaging, Parameterization, and Generalization
- Blog: On the Role of Transformer Feed-Forward Layers in Nonlinear In-Context Learning
- Blog: Trained Mamba Emulates Online Gradient Descent in In-Context Linear Regression
- Blog: Transformers Learn In-Context by Gradient Descent
- Blog: A Closer Look at In-Context Learning under Distribution Shifts
- Blog: BOTS: A Unified Framework for Bayesian Online Task Selection in LLM Reinforcement Finetuning
- Blog: Disentangled Graph Self-supervised Learning for Out-of-Distribution Generalization
- Blog: Pretrained Transformer Efficiently Learns Low-Dimensional Target Functions In-Context
- Blog: Fine-grained Analysis of In-context Linear Estimation: Data, Architecture, and Beyond
- Blog: Dual Operating Modes of In-Context Learning
- Blog: Training Dynamics of Multi-Head Softmax Attention for In-Context Learning: Emergence, Convergence, and Optimality (extended abstract)
- Blog: Understanding In-Context Learning on Structured Manifolds: Bridging Attention to Kernel Methods
- Blog: Transformers are Minimax Optimal Nonparametric In-Context Learners
- Blog: Linear Transformers are Versatile In-Context Learners
- Blog: Provable In-Context Learning of Nonlinear Regression with Transformers
- Blog: In-context Convergence of Transformers
- Blog: Transformers learn to implement preconditioned gradient descent for in-context learning
- Blog: Understanding In-Context Learning of Linear Models in Transformers Through an Adversarial Lens
- Blog: How Data Mixing Shapes In-Context Learning: Asymptotic Equivalence for Transformers with MLPs
- Blog: Function Induction and Task Generalization: An Interpretability Study with Off-by-One Addition
- Blog: Transformers Efficiently Perform In-Context Logistic Regression via Normalized Gradient Descent
History & citation
Current · Permanent link
- This direction split from Transformers as In-Context Mesa Optimizers (97% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_linear_task_simplification_aa2e0aed,
title = {linear task simplification},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/linear-task-simplification/rdr_aa2e0aedd62340a7b6b5ecfc960d01eb},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-19},
}This exact version (version 1, frozen text):
@misc{lacuna_linear_task_simplification_aa2e0aed_v1,
title = {linear task simplification},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/linear-task-simplification/rdr_aa2e0aedd62340a7b6b5ecfc960d01eb/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-19},
}