No article text was recorded for this version.
multi-head attention interpretability
Version 1 of 130 papers34 conceptsfrozen 2026-10-04
Papers in this version
- Blog: A Functional Information Perspective on Model Interpretation
- Blog: What do Vision Transformers Learn? A Visual Exploration
- Blog: Transformers in Vision: A Survey
- Blog: Decomposing Query-Key Feature Interactions Using Contrastive Covariances
- Blog: PaCa-ViT: Learning Patch-to-Cluster Attention in Vision Transformers
- Blog: Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned
- Blog: Advancing Attribution-Based Neural Network Explainability through Relative Absolute Magnitude Layer-Wise Relevance Propagation and Multi-Component Evaluation
- Blog: Dodrio: Exploring Transformer Models with Interactive Visualization
- Blog: SANVis: Visual Analytics for Understanding Self-Attention Networks
- Blog: Attention as Implicit Structural Inference
- Blog: How do Large Language Models Learn In-Context? Query and Key Matrices of In-Context Heads are Two Towers for Metric Learning
- Blog: Neuro-symbolic Natural Logic with Introspective Revision for Natural Language Inference
- Blog: Visualizing Paired Image Similarity in Transformer Networks
- Blog: Attention Head Masking for Inference Time Content Selection in Abstractive Summarization
- Blog: Fighter: Unveiling the Graph Convolutional Nature of Transformers in Time Series Modeling
- Blog: Head Pursuit: Probing Attention Specialization in Multimodal Transformers
- Blog: An Exploratory Study on Code Attention in BERT
- Blog: PACEAttention: Principled and Adaptive Feature Compression-Expansion Grounded in the Geometry of $\text{MCR}^2$
- Blog: A multimodal transformer system for noninvasive diabetic nephropathy diagnosis via retinal imaging
- Blog: Interpreting Context Look-ups in Transformers: Investigating Attention-MLP Interactions
- Blog: Exploring Neural Language Models via Analysis of Local and Global Self-Attention Spaces
- Blog: The emergence of clusters in self-attention dynamics
- Blog: Transformer-Based Explainable Model for Breast Cancer Lesion Segmentation
- Blog: Multi-view 3D Reconstruction with Transformers
- Blog: How Far Does BERT Look At: Distance-based Clustering and Analysis of BERT’s Attention
- Blog: Rethinking Self-Attention: Towards Interpretability in Neural Parsing
- Blog: ULTra: Unveiling Latent Token Interpretability in Transformer-Based Understanding and Segmentation
- Blog: Decomposing and Interpreting Image Representations via Text in ViTs Beyond CLIP
- Blog: Learning Multiscale Transformer Models for Sequence Generation
- Blog: AttExplainer: Explain Transformer via Attention by Reinforcement Learning
History & citation
Current · Permanent link
Cite this direction
Latest version (a living page):
@misc{lacuna_multi_head_attention_interpretability_cd5762d2,
title = {multi-head attention interpretability},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/multi-head-attention-interpretability/rdr_cd5762d2119f412a92db0e6e70014c41},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-19},
}This exact version (version 1, frozen text):
@misc{lacuna_multi_head_attention_interpretability_cd5762d2_v1,
title = {multi-head attention interpretability},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/multi-head-attention-interpretability/rdr_cd5762d2119f412a92db0e6e70014c41/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-19},
}