Attention @ NeurIPS

9 papers4 directions

Papers by Year

2022 9

Top Research Directions

Research directions most represented by papers from this venue.

Managing Action Space Explosion in Hierarchical Reinforcement Learning 1
The Architectural Simplification Gap in Transformer Theory 1
Disentangling Trend and Seasonality in Time Series Networks 1
Mitigating Non-Stationary Distribution Shift in Time-Series Forecasting 1

Top Authors

AuthorPapers
Alexander Wong1
Alexandre Lacoste1
Andrei Cristian Nica1
Bernie Wang1
Bingyang Wen1
Caroline Haimerl1
Cristina Savin1
Danielle C. Maddix1
Doina Precup1
Eero P Simoncelli1
Gaurav Gupta1
Hao Wang1
Hyeongu Yun1
Karthick Gopalswamy1
Khimya Khetarpal1
K.P. Subbalakshmi1
Kyomin Jung1
Laurent Charlin1
Mohammad Javad Shafiee1
Oleksiy Ostapenko1

Impactful Papers

Papers from this venue that shaped research clusters.

Influential

Papers

TitleYear
Attention as inference with third-order interactions2022
Attention for Compositional Modularity2022
Faster Attention Is What You Need: A Fast Self-Attention Neural Network Backbone Architecture for the Edge via Double-Condensing Attention Condensers2022
Fine-tuning hierarchical circuits through learned stochastic co-modulation2022
First De-Trend then Attend: Rethinking Attention for Time-Series Forecasting2022
Foundations of Attention Mechanisms in Deep Neural Network Architectures2022
Improving cross-modal attention via object detection2022
Revisiting Attention Weights as Explanations from an Information Theoretic Perspective2022
The Paradox of Choice: On the Role of Attention in Hierarchical Reinforcement Learning2022