Attention @ NeurIPS 2022

9 papers

Top Research Directions

The 4 research directions with Attention @ NeurIPS 2022 papers, ranked by paper count. Share is the fraction of the edition’s papers in the direction.

#DirectionPapersShare
1Disentangling Trend and Seasonality in Time Series Networks111.1%
2Managing Action Space Explosion in Hierarchical Reinforcement Learning111.1%
3Mitigating Non-Stationary Distribution Shift in Time-Series Forecasting111.1%
4The Architectural Simplification Gap in Transformer Theory111.1%

Download all directions as CSV

Institutions

Institutions credited by Attention @ NeurIPS 2022 papers: a paper credits every institution named in its affiliations, once. 7 institutions share 4 credited papers.

#InstitutionPapersShare
1Google DeepMind (United Kingdom) 125.0%
2McGill University 125.0%
3Mila - Quebec Artificial Intelligence Institute 125.0%
4Stevens Institute of Technology 125.0%
5Universitatea Națională de Știință și Tehnologie Politehnica București 125.0%
6University of California San Diego 125.0%
7University of Waterloo 125.0%

Download all institutions as CSV

About this data

Papers. Attention @ NeurIPS 2022 lists 9 papers on Lacuna, duplicate versions counted once; rejected and withdrawn submissions are left out.

Directions. Directions are Lacuna’s clustering of the concept elements extracted from each paper, so a paper can belong to several and direction counts add up to more than the paper count. A direction’s share is its papers divided by the edition’s papers.

Institutions. A paper credits each institution named in its affiliations, resolved to a ROR record, once. 4 of 9 papers (44.4%) credit at least one institution and are the base for institution shares; the rest have no resolved affiliation yet.

Data. Counts come from Lacuna’s data build of 2026-11-21 and change as papers are added. Tables as CSV: directions · institutions. Cite as: Lacuna, “Attention @ NeurIPS 2022”, https://lacuna.tiptreesystems.com/venue/attention-neurips/2022.

Top Authors

AuthorPapers
Alexander Wong1
Alexandre Lacoste1
Andrei Cristian Nica1
Bernie Wang1
Bingyang Wen1
Caroline Haimerl1
Cristina Savin1
Danielle C. Maddix1
Doina Precup1
Eero P Simoncelli1
Gaurav Gupta1
Hao Wang1
Hyeongu Yun1
Karthick Gopalswamy1
Khimya Khetarpal1
K.P. Subbalakshmi1
Kyomin Jung1
Laurent Charlin1
Mohammad Javad Shafiee1
Oleksiy Ostapenko1

Impactful Papers

Papers from Attention @ NeurIPS 2022 that shaped research clusters.

Influential

Papers

Title
Attention as inference with third-order interactions
Attention for Compositional Modularity
Faster Attention Is What You Need: A Fast Self-Attention Neural Network Backbone Architecture for the Edge via Double-Condensing Attention Condensers
Fine-tuning hierarchical circuits through learned stochastic co-modulation
First De-Trend then Attend: Rethinking Attention for Time-Series Forecasting
Foundations of Attention Mechanisms in Deep Neural Network Architectures
Improving cross-modal attention via object detection
Revisiting Attention Weights as Explanations from an Information Theoretic Perspective
The Paradox of Choice: On the Role of Attention in Hierarchical Reinforcement Learning