ICLR 2022

2,337 papers

Top Research Directions

Research directions most represented by ICLR 2022 papers.

Bypassing the Computational Bottleneck of Adversarial Training 21
Sample Efficient Reinforcement Learning 19
The Mechanics of Benign Overfitting in High Dimensions 18
Clean Accuracy Degradation in Machine Learning Defenses 17
Overcoming the Homophily Assumption in Graph Neural Networks 13
Accelerating Sparse Neural Networks on Dense Hardware 13
Accelerating Neural Architecture Search Without Full Model Training 12
The Non-Linear Function Approximation Gap in Reinforcement Learning 12
The Mechanics of Backdoor Attacks in Neural Networks 12
Beyond the Lazy Training Regime of Neural Networks 11
The Infinite Width Approximation Gap in Deep Learning 10
Matrix-Free Curvature Estimation for Deep Learning 10
The Computational Overhead of Iterative Model Pruning 9
The Weisfeiler Lehman Expressivity Bottleneck 9
Why Theoretical FLOPs Fail to Predict Real Latency 9

Top Authors

AuthorPapers
Zhangyang Wang23
Sergey Levine21
Tianlong Chen15
Tongliang Liu14
Bo Han13
Chelsea Finn13
Gang Niu13
Jun Wang13
Yoshua Bengio13
Bernhard Schölkopf12
Joshua B. Tenenbaum12
J Zico Kolter12
Ping Li12
Tie-Yan Liu12
Dacheng Tao11
Stephan Günnemann11
Tom Goldstein11
Masashi Sugiyama10
Pieter Abbeel9
Pin-Yu Chen9

Impactful Papers

Papers from ICLR 2022 that shaped research clusters.

Foundational

Influential

Papers

Title
When in Doubt, Summon the Titans: A Framework for Efficient Inference with Large Models
When less is more: Simplifying inputs aids neural network understanding
When should agents explore?
When Vision Transformers Outperform ResNets without Pre-training or Strong Data Augmentations
When, Why, and Which Pretrained GANs Are Useful?
Where can quantum kernel methods make a big difference?
Where is the bottleneck in long-tailed classification?
Which Shortcut Cues Will DNNs Choose? A Study from the Parameter-Space Perspective
Who Is the Strongest Enemy? Towards Optimal and Efficient Evasion Attacks in Deep RL
Who Is Your Right Mixup Partner in Positive and Unlabeled Learning
Why be adversarial? Let's cooperate!: Cooperative Dataset Alignment via JSD Upper Bound
Why do embedding spaces look as they do?
WHY FLATNESS DOES AND DOES NOT CORRELATE WITH GENERALIZATION FOR DEEP NEURAL NETWORKS
Why Propagate Alone? Parallel Use of Labels and Features on Graphs
Why self-attention is Natural for Sequence-to-Sequence Problems? A Perspective from Symmetries
Why Should I Trust You, Bellman? Evaluating the Bellman Objective with Off-Policy Data
Wide Attention Is The Way Forward For Transformers?
Wiring Up Vision: Minimizing Supervised Synaptic Updates Needed to Produce a Primate Ventral Stream
Wisdom of Committees: An Overlooked Approach To Faster and More Accurate Models
Wish you were here: Hindsight Goal Selection for long-horizon dexterous manipulation
Word Sense Induction with Knowledge Distillation from BERT
X-model: Improving Data Efficiency in Deep Learning with A Minimax Model
You are AllSet: A Multiset Function Framework for Hypergraph Neural Networks
You May Need both Good-GAN and Bad-GAN for Anomaly Detection
You Mostly Walk Alone: Analyzing Feature Attribution in Trajectory Prediction
YOUR AUTOREGRESSIVE GENERATIVE MODEL CAN BE BETTER IF YOU TREAT IT AS AN ENERGY-BASED ONE
ZenDet: Revisiting Efficient Object Detection Backbones from Zero-Shot Neural Architecture Search
Zero-CL: Instance and Feature decorrelation for negative-free symmetric contrastive learning
Zero-Cost Operation Scoring in Differentiable Architecture Search
ZeroFL: Efficient On-Device Training for Federated Learning with Local Sparsity
ZerO Initialization: Initializing Residual Networks with only Zeros and Ones
Zero Pixel Directional Boundary by Vector Transform
ZeroSARAH: Efficient Nonconvex Finite-Sum Optimization with Zero Full Gradient Computations
Zero-Shot Coordination via Semantic Relationships Between Actions and Observations
Zero-Shot Reward Specification via Grounded Natural Language
Zero-Shot Self-Supervised Learning for MRI Reconstruction
Zeroth-Order Actor-Critic

« prev Page 47/47