ICLR 2022

2,337 papers

Top Research Directions

Research directions most represented by ICLR 2022 papers.

Bypassing the Computational Bottleneck of Adversarial Training 21
Sample Efficient Reinforcement Learning 19
The Mechanics of Benign Overfitting in High Dimensions 18
Clean Accuracy Degradation in Machine Learning Defenses 17
Overcoming the Homophily Assumption in Graph Neural Networks 13
Accelerating Sparse Neural Networks on Dense Hardware 13
Accelerating Neural Architecture Search Without Full Model Training 12
The Non-Linear Function Approximation Gap in Reinforcement Learning 12
The Mechanics of Backdoor Attacks in Neural Networks 12
Beyond the Lazy Training Regime of Neural Networks 11
The Infinite Width Approximation Gap in Deep Learning 10
Matrix-Free Curvature Estimation for Deep Learning 10
The Computational Overhead of Iterative Model Pruning 9
The Weisfeiler Lehman Expressivity Bottleneck 9
Why Theoretical FLOPs Fail to Predict Real Latency 9

Top Authors

AuthorPapers
Zhangyang Wang23
Sergey Levine21
Tianlong Chen15
Tongliang Liu14
Bo Han13
Chelsea Finn13
Gang Niu13
Jun Wang13
Yoshua Bengio13
Bernhard Schölkopf12
Joshua B. Tenenbaum12
J Zico Kolter12
Ping Li12
Tie-Yan Liu12
Dacheng Tao11
Stephan Günnemann11
Tom Goldstein11
Masashi Sugiyama10
Pieter Abbeel9
Pin-Yu Chen9

Impactful Papers

Papers from ICLR 2022 that shaped research clusters.

Foundational

Influential

Papers

Title
A Large Batch Optimizer Reality Check: Traditional, Generic Optimizers Suffice Across Batch Sizes
Almost Tight L0-norm Certified Robustness of Top-k Predictions against Adversarial Perturbations
A Loss Curvature Perspective on Training Instabilities of Deep Learning Models
AlphaZero-based Proof Cost Network to Aid Game Solving
A Modulation Layer to Increase Neural Network Robustness Against Data Quality Issues
Amortized Implicit Differentiation for Stochastic Bilevel Optimization
Amortized Tree Generation for Bottom-up Synthesis Planning and Synthesizable Molecular Design
An Agnostic Approach to Federated Learning with Class Imbalance
Analogies and Feature Attributions for Model Agnostic Explanation of Similarity Learners
Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Models
Analyzing and Improving the Optimization Landscape of Noise-Contrastive Estimation
Analyzing the Effects of Classifier Lipschitzness on Explainers
Anarchic Federated Learning
Ancestral protein sequence reconstruction using a tree-structured Ornstein-Uhlenbeck variational autoencoder
An Empirical Investigation of the Role of Pre-training in Lifelong Learning
An Empirical Study of Pre-trained Models on Out-of-distribution Generalization
An Equivalence Between Data Poisoning and Byzantine Gradient Attacks
A neural network framework for learning Green's function
A Neural Tangent Kernel Perspective of Infinite Tree Ensembles
An evaluation of quality and robustness of smoothed explanations
A NEW BACKBONE FOR HYPERSPECTRAL IMAGE RECONSTRUCTION
A new look at fairness in stochastic multi-armed bandit problems
A New Perspective on "How Graph Neural Networks Go Beyond Weisfeiler-Lehman?"
An Experimental Design Perspective on Model-Based Reinforcement Learning
An Explanation of In-context Learning as Implicit Bayesian Inference
An Information Fusion Approach to Learning with Instance-Dependent Label Noise
An Interpretable Graph Generative Model with Heterophily
An Investigation into the Role of Author Demographics in ICLR Participation and Review
An Investigation on Hardware-Aware Vision Transformer Scaling
Anisotropic Random Feature Regression in High Dimensions
Anomaly Detection for Tabular Data with Internal Contrastive Learning
Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancy
A NON-PARAMETRIC REGRESSION VIEWPOINT : GENERALIZATION OF OVERPARAMETRIZED DEEP RELU NETWORK UNDER NOISY OBSERVATIONS
An Operator Theoretic View On Pruning Deep Neural Networks
An Optimization Perspective on Realizing Backdoor Injection Attacks on Deep Neural Networks in Hardware
Anti-Concentrated Confidence Bonuses For Scalable Exploration
Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice
An Unconstrained Layer-Peeled Perspective on Neural Collapse
Anytime Dense Prediction with Confidence Adaptivity
Apollo: An Adaptive Parameter-wised Diagonal Quasi-Newton Method for Nonconvex Stochastic Optimization
Approximating Instance-Dependent Noise via Instance-Confidence Embedding
Approximation and Learning with Deep Convolutional Models: a Kernel Perspective
A Principled Permutation Invariant Approach to Mean-Field Multi-Agent Reinforcement Learning
A Program to Build E(N)-Equivariant Steerable CNNs
AQUILA: Communication Efficient Federated Learning with Adaptive Quantization of Lazily-Aggregated Gradients
A Rate-Distortion Approach to Domain Generalization
A Reduction-Based Framework for Conservative Bandits and Reinforcement Learning
A Relational Intervention Approach for Unsupervised Dynamics Generalization in Model-Based Reinforcement Learning
A Risk-Sensitive Policy Gradient Method
ARTEMIS: Attention-based Retrieval with Text-Explicit Matching and Implicit Similarity

« prev Page 3/47 next »