ICLR 2020

718 papers

Top Research Directions

Research directions most represented by ICLR 2020 papers.

The Mechanics of Benign Overfitting in High Dimensions 14
Sample Efficient Reinforcement Learning 12
Clean Accuracy Degradation in Machine Learning Defenses 12
Bypassing the Computational Bottleneck of Adversarial Training 11
Optimization and Generalization with Non-Smooth Activations 10
Accelerating Neural Architecture Search Without Full Model Training 10
Mitigating Input Perturbation Sensitivity in Deep Networks 10
The Computational Overhead of Iterative Model Pruning 8
Mitigating Gradient Variance in Policy Optimization 8
Exploration Strategies for Sparse Reward Reinforcement Learning 8
Mitigating Posterior Collapse in Latent Variable Models 7
Harnessing Parameter Redundancy in Deep Neural Networks 7
Why Differentiable Architecture Search Collapses to Skip Connections 6
Learning Minimal Sufficient Representations via Information Bottlenecks 6
Linearizing Deep Learning via the Neural Tangent Kernel 6

Top Authors

AuthorPapers
Sergey Levine13
Jun Zhu7
Cho-Jui Hsieh6
Liwei Wang6
Pushmeet Kohli6
Yoshua Bengio6
Anirudh Goyal5
Chelsea Finn5
Martin Jaggi5
Tom Goldstein5
Abhinav Gupta4
Deva Ramanan4
Eunho Yang4
Frank Hutter4
Graham Neubig4
Jiatao Gu4
Kyunghyun Cho4
Matthew Botvinick4
Max Welling4
Quanquan Gu4

Impactful Papers

Papers from ICLR 2020 that shaped research clusters.

Foundational

Influential

Papers

Title
Skip Connections Matter: On the Transferability of Adversarial Examples Generated with ResNets
Sliced Cramer Synaptic Consolidation for Preserving Deeply Learned Representations
SlowMo: Improving Communication-Efficient Distributed SGD with Slow Momentum
Smooth markets: A basic mechanism for organizing gradient-based learners
Smoothness and Stability in GANs
SNODE: Spectral Discretization of Neural ODEs for System Identification
SNOW: Subscribing to Knowledge via Channel Pooling for Transfer & Lifelong Learning of Convolutional Neural Networks
Solving ODE with Universal Flows: Approximation Theory for Flow-Based Models
Soteria: In search of efficient neural networks for private inference
SPACE: Unsupervised Object-Oriented Scene Representation via Spatial Attention and Decomposition
Span Recovery for Deep Neural Networks with Applications to Input Obfuscation
Sparse Coding with Gated Learned ISTA
Spectral Embedding of Regularized Block Models
Spike-based causal inference for weight alignment
SpikeGrad: An ANN-equivalent Computation Model for Implementing Backpropagation with Spikes
SQIL: Imitation Learning via Reinforcement Learning with Sparse Rewards
Stable Rank Normalization for Improved Generalization in Neural Networks and GANs
State Alignment-based Imitation Learning
State-only Imitation with Transition Dynamics Mismatch
Stochastic AUC Maximization with Deep Neural Networks
Stochastic Conditional Generative Networks with Basis Decomposition
Stochastic Weight Averaging in Parallel: Large-Batch Training That Generalizes Well
Strategies for Pre-training Graph Neural Networks
StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understanding
StructPool: Structured Graph Pooling via Conditional Random Fields
Structured Object-Aware Physics Prediction for Video Modeling and Planning
Sub-policy Adaptation for Hierarchical Reinforcement Learning
SUMO: Unbiased Estimation of Log Marginal Probability for Latent Variable Models
SVQN: Sequential Variational Soft Q-Learning Networks
Symplectic ODE-Net: Learning Hamiltonian Dynamics with Control
Symplectic Recurrent Neural Networks
Synthesizing Programmatic Policies that Inductively Generalize
TabFact: A Large-scale Dataset for Table-based Fact Verification
Target-Embedding Autoencoders for Supervised Representation Learning
Tensor Decompositions for Temporal Knowledge Base Completion
The asymptotic spectrum of the Hessian of DNN throughout training
The Break-Even Point on Optimization Trajectories of Deep Neural Networks
The Curious Case of Neural Text Degeneration
The Deep Bootstrap Framework: Good Online Learners are Good Offline Generalizers
The Early Phase of Neural Network Training
The Gambler's Problem and Beyond
The Implicit Bias of Depth: How Incremental Learning Drives Generalization
The intriguing role of module criticality in the generalization of deep networks
The Local Elasticity of Neural Networks
The Logical Expressiveness of Graph Neural Networks
Theory and Evaluation Metrics for Learning Disentangled Representations
The Shape of Data: Intrinsic Distance for Data Distributions
The Variational Bandwidth Bottleneck: Stochastic Evaluation on an Information Budget
Thieves on Sesame Street! Model Extraction of BERT-based APIs
Thinking While Moving: Deep Reinforcement Learning with Concurrent Control

« prev Page 13/15 next »