ICLR 2020

718 papers

Top Research Directions

Research directions most represented by ICLR 2020 papers.

The Mechanics of Benign Overfitting in High Dimensions 14
Sample Efficient Reinforcement Learning 12
Clean Accuracy Degradation in Machine Learning Defenses 12
Bypassing the Computational Bottleneck of Adversarial Training 11
Optimization and Generalization with Non-Smooth Activations 10
Accelerating Neural Architecture Search Without Full Model Training 10
Mitigating Input Perturbation Sensitivity in Deep Networks 10
The Computational Overhead of Iterative Model Pruning 8
Mitigating Gradient Variance in Policy Optimization 8
Exploration Strategies for Sparse Reward Reinforcement Learning 8
Mitigating Posterior Collapse in Latent Variable Models 7
Harnessing Parameter Redundancy in Deep Neural Networks 7
Why Differentiable Architecture Search Collapses to Skip Connections 6
Learning Minimal Sufficient Representations via Information Bottlenecks 6
Linearizing Deep Learning via the Neural Tangent Kernel 6

Top Authors

AuthorPapers
Sergey Levine13
Jun Zhu7
Cho-Jui Hsieh6
Liwei Wang6
Pushmeet Kohli6
Yoshua Bengio6
Anirudh Goyal5
Chelsea Finn5
Martin Jaggi5
Tom Goldstein5
Abhinav Gupta4
Deva Ramanan4
Eunho Yang4
Frank Hutter4
Graham Neubig4
Jiatao Gu4
Kyunghyun Cho4
Matthew Botvinick4
Max Welling4
Quanquan Gu4

Impactful Papers

Papers from ICLR 2020 that shaped research clusters.

Foundational

Influential

Papers

Title
Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learning
Playing the lottery with rewards and multiple languages: lottery tickets in RL and NLP
Plug and Play Language Models: A Simple Approach to Controlled Text Generation
Poly-encoders: Architectures and Pre-training Strategies for Fast and Accurate Multi-sentence Scoring
Polylogarithmic width suffices for gradient descent to achieve arbitrarily small test error with shallow ReLU networks
Population-Guided Parallel Policy Search for Reinforcement Learning
Port-Hamiltonian Gradient Flows
Posterior sampling for multi-agent reinforcement learning: solving extensive games with imperfect information
Precision Gating: Improving Neural Network Efficiency with Dynamic Dual-Precision Activations
Prediction, Consistency, Curvature: Representation Learning for Locally-Linear Control
Prediction Poisoning: Towards Defenses Against DNN Model Stealing Attacks
Pretrained Encyclopedia: Weakly Supervised Knowledge-Pretrained Language Model
Pre-training Tasks for Embedding-based Large-scale Retrieval
Principled Weight Initialization for Hypernetworks
Probabilistic Connection Importance Inference and Lossless Compression of Deep Neural Networks
Probability Calibration for Knowledge Graph Embedding Models
Program Guided Agent
Progressive Learning and Disentanglement of Hierarchical Representations
Progressive Memory Banks for Incremental Domain Adaptation
Projection-Based Constrained Policy Optimization
Provable Benefit of Orthogonal Initialization in Optimizing Deep Linear Networks
Provable Filter Pruning for Efficient Neural Networks
Provable robustness against all adversarial $l_p$-perturbations for $p\geq 1$
ProxSGD: Training Structured Neural Networks under Regularization and Constraints
Pruned Graph Scattering Transforms
Pseudo-LiDAR++: Accurate Depth for 3D Object Detection in Autonomous Driving
Pure and Spurious Critical Points: a Geometric Study of Linear Networks
Q-learning with UCB Exploration is Sample Efficient for Infinite-Horizon MDP
Quantifying Point-Prediction Uncertainty in Neural Networks via Residual Estimation with an I/O Kernel
Quantifying the Cost of Reliable Photo Authentication via High-Performance Learned Lossy Representations
Quantum Algorithms for Deep Convolutional Neural Networks
Query2box: Reasoning over Knowledge Graphs in Vector Space Using Box Embeddings
Query-efficient Meta Attack to Deep Neural Networks
RaCT: Toward Amortized Ranking-Critical Training For Collaborative Filtering
Ranking Policy Gradient
Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAML
RaPP: Novelty Detection with Reconstruction along Projection Pathway
Real or Not Real, that is the Question
Reanalysis of Variance Reduced Temporal Difference Learning
ReClor: A Reading Comprehension Dataset Requiring Logical Reasoning
Reconstructing continuous distributions of 3D protein structure from cryo-EM images
Recurrent neural circuits for contour detection
Reducing Transformer Depth on Demand with Structured Dropout
Reformer: The Efficient Transformer
Regularizing activations in neural networks via distribution matching with the Wasserstein metric
Reinforced active learning for image segmentation
Reinforced Genetic Algorithm Learning for Optimizing Computation Graphs
Reinforcement Learning Based Graph-to-Sequence Model for Natural Question Generation
Reinforcement Learning with Competitive Ensembles of Information-Constrained Primitives
Reinforcement Learning with Competitive Ensembles of Information-Constrained Primitives.

« prev Page 11/15 next »