arXiv 2018

47,976 papers
In 2018, arXiv hosted 2,294 papers, with a significant focus on advancing optimization techniques for neural networks and large-scale systems. Key research directions included scalable second-order optimization, local curvature adaptation, and decentralized optimization strategies that account for topology and spectral gaps. Scholars such as Wotao Yin, Michael Jordan, and Jianqing Fan contributed to these developments, alongside work on robust optimization using inexact oracles and proximal operators. There was also a notable emphasis on statistical learning theory, particularly concerning dependent dynamical systems and convergence to second-order stationarity in non-convex optimization. Research also prioritized scaling Bayesian inference through stochastic gradient MCMC and addressing computationally expensive simulators. Gaussian processes were explored with a focus on overcoming cubic complexity limitations. Applied research spanned diverse fields, including wireless spectrum anomaly detection, renewable energy forecasting, and the study of eye movement influences. Additionally, papers examined the intersection of economics and engineering, such as token economics in energy systems and the relationship between Bayes A-optimal designs and the Group Lasso. Other contributions investigated signal waveform recovery and diffusion coefficients in multi-component glass-forming liquids.

Top Research Directions

Research directions most represented by arXiv 2018 papers.

Generalizing from Synthetic Data to the Real World 181
Preserving Tiny Features Against Spatial Resolution Degradation 152
Sample Efficient Reinforcement Learning 127
Mitigating Input Perturbation Sensitivity in Deep Networks 126
Scaling Gaussian Processes Beyond Cubic Complexity 122
Dynamic Preference Modeling in Interactive Systems 102
Self-Explainable Neural Networks without Performance Loss 100
Clean Accuracy Degradation in Machine Learning Defenses 99
Compressing Deep Networks for Edge Hardware Constraints 98
Bypassing the Computational Bottleneck of Adversarial Training 96
The Empirical Validation Gap 93
Parallelizing Recurrent Models via Linear State Transitions 92
Adversarial Training for Domain Invariant Representations 87
Overcoming Volumetric Context Loss in Medical Vision Models 86
Overcoming the Convexity Constraint in Modern Optimization 86

Top Authors

AuthorPapers
Yoshua Bengio68
Sergey Levine66
Philip S. Yu55
Xiaojiang Du49
Wei Liu44
Sven Behnke43
Dacheng Tao42
Nassir Navab41
Eric P. Xing38
Mohsen Guizani38
Walid Saad38
Mohamed-Slim Alouini37
Graham Neubig36
Luc Van Gool34
Dusit Niyato33
Alan Yuille32
Xu Sun32
Bernhard Schölkopf31
Ming-Hsuan Yang31
Chunhua Shen30

Impactful Papers

Papers from arXiv 2018 that shaped research clusters.

Foundational

Influential

Papers

Title
A Tensor-Based Sub-Mode Coordinate Algorithm for Stock Prediction
A test case for application of convolutional neural networks to spatio-temporal climate data: Re-identifying clustered weather patterns
ATHENA: Automated Tuning of Genomic Error Correction Algorithms using Language Models
A Theoretical Explanation for Perplexing Behaviors of Backpropagation-based Visualizations
A theoretical framework of the scaled Gaussian stochastic process in prediction and calibration
A Theoretical Investigation of Graph Degree as an Unsupervised Normality Measure
A Theoretically Guaranteed Deep Optimization Framework for Robust Compressive Sensing MRI
A Theory-Based Evaluation of Nearest Neighbor Models Put Into Practice
A Theory of Statistical Inference for Ensuring the Robustness of Scientific Results
A theory on the absence of spurious solutions for nonconvex and nonsmooth optimization
At Human Speed: Deep Reinforcement Learning with Action Delay
A Tight Analysis of Bethe Approximation for Permanent
A Tight Convergence Analysis for Stochastic Gradient Descent with Delayed Updates

« prev Page 133/960 next »