arXiv 2018

47,976 papers
In 2018, arXiv hosted 2,294 papers, with a significant focus on advancing optimization techniques for neural networks and large-scale systems. Key research directions included scalable second-order optimization, local curvature adaptation, and decentralized optimization strategies that account for topology and spectral gaps. Scholars such as Wotao Yin, Michael Jordan, and Jianqing Fan contributed to these developments, alongside work on robust optimization using inexact oracles and proximal operators. There was also a notable emphasis on statistical learning theory, particularly concerning dependent dynamical systems and convergence to second-order stationarity in non-convex optimization. Research also prioritized scaling Bayesian inference through stochastic gradient MCMC and addressing computationally expensive simulators. Gaussian processes were explored with a focus on overcoming cubic complexity limitations. Applied research spanned diverse fields, including wireless spectrum anomaly detection, renewable energy forecasting, and the study of eye movement influences. Additionally, papers examined the intersection of economics and engineering, such as token economics in energy systems and the relationship between Bayes A-optimal designs and the Group Lasso. Other contributions investigated signal waveform recovery and diffusion coefficients in multi-component glass-forming liquids.

Top Research Directions

Research directions most represented by arXiv 2018 papers.

Generalizing from Synthetic Data to the Real World 181
Preserving Tiny Features Against Spatial Resolution Degradation 152
Sample Efficient Reinforcement Learning 127
Mitigating Input Perturbation Sensitivity in Deep Networks 126
Scaling Gaussian Processes Beyond Cubic Complexity 122
Dynamic Preference Modeling in Interactive Systems 102
Self-Explainable Neural Networks without Performance Loss 100
Clean Accuracy Degradation in Machine Learning Defenses 99
Compressing Deep Networks for Edge Hardware Constraints 98
Bypassing the Computational Bottleneck of Adversarial Training 96
The Empirical Validation Gap 93
Parallelizing Recurrent Models via Linear State Transitions 92
Adversarial Training for Domain Invariant Representations 87
Overcoming Volumetric Context Loss in Medical Vision Models 86
Overcoming the Convexity Constraint in Modern Optimization 86

Top Authors

AuthorPapers
Yoshua Bengio68
Sergey Levine66
Philip S. Yu55
Xiaojiang Du49
Wei Liu44
Sven Behnke43
Dacheng Tao42
Nassir Navab41
Eric P. Xing38
Mohsen Guizani38
Walid Saad38
Mohamed-Slim Alouini37
Graham Neubig36
Luc Van Gool34
Dusit Niyato33
Alan Yuille32
Xu Sun32
Bernhard Schölkopf31
Ming-Hsuan Yang31
Chunhua Shen30

Impactful Papers

Papers from arXiv 2018 that shaped research clusters.

Foundational

Influential

Papers

Title
Accelerating Natural Gradient with Higher-Order Invariance
Accelerating Neural Transformer via an Average Attention Network
Accelerating NMT Batched Beam Decoding with LMBR Posteriors for Deployment
Accelerating Nonnegative Matrix Factorization Algorithms using Extrapolation
Accelerating Photovoltaic Materials Development via High-Throughput Experiments and Machine-Learning-Assisted Diagnosis
Accelerating Prototype-Based Drug Discovery using Conditional Diversity Networks
Accelerating Reduction and Scan Using Tensor Core Units
Accelerating SGD with momentum for over-parameterized learning
Accelerating Stochastic Gradient Descent Using Antithetic Sampling
Accelerating the Evolution of Convolutional Neural Networks with Node-Level Mutations and Epigenetic Weight Initialization
Accelerating vapor condensation with daytime radiative cooling
Acceleration of Primal-Dual Methods by Preconditioning and Simple Subproblem Procedures
Acceleration of RED via Vector Extrapolation
Acceleration through Optimistic No-Regret Dynamics
Access to Population-Level Signaling as a Source of Inequality
Accident Forecasting in CCTV Traffic Camera Videos
Accounting for the Neglected Dimensions of AI Progress
Accumulating Knowledge for Lifelong Online Learning
Accuracy-based Curriculum Learning in Deep Reinforcement Learning
Accuracy of noisy Spike-Train Reconstruction: a Singularity Theory point of view
Accurate 3-D Reconstruction with RGB-D Cameras using Depth Map Fusion and Pose Refinement
Accurate and Diverse Sampling of Sequences based on a "Best of Many" Sample Objective
Accurate and Efficient Similarity Search for Large Scale Face Recognition

« prev Page 11/960 next »