arXiv 2018

47,976 papers
In 2018, arXiv hosted 2,294 papers, with a significant focus on advancing optimization techniques for neural networks and large-scale systems. Key research directions included scalable second-order optimization, local curvature adaptation, and decentralized optimization strategies that account for topology and spectral gaps. Scholars such as Wotao Yin, Michael Jordan, and Jianqing Fan contributed to these developments, alongside work on robust optimization using inexact oracles and proximal operators. There was also a notable emphasis on statistical learning theory, particularly concerning dependent dynamical systems and convergence to second-order stationarity in non-convex optimization. Research also prioritized scaling Bayesian inference through stochastic gradient MCMC and addressing computationally expensive simulators. Gaussian processes were explored with a focus on overcoming cubic complexity limitations. Applied research spanned diverse fields, including wireless spectrum anomaly detection, renewable energy forecasting, and the study of eye movement influences. Additionally, papers examined the intersection of economics and engineering, such as token economics in energy systems and the relationship between Bayes A-optimal designs and the Group Lasso. Other contributions investigated signal waveform recovery and diffusion coefficients in multi-component glass-forming liquids.

Top Research Directions

Research directions most represented by arXiv 2018 papers.

Generalizing from Synthetic Data to the Real World 181
Preserving Tiny Features Against Spatial Resolution Degradation 152
Sample Efficient Reinforcement Learning 127
Mitigating Input Perturbation Sensitivity in Deep Networks 126
Scaling Gaussian Processes Beyond Cubic Complexity 122
Dynamic Preference Modeling in Interactive Systems 102
Self-Explainable Neural Networks without Performance Loss 100
Clean Accuracy Degradation in Machine Learning Defenses 99
Compressing Deep Networks for Edge Hardware Constraints 98
Bypassing the Computational Bottleneck of Adversarial Training 96
The Empirical Validation Gap 93
Parallelizing Recurrent Models via Linear State Transitions 92
Adversarial Training for Domain Invariant Representations 87
Overcoming Volumetric Context Loss in Medical Vision Models 86
Overcoming the Convexity Constraint in Modern Optimization 86

Top Authors

AuthorPapers
Yoshua Bengio68
Sergey Levine66
Philip S. Yu55
Xiaojiang Du49
Wei Liu44
Sven Behnke43
Dacheng Tao42
Nassir Navab41
Eric P. Xing38
Mohsen Guizani38
Walid Saad38
Mohamed-Slim Alouini37
Graham Neubig36
Luc Van Gool34
Dusit Niyato33
Alan Yuille32
Xu Sun32
Bernhard Schölkopf31
Ming-Hsuan Yang31
Chunhua Shen30

Impactful Papers

Papers from arXiv 2018 that shaped research clusters.

Foundational

Influential

Papers

Title
Attaining the Unattainable? Reassessing Claims of Human Parity in Neural Machine Translation
Attend and Rectify: a Gated Attention Mechanism for Fine-Grained Recovery
Attend Before you Act: Leveraging human visual attention for continual learning
Attend, Copy, Parse - End-to-end information extraction from documents
Attend, Copy, Parse -- End-to-end information extraction from documents
Attended Temperature Scaling: A Practical Approach for Calibrating Deep Neural Networks
Attending Category Disentangled Global Context for Image Classification
Attend More Times for Image Captioning
Attentional Aggregation of Deep Feature Sets for Multi-view 3D Reconstruction
Attentional Heterogeneous Graph Neural Network: Application to Program Reidentification
Attentional Multilabel Learning over Graphs: A Message Passing Approach
Attentional Multi-Reading Sarcasm Detection
Attentional Road Safety Networks
Attention-Aware Compositional Network for Person Re-identification
Attention-based Active Visual Search for Mobile Robots
Attention-based Adaptive Selection of Operations for Image Restoration in the Presence of Unknown Combined Distortions
Attention-Based Capsule Networks with Dynamic Routing for Relation Extraction
Attention-based Deep Multiple Instance Learning
Attention-Based Deep Neural Networks for Detection of Cancerous and Precancerous Esophagus Tissue on Histopathological Slides
Attention-based End-to-End Models for Small-Footprint Keyword Spotting
Attention-based Few-Shot Person Re-identification Using Meta Learning
Attention Based Fully Convolutional Network for Speech Emotion Recognition
Attention-based Graph Neural Network for Semi-supervised Learning
Attention-based Group Recommendation
Attention-based Hierarchical Neural Query Suggestion
Attention-Based LSTM for Psychological Stress Detection from Spoken Language Using Distant Supervision
Attention Based Natural Language Grounding by Navigating Virtual Environment
Attention-based Neural Text Segmentation
Attention-based Pyramid Aggregation Network for Visual Place Recognition
Attention-based sequence-to-sequence model for speech recognition: development of state-of-the-art system on LibriSpeech and its application to non-native English
Attention-based Temporal Weighted Convolutional Neural Network for Action Recognition
Attention-based Walking Gait and Direction Recognition in Wi-Fi Networks
Attention Branch Network: Learning of Attention Mechanism for Visual Explanation
Attention Cropping: A Novel Data Augmentation Method for Real-world Plant Species Identification
Attention Driven Person Re-identification

« prev Page 136/960 next »