arXiv 2018

47,976 papers
In 2018, arXiv hosted 2,294 papers, with a significant focus on advancing optimization techniques for neural networks and large-scale systems. Key research directions included scalable second-order optimization, local curvature adaptation, and decentralized optimization strategies that account for topology and spectral gaps. Scholars such as Wotao Yin, Michael Jordan, and Jianqing Fan contributed to these developments, alongside work on robust optimization using inexact oracles and proximal operators. There was also a notable emphasis on statistical learning theory, particularly concerning dependent dynamical systems and convergence to second-order stationarity in non-convex optimization. Research also prioritized scaling Bayesian inference through stochastic gradient MCMC and addressing computationally expensive simulators. Gaussian processes were explored with a focus on overcoming cubic complexity limitations. Applied research spanned diverse fields, including wireless spectrum anomaly detection, renewable energy forecasting, and the study of eye movement influences. Additionally, papers examined the intersection of economics and engineering, such as token economics in energy systems and the relationship between Bayes A-optimal designs and the Group Lasso. Other contributions investigated signal waveform recovery and diffusion coefficients in multi-component glass-forming liquids.

Top Research Directions

Research directions most represented by arXiv 2018 papers.

Generalizing from Synthetic Data to the Real World 181
Preserving Tiny Features Against Spatial Resolution Degradation 152
Sample Efficient Reinforcement Learning 127
Mitigating Input Perturbation Sensitivity in Deep Networks 126
Scaling Gaussian Processes Beyond Cubic Complexity 122
Dynamic Preference Modeling in Interactive Systems 102
Self-Explainable Neural Networks without Performance Loss 100
Clean Accuracy Degradation in Machine Learning Defenses 99
Compressing Deep Networks for Edge Hardware Constraints 98
Bypassing the Computational Bottleneck of Adversarial Training 96
The Empirical Validation Gap 93
Parallelizing Recurrent Models via Linear State Transitions 92
Adversarial Training for Domain Invariant Representations 87
Overcoming Volumetric Context Loss in Medical Vision Models 86
Overcoming the Convexity Constraint in Modern Optimization 86

Top Authors

AuthorPapers
Yoshua Bengio68
Sergey Levine66
Philip S. Yu55
Xiaojiang Du49
Wei Liu44
Sven Behnke43
Dacheng Tao42
Nassir Navab41
Eric P. Xing38
Mohsen Guizani38
Walid Saad38
Mohamed-Slim Alouini37
Graham Neubig36
Luc Van Gool34
Dusit Niyato33
Alan Yuille32
Xu Sun32
Bernhard Schölkopf31
Ming-Hsuan Yang31
Chunhua Shen30

Impactful Papers

Papers from arXiv 2018 that shaped research clusters.

Foundational

Influential

Papers

Title
Attentioned Convolutional LSTM InpaintingNetwork for Anomaly Detection in Videos
Attention-GAN for Object Transfiguration in Wild Images
Attention-Gated Networks for Improving Ultrasound Scan Plane Detection
Attention Gated Networks: Learning to Leverage Salient Regions in Medical Images
Attention-Guided Answer Distillation for Machine Reading Comprehension
Attention-Guided Curriculum Learning for Weakly Supervised Classification and Localization of Thoracic Diseases on Chest Radiographs
Attention-guided Unified Network for Panoptic Segmentation
Attention Incorporate Network: A network can adapt various data size
Attention is All We Need: Nailing Down Object-centric Attention for Egocentric Activity Recognition
Attention-Mechanism-based Tracking Method for Intelligent Internet of Vehicles
Attention Mechanism in Speaker Recognition: What Does It Learn in Deep Speaker Embedding?
Attention Mechanisms for Object Recognition with Event-Based Cameras
Attention Models in Graphs: A Survey
Attention Models with Random Features for Multi-layered Graph Embeddings
Attention, Please! Adversarial Defense via Activation Rectification and Preservation
Attention, Please! Adversarial Defense via Attention Rectification and Preservation
Attention Please: Consider Mockito when Evaluating Newly Proposed Automated Program Repair Techniques
Attention Please: Consider Mockito when Evaluating Newly Released Automated Program Repair Techniques
Attention Solves Your TSP
Attention Solves Your TSP, Approximately
Attention U-Net: Learning Where to Look for the Pancreas
AttentionXML: Label Tree-based Attention-Aware Deep Model for High-Performance Extreme Multi-Label Text Classification
Attentive Aspect Modeling for Review-aware Recommendation
Attentive cross-modal paratope prediction
Attentive Crowd Flow Machines
Attentive Filtering Networks for Audio Replay Attack Detection
Attentive Interaction Model: Modeling Changes in View in Argumentation
Attentive Long Short-Term Preference Modeling for Personalized Product Search
Attentive Neural Architecture Incorporating Song Features For Music Recommendation
Attentive Neural Network for Named Entity Recognition in Vietnamese
Attentive Recurrent Tensor Model for Community Question Answering
Attentive Relational Networks for Mapping Images to Scene Graphs
Attentive Semantic Alignment with Offset-Aware Correlation Kernels
Attentive Semantic Role Labeling with Boundary Indicator
Attentive Sequence to Sequence Translation for Localizing Clips of Interest by Natural Language Descriptions
Attentive Tensor Product Learning
Attentive Tensor Product Learning for Language Generation and Grammar Parsing
Attenuate Locally, Win Globally: An Attenuation-based Framework for Online Stochastic Matching with Timeouts
AttnConvnet at SemEval-2018 Task 1: Attention-based Convolutional Neural Networks for Multi-label Emotion Classification

« prev Page 137/960 next »