arXiv 2016
27,850 papers
In 2016, arXiv hosted 1,469 papers with a strong focus on scalable optimization and Bayesian inference. Key research directions included stochastic gradient MCMC for Bayesian inference and robust decentralized optimization within dynamic networks. There was a significant emphasis on high-dimensional data analysis, particularly regarding sampling in non-convex landscapes and learning from low-sample-size biological datasets. Statistical learning theory also saw advancements in understanding dependent dynamical systems and refining generalization bounds.
Technical developments during this year centered on refining optimization algorithms, such as randomized block coordinate methods and the Alternating Direction Method of Multipliers (ADMM) integrated with Nesterov’s extrapolation. Research also explored the intersection of neural networks and partial differential equations, fairness in reinforcement learning, and improving the accuracy of Variational Autoencoders. Prolific contributors included Danielle S. Bassett, Shi Gu, and J. Nathan Kutz, reflecting a broader trend toward integrating complex dynamical systems with statistical learning and high-dimensional sampling techniques.
Top Research Directions
Research directions most represented by arXiv 2016 papers.
Top Authors
Impactful Papers
Papers from arXiv 2016 that shaped research clusters.
Foundational
Modeling Visual Representations: Defining Properties and Deep Approximations
foundational
Task Dependent Nuisance Invariance in Vi
Recurrence Width for Structured Dense Matrix Vector Multiplication
foundational
Unifying Structured Matrices with Genera
Load Optimization with User Association in Cooperative and Load-Coupled LTE Networks
foundational
Inter-Cell Load Coupling in Cellular Net
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
foundational
Noise Robustness Through Activation Symm
Crafting Adversarial Input Sequences for Recurrent Neural Networks
foundational
Adversarial State Propagation in Recurre
Ornstein-Uhlenbeck Process with Fluctuating Damping
foundational
The Critical Threshold for Moment Stabil
Cache-Aided Coded Multicast for Correlated Sources
foundational
Exploiting Content Correlation in Cache-
Energy-Aware Wireless Relay Selection in Load-Coupled OFDMA Cellular Networks
foundational
Inter-Cell Load Coupling in Cellular Net
Influential
Learning Recurrent Span Representations for Extractive Question Answering
influential
The Quadratic Complexity of Span Based T
Towards deep learning with spiking neurons in energy based models with contrastive Hebbian plasticit
influential
Credit Assignment Without Weight Transpo
Forecasting Social Navigation in Crowded Complex Scenes
influential
Modeling Heterogeneous Agent Interaction
End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF
influential
Constrained Sequence Decoding for Neural
Sequence-to-Sequence RNNs for Text Summarization
influential
Augmenting Word Embeddings with Explicit
Using the Output Embedding to Improve Language Models
influential
Compressing the Embedding Layer Memory B
Neural Network-Based Abstract Generation for Opinions and Arguments
influential
Augmenting Word Embeddings with Explicit