No article text was recorded for this version.
shallow network theoretical constraints
Version 1 of 1138 papers139 conceptsfrozen 2026-10-04
Papers in this version
- Blog: The Gaussian equivalence of generative models for learning with shallow neural networks
- Blog: Feature learning via mean-field Langevin dynamics: classifying sparse parities and beyond
- Blog: Benign Overfitting for Regression with Trained Two-Layer ReLU Networks
- Blog: Efficiently Learning One Hidden Layer ReLU Networks From Queries
- Blog: iGraphMix: Input Graph Mixup Method for Node Classification
- Blog: Generalizability of Neural Networks Minimizing Empirical Risk Based on Expressive Ability
- Blog: Stable Minima of ReLU Neural Networks Suffer from the Curse of Dimensionality: The Neural Shattering Phenomenon
- Blog: Provably Neural Active Learning Succeeds via Prioritizing Perplexing Samples
- Blog: Overfitting in Neural Nets: Backpropagation, Conjugate Gradient, and Early Stopping
- Blog: Early Stopping of Untrained Convolutional Neural Networks
- Blog: A Convex Relaxation Approach to Generalization Analysis for Parallel Positively Homogeneous Networks
- Blog: A Priori Estimation of the Approximation, Optimization and Generalization Errors of Random Neural Networks for Solving Partial Differential Equations
- Blog: From Tempered to Benign Overfitting in ReLU Neural Networks
- Blog: A Law of Robustness for Two-Layers Neural Networks
- Blog: Learning Curves for Deep Structured Gaussian Feature Models
- Blog: When do neural networks outperform kernel methods?*
- Blog: Drawback of Enforcing Equivariance and its Compensation via the Lens of Expressive Power
- Blog: On the Effect of Initialization: The Scaling Path of 2-Layer Neural Networks
- Blog: Generalization of Two-layer Neural Networks: An Asymptotic Viewpoint
- Blog: Provably Neural Active Learning Succeeds via Prioritizing Perplexing Samples
- Blog: From high-dimensional & mean-field dynamics to dimensionless ODEs: A unifying approach to SGD in two-layers networks
- Blog: What Can ResNet Learn Efficiently, Going Beyond Kernels?
- Blog: Dynamics of Supervised Learning with Restricted Training Sets and Noisy Teachers
- Blog: Impact of Bottleneck Layers and Skip Connections on the Generalization of Linear Denoising Autoencoders
- Blog: A priori estimates for classification problems using neural networks
- Blog: Provable Guarantees for Nonlinear Feature Learning in Three-Layer Neural Networks
- Blog: Exact Gap between Generalization Error and Uniform Convergence in Random Feature Models
- Blog: Learning Overparameterized Neural Networks via Stochastic Gradient Descent on Structured Data
- Blog: Gradient Descent Finds Over-Parameterized Neural Networks with Sharp Generalization for Nonparametric Regression: A Distribution-Free Analysis
- Blog: Benign Overfitting in Two-Layer ReLU Convolutional Neural Networks for XOR Data
- Blog: Dropout: Explicit Forms and Capacity Control
- Blog: Integral representations of shallow neural network with Rectified Power Unit activation function
- Blog: A law of robustness for two-layers neural networks
- Blog: $H$-Consistency Bounds for Pairwise Misranking Loss Surrogates
- Blog: On the approximation of functions by tanh neural networks
- Blog: On the Approximation Power of Two-Layer Networks of Random ReLUs
- Blog: Benign Overfitting for Two-layer ReLU Networks
- Blog: Limitations of Lazy Training of Two-layers Neural Networks.
- Blog: Can Shallow Neural Networks Beat the Curse of Dimensionality? A Mean Field Training Perspective
- Blog: Dropout Training is Distributionally Robust Optimal
- Blog: On Achieving Optimal Adversarial Test Error
- Blog: Robust Learning for Data Poisoning Attacks
- Blog: Stability and Generalization Analysis of Gradient Methods for Shallow Neural Networks
- Blog: Learning Overparameterized Neural Networks via Stochastic Gradient Descent on Structured Data
- Blog: Fine-Grained Analysis of Optimization and Generalization for Overparameterized Two-Layer Neural Networks
- Blog: Provable Multi-Task Representation Learning by Two-Layer ReLU Neural Networks
- Blog: Reliably Learning the ReLU in Polynomial Time
- Blog: On the Comparison between Multi-modal and Single-modal Contrastive Learning
- Blog: A Priori Generalization Error Analysis of Two-Layer Neural Networks for Solving High Dimensional Schrödinger Eigenvalue Problems
- Blog: Simplicity Bias via Global Convergence of Sharpness Minimization
- Blog: The Slow Deterioration of the Generalization Error of the Random Feature Model
- Blog: The Neural Tangent Kernel in High Dimensions: Triple Descent and a Multi-Scale Theory of Generalization
- Blog: The committee machine: computational to statistical gaps in learning a two-layers neural network
- Blog: Beyond the Storage Capacity: Data-Driven Satisfiability Transition
- Blog: Sharp Generalization for Nonparametric Regression by Over-Parameterized Neural Networks: A Distribution-Free Analysis in Spherical Covariate
- Blog: Simplicity Bias and Optimization Threshold in Two-Layer ReLU Networks
- Blog: Generalization Below the Edge of Stability: The Role of Data Geometry
- Blog: Benign Overfitting in Linear Classifiers and Leaky ReLU Networks from KKT Conditions for Margin Maximization
- Blog: Generalization error in high-dimensional perceptrons: Approaching Bayes error with convex optimization
- Blog: Towards Understanding the Role of Over-Parametrization in Generalization of Neural Networks
Showing 60 of 138 papers.
History & citation
Current · Permanent link
- This direction split from Generalization Theory for Shallow and Deep Neural Networks (80% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_shallow_network_theoretical_constraints_0934125e,
title = {shallow network theoretical constraints},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/shallow-network-theoretical-constraints/rdr_0934125e75c14abfa5ff672f358ee1b0},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 1, frozen text):
@misc{lacuna_shallow_network_theoretical_constraints_0934125e_v1,
title = {shallow network theoretical constraints},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/shallow-network-theoretical-constraints/rdr_0934125e75c14abfa5ff672f358ee1b0/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-20},
}