No article text was recorded for this version.
compression-generalization decoupling
Version 1 of 114 papers25 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Entropy and mutual information in models of deep neural networks
- Blog: Entropy and mutual information in models of deep neural networks
- Blog: On the Information Bottleneck Theory of Deep Learning
- Blog: Estimating Information Flow in Deep Neural Networks
- Blog: Adaptive Estimators Show Information Compression in Deep Neural Networks
- Blog: Information Bottleneck: Exact Analysis of (Quantized) Neural Networks
- Blog: End-to-End Training Induces Information Bottleneck through Layer-Role Differentiation: A Comparative Analysis with Layer-wise Training
- Blog: Information Plane Analysis for Dropout Neural Networks
- Blog: Feature learning in deep classifiers through Intermediate Neural Collapse
- Blog: The Information Bottleneck Problem and its Applications in Machine Learning
- Blog: Information in Infinite Ensembles of Infinitely-Wide Neural Networks
- Blog: Information Flows of Diverse Autoencoders
- Blog: Analysis of Deep Convolutional Neural Networks Using Tensor Kernels and Matrix-Based Entropy
- Blog: Low-dimensional intrinsic dimension reveals a phase transition in gradient-based learning of deep neural networks
History & citation
Current · Permanent link
- This direction split from Information Compression and Generalization in Deep Networks (64% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_compression_generalization_decoupling_eba168dd,
title = {compression-generalization decoupling},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/compression-generalization-decoupling/rdr_eba168dd6512497fa9c5ce89e6dbb68c},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-21},
}This exact version (version 1, frozen text):
@misc{lacuna_compression_generalization_decoupling_eba168dd_v1,
title = {compression-generalization decoupling},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/compression-generalization-decoupling/rdr_eba168dd6512497fa9c5ce89e6dbb68c/v/1},
note = {Version 1, frozen 2026-10-04. Accessed 2026-11-21},
}