No article text was recorded for this version.
high-dimensional mutual information estimation (high-dimensional information estimation)
Version 2 of 2312 papers334 conceptsfrozen 2026-10-04
Papers in this version
- Blog: Unpacking Information Bottlenecks: Surrogate Objectives for Deep Learning
- Blog: Projection Head is Secretly an Information Bottleneck
- Blog: The Information Bottleneck Problem and Its Applications in Machine Learning
- Blog: Whence Sparseness?
- Blog: The Information Bottleneck Problem and its Applications in Machine Learning
- Blog: Mutual Information-Empowered Task-Oriented Communication: Principles, Applications and Challenges
- Blog: Information-Theoretic Generalization Bounds for Transductive Learning and its Applications
- Blog: Bounding generalization error with input compression: An empirical study with infinite-width networks
- Blog: Understanding the Generalization Ability of Deep Learning Algorithms: A Kernelized Renyi's Entropy Perspective
- Blog: Strengthened Information-theoretic Bounds on the Generalization Error
- Blog: Slicing Mutual Information Generalization Bounds for Neural Networks
- Blog: On Neural Networks Fitting, Compression, and Generalization Behavior via Information-Bottleneck-like Approaches
- Blog: Conditioning and Processing: Techniques to Improve Information-Theoretic Generalization Bounds
- Blog: Information-theoretic Generalization Analysis for VQ-VAEs: A Role of Latent Variables
- Blog: The Role of Information Complexity and Randomization in Representation Learning
- Blog: Slicing Mutual Information Generalization Bounds for Neural Networks
- Blog: An Exact Characterization of the Generalization Error for the Gibbs Algorithm
- Blog: Fast Rate Information-theoretic Bounds on Generalization Errors
- Blog: Fisher Information Flow in Artificial Neural Networks
- Blog: Towards Sharper Information-theoretic Generalization Bounds for Meta-Learning
- Blog: Information-Theoretic Generalization Bounds for VAEs: A Role of Encoder and Latent Variable
- Blog: CIBR: Cross-Modal Information Bottleneck Regularization for Robust CLIP Generalization
- Blog: Parametric inference in the large data limit using maximally informative models
- Blog: Efficient Visual Transformer by Learnable Token Merging
- Blog: Uncertainty Autoencoders: Learning Compressed Representations via Variational Information Maximization
- Blog: Exploring Adversarial Examples and Adversarial Robustness of Convolutional Neural Networks by Mutual Information
- Blog: Generalizability of Neural Networks Minimizing Empirical Risk Based on Expressive Power
- Blog: Mutual Information and Optimality of Approximate Message-Passing in Random Linear Estimation
- Blog: Fair Selective Classification Via Sufficiency
- Blog: Auto-Encoding Total Correlation Explanation
- Blog: Gacs-Korner Common Information Variational Autoencoder
- Blog: Analyzing Inference Privacy Risks Through Gradients In Machine Learning
- Blog: Information-theoretic Analysis of Bayesian Test Data Sensitivity
- Blog: Is There a Trade-Off Between Fairness and Accuracy? A Perspective Using Mismatched Hypothesis Testing
- Blog: Learners that Use Little Information
- Blog: Reduce and Conquer: Independent Component Analysis at linear sample complexity
- Blog: Information Theoretic Representation Distillation
- Blog: Deep Deterministic Information Bottleneck with Matrix-based Entropy Functional
- Blog: Gate Recurrent Unit Network based on Hilbert-Schmidt Independence Criterion for State-of-Health Estimation
- Blog: Maximally Informative Hierarchical Representations of High-Dimensional Data
- Blog: MIMIR: Masked Image Modeling for Mutual Information-based Adversarial Robustness
- Blog: Deep Privacy Funnel Model: From a Discriminative to a Generative Approach with an Application to Face Recognition
- Blog: On the Emergence of Invariance and Disentangling in Deep Representations
- Blog: Discovering influential factors in variational autoencoders
- Blog: Convergence of Statistical Estimators via Mutual Information Bounds
- Blog: Generalization Bounds using Data-Dependent Fractal Dimensions
- Blog: Emergence of Invariance and Disentanglement in Deep Representations
- Blog: Usable Information and Evolution of Optimal Representations During Training
- Blog: On the Generalization for Transfer Learning: An Information-Theoretic Analysis
- Blog: Variable Selection Using Deep Variational Information Bottleneck with Drop-Out-One Loss
- Blog: What Makes Data Suitable for a Locally Connected Neural Network? A Necessary and Sufficient Condition Based on Quantum Entanglement
- Blog: PAC-Bayes Information Bottleneck
- Blog: Fairness Overfitting in Machine Learning: An Information-Theoretic Perspective
- Blog: Scalable Infomin Learning
- Blog: Ergodic Theory for Controlled Markov Chains with Stationary Inputs
- Blog: Decomposing stimulus-specific sensory neural information via diffusion models
- Blog: Characterizing and Understanding the Generalization Error of Transfer Learning with Gibbs Algorithm
- Blog: Sliced Mutual Information: A Scalable Measure of Statistical Dependence
- Blog: Learning is Forgetting; LLM Training As Lossy Compression
- Blog: On The Utility of Conditional Generation Based Mutual Information for Characterizing Adversarial Subspaces
Showing 60 of 312 papers.
History & citation
Current · Permanent link
- Diffeomorphic Modes and Parameter Identifiability in Information-Theoretic Inference merged into this direction (50% overlap)
- Generalization Bounds via Scalar Loss Projections merged into this direction (52% overlap)
- loss-difference projection split from this direction (80% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_high_dimensional_mutual_information_esti_ba39ea83,
title = {high-dimensional mutual information estimation (high-dimensional information estimation)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/high-dimensional-mutual-information-estimation-high-dimensional-information/rdr_ba39ea83b4494c648958aad7598a054d},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-19},
}This exact version (version 2, frozen text):
@misc{lacuna_high_dimensional_mutual_information_esti_ba39ea83_v2,
title = {high-dimensional mutual information estimation (high-dimensional information estimation)},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/high-dimensional-mutual-information-estimation-high-dimensional-information/rdr_ba39ea83b4494c648958aad7598a054d/v/2},
note = {Version 2, frozen 2026-10-04. Accessed 2026-11-19},
}