ISIT 2022

204 papers
The 2022 IEEE International Symposium on Information Theory (ISIT) featured 238 papers addressing core information-theoretic problems and their applications in machine learning. A prominent research theme involved generalization in deep learning, with studies focusing on computable generalization bounds for self-certified learning, neural collapse under cross-entropy loss, and the behavior of overparameterized models. Optimization techniques also received attention, specifically Bregman proximal methods and strategies for reducing gradient variance in stochastic processes. Another area of inquiry was partial information decomposition for analyzing complex, multimodal, and multivariate systems. The year's contributions also covered advancements in coding theory and signal processing, including list decoding of binary alternant codes, universal 1-bit compressive sensing, and universal error correction using foundation models. Research further explored practical communication constraints, such as finite block-length regimes and joint communication and privacy requirements. Prolific authors for this edition included Yihan Zhang, Bo Bai, Antonia Wachter-Zeh, and Deniz Gündüz. The proceedings reflected a continued integration of information theory with federated learning and the mitigation of spurious correlations in large-scale models.

Top Research Directions

Research directions most represented by ISIT 2022 papers.

Geometry Aware Optimization via Relative Smoothness 2
Straggler-Resilient Coded Computation 2
Moment Constraints for Information Measures on Infinite Alphabets 1
Probabilistic Constellation Shaping 1
Learning from Dependent Data with Unknown Mixing Rates 1
Tightening the Bounds Between Total Variation and KL Divergence 1
Asymptotically Optimal Quickest Change Detection 1
Monolithic Neural Architectures for End to End Wireless Receivers 1
Sequential Rademacher Complexity for Online Learning 1
The Duality Between Information and Estimation 1
Exploiting Statistical Correlations in Group Testing 1
Bandwidth Adaptive Repair for Distributed Storage 1
Non-Uniform Noise Modeling in Ranking and Sorting 1
Quantifying Generalization via Information Leakage 1
Regret Bounds for Gaussian Process Bandits 1

Top Authors

AuthorPapers
Yihan Zhang7
Antonia Wachter-Zeh6
Deniz Gunduz6
Alex Dytso5
Bo Bai5
Martina Cardone5
Cheuk Ting Li4
Christina Fragouli4
Jonathan Scarlett4
Rawad Bitar4
Chao Tian3
Christos Thrampoulidis3
Farhad Shirani3
Gong Zhang3
Hamed Hassani3
Oliver Kosut3
Songze Li3
Vincent Y. F. Tan3
Alfred O. Hero2
Anand D. Sarwate2

Impactful Papers

Papers from ISIT 2022 that shaped research clusters.

Foundational

Influential

Papers

Title
Warm-Starting in Message Passing algorithms
Weighted Parity-Check Codes for Channels with State and Asymmetric Channels
Wyner-Ziv compression is (almost) optimal for distributed optimization
α-GAN: Convergence and Estimation Guarantees

« prev Page 5/5