ISIT 2021

215 papers
The 2021 IEEE International Symposium on Information Theory (ISIT) featured 246 papers addressing core challenges in communication and data processing. A primary research direction involved the intersection of information theory and machine learning, with significant focus on information-theoretic generalization, the bottleneck principle, and high probability generalization bounds. Other prominent themes included semantic communication for wireless image transmission, unsourced random access for massive machine-type communications, and the development of provable guarantees for algorithmic performance. Technical contributions also explored bridging the gap between combinatorial existence and efficient decoding, alongside advancements in parallel architectures for sequential decoding. Notable papers investigated topics such as sparse recovery with shuffled labels, analog joint source-channel coding using deep neural networks, and new uncertainty measures like $t$-entropy. Prolific authors during this edition included Flávio P. Calmon, Antonia Wachter-Zeh, Yury Polyanskiy, and Deniz Gunduz. The year’s research reflected a trend toward integrating deep learning with classical information theory, evidenced by work on distributed interference alignment and Riemannian manifold optimization for learning orthogonal representations.

Top Research Directions

Research directions most represented by ISIT 2021 papers.

The Empirical Validation Gap 7
Quantifying Generalization via Information Leakage 3
Generalization Bounds for Unbounded Loss Functions 3
Straggler-Resilient Coded Computation 3
Data-Dependent Priors for Tight PAC-Bayesian Bounds 2
Threshold Saturation via Spatially Coupled Codes 2
Breaking the Linear Scan Barrier in Private Information Retrieval 2
Inherent Rate Adaptation via Rateless Coding 2
Formulating Complex Problems as Markov Decision Processes 2
The Intractability of Multi-Letter Channel Capacities 2
Joint Latent State and Parameter Estimation 2
Overcoming Idealized Assumptions in Channel Modeling 2
Error Feedback for Compressed Distributed Learning 2
Scaling Mutual Information Estimation to High Dimensions 2
Non-Vacuous Generalization Bounds for Deep Learning 2

Top Authors

AuthorPapers
Antonia Wachter-Zeh7
Ayfer Ozgur6
Jean Honorio6
Flavio Calmon5
Rawad Bitar5
Deniz Gunduz4
Or Ordentlich4
Farzad Farnoud3
Giuseppe Durisi3
Lele Wang3
Oliver Kosut3
Ping Li3
Yihan Zhang3
Yury Polyanskiy3
Abdellatif Zaidi2
Alexandre Graell i Amat2
Alfred O. Hero2
Ali Tajer2
Arya Mazumdar2
Chao Tian2

Impactful Papers

Papers from ISIT 2021 that shaped research clusters.

Influential

Papers

Title
Two-sample Testing of Discrete Distributions under Rare/Weak Perturbations
Two-sample Test using Projected Wasserstein Distance
Two-Timescale Stochastic EM Algorithms
Two-tone Shift-XOR Storage Codes
Type Graphs and Small-Set Expansion
Understanding Entropic Regularization in GANs
Universal Graph Compression: Stochastic Block Models
Unsigned Matrix Completion
Upper bound on the classical capacity of a quantum channel assisted by classical feedback
WaveMax: FrFT-Based Convex Phase Retrieval for Radar Waveform Design
When an Energy-Efficient Scheduling is Optimal for Half-Duplex Relay Networks?
When to Use Graph Side Information in Matrix Completion
Wiretap Channel with Latent Variable Secrecy
Zero-Error Communication over Adversarial MACs
Zero-rate reliability function for mismatched decoding

« prev Page 5/5