Entropy 2019

158 papers
In 2019, the journal Entropy published 171 papers, with a primary focus on Information Bottleneck (IB) theory. Research directions centered on utilizing IB for developing robust and generalizable representations, exploring minimal sufficient representations, and analyzing phase transitions within these frameworks. Theoretical contributions addressed maximum-entropy priors, logarithmic loss in fixed-length lossy compression, and extremal results for long Markov chains using monotone path proofs. The year also featured diverse applications of information-theoretic principles across multiple disciplines. Research included the non-linear dynamics analysis of protein sequences, capacity analysis of nondispersive optical perturbative models, and the use of convolutional recurrent neural networks with self-attention for personnel performance prediction. Additionally, studies explored secure holographic image watermarking schemes. Prolific contributors during this period included Albert No, Jun Chen, Jun Feng, and Nicola Toschi, reflecting an interdisciplinary approach to entropy and information theory.

Top Research Directions

Research directions most represented by Entropy 2019 papers.

Multiscale Entropy Analysis of Complex Time Series 6
The Empirical Validation Gap 5
Constrained Entropy Maximization for Probabilistic Modeling 4
Empirical Mode Decomposition for Non-Stationary Signals 4
Adaptive Time-Frequency Analysis for Non-Stationary Signals 3
Quantifying Integrated Information in Complex Systems 2
Mapping Thermodynamic Irreversibility via Entropy Generation Analysis 2
Tuning Mode Selection via Parameterized Divergence Minimization 2
Detrended Fluctuation Analysis for Long-Range Dependence 2
Driving Solid-State Reactions with High-Energy Ball Milling 2
Neural Mutual Information Estimation 2
Logarithmic Loss in Lossy Source Coding 2
Partial Information Decomposition 2
Generalizing Information Theory Beyond Discrete Memoryless Channels 2
Information Entropy for Objective Indicator Weighting 2

Top Authors

AuthorPapers
Albert No3
Alfred O. Hero3
Jun Feng3
xia sun3
Fernando Rosas2
Jun Chen2
Kele Xu2
Max Tegmark2
Michael A Osborne2
Michal Pavelka2
Nicola Toschi2
Rui She2
Sergio Escalera2
S Roberts2
Stefano Panzeri2
Vincent Y. F. Tan2
Yingjie Wang2
Aleksander Wieczorek1
Alex Dytso1
Alfonso Ortega1

Impactful Papers

Papers from Entropy 2019 that shaped research clusters.

Foundational

Influential

Papers

Title
Thermodynamics in the Universe Described by the Emergence of Space and the Energy Balance Relation
The Secret Key Capacity of a Class of Noisy Channels with Correlated Sources
The Solutions to the Uncertainty Problem of Urban Fractal Dimension Calculation
Universality of Logarithmic Loss in Fixed-Length Lossy Compression
Universality of Logarithmic Loss in Successive Refinement
Universal Sample Size Invariant Measures for Uncertainty Quantification in Density Estimation
Utilizing Information Bottleneck to Evaluate the Capability of Deep Neural Networks for Image Classification
Variability and Reproducibility of Directed and Undirected Functional MRI Connectomes in the Human Brain

« prev Page 4/4