Entropy 2021

198 papers
In 2021, the journal Entropy published 223 papers, with a significant emphasis on adversarial machine learning and the theoretical limits of model robustness. Key research directions explored the trade-offs between robustness and performance, the identification of obfuscated gradients, and the use of statistical methods to reject adversarial examples. Prolific contributors during this period included researchers such as Benjamin Guedj, Jiayi Ma, and Evgeny M. Mirkes, who contributed to the year's focus on high-dimensional separability and statistical learning. Beyond theoretical machine learning, the year's publications spanned diverse applications including industrial blockchain security through quantum multi-signature methods and fault diagnosis in wind turbines. Research also addressed optimization in multi-UAV networks and knowledge reuse in multi-agent reinforcement learning. Other notable studies applied entropy-based feature extraction to power transformer signals and analyzed trends in cancer research using fusion feature representation. This breadth reflects the journal's application of information-theoretic concepts across engineering, biology, and computer science.

Top Research Directions

Research directions most represented by Entropy 2021 papers.

Tuning Mode Selection via Parameterized Divergence Minimization 4
Cross Domain Validation for Predictive Maintenance 4
Empirical Mode Decomposition for Non-Stationary Signals 4
Variational Inference as an Optimization Problem 4
Overcoming the Static Network Assumption 4
The Real World Validation Gap of Synthetic Data 4
Finite-Key Security in Quantum Cryptography 3
High Accuracy Fault Diagnosis via Signal Decomposition and Machine Learning 3
Plaintext Dependent Initialization for Chaotic Ciphers 3
Quantifying Directed Information Flow with Transfer Entropy 3
Complementary Feature Integration in Multi-Modal Image Fusion 3
Adaptive Time-Frequency Analysis for Non-Stationary Signals 3
Decoding Noisy Neural Signals via Latent Generative Priors 3
Neural Density Estimation for Likelihood Free Inference 3
Cross Dataset Validation for Robust Model Generalization 3

Top Authors

AuthorPapers
Benjamin Guedj4
Ivan Y Tyukin3
Jiayi Ma3
Alexander N. Gorban2
Amir Hussain2
Chengwei Li2
Chengyu Liu2
Edwin Hancock2
Frank Nielsen2
Ivan Garibay2
Jasper Snoek2
Luca Oneto2
Shiqiang Zhang2
Vaneet Aggarwal2
Xiaojie Guo2
Yuanbin Fu2
Yueqi Cao2
Yuhui Shi2
Adèle H. Ribeiro1
AIHUA ZHENG1

Impactful Papers

Papers from Entropy 2021 that shaped research clusters.

Foundational

Influential

Papers

Title
Information-Theoretic Generalization Bounds for Meta-Learning and Applications
Interactive System for Similarity-Based Inspection and Assessment of the Well-Being of mHealth Users
Interpretable Multi-Head Self-Attention Architecture for Sarcasm Detection in Social Media
Interventional Fairness with Indirect Knowledge of Unobserved Protected Attributes
Joint UAVs' Load Balancing and UEs' Data Rate Fairness Optimization by Diffusion UAV Deployment Algorithm in Multi-UAV Networks
KnowRU: Knowledge Reuse via Knowledge Distillation in Multi-Agent Reinforcement Learning
Kolmogorov Basic Graphs and Their Application in Network Complexity Analysis
Latent Network Construction for Univariate Time Series Based on Variational Auto-Encode
Leak Detection in Water Pipes Based on Maximum Entropy Version of Least Square Twin K-Class Support Vector Machine
Learning from Scarce Information: Using Synthetic Data to Classify Roman Fine Ware Pottery
Leveraging Stochasticity for Open Loop and Model Predictive Control of Spatio-Temporal Systems
Low-Latency Short-Packet Transmission over a Large Spatial Scale
Low-Pass Filtering Empirical Wavelet Transform Machine Learning Based Fault Diagnosis for Combined Fault of Wind Turbines
LPA-MNI: An Improved Label Propagation Algorithm Based on Modularity and Node Importance for Community Detection
Machine Learning-Assisted Measurement Device-Independent Quantum Key Distribution on Reference Frame Calibration
Machine Learning for Communications
Menzerath's Law in the Syntax of Languages Compared with Random Sentences
Mesoscale Simulation of Bacterial Chromosome and Cytoplasmic Nanoparticles in Confinement
Message Passing-Based Inference for Time-Varying Autoregressive Models
Meta-Strategy for Learning Tuning Parameters with Guarantees
Microcanonical and Canonical Ensembles for fMRI Brain Networks in Alzheimer's Disease
Minimum Distribution Support Vector Clustering
Minimum Message Length Inference of the Exponential Distribution with Type I Censoring
Misalignment Fault Diagnosis for Wind Turbines Based on Information Fusion
Modeling the Dynamics of T-Cell Development in the Thymus
Multi-Focus Image Fusion Method Based on Multi-Scale Decomposition of Information Complementary
Multifractality in Quasienergy Space of Coherent States as a Signature of Quantum Chaos
Multivariate Count Data Models for Time Series Forecasting
Mutual Information and Quantum Discord in Quantum State Discrimination with a Fixed Rate of Inconclusive Outcomes
Neural Dynamics under Active Inference: Plausibility and Efficiency of Information Processing
News Video Summarization Combining SURF and Color Histogram Features
Noise-Robust Image Reconstruction Based on Minimizing Extended Class of Power-Divergence Measures
No Statistical-Computational Gap in Spiked Matrix Models with Generative Network Priors
Novel Convolutional Neural Network with Variational Information Bottleneck for P300 Detection
Novel Deep Convolutional Neural Network-Based Contextual Recognition of Arabic Handwritten Scripts
Occlusion-Based Explanations in Deep Recurrent Models for Biomedical Signals
On Architecture Selection for Linear Inverse Problems with Untrained Neural Networks
On a Variational Definition for the Jensen-Shannon Symmetrization of Distances Based on the Information Radius
On Compressed Sensing of Binary Signals for the Unsourced Random Access Channel
On Epistemics in Expected Free Energy for Linear Gaussian State Space Models
Optimization Algorithms for Joint Power and Sub-Channel Allocation for NOMA-Based Maritime Communications
PAC-Bayes Bounds on Variational Tempered Posteriors for Markov Models
PAC-Bayes Unleashed: Generalisation Bounds with Unbounded Losses
Part-Aware Mask-Guided Attention for Thorax Disease Classification
Perfect Density Models Cannot Guarantee Anomaly Detection
Personal Interest Attention Graph Neural Networks for Session-Based Recommendation
PFC: A Novel Perceptual Features-Based Framework for Time Series Classification
Phase Transitions in Transfer Learning for High-Dimensional Perceptrons
Population Risk Improvement with Model Compression: An Information-Theoretic Approach
Predicting the Critical Number of Layers for Hierarchical Support Vector Regression

« prev Page 3/4 next »