Improving Evolutionary Multi-View Classification via Eliminating Individual Fitness Bias

Xinyan Liang, ShuaiLi, Qian Guo, Yuhua Qian, Bingbing Jiang, Tingjin Luo, Liang DuNeurIPS 2025 · OpenReview

In the world of machine learning, Multi-View Classification (MVC) is the art of combining different perspectives—like audio, video, and text—to make a single, smarter decision. One of the most promising ways to achieve this is through Evolutionary Multi-View Classification (EMVC), where algorithms mimic natural selection to find the perfect way to fuse these diverse data streams.

However, a new paper set to appear at NeurIPS 2025 reveals a hidden flaw in this process: the "evolution" is often being lied to.

TL;DR

Researchers have identified Fitness Evaluation Bias (FEB), a systemic issue where evolutionary algorithms fail because they cannot accurately rank the performance of different models. By introducing Evolutionary Navigators (ENs)—pre-trained "teachers" for each data view—the authors’ new method, EFB-EMVC, prevents the search process from getting stuck in local optima, significantly boosting classification accuracy across diverse datasets.

The Problem: What is Fitness Evaluation Bias?

In EMVC, the algorithm maintains a population of "individuals" (representing different model architectures or fusion strategies). To decide which models should "survive" and "reproduce," the system performs a Fitness Evaluation (FE), usually based on classification accuracy.

The authors discovered that this evaluation is often heavily biased. When a model tries to learn from multiple views simultaneously (joint training), it tends to focus on "strong" views (those with high information content) and ignore "weak" ones. This leads to a suboptimal model that doesn't reflect the true potential of that specific architecture.

If the fitness score is wrong, the ranking is wrong. If the ranking is wrong, the evolutionary algorithm starts selecting the wrong "parents," eventually leading the entire population into a dead end—a local optimum. The authors coined this phenomenon Fitness Evaluation Bias (FEB).

Comparison of existing EMVC methods suffering from Fitness Evaluation Bias versus the proposed EFB-EMVC approach.

The Solution: EFB-EMVC

To eliminate this bias, the authors propose EFB-EMVC, which introduces two major innovations to keep the evolutionary process honest:

  1. Evolutionary Navigators (ENs): For every data view (e.g., just the audio or just the text), the researchers pre-train a dedicated "teacher" model. These ENs act as guides for the individual models in the population, ensuring that no view is left behind during training.
  2. Wasserstein Distance-Oriented Loss Function (WDOLF): Instead of just teaching the models the correct labels, the ENs use Knowledge Distillation (KD). Crucially, they don't just pass on category information; they use the Wasserstein distance to transmit "cross-category" relationships (e.g., "this image of a dog looks a bit like a cat, but nothing like a car").
The overall architecture of EFB-EMVC, detailing the evolutionary process and the unbiased fitness evaluation using Evolutionary Navigators.

This "dual-path" optimization ensures that even if a view has low information content, the model is forced to explore it deeply under the guidance of its dedicated Navigator. This results in a more "honest" fitness score and a correct evolutionary path.

Key Insights and Ideas

  • The Mountaineer Analogy: The paper compares FEB to a mountaineer misjudging the highest peak because they only looked at the terrain from one side. By using ENs, the mountaineer gets a "guide" who knows the whole mountain range, ensuring they don't stop at a smaller, deceptive hilltop.
  • Ranking is Everything: The most striking insight isn't just that accuracy improved, but that the order of individuals changed. Without ENs, a "mediocre" model might be ranked #1; with ENs, the true "superior" model takes its rightful place.
  • Cross-Category Wisdom: Standard distillation often ignores how classes relate to one another. By using the Wasserstein distance, the authors capture the structural nuances of the data that simple labels miss.
  • Plug-and-Play Generality: The EN mechanism isn't tied to one specific architecture. The authors showed it could be integrated into other existing EMVC frameworks (like EDF and DC-NAS) to improve their performance as well.

Datasets and Key Results

The researchers put their method to the test against a massive battery of nine multi-view datasets, spanning Audio/Video (MVoxCeleb, YoutubeFace), Image/Text (NUS-WIDE-128, MM-IMDB), Multilingual Text (Reuters), Action/Gesture Recognition (NTU RGB-D, EgoGesture), and Specialized data (CB).

The EFB-EMVC method consistently outperformed State-of-the-Art (SOTA) methods:

  • Accuracy Boosts: On the MVoxCeleb and YouTubeFace datasets, accuracy improved by 1.73% and 1.65% respectively compared to the best previous evolutionary methods.
  • Correcting the Path: In ablation studies, the authors calculated correlation coefficients (Pearson, Spearman) between biased and unbiased rankings. The correlation was extremely low (~0.21), proving that FEB was indeed causing a massive distortion in how models were being evaluated.
  • Robustness: The method achieved the best performance on almost all tested datasets, proving it works whether you are classifying movie genres or recognizing hand gestures.

Limitations and Future Work

The primary drawback acknowledged by the authors is computational cost. Training dedicated Evolutionary Navigators for every view and then using them to guide an entire population through multiple generations is resource-intensive.

Future work will focus on developing optimization techniques to reduce the training overhead of EFB-EMVC and investigating other potential factors beyond "view information content" that might trigger fitness bias.

Paper Title: Improving Evolutionary Multi-View Classification via Eliminating Individual Fitness Bias
Code: Available on GitHub

Summary updated

Abstract

Evolutionary multi-view classification (EMVC) methods have gained wide recognition due to their adaptive mechanisms. Fitness evaluation (FE), which aims to calculate the classification performance of each individual in the population and provide reliable performance ranking for subsequent operations, is a core step in such methods. Its accuracy directly determines the correctness of the evolutionary direction. That is, when FE fails to correctly reflect the superiority-inferiority relationship among individuals, it will lead to confusion in individual performance ranking, which in turn misleads the evolutionary direction and results in trapping into local optima. This paper is the first to identify the aforementioned issue in the field of EMVC and call it as fitness evaluation bias (FEB). FEB may be caused by a variety of factors, and this paper approaches the issue from the perspective of view information content: existing methods generally adopt joint training strategies, which restrict the exploration of key information in views with low information content. This makes it difficult for multi-view model (MVM) to achieve optimal performance during convergence, which in turn leads to FE failing to accurately reflect individual performance rankings and ultimately triggering FEB. To address this issue, we propose an evolutionary multi-view classification via eliminating individual fitness bias (EFB-EMVC) method, which alleviates the FEB issue by introducing evolutionary navigators for each MVM, thereby providing more accurate individual ranking. Experimental results fully verify the effectiveness of the proposed method in alleviating the FEB problem, and the EMVC method equipped with this strategy exhibits more superior performance compared with the original EMVC method. (The code is available at https://github.com/LiShuailzn/Neurips-2025-EFB-EMVC)
BibTeX
@inproceedings{liang2025improving,
  author = {Xinyan Liang and ShuaiLi and Qian Guo and Yuhua Qian and Bingbing Jiang and Tingjin Luo and Liang Du},
  title = {{Improving Evolutionary Multi-View Classification via Eliminating Individual Fitness Bias}},
  booktitle = {Advances in Neural Information Processing Systems},
  year = {2025},
  url = {https://openreview.net/forum?id=xgTxQe3CNl},
}
Figure