Navigating Conflicting Views: Harnessing Trust for Learning

Jueqing Lu, Wray Buntine, Yuanyuan Qi, Joanna Dipnall, Belinda Gabbe, Lan Du

TL;DR

This paper introduces a trust-based discounting mechanism for multi-view classification that identifies and down-weights unreliable or conflicting information on an instance-by-instance basis. By leveraging "referral trust," the model can resolve contradictions between data sources, leading to significantly higher accuracy and more consistent predictions.

What Problem Does This Paper Address?

Multi-view classification (MVC) aims to improve decision-making by integrating information from multiple sources (e.g., different camera angles, text descriptions, and sensor data). Most existing methods assume that all views are equally reliable and perfectly aligned with the ground truth.

However, in the real world, views often conflict. The authors illustrate this with a "Titanic" scenario: a captain and a polar bear might only see the tip of an iceberg and conclude the route is "safe," while a dolphin underwater sees the massive structure and knows it is "unsafe."

Figure 1. Example of conflicting multi-view opinions. The Ti- tanic’s route is safe in Captain’s and Polar Bear’s View, while unsafe in Dolphin’s view.

Traditional fusion methods often side with the majority, leading to confidently incorrect predictions. This paper tackles the challenge of identifying which views to trust for every specific data instance to prevent misleading information from ruining the final result.

Methods

The authors build upon the Evidential Multi-view Classification framework, which uses Subjective Logic to model predictions not just as probabilities, but as "opinions" containing belief, uncertainty, and base rates. Their key innovations include:

  • Referral vs. Functional Opinions: For every view, the model generates two outputs: a functional opinion (the actual prediction) and a referral opinion (a measure of how much that view's prediction should be trusted for that specific instance).
  • Trust Discounting (TD) Module: A novel, learnable mechanism that uses the referral trust to "discount" the functional opinion. If a view is deemed untrustworthy for a particular sample, its influence on the final fused decision is minimized.
  • Stage-Wise Training: To ensure the trust mechanism works reliably, the authors developed a four-stage training strategy. It starts by "warming up" the referral networks to recognize correct vs. incorrect predictions before optimizing the entire system end-to-end.
Figure 2. The TF Enhanced Evidential MVC Framework. The top half illustrates the overall pipeline of the Evidential MCV framework, while the bottom half zooms in to highlight the view-specific Trust Fusion.

Datasets

The method was evaluated on seven diverse real-world datasets:

  • Handwritten: 10 classes of digits represented by six different feature descriptors.
  • Caltech101: 101 object categories using features from two different deep neural networks (DECAF and VGG19).
  • PIE: 68 facial image subjects with three types of facial features.
  • Scene15: 15 indoor/outdoor scene categories with three view types.
  • HMDB: 51 action recognition categories using a 2-view dataset.
  • CUB: 10 bird categories using image and text views.
  • Food101: A large-scale dataset (over 90,000 instances) used to test the scalability of end-to-end training.

Key Insights and Ideas

  • Trust is Instance-Specific: A view might be highly reliable for one image but completely misleading for another. The "aha moment" here is moving from global view-weighting to instance-wise trust.
  • Honest Uncertainty: When views conflict, the proposed method (TF) actually produces higher uncertainty in its final fused opinion compared to standard methods. This is a desirable trait; it means the model "knows what it doesn't know" when faced with contradictory evidence, rather than picking a wrong side with high confidence.
  • Implicit Alignment: By incorporating trust discounting into the training loss, the model naturally enforces individual views to align better with the ground truth. This leads to a significant increase in consistency across views at test time.

Key Results

The proposed methods (TF and ETF, which includes a "pseudo-view") consistently outperformed state-of-the-art baselines like TMC and ECML.

  • Accuracy: ETF achieved the highest Top-1 accuracy across all six benchmark datasets. On the Scene15 dataset, it improved accuracy by 3.6% over the previous best method.
  • Consistency: The improvement in Fleiss' Kappa (a measure of agreement between views) was dramatic. On the HMDB dataset, where previous methods showed negative agreement (-0.15), the new method achieved a robust score of 0.65.
Table 5. Fleiss’ Kappa on test splits. The best results are highlighted in bold and the second-best results are underlined.

Limitations and Future Work

  • Late Fusion Constraints: The current framework relies on late fusion, meaning views don't interact during the initial feature extraction phase. This might limit the model's ability to integrate complementary information early on.
  • Referral Uncertainty: The referral networks themselves can sometimes produce high-uncertainty opinions. The authors suggest that more fine-grained handling of these "uncertain trust" cases is a promising direction for future research.
  • Training Time: The stage-wise training algorithm, while effective, is more time-consuming than standard single-stage training. Improving its efficiency is noted as a future goal.

Summary updated

Abstract

Resolving conflicts is critical for improving the reliability of multi-view classification. While prior work focuses on learning consistent and informative representations across views, it often assumes perfect alignment and equal importance of all views, an assumption rarely met in real-world scenarios, as some views may express distinct information. To address this, we develop a computational trust-based discounting method that enhances the Evidential Multi-view framework by accounting for the instance-wise reliability of each view through a probability-sensitive trust mechanism. We evaluate our method on six real-world datasets using Top-1 Accuracy, Fleiss' Kappa, and a new metric, Multi-View Agreement with Ground Truth, to assess prediction reliability. We also assess the effectiveness of uncertainty in indicating prediction correctness via AUROC. Additionally, we test the scalability of our method through end-to-end training on a large-scale dataset. The experimental results show that computational trust can effectively resolve conflicts, paving the way for more reliable multi-view classification models in real-world applications. Codes available at: https://github.com/OverfitFlow/Trust4Conflict
BibTeX
@inproceedings{lu2025navigating,
  author = {Jueqing Lu and Wray Buntine and Yuanyuan Qi and Joanna Dipnall and Belinda Gabbe and Lan Du},
  title = {{Navigating Conflicting Views: Harnessing Trust for Learning}},
  booktitle = {International Conference on Machine Learning},
  year = {2025},
  url = {https://openreview.net/forum?id=uJ3JqtBYWk},
}
Figure