Combining Relevant Expert Knowledge Using Mixtures of Feedback Fuzzy Cognitive Maps

Olaoluwa Adigun, Akash Kumar Panda, Bart KoskoarXiv 2026 · arXiv

TL;DR

This paper introduces a formal framework for combining multiple expert models—represented as Fuzzy Cognitive Maps (FCMs)—by dynamically weighting them based on their "relevance" to a specific query. By adapting legal definitions of evidence (probative and material) into a new Bayesian-like theorem for causal graphs, the authors demonstrate how to filter out irrelevant expert noise to achieve more accurate, query-specific predictions.

What Problem Does This Paper Address?

In the quest for scalable neuro-symbolic AI, we often face a "too many cooks" problem. As knowledge networks grow, they incorporate more expert agents and data sources. However, not every expert is relevant to every question. If you ask a stroke specialist about a broken leg, their "expert" opinion is just noise.

The challenge is twofold:

  1. Defining Relevance: How do we mathematically define if a model's output is actually useful for a specific input?
  2. Dynamic Mixing: How do we combine these models so that the most relevant voices are amplified while irrelevant ones are silenced, all without manually tuning weights for every possible query?

Methods

The authors utilize Fuzzy Cognitive Maps (FCMs), which are signed, cyclic directed graphs where nodes represent concepts and edges represent causal weights. Unlike static graphs, FCMs are dynamical systems; they evolve over time until they settle into an equilibrium, such as a fixed point or a repeating "limit cycle."

The core of their approach is a three-step pipeline:

  1. Likelihood Mixing: Multiple expert FCMs (likelihoods) are combined using prior weights. To handle experts who might not know about the same variables, the authors use a "zero-padding" trick to make their causal matrices conformable for addition.
  2. Bayesian-like De-mixing: The authors introduce a new Bayes-like theorem for FCMs. This allows them to derive "posterior" FCMs for each expert. These posteriors represent how each expert's knowledge is updated in light of the collective mixture.
  3. Relevance Calculation: Borrowing from legal theory (Federal Rule of Evidence 401), they define relevance as the product of Materiality (is the expert talking about the right topic?) and Probativeness (does the expert's answer actually change the outcome?).
Fig. 1: Fuzzy Cognitive Map (FCM) mixture of relevant experts. The expert likelihood FCMs Fk on the left mix through convex combination with prior mixing weights wk to give the likelihood FCM mixture F. The likelihood FCM mixture gives Bayesian posterior-like FCMs Pk that produce limit cycle equilibria Lk. These posterior FCMs also mix with the same prior mixing weights wk to give the posterior FCM mixture P with its limit cycle L. The convex relevancy weights rk(x) for query x measure the relevance of the likelihood FCMs by comparing the posterior FCMs’ limit cycles Lk to the limit cycle L of the posterior FCM mixture through the norm of their difference. The likelihood FCMs mix with the final relevance weights rk(x) to produce the final relevant FCM given input x.

Probativeness is measured by comparing the equilibrium limit cycles of the individual posterior FCMs to the limit cycle of the total mixture. The more an expert's specific insight deviates from the "consensus" in a meaningful way, the more probative (and thus relevant) they are considered for that specific query.

Datasets

The study uses a synthetic setup based on a real-world medical model:

  • Ground Truth: A 13-node expert FCM designed to model ischemic-stroke risk, involving variables like Age, Blood Pressure, Smoking, and BMI.
  • Synthetic Experts: The authors generated 7 synthetic experts by applying multiplicative and additive noise (perturbations) to the ground-truth stroke FCM. This simulates a group of experts with slightly different perspectives or levels of accuracy on the same subject matter.

Key Insights and Ideas

  • Relevance is Query-Dependent: An expert might be highly relevant for a query about "Age and Stroke Risk" but completely irrelevant for a query about "Exercise and BMI." The system recalculates mixing weights ($r_k(x)$) for every new input $x$.
  • Equilibria as Answers: In FCMs, the "answer" to a query isn't a single value, but the long-term behavior of the system. By comparing these dynamical limit cycles using norms, the authors can quantify the "Bayesian surprise" or information gain provided by an individual expert.
  • Legal Logic for AI: Using the legal concepts of "probative" and "material" provides a rigorous, non-arbitrary foundation for information fusion that aligns with how humans evaluate evidence in complex disputes.
The 13-node Ischemic Stroke FCM and its corresponding causal matrix.

Key Results

  • Superiority over Uniform Mixing: The authors compared their relevancy-mixed model against a simple uniform average of experts. In a test case involving the "Age" node, the uniform mixture incorrectly predicted no stroke risk (a fixed point at zero). In contrast, the relevancy-mixed FCM correctly identified an ever-present risk, settling into a 3-step limit cycle where the "Stroke Risk" node remained active.
  • Sparse Mixtures: The technique naturally leads to sparser, more efficient mixtures by assigning near-zero weights to experts whose contributions are neither material nor probative for the task at hand.
  • Computational Efficiency: The main operations involve vector-matrix multiplication and pseudo-inverses. Because the zero-padded matrices are often sparse, these computations are highly parallelizable and suitable for large-scale knowledge processing.

Limitations and Future Work

  • Materiality Simplification: In this paper, the authors assumed all experts were "material" (focused on strokes) and set the materiality measure to unity. Future work is needed to automate the detection of materiality when mixing experts from vastly different domains.
  • Credibility Weights: The current model assumes all experts have equal baseline credibility. The authors suggest that incorporating a "credibility weight" could further refine the system by dampening the influence of historically unreliable experts.
  • Real-world Validation: While the synthetic experts were based on a real medical FCM, the system has yet to be tested against a large pool of heterogeneous, real-world human experts or diverse LLM-generated agents.

Summary updated

Abstract

A neuro-symbolic system should combine only relevant answers from expert agents or other knowledge sources. Using only relevant experts for a given input query becomes ever more important for accuracy and scalability as the knowledge network grows and connects ever more knowledge sources. We extend the standard definition of relevance from the legal theory of evidence: An answer is relevant if and only if it is both probative and material for the matter at hand given the knowledge available. We apply this relevancy scheme to mixing the feedback fuzzy cognitive maps (FCMs) of real or artificial experts. The expert FCM directed causal graphs mix or combine into a common knowledge network. We compare the equilibrium limit-cycle predictions or answers of the experts to the answers of the mixture FCM and then estimate the probative status of answers by their difference or variation. A new Bayes-like theorem de-mixes the knowledge mixture into corresponding posterior-like FCMs that also allow relevancy-based comparisons. The result is a final set of relevancy mixing weights that produces a relevancy-mixed FCM knowledge network for the given query. So different queries produce different relevancy-mixed FCMs. We demonstrate this relevancy approach using generated synthetic FCMs from an actual 13-node expert FCM that models the causes and feedbacks of ischemic-stroke risk.
BibTeX
@misc{adigun2026combining,
  author = {Olaoluwa Adigun and Akash Kumar Panda and Bart Kosko},
  title = {{Combining Relevant Expert Knowledge Using Mixtures of Feedback Fuzzy Cognitive Maps}},
  year = {2026},
  eprint = {2611.05664},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.05664},
}
Figure