The Neural Marketplace: I. General Formalism and Linear Theory

Sarah Noami Lewis, Kenneth D. HarrisbioRxiv 2014 · DOI

TL;DR

This paper proposes a novel "neural marketplace" theory where neurons act as entrepreneurs competing to provide useful information to others. This self-organization is driven by a hypothesized "retroaxonal" communication pathway, allowing neurons to estimate their "worth" and learn more efficiently, akin to economic markets.

What Problem Does This Paper Address?

The brain is a remarkably complex information processing system, yet how billions of individual neurons self-organize into coherent, adaptive networks remains a profound question. Current models often struggle with the "credit assignment problem" – determining which specific neuron or synapse is responsible for a network-wide change in performance. This paper addresses this by proposing a new biological mechanism, the "retroaxonal hypothesis," which suggests a form of backward communication along axons could enable neurons to gauge their individual contribution to network success, thereby facilitating more efficient and robust learning and self-organization.

Methods

The authors introduce a mathematical framework based on the "neural marketplace" analogy. Key components include:

  • Retroaxonal Hypothesis: This is the core biological postulate, suggesting that signals travel backward along axons, carrying information about a neuron's output synapse strength and its impact on downstream targets. This is hypothesized to be mediated by molecules like neurotrophins.
  • "Worth" of a Neuron: A central concept defined as the increase in network loss if a neuron were to become silent. This provides a quantifiable measure of a neuron's contribution.
  • Parallel Metropolis-Hastings (PMH) Algorithm: A novel learning algorithm inspired by simulated annealing and the Metropolis-Hastings algorithm. It allows neurons to propose changes to their input weights and then accept or reject these changes based on their estimated worth, promoting a parallel search for optimal network configurations.
  • Two Levels of Abstraction: The theory is developed first at a general level (arbitrary networks, loss functions) and then applied to a specific linear consumer model to derive analytical results.

Datasets

Not discussed in the paper. The simulations used synthetic data generated by the models themselves.

Key Insights and Ideas

  • Neurons as Entrepreneurs: The analogy of neurons as economic actors competing to "sell" information provides an intuitive framework for understanding self-organization.
  • Retroaxonal Communication as Payment: Slow, backward-traveling signals act as a "payment" for useful information, guiding learning and consolidation.
  • Worth as a Local Credit Assignment Signal: Neurons can estimate their worth locally, bypassing the need for global error signals and solving the credit assignment problem in a decentralized manner.
  • Parallel Search for Optimal Configurations: The PMH algorithm allows for efficient exploration of the vast parameter space by enabling neurons to experiment with changes, particularly those with low estimated worth.
  • Redundant Coding for Efficiency: The theory suggests that redundant coding (multiple neurons representing similar information) is crucial for accurate worth estimation and efficient network learning, mirroring economic principles of competition.

Key Results

  • Analytical Validation: The paper provides analytical derivations showing that for a linear consumer model, direct worth is approximately proportional to the square of a neuron's output weight.
  • Additivity of Worth: It's shown that for small sets of neurons, their collective worth is approximately additive, a crucial condition for the PMH algorithm's credit assignment capabilities.
  • Simulation Support: Simulations demonstrate that the PMH algorithm effectively learns in a "cocktail party" problem, where producers learn to identify useful signals and consumers learn to extract them. The simulations also show that the worth approximation holds well for small to moderate-sized cell sets.
  • Worth vs. Performance: The simulations highlight that increased network performance does not necessarily correlate with increased worth of individual cells, especially in scenarios with redundant coding.

Limitations and Future Work

  • Hypothetical Mechanism: The retroaxonal hypothesis itself is a proposal and has not been directly experimentally tested.
  • Approximations: The mathematical derivations rely on approximations (e.g., additivity of worths) that hold under specific conditions (e.g., redundant coding, small sets of neurons).
  • Complex Networks: While the formalism is general, the analytical results are primarily for linear consumers and feedforward architectures. Extending the analysis to recurrent networks is a significant future direction.
  • Biological Plausibility: While the proposed molecular mechanisms are consistent with known biology, their precise implementation and role in adult learning require further investigation.
  • Future Work: The authors indicate that a forthcoming manuscript will present a mathematical analysis of recurrent networks and the implications for retroaxonal signaling.

Summary updated

Abstract

Abstract We propose a mathematical theory for how networks of neurons in the brain self-organize into functional networks, similarly to the self-organization of supply networks in a free-market economy. The theory is inspired by recent experimental results showing how information about changes to output synapses can travel backward along axons to affect a neuron’s inputs. In neuronal development, competition for such “retroaxonal” signals determines which neurons live and which die. We suggest that in adults, an analogous form of competition occurs between neurons, to supply their targets with appropriate information in exchange for a “payment” returned to them backward along the axon. We review experimental evidence suggesting that neurotrophins may constitute such a signaling pathway in the adult brain. We construct a mathematical model, in which a small number of “consumer” neurons receive explicit fast error signals while a larger number of “producer” neurons compete to supply them with information, guided by retroaxonal signals from the consumers and from each other. We define a loss function to measure network performance and define the “worth” of a producer to be the increase in loss that would result if that neuron were to fall silent. We show how slow retroaxonal signals can allow producers to estimate their worth, and how these estimates allow the network to perform a form of parallel search over multiple producer cells. We validate our approximations and demonstrate the proposed learning rule using simulations.
BibTeX
@misc{lewis2014neural,
  author = {Sarah Noami Lewis and Kenneth D. Harris},
  title = {{The Neural Marketplace: I. General Formalism and Linear Theory}},
  year = {2014},
  doi = {10.1101/013185},
  howpublished = {bioRxiv},
}
Figure