The Complexity of Dynamics in Small Neural Circuits

Diego Fasoli, Anna Cattani, Stefano PanzeriPLOS Computational Biology 2016 · DOI · OpenReview

Abstract

This study investigates the "mesoscopic gap" in computational neuroscience, focusing on circuits of tens to hundreds of neurons. By analyzing a deterministic firing-rate model, the authors demonstrate that small neural populations exhibit complex dynamics—specifically spontaneous symmetry-breaking—that are overlooked by standard mean-field approximations. These findings show that functional heterogeneity can emerge purely from circuit dynamics, potentially enhancing information processing by reducing noise correlations.

Introduction

In computational neuroscience, researchers typically rely on two extremes: microscopic single-neuron models or macroscopic mean-field theories describing millions of neurons. However, much of the brain's critical computation occurs at the "mesoscopic" scale—circuits comprising a few dozen to a few hundred neurons.

The standard shortcut for studying these circuits is mean-field theory, which assumes the number of neurons ($N$) is infinite. While mathematically convenient, this "thermodynamic limit" ignores the specific interactions and fluctuations present in small populations. This paper addresses the mesoscopic gap by investigating whether small, finite-size networks behave qualitatively differently than their infinite-size approximations.

Methods

The authors developed a systematic mathematical analysis of a deterministic firing-rate model consisting of two populations: excitatory (E) and inhibitory (I) neurons. The model architecture utilizes a fully connected network where neurons within a population are initially identical (homogeneous).

To move beyond purely numerical simulations, the study employs a specific algebraic activation function (a sigmoidal curve). This choice allows for the derivation of exact analytical expressions for the system's equilibrium points and local bifurcations. The researchers combined linear stability analysis with numerical continuation tools (such as MatCont and XPPAUT) to map how the network's behavior changes as external input and inhibitory strength are varied.

Spontaneous Symmetry-Breaking and Functional Heterogeneity

The most striking finding is that under strong inhibition, the network undergoes a "branching-point" (pitchfork) bifurcation. Even though all neurons in a population are identical and receive the same input, they split into subgroups with different firing rates. The symmetry of the system breaks spontaneously.

This phenomenon can be visualized through the system's "energy landscape." In weak-inhibition regimes, the landscape has a single valley (one stable state). Strong inhibition warps this landscape, creating multiple valleys. A tiny perturbation determines which "valley" a neuron falls into, leading to a heterogeneous state. This suggests that functional heterogeneity—a feature thought to help circuits "quench" noise correlations and improve information processing—can emerge purely from the dynamics of small circuits, rather than requiring physical differences between neurons.

The Failure of Mean-Field Theory

The authors demonstrate that as the number of neurons ($N$) increases, these branching solutions disappear or become significantly harder to reach. This explains why mean-field theory—which assumes $N \to \infty$—fails to predict these complex mesoscopic behaviors.

Key results include:

  • Bifurcation Manifolds: The derivation of exact parametric equations for Saddle-Node (LP) and Andronov-Hopf (H) bifurcations in finite-size networks.
  • Complexity under Inhibition: The identification of new types of codimension-one and codimension-two bifurcations (like Zero-Hopf and Torus bifurcations) in the strong-inhibition regime that do not exist in the mean-field version of the model.
  • Transition to Chaos: Evidence that for networks with $N_I > 2$, branching solutions can lead to high-dimensional complexity and chaos via double-Hopf bifurcations.

Limitations and Future Work

While providing a rigorous framework for mesoscopic dynamics, the current model is deterministic. Real neural circuits are inherently noisy, and stochastic fluctuations might further interact with these branching solutions. Additionally, the study assumes a fully connected, homogeneous topology; future work should explore how sparse or structured connectivity affects symmetry-breaking. Finally, testing these findings in more detailed spiking neuron models (like Hodgkin-Huxley) is a necessary step to confirm the biological robustness of these finite-size effects.

Summary updated

Abstract

Author Summary The mesoscopic level of brain organization, describing the organization and dynamics of small circuits of neurons including from few tens to few thousands, has recently received considerable experimental attention. It is useful for describing small neural systems of invertebrates, and in mammalian neural systems it is often seen as a middle ground that is fundamental to link single neuron activity to complex functions and behavior. However, and somewhat counter-intuitively, the behavior of neural networks of small and intermediate size can be much more difficult to study mathematically than that of large networks, and appropriate mathematical methods to study the dynamics of such networks have not been developed yet. Here we consider a model of a network of firing-rate neurons with arbitrary finite size, and we study its local bifurcations using an analytical approach. This analysis, complemented by numerical studies for both the local and global bifurcations, shows the emergence of strong and previously unexplored finite-size effects that are particularly hard to detect in large networks. This study advances the tools available for the comprehension of finite-size neural circuits, going beyond the insights provided by the mean-field approximation and the current techniques for the quantification of finite-size effects.
BibTeX
@article{fasoli2016complexity,
  author = {Diego Fasoli and Anna Cattani and Stefano Panzeri},
  title = {{The Complexity of Dynamics in Small Neural Circuits}},
  journal = {PLOS Computational Biology},
  year = {2016},
  doi = {10.1371/journal.pcbi.1004992},
}
Figure