In classical theoretical neuroscience, large networks of neurons are frequently modeled using mean-field approximations. These models assume an infinite number of neurons ($N \to \infty$), meaning that the random, discrete spikes of individual cells average out perfectly into smooth, deterministic population rates. As shown by Wulfram Gerstner in Population Dynamics of Spiking Neurons: Fast Transients, Asynchronous States, and Locking, while these infinite-population assumptions simplify mathematical derivations, they completely discard the stochastic fluctuations inherent to real biological networks.
In any finite network, the law of large numbers does not fully eliminate noise. Instead, the discrete nature of spiking creates an intrinsic, structural stochasticity known as finite-size fluctuations. Wulfram Gerstner et al. argued in How to Describe Neuronal Activity: Spikes, Rates, or Assemblies? that ignoring this noise makes macroscopic equations unreliable representations of true biological states. Rather than being an unwanted source of error, this finite-size noise acts as a vital dynamical mechanism that allows brains to switch flexibly between different states.
Why Noise is a Functional Requirement
If a neural network were purely deterministic, it would quickly become trapped in its nearest stable equilibrium point, or attractor. To switch behaviors, process new inputs, or resolve ambiguous sensory data, the network needs a way to escape these local energy minima.
This is where stochasticity becomes functional. By deriving population-level dynamics that explicitly retain finite-size fluctuations, Tilo Schwalger et al. demonstrated in Bridging spiking neuron models and mesoscopic population models - a general theory for neural population dynamics that random fluctuations drive essential behaviors like metastability and task switching.
Without this noise, deterministic models often suffer from activity decay, collapsing into complete inactivity. As Yu Toyoshima et al. showed in Ensemble dynamics and information flow deduction from whole-brain imaging data, integrating intrinsic noise is a strict requirement for models to spontaneously generate and sustain complex, bursty ensemble dynamics without decaying over time.
The Mechanism of Stochastic Escape
How exactly does noise drive a state transition? The process can be understood as a stochastic escape over a dynamical barrier. Imagine a system with two stable states (a bistable system). The network sits in one attractor basin. Over time, internal or external noise provides random perturbations. Eventually, a large enough fluctuation occurs, pushing the system over the threshold into the alternative attractor.
This mechanism explains why transitions are probabilistic rather than fixed. For instance, Lorenzo Posani et al. found in Integration and multiplexing of positional and contextual information by the hippocampal network that when internal maps conflict with external sensory inputs, the resolution follows an exponential distribution characteristic of a stochastic escape process.
Crucially, this escape process often operates in tandem with neural adaptation (or fatigue). In Neural model for multi-stability in visual action recognition, Martin A. Giese et al. illuminated the precise division of labor between adaptation and noise: as a neuron fires in a dominant state, adaptation gradually tires the representation, flattening the energy barrier. However, adaptation alone does not cause the flip. It is the random, stochastic fluctuations that provide the final, necessary kick to cross the threshold into the new state.
Deterministic (No Noise):
[State A] --(Adaptation flattens barrier)--> [State A still held]
Stochastic (With Noise):
[State A] --(Adaptation flattens barrier)--> [Fluctuation Kick] --> [State B]
Applications in Perception and Behavior
This interplay of adaptation and noise provides an elegant explanation for several cognitive and behavioral phenomena across species:
- Perceptual Bistability: When presented with ambiguous visual stimuli, our perception spontaneously flips between interpretations. Howard S. Hock et al. in The dynamical foundations of motion pattern formation: Stability, selective adaptation, and perceptual continuity and Martin A. Giese et al. in Neurodynamical model for visual action recognition modeled this using Gaussian white noise integrated into dynamical systems, showing that noise allows the visual system to explore alternative valid interpretations of the same constant input.
- Locomotor Pattern Generation: In motor control, animals must transition smoothly between resting and active states. Andrea Maesani demonstrated in Fluctuation-Driven Neural Dynamics Reproduce Drosophila Locomotor Patterns that deterministic models cannot replicate real fruit fly walking patterns because they get stuck in resting equilibria. Internal neural fluctuations are required to cross decision thresholds and linearize responses to sensory cues.
- Sequence Learning: In memory networks, noise prevents the system from getting trapped in a single fixed-point memory. Zuozhu Liu et al. showed in Biologically Plausible Sequence Learning with Spiking Neural Networks that modeling firing as a stochastic process introduces beneficial noise that facilitates flexible transitions between different stored temporal sequences.
Beyond Equilibrium Physics
Because these systems are constantly driven by discrete spiking noise and exhibit directed transitions, they cannot be analyzed using classical equilibrium thermodynamics (like the static energy landscapes of Hopfield networks).
Michael C. Crair et al. proved in Non-Boltzmann Dynamics in Networks of Spiking Neurons that discrete spiking noise generates probability currents in the state space. This reveals that the brain operates in a fundamentally non-equilibrium regime, where stochasticity actively shapes the trajectory of neural states rather than merely blurring them.
Key Foundational Work
Burst Synchronization without Frequency Locking in a Completely Solvable Neural Network Model (1991) — contributed 1 concept elements to this direction.
Non-Boltzmann Dynamics in Networks of Spiking Neurons (1989) — contributed 1 concept elements to this direction.