Control of the Correlation of Spontaneous Neuron Activity in Biological and Noise-activated CMOS Artificial Neural Microcircuits

Ramin M. Hasani, Giorgio Ferrari, Hideaki Yamamoto, Sho Kono, Koji Ishihara, Soya Fujimori, Takashi Tanii, Enrico PratiarXiv 2017 · OpenReview

TL;DR

This paper explores how spontaneous neural activity and its correlations arise in both biological and artificial neural circuits. By building and simulating CMOS-based artificial neural microcircuits that mimic biological systems, the researchers demonstrate that the degree of correlation can be effectively controlled by tuning the number and type of synaptic connections, offering insights into how biological brains might achieve complex computations.

What Problem Does This Paper Address?

The brain is not just a collection of individual neurons, but rather a complex architecture built from micro-circuits. Understanding how these micro-circuits function, particularly how spontaneous neural activity and its correlations emerge, is crucial for building more sophisticated artificial neural networks. This paper tackles the challenge of replicating and understanding these emergent correlations, focusing on how background noise, neuron connectivity, and network topology influence spontaneous firing patterns in both biological and artificial systems. The goal is to bridge the gap between the behavior of individual neurons and the collective dynamics of larger neural assemblies.

Methods

The researchers employed a multi-pronged approach:

  • Biological Experiments: They cultured rat cortical neurons on micropatterned substrates designed to create distinct "islands" of neurons. By varying the number of connections (neurite guidance pathways) between these islands, they measured and analyzed the correlation of spontaneous neural activity using calcium imaging.
  • CMOS Artificial Neural Networks: They designed and simulated a network of artificial neurons and synapses using CMOS technology. This included:
  • Fast-mode (HH) Silicon Neuron: A circuit designed to mimic the Hodgkin-Huxley model, capable of firing much faster than biological neurons.
  • Excitatory and Inhibitory Silicon Synapses: Circuits designed to emulate biological synaptic transmission with exponentially decaying time courses.
  • Noise Generators: Compact circuits for producing both white and pink noise to ignite spontaneous firing in the artificial neurons.
  • Comparative Analysis: They directly compared the correlation patterns observed in the biological experiments with those generated by their simulated CMOS networks. This involved systematically varying parameters like the number of connections and the nature of synapses in the artificial systems to match biological observations.

Datasets

Not discussed in the paper. The study primarily relies on experimental data from cultured biological neurons and simulations of artificial neural networks.

Key Insights and Ideas

  • Noise as a Computational Resource: The paper reinforces the idea that noise isn't just a nuisance but can be a crucial factor in neural computation, igniting spontaneous activity and influencing network dynamics.
  • Synaptic Connectivity is Key: The degree of correlation in neural activity is not solely determined by the number of neurons but is highly sensitive to the type and density of synaptic connections. Specifically, multiple synapses per connection proved more effective at increasing correlation than simply increasing the number of individual point-to-point connections.
  • Microcircuits as "Lego Blocks": The research supports the concept of microcircuits acting as fundamental building blocks for complex neural architectures, both in biology and in artificial systems.
  • CMOS as a Viable Platform: The study demonstrates the potential of CMOS technology to create flexible, low-power artificial neural microcircuits that can emulate complex biological phenomena.
  • Reverse Engineering Biological Networks: By successfully replicating and controlling correlation patterns in their artificial networks, the authors suggest they are gaining insights into how biological systems achieve similar coordination.

Key Results

  • Correlation Control: The researchers demonstrated that they could control the correlation of spiking activity in both biological and artificial neural networks by manipulating the number and type of inter-neuron connections.
  • Synapse Efficacy: Adding multiple synapses to connections was found to be a more effective way to increase neural correlation than increasing the number of independent point-to-point connections.
  • Biological vs. Artificial Correlation: The simulations showed that to achieve a similar level of correlation as observed in biological networks with a few connections, the artificial networks required a higher number of neuron-to-neuron connections, suggesting that biological neurons might have a denser connectivity within their local microcircuits.
  • Noise-Induced Activity: The CMOS artificial neurons successfully generated spontaneous firing activity when stimulated by tailored white and pink noise, mimicking biological behavior.

Limitations and Future Work

  • Population Size: The authors note that the smaller population sizes in their silicon island simulations might contribute to a lower level of correlation compared to biological networks.
  • Saturation of Correlation: In some limiting cases of their simulations, the correlation did not fully saturate, which they hypothesize might be due to the strong boundary conditions imposed by injecting uncorrelated noise to the islands.
  • Future Work: The paper suggests further statistical analysis of structure-dependent modulation in activity patterns is ongoing. They also aim to explore the condition of multiple synapses associated with the same neuron in more detail. The findings also point towards the need for a higher degree of connections between interneurons and islands in artificial systems to fully match biological correlation levels.

Summary updated

Abstract

There are several indications that brain is organized not on a basis of individual unreliable neurons, but on a micro-circuital scale providing Lego blocks employed to create complex architectures. At such an intermediate scale, the firing activity in the microcircuits is governed by collective effects emerging by the background noise soliciting spontaneous firing, the degree of mutual connections between the neurons, and the topology of the connections. We compare spontaneous firing activity of small populations of neurons adhering to an engineered scaffold with simulations of biologically plausible CMOS artificial neuron populations whose spontaneous activity is ignited by tailored background noise. We provide a full set of flexible and low-power consuming silicon blocks including neurons, excitatory and inhibitory synapses, and both white and pink noise generators for spontaneous firing activation. We achieve a comparable degree of correlation of the firing activity of the biological neurons by controlling the kind and the number of connection among the silicon neurons. The correlation between groups of neurons, organized as a ring of four distinct populations connected by the equivalent of interneurons, is triggered more effectively by adding multiple synapses to the connections than increasing the number of independent point-to-point connections. The comparison between the biological and the artificial systems suggests that a considerable number of synapses is active also in biological populations adhering to engineered scaffolds.
BibTeX
@misc{hasani2017control,
  author = {Ramin M. Hasani and Giorgio Ferrari and Hideaki Yamamoto and Sho Kono and Koji Ishihara and Soya Fujimori and Takashi Tanii and Enrico Prati},
  title = {{Control of the Correlation of Spontaneous Neuron Activity in Biological and Noise-activated CMOS Artificial Neural Microcircuits}},
  year = {2017},
  eprint = {1702.07426},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/1702.07426},
}
Figure