Subdural CMOS optical probe (SCOPe) for bidirectional neural interfacing

Eric H. Pollmann, Heyu Yin, Ilke Uguz, Agrita Dubey, Katie Wingel, John Choi, Sajjad Moazeni, Yatin Gilhotra, Victoria Andino-Pavlovsky, Adam Banees, Vivek Boominathan, Jacob T. Robinson, Ashok Veeraraghavan, Vincent A. Pieribone, Bijan Pesaran, Kenneth L. ShepardbioRxiv 2023 · DOI

TL;DR

This paper introduces SCOPe, a revolutionary ultra-thin, flexible, and fully implantable optical probe for bidirectional neural interfacing. By leveraging advanced CMOS technology and optoelectronic packaging, SCOPe enables high-resolution neural recording and stimulation within the subdural space, paving the way for next-generation brain-machine interfaces.

What Problem Does This Paper Address?

Current optical neurotechnologies, while powerful for neuroscience research, are often bulky and not suitable for long-term implantation, especially in humans. Existing miniaturized microscopes are still too large for full implantation, and their reliance on external components or invasive procedures limits their translational potential. The challenge is to create a device that is minimally invasive, highly integrated, and capable of both monitoring and manipulating neural activity with high precision, all within a form factor that can reside safely within the brain's subdural space.

Methods

The core of SCOPe is a custom-designed CMOS Application-Specific Integrated Circuit (ASIC) featuring an array of single-photon avalanche diodes (SPADs) for low-light fluorescence imaging and integrated micro-light-emitting diodes (µLEDs) for optogenetic stimulation. The ASIC is thinned to less than 15 µm to achieve mechanical flexibility, allowing it to conform to the brain's surface. This chip is then integrated with µLED light sources, optical filters, and a computational imaging mask onto a flexible polyimide printed circuit board. The device employs a lens-less computational imaging approach, which, combined with its thin profile, allows for a large field of view (FoV) and minimal invasiveness. For data acquisition, a custom FPGA module handles data streaming and processing.

Datasets

The paper describes experiments using transgenic GCaMP6f mice and GCaMP8m-expressing non-human primates (NHPs). These genetically modified animals express fluorescent calcium indicators, allowing their neural activity to be visualized. The data collected from these experiments, including neural recordings and behavioral tracking, were used to validate the SCOPe device's performance in both imaging and decoding motor intent.

Key Insights and Ideas

  • Subdural Form Factor is Key: The ability of SCOPe to lie entirely within the subdural space is a major breakthrough, enabling a truly implantable and less invasive neural interface.
  • CMOS Integration for Flexibility: Thinning the CMOS chip and integrating it with flexible packaging is crucial for achieving the device's conformability and mechanical flexibility, overcoming limitations of rigid electronics.
  • Lens-less Computational Imaging: This approach, combined with the integrated µLEDs, allows for a compact and high-resolution imaging system without the bulk of traditional lenses.
  • Bidirectional Interfacing: The simultaneous capability for both optical recording (imaging neural activity) and optical stimulation (optogenetics) in a single, integrated device opens up new possibilities for closed-loop brain control and modulation.
  • Decoding Motor Intent: The successful decoding of movement speed trajectories from neural activity in NHPs demonstrates the potential of SCOPe for advanced brain-machine interfaces.

Key Results

  • SCOPe is an ultrathin (less than 200 µm) and mechanically flexible device.
  • It achieves a large field of view (5.1 x 6.8 mm²) with a displacement factor significantly lower than existing miniature microscopes (0.5 vs. >140 for lens-based).
  • In vivo experiments in mice demonstrated successful imaging of calcium dynamics with electrical stimulation and optogenetic stimulation.
  • In non-human primates, SCOPe successfully imaged neural activity during a reaching task and decoded movement speed trajectories with a correlation of p = 0.66.
  • The device generates minimal heat (<1°C) during operation, crucial for long-term implantation.
  • Power consumption is low (<10 mW for imaging at 40 fps), making it amenable to wireless power and data transmission.

Limitations and Future Work

The authors acknowledge that while SCOPe offers high resolution at the mesoscopic level, achieving single-cell resolution would require further advancements, such as increasing pixel density or employing advanced computational imaging techniques. The current device is too large for subdural implantation in mice, though it is suitable for larger brains. Future work could focus on further miniaturization, integration of wireless power and data telemetry directly onto the ASIC, and exploring more advanced computational imaging algorithms for enhanced resolution and signal processing. The authors also suggest that for applications requiring single-cell resolution, sparse labeling and soma-localized reporters would be beneficial.

Summary updated

Abstract

Optical neurotechnologies use light to interface with neurons and can monitor and manipulate neural activity with high spatial-temporal precision over large cortical extents. While there has been significant progress in miniaturizing microscope for head-mounted configurations, these existing devices are still very bulky and could never be fully implanted. Any viable translation of these technologies to human use will require a much more noninvasive, fully implantable form factor. Here, we leverage advances in microelectronics and heterogeneous optoelectronic packaging to develop a transformative, ultrathin, miniaturized device for bidirectional optical stimulation and recording: the subdural CMOS Optical Probe (SCOPe). By being thin enough to lie entirely within the subdural space of the primate brain, SCOPe defines a path for the eventual human translation of a new generation of brain-machine interfaces based on light.
BibTeX
@misc{pollmann2023subdural,
  author = {Eric H. Pollmann and Heyu Yin and Ilke Uguz and Agrita Dubey and Katie Wingel and John Choi and Sajjad Moazeni and Yatin Gilhotra and Victoria Andino-Pavlovsky and Adam Banees and Vivek Boominathan and Jacob T. Robinson and Ashok Veeraraghavan and Vincent A. Pieribone and Bijan Pesaran and Kenneth L. Shepard},
  title = {{Subdural CMOS optical probe (SCOPe) for bidirectional neural interfacing}},
  year = {2023},
  doi = {10.1101/2023.02.07.527500},
  howpublished = {bioRxiv},
}
Figure