Mesoscopic calcium imaging in a head-unrestrained male non-human primate using a lensless microscope

Jimin Wu, Yuzhi Chen, Ashok Veeraraghavan, Eyal Seidemann, Jacob T. RobinsonNature Communications 2024 · DOI

This paper, recently published in Nature Communications, introduces a breakthrough in neuroimaging technology: a miniature, lensless microscope capable of recording large-scale brain activity in primates while they move their heads freely.

TL;DR

Researchers have developed the "Bio-FlatScopeNHP," a 17.2g lensless microscope that enables mesoscopic calcium imaging in head-unrestrained non-human primates. By replacing traditional lenses with a computational phase mask, the device achieves a massive 20 mm² field-of-view and sub-10 µm resolution, allowing scientists to map complex neural structures like orientation columns under naturalistic conditions.

What Problem Does This Paper Address?

To understand how the brain produces behavior, researchers need to see "the big picture"—mesoscopic imaging that captures activity across multiple brain regions simultaneously. Traditionally, this requires non-human primates (NHPs) to be head-fixed under bulky, table-top microscopes.

However, a growing body of evidence suggests that neural activity changes significantly when an animal is restrained versus when it is free to move. While "miniscopes" exist for freely moving rodents, they typically have tiny fields-of-view (FOVs) of less than 1 mm². For primates, whose functional brain maps (like the visual cortex) span several millimeters, these tiny windows are insufficient. The challenge was to create a device light enough for a primate to wear, yet powerful enough to capture high-resolution data over a large area.

Methods

The authors bypassed the weight and size constraints of traditional optics by using computational lensless imaging.

  1. The Hardware: Instead of a heavy glass lens, the device uses a "contour" phase mask—a thin, transparent plate with a complex surface pattern generated via Perlin noise and Canny edge detection. This mask was fabricated using high-precision two-photon lithography.
  2. The Optics: When light from the brain passes through this mask, it creates a highly specific, multiplexed pattern (a Point Spread Function or PSF) on a CMOS sensor.
  3. The Algorithm: Since the raw data looks like a blurry mess to the human eye, the researchers used a Tikhonov regularization-based reconstruction algorithm (Wiener deconvolution) to "unmix" the signal and reconstruct the original image.
  4. Integrated Systems: The 17.2g package includes four blue LEDs for excitation, a hybrid filter set to isolate fluorescence, and a 3D-printed housing.

Datasets

The researchers validated the system using several benchmarks:

  • Standardized Targets: 1951 USAF resolution targets to quantify the <10 µm resolution.
  • Biological Phantoms: Fixed slices of Convallaria Rhizome and live spiking human embryonic kidney (HEK293) cells.
  • In Vivo Ground Truth: Data from the primary visual cortex (V1) of macaques expressing GCaMP6f (a calcium indicator), compared directly against results from a "gold standard" table-top widefield microscope.

Key Insights and Ideas

  • Breaking the FOV-Resolution Tradeoff: In traditional lens-based systems, increasing the field of view usually requires a larger, heavier lens or results in lower resolution. Lensless imaging decouples these factors, allowing for a 20 mm² FOV in a device that weighs less than a AA battery.
  • Digital Refocusing: Because the system is computational, researchers can "refocus" the image at different depths after the data is collected. This is a massive advantage when imaging the curved surface of a primate brain.
  • Naturalistic Mapping: The study successfully mapped orientation columns—pinwheel-like structures in the visual cortex that respond to specific edge angles—in a head-unrestrained animal. This proves the device is sensitive enough to detect subtle functional organization even during movement.

Key Results

  • Ultra-Lightweight: The total weight is just 17.2g, significantly lighter than many existing head-mounted microscopes used in smaller animals like rats.
  • Large FOV: Achieved a ~20 mm² FOV in vivo, which is roughly 3 times larger than previous miniature primate microscopes.
  • High Resolution: Maintained sub-10 µm resolution across the FOV, sufficient to resolve individual cells in vitro and functional columns in vivo.
  • Stability: Even when the macaque moved its head, the maximum displacement of the brain relative to the sensor was only ~17–27 µm, which was easily corrected via software.
  • Fidelity: The orientation maps produced by the Bio-FlatScopeNHP showed a high correlation (0.72) with those captured by traditional table-top systems.

Limitations and Future Work

  • Signal-to-Noise Ratio (SNR): The SNR is currently lower than table-top systems, particularly at the edges of the FOV where illumination is less uniform.
  • Hemodynamic Artifacts: Changes in blood flow (which absorb light) can interfere with calcium signals. The authors currently use heartbeat-triggered averaging to mitigate this, but future versions may incorporate multi-wavelength imaging for better real-time correction.
  • The "Tether": While the head is unrestrained, the device is still wired to a computer. The authors aim to develop a fully wireless version for completely unrestricted natural behavior.
  • Expansion to Other Species: The authors suggest this technology is a prime candidate for imaging marmosets, which have smaller, flatter brains that are even better suited for lensless setups.

Summary updated

Abstract

Mesoscopic calcium imaging enables studies of cell-type specific neural activity over large areas. A growing body of literature suggests that neural activity can be different when animals are free to move compared to when they are restrained. Unfortunately, existing systems for imaging calcium dynamics over large areas in non-human primates (NHPs) are table-top devices that require restraint of the animal's head. Here, we demonstrate an imaging device capable of imaging mesoscale calcium activity in a head-unrestrained male non-human primate. We successfully miniaturize our system by replacing lenses with an optical mask and computational algorithms. The resulting lensless microscope can fit comfortably on an NHP, allowing its head to move freely while imaging. We are able to measure orientation columns maps over a 20 mm<sup>2</sup> field-of-view in a head-unrestrained macaque. Our work establishes mesoscopic imaging using a lensless microscope as a powerful approach for studying neural activity under more naturalistic conditions.
BibTeX
@inproceedings{wu2024mesoscopic,
  author = {Jimin Wu and Yuzhi Chen and Ashok Veeraraghavan and Eyal Seidemann and Jacob T. Robinson},
  title = {{Mesoscopic calcium imaging in a head-unrestrained male non-human primate using a lensless microscope}},
  booktitle = {Nature Communications},
  year = {2024},
  doi = {10.1038/s41467-024-45417-6},
}
Figure