In vivo imaging with a flat, lensless microscope

Jesse K. Adams, Dong Yan, Jimin Wu, Vivek Boominathan, Sibo Gao, Alexander V. Rodriguez, Jennifer Carns, Rebecca Richards‐Kortum, Caleb Kemere, Ashok Veeraraghavan, Jacob RobinsonResearch Square 2021 · DOI

Abstract

Lensless microscopes that form images using simple, compact optics, along with associated computational algorithms provide several advantages: small, inexpensive form factors, large fields of view (FOV), and the ability to refocus an image after capture. To date, however, lensless microscopy has yet to be demonstrated for in vivo biological imaging. The primary challenge with in vivo bio-imaging is these dense, low-contrast scenes cannot be accurately reconstructed with existing lensless techniques. To overcome this challenge, we designed an optical phase mask that creates a point-spread function consisting of high-contrast contours with a broad spatial frequency spectrum. Here we show that this “contour” phase mask enables in vivo imaging where previous lensless imaging technologies have failed. As a proof of concept, we demonstrate 3D imaging of a behaving invertebrate, functional calcium imaging in mouse cortex, and in vivo imaging of microvasculature in the human oral mucosa. Together these results demonstrate the ability of lensless imaging to operate in realistic biological imaging applications ranging from pre-clinical animal models to clinical biomedical imaging. Overall, this “Bio-FlatScope” is a clinically relevant imaging technique with advantages of 3D computational refocusing in a low-cost, small form factor that is useful for low-resource settings and difficult-to-reach areas of the body.

Introduction

Traditional microscopy relies on bulky glass lenses to focus light, creating a fundamental trade-off between device size, field of view (FOV), and depth of field. While miniature microscopes ("miniscopes") have been developed for applications like neural imaging in moving animals, they remain limited by fixed focal planes and relatively small FOVs. Lensless cameras offer a potential solution by replacing lenses with thin masks and computational reconstruction. However, previous designs have struggled with the low-contrast, dense environments typical of in vivo biological tissue. The Bio-FlatScope was developed to bridge this gap, providing high-resolution, wide-field imaging in a ultra-thin form factor.

The Bio-FlatScope Architecture

The Bio-FlatScope addresses the limitations of previous lensless designs through a novel hardware-software co-design. The device consists of a CMOS sensor topped with a specialized "contour" phase mask. Unlike amplitude masks that block light or random diffusers that lose high-frequency information, this phase mask is designed using Perlin noise and Canny edge detection to create a high-contrast Point Spread Function (PSF).

Bio-FlatScope design, reconstruction pipeline, and performance comparison against existing lensless technologies.

The system captures a scrambled "interferogram," which is then processed using Wiener deconvolution and Tikhonov regularization to mathematically reconstruct the original scene. Because the PSF varies predictably with the distance of the light source from the sensor, the Bio-FlatScope can reconstruct 3D volumes from a single 2D capture by solving the reconstruction problem across multiple depth planes.

Key Insights: Flattening the MTF

A critical advantage of the contour phase mask is its effect on the Modulation Transfer Function (MTF). By ensuring a flatter MTF, the Bio-FlatScope preserves high-frequency spatial information that is typically lost to noise in low-contrast biological scenes. This allows the device to maintain a lateral resolution of approximately 9 µm across a massive 16 mm² FOV—a 30-fold increase over traditional cellular-resolution miniscopes. Furthermore, the computational nature of the device allows for post-capture digital refocusing, eliminating the need for mechanical focus components.

In Vivo Results

The researchers demonstrated the Bio-FlatScope's versatility across several challenging biological models. It successfully performed functional calcium imaging in the motor cortex of running mice, with results correlating highly ($r \approx 0.85$) with traditional epifluorescence microscopy.

3D tracking and functional imaging of Hydra vulgaris, showing depth-coded maps and calcium activity traces.

In invertebrate studies, the device tracked the 3D movement of Hydra vulgaris within a 4 mm³ volume at 1-2 Hz from single-shot captures. Beyond research models, the Bio-FlatScope showed clinical promise by resolving individual capillaries (< 20 µm) in the human oral mucosa, suggesting applications in monitoring microvascular health in low-resource settings.

Limitations and Future Work

While the Bio-FlatScope excels in low-contrast environments, its resolution degrades as the distance from the sensor increases. Current cellular-resolution imaging requires the target to be within a few millimeters. Additionally, light scattering remains a hurdle for deep-tissue imaging. Future development will focus on "scattering-aware" algorithms and the integration of internal excitation light sources to create fully self-contained, wearable imaging systems for freely behaving animals.

Summary updated

Abstract

<title>Abstract</title> Lenless microscopes that form images using simple, compact optics, along with associated computational algorithms provide several advantages: small, inexpensive form factors, large fields of view (FOV), and the ability to refocus an image after capture. To date, however, lensless microscopy has yet to be demonstrated for <italic>in vivo</italic> biological imaging. The primary challenge with <italic>in vivo</italic> bio-imaging is these dense, low-contrast scenes cannot be accurately reconstructed with existing lensless techniques. To overcome this challenge, we designed an optical phase mask that creates a point-spread function consisting of high-contrast contours with a broad spatial frequency spectrum. Here we show that this “contour” phase mask enables <italic>in vivo</italic> imaging where previous lensless imaging technologies have failed. As a proof of concept, we demonstrate 3D imaging of a behaving invertebrate, functional calcium imaging in mouse cortex, and <italic>in vivo</italic> imaging of microvasculature in the human oral mucosa. Together these results demonstrate the ability of lensless imaging to operate in realistic biological imaging applications ranging from pre-clinical animal models to clinical biomedical imaging. Overall, this “Bio-FlatScope” is a clinically relevant imaging technique with advantages of 3D computational refocusing in a low-cost, small form factor that is useful for low-resource settings and difficult-to-reach areas of the body.
BibTeX
@inproceedings{adams2021vivo,
  author = {Jesse K. Adams and Dong Yan and Jimin Wu and Vivek Boominathan and Sibo Gao and Alexander V. Rodriguez and Jennifer Carns and Rebecca Richards‐Kortum and Caleb Kemere and Ashok Veeraraghavan and Jacob Robinson},
  title = {{In vivo imaging with a flat, lensless microscope}},
  booktitle = {Research Square},
  year = {2021},
  doi = {10.21203/rs.3.rs-142332/v1},
}
Figure