HyperProbe consortium: innovate tumour neurosurgery with innovative photonic solutions

Luca Giannoni, Marta Marradi, Marco Marchetti, Duccio Rossi Degl’Innocenti, Ivan Ezhov, Charly Caredda, Arthur Gautheron, Fernand Fort, F. Schneider, Moncef Berhouma, Camilla Bonaudo, Thiébaud Picart, Frédéric Lange, Katharina Krischak, Peter Gordebeke, Domenico Alfieri, Daniel Rueckert, Bruno Montcel, Alessandro Della Puppa, Jacques Guyotat, Ilias Tachtsidis, Francesco S. Pavone2023 · DOI

Abstract

Recent advancements in imaging technologies (MRI, PET, CT, among others) have significantly improved clinical localisation of lesions of the central nervous system (CNS) before surgery, making possible for neurosurgeons to plan and navigate away from functional brain locations when removing tumours, such as gliomas. However, neuronavigation in the surgical management of brain tumours remains a significant challenge, due to the inability to maintain accurate spatial information of pathological and healthy locations intraoperatively. To answer this challenge, the HyperProbe consortium have been put together, consisting of a team of engineers, physicists, data scientists and neurosurgeons, to develop an innovative, all-optical, intraoperative imaging system based on (i) hyperspectral imaging (HSI) for rapid, multiwavelength spectral acquisition, and (ii) artificial intelligence (AI) for image reconstruction, morpho-chemical characterisation and molecular fingerprint recognition. Our HyperProbe system will (1) map, monitor and quantify biomolecules of interest in cerebral physiology; (2) be handheld, cost-effective and user-friendly; (3) apply AI-based methods for the reconstruction of the hyperspectral images, the analysis of the spatio-spectral data and the development and quantification of novel biomarkers for identification of glioma and differentiation from functional brain tissue. HyperProbe will be validated and optimised with studies in optical phantoms, in vivo against gold standard modalities in neuronavigational imaging, and finally we will provide proof of principle of its performances during routine brain tumour surgery on patients. HyperProbe aims at providing functional and structural information on biomarkers of interest that is currently missing during neuro-oncological interventions.

Introduction: The Challenge of Brain Shift

In neurosurgery, precision is paramount. Surgeons currently rely on pre-operative imaging like MRI and PET scans to map tumor locations. However, once the skull is opened, the brain physically shifts—a phenomenon known as "brain shift"—which renders pre-operative maps increasingly inaccurate as the procedure progresses. While intraoperative tools like fluorescence-guided surgery (using dyes like 5-ALA) provide some guidance, they often lack the chemical specificity and spatial resolution required to distinguish low-density tumor infiltration from healthy, functional brain tissue.

Current intraoperative imaging modalities including MRI/PET and fluorescence-guided surgery.

Methods: The HyperProbe Approach

The HyperProbe project addresses this gap by developing an all-optical, handheld hyperspectral imaging (HSI) platform. Unlike standard RGB cameras, HSI captures a wide range of contiguous wavelengths (300–1100 nm), creating a "hypercube" of data that reveals the unique optical signatures of various tissues.

The project follows a structured development roadmap:

  1. Hardware Evolution: Transitioning from HyperProbe1 (a laboratory-scale system using high-power supercontinuum lasers for high spectral precision) to HyperProbe2 (a clinical prototype utilizing compact, cost-effective LED arrays).
  2. AI-Driven Reconstruction: Developing deep learning pipelines, specifically focusing on unsupervised and self-supervised learning, to reconstruct images and identify biomarkers without requiring massive labeled surgical datasets.
  3. Biomarker Targeting: The system targets endogenous markers such as oxygenated/deoxygenated hemoglobin, water, lipids, and Cytochrome-c-oxidase (CCO)—a critical indicator of mitochondrial metabolism.
The HyperProbe project roadmap, illustrating the transition from laboratory systems to clinical application.

Validation is performed through a multi-tiered strategy involving homogeneous liquid and 3D-printed optical phantoms, digital computational models, in vivo animal testing, and eventually clinical observational studies in patients undergoing glioma surgery.

Key Insights and Results

HyperProbe shifts the paradigm from qualitative "pretty pictures" to quantitative data. By providing actual concentrations of molecules, it offers objective decision support to surgeons. A key innovation is the monitoring of Cytochrome-c-oxidase (CCO), which allows for real-time assessment of the metabolic health of brain tissue, going beyond simple blood flow observation.

Technical specifications for the system include:

  • Spectral Range: 300 nm (near-UV) to 1100 nm (NIR).
  • Speed: Rapid wavelength switching (10–100 μs) using AOTF technology, essential for real-time intraoperative use.
  • Clinical Integration: The device is designed to be handheld and compatible with existing surgical microscopes and neuronavigation systems.

Discussion and Future Work

While the project faces challenges such as signal "crosstalk" between different molecules and complex regulatory hurdles for clinical certification, the long-term vision is transformative. Beyond tumor margin identification, the HyperProbe consortium aims to enable intraoperative mapping of brain function, ensuring that critical areas responsible for speech or movement are preserved during resection. This photonic solution promises to bring unprecedented precision to the operating room, bridging the gap between pre-operative planning and intraoperative reality.

Summary updated

Abstract

Recent advancements in imaging technologies (MRI, PET, CT, among others) have significantly improved clinical localisation of lesions of the central nervous system (CNS) before surgery, making possible for neurosurgeons to plan and navigate away from functional brain locations when removing tumours, such as gliomas. However, neuronavigation in the surgical management of brain tumours remains a significant challenge, due to the inability to maintain accurate spatial information of pathological and healthy locations intraoperatively. To answer this challenge, the HyperProbe consortium have been put together, consisting of a team of engineers, physicists, data scientists and neurosurgeons, to develop an innovative, all-optical, intraoperative imaging system based on (i) hyperspectral imaging (HSI) for rapid, multiwavelength spectral acquisition, and (ii) artificial intelligence (AI) for image reconstruction, morpho-chemical characterisation and molecular fingerprint recognition. Our HyperProbe system will (1) map, monitor and quantify biomolecules of interest in cerebral physiology; (2) be handheld, cost-effective and user-friendly; (3) apply AI-based methods for the reconstruction of the hyperspectral images, the analysis of the spatio-spectral data and the development and quantification of novel biomarkers for identification of glioma and differentiation from functional brain tissue. HyperProbe will be validated and optimised with studies in optical phantoms, in vivo against gold standard modalities in neuronavigational imaging, and finally we will provide proof of principle of its performances during routine brain tumour surgery on patients. HyperProbe aims at providing functional and structural information on biomarkers of interest that is currently missing during neuro-oncological interventions.
BibTeX
@misc{giannoni2023hyperprobe,
  author = {Luca Giannoni and Marta Marradi and Marco Marchetti and Duccio Rossi Degl’Innocenti and Ivan Ezhov and Charly Caredda and Arthur Gautheron and Fernand Fort and F. Schneider and Moncef Berhouma and Camilla Bonaudo and Thiébaud Picart and Frédéric Lange and Katharina Krischak and Peter Gordebeke and Domenico Alfieri and Daniel Rueckert and Bruno Montcel and Alessandro Della Puppa and Jacques Guyotat and Ilias Tachtsidis and Francesco S. Pavone},
  title = {{HyperProbe consortium: innovate tumour neurosurgery with innovative photonic solutions}},
  year = {2023},
  doi = {10.1117/12.2670764},
}
Figure