Refining Brain Stimulation Therapies: An Active Learning Approach to Personalization

Mohammad S.e. Sendi, Eric R. Cole, Brigitte Piallat, Charles A. Ellis, Thomas E. Eggers, Nealen G. Laxpati, Babak Mahmoudi, Claire‐Anne Gutekunst, Annaelle Devergnas, Helen S. Mayberg, Robert A. Gross, Vince D. CalhounResearch Square 2024 · DOI

TL;DR

Researchers have developed an active learning (AL) framework to solve the "needle in a haystack" problem of personalizing brain stimulation therapies. By using "smart" sampling algorithms to choose the most informative experiments rather than relying on random trial-and-error, the team demonstrated that they could build accurate predictive models of brain responses significantly faster and with fewer samples across synthetic, non-human primate, and live rat models.

What Problem Does This Paper Address?

Deep Brain Stimulation (DBS) is a powerful tool for treating over 600 neurological conditions, including Parkinson’s disease and epilepsy. However, its effectiveness is often hampered by a lack of personalization. Every brain is different, and the "parameter space"—the combination of stimulation amplitude, frequency, and pulse width—is massive.

Currently, clinicians often rely on manual tuning or random sampling (RS) to find the right settings. This is inefficient, costly, and time-consuming. To make DBS truly scalable and effective, we need a way to quickly map how a specific patient’s brain responds to various inputs without testing every single combination.

Methods

The authors propose an Active Learning (AL) framework. Unlike standard machine learning, where a model learns from a fixed dataset, AL allows the model to "ask" for the specific data points it needs most to improve its accuracy.

The process follows a three-phase cycle:

  1. Initial Sampling: Start with a tiny set of random stimulation parameters and record the brain's response.
  2. Model Improvement: Train a regression model (like Ridge Regression or Gaussian Process Regression) and use a query strategy to pick the next best parameter set to test.
  3. Validation: Test the model on unseen data to see how well it predicts responses across the entire parameter space.

The researchers tested several query strategies, most notably Query by Committee (QBC)—which uses multiple models to find areas of highest disagreement—and Expected Model Change Maximization (EMCM). Crucially, they also introduced "dynamic modeling" variants that account for the brain's shifting states and stochastic (random) nature, rather than treating the brain as a static system.

Datasets

The framework was validated across three distinct tiers of complexity:

  • Synthetic Parkinson’s Model: A biophysical simulation of the cortex-basal ganglia-thalamus network in a rat model of Parkinson’s.
  • Non-Human Primate (NHP) Data: Real-world recordings from a Macaca fascicularis, where the team stimulated the hippocampus to observe post-stimulation theta power.
  • In Vivo Rat Optogenetics: A real-time experiment where light-based stimulation was delivered to the medial septum of a live rat while recording gamma power in the hippocampus. This served as the ultimate "closed-loop" test of the system.

Key Insights and Ideas

  • AL vs. Bayesian Optimization (BaO): While BaO is often used to find a single "optimal" setting, AL aims to build a robust global model of the entire system. This is more useful for clinicians who need to understand the full range of a patient's responses.
  • The Brain is a Moving Target: The paper highlights that brain responses are stochastic. The same stimulation might yield different results depending on the brain's state just before the pulse. Incorporating "pre-stimulation state" into the AL models significantly improved their predictive power.
  • Model Selection Matters: There is no "one size fits all" algorithm. While Ridge Regression with QBC performed best in the live rat experiment, other models like Gaussian Process Regression were more effective in different scenarios. This suggests that in silico (simulated) modeling is a necessary first step to pick the right "brain-algorithm" pair before heading into the clinic.

Key Results

  • Superior Efficiency: In every experiment, AL models outperformed random sampling. They achieved lower Root Mean Square Error (RMSE) on unseen test data using significantly fewer trials.
  • Statistical Significance: In the in silico Parkinson's model, AL was superior across 1,000 iterations ($p < 0.0056$).
  • Real-Time Success: In the live in vivo rat experiment, the Ridge Regression model using the QBC strategy consistently beat random sampling across 20 experimental sessions ($p = 0.0036$).
  • Dynamic Advantage: Adding brain-state dynamics to the models made the efficiency gap between AL and random sampling even more pronounced, proving that "smart" sampling is especially vital for complex, changing systems.

Limitations and Future Work

The authors acknowledge several hurdles before this hits the clinic:

  • Noise Sensitivity: AL can sometimes be "misled" by noisy data. If the model queries a sample that contains a measurement artifact, it can skew future queries. The authors suggest that strategies focusing on "representativeness" might help filter out these outliers.
  • Scaling Complexity: This study focused on single-output regression (predicting one biomarker). Future work needs to tackle multiple-output models to account for the many ways a brain responds to stimulation simultaneously.
  • Deep Learning: The study stuck to traditional machine learning. Exploring deep learning architectures could potentially handle even more complex neural dynamics.
  • Subject Diversity: The in vivo portion was limited to a single animal. Larger, multi-subject studies are required to prove the framework's generalizability across different individuals.

Summary updated

Abstract

Brain stimulation holds promise for treating brain disorders, but personalizing therapy remains challenging. Effective treatment requires establishing a functional link between stimulation parameters and brain response, yet traditional methods like random sampling (RS) are inefficient and costly. To overcome this, we developed an active learning (AL) framework that identifies optimal relationships between stimulation parameters and brain response with fewer experiments. We validated this framework through three experiments: (1) in silico modeling with synthetic data from a Parkinson's disease model, (2) in silico modeling with real data from a non-human primate, and (3) in vivo modeling with a real-time rat optogenetic stimulation experiment. In each experiment, we compared AL models to RS models, using various query strategies and stimulation parameters (amplitude, frequency, pulse width). AL models consistently outperformed RS models, achieving lower error on unseen test data in silico <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:mo>(</mml:mo> <mml:mi>p</mml:mi> <mml:mo><</mml:mo> <mml:mn>0.0056</mml:mn> <mml:mo>,</mml:mo> <mml:mspace></mml:mspace> <mml:mi>N</mml:mi> <mml:mo>=</mml:mo> <mml:mn>1000</mml:mn> <mml:mo>)</mml:mo></mml:math> and in vivo <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:mo>(</mml:mo> <mml:mi>p</mml:mi> <mml:mo>=</mml:mo> <mml:mn>0.0036</mml:mn> <mml:mo>,</mml:mo> <mml:mspace></mml:mspace> <mml:mi>N</mml:mi> <mml:mo>=</mml:mo> <mml:mn>20</mml:mn> <mml:mo>)</mml:mo></mml:math> . This approach represents a significant advancement in brain stimulation, potentially improving both research and clinical applications by making them more efficient and effective. Our findings suggest that AL can substantially reduce the cost and time required for developing personalized brain stimulation therapies, paving the way for more effective and accessible treatments for brain disorders.
BibTeX
@inproceedings{sendi2024refining,
  author = {Mohammad S.E. Sendi and Eric R. Cole and Brigitte Piallat and Charles A. Ellis and Thomas E. Eggers and Nealen G. Laxpati and Babak Mahmoudi and Claire‐Anne Gutekunst and Annaelle Devergnas and Helen S. Mayberg and Robert A. Gross and Vince D. Calhoun},
  title = {{Refining Brain Stimulation Therapies: An Active Learning Approach to Personalization}},
  booktitle = {Research Square},
  year = {2024},
  doi = {10.21203/rs.3.rs-4876094/v1},
}
Figure