Inferring neuronal ionic conductances from membrane potentials using CNNs

Roy Ben‐Shalom, J. Balewski, Anand Siththaranjan, Vyassa L. Baratham, Henry Kyoung, Kyung Geun Kim, Kevin J. Bender, Kristofer E. BouchardbioRxiv 2019 · DOI

TL;DR

This paper introduces a novel approach using Convolutional Neural Networks (CNNs) to directly infer the biophysical parameters (like ion channel densities) of neuronal models from their simulated electrical activity (membrane potentials). The CNN-based method significantly outperforms the traditional Multi-Objective Optimization (MOO) approach in accuracy and efficiency, paving the way for more precise understanding of neuronal function.

What Problem Does This Paper Address?

Understanding how neurons function requires knowing the precise distribution and density of ion channels along their membranes. These ion channels are the molecular machinery that dictates how a neuron responds to electrical signals. However, experimentally measuring these microscopic properties directly is incredibly challenging, especially in complex neuronal structures. Researchers have traditionally relied on fitting computational models of neurons to experimental recordings. This often involves using Multi-Objective Optimization (MOO) to adjust model parameters (like ion channel densities) until the model's simulated electrical activity closely matches experimental data. While effective, MOO has limitations: it's computationally intensive, sensitive to the choice of features used for comparison, and can yield inconsistent results. This paper aims to overcome these limitations by proposing a data-driven approach using CNNs to directly predict these crucial biophysical parameters from simulated voltage traces.

Methods

The core of this work is the application of Convolutional Neural Networks (CNNs) for parameter regression. The authors designed a specific 1D CNN architecture, incorporating convolutional and pooling layers to extract features from the time-series voltage data, followed by fully connected layers to predict the neuronal parameters.

Here's a breakdown of their approach:

  • Data Generation: They simulated neuronal activity using three different models (Izhikevich, Hodgkin-Huxley, and Mainen-Sejnowski) with varying numbers of adjustable parameters (4, 7, and 10). For each model, they generated millions of voltage traces by systematically varying these parameters within realistic ranges and applying a "chirp" stimulus.
  • CNN Training: The generated voltage traces and their corresponding ground-truth parameters formed the training dataset. They trained 32 independent CNN models for each neuronal model, averaging their predictions to improve robustness.
  • Parameter Prediction: The trained CNNs take a simulated voltage trace as input and directly output a vector of predicted neuronal parameters (e.g., ion channel conductances).
  • Comparison with MOO: They benchmarked their CNN approach against the standard MOO method, using the electrophysiology Feature Extraction Library (eFEL) to quantify the accuracy of both methods in fitting features and predicting parameters.

Datasets

The paper does not introduce new experimental datasets. Instead, it relies on synthetically generated datasets from well-established neuronal simulators:

  • Izhikevich model: Used with 4 varied parameters.
  • Hodgkin-Huxley model: Used with 7 varied parameters (ball and stick morphology) and variations with 4 parameters.
  • Mainen-Sejnowski model: Used with 4, 7, and 10 varied parameters, representing a more complex and biophysically detailed neuron.

For each model, millions of voltage traces were generated by sampling the parameter space. These synthetic datasets were split into training, validation, and testing sets.

Key Insights and Ideas

  • CNNs as Direct Parameter Regressors: The most significant insight is that CNNs can be trained to directly map complex voltage waveforms to specific biophysical parameters, bypassing the iterative optimization process of MOO.
  • Superiority over MOO: The CNN approach consistently outperformed MOO in accurately predicting the underlying generative parameters, especially for more complex neuronal models.
  • Parameter Identifiability Challenges: The study highlights that highly correlated parameters or parameters with subtle contributions to the overall voltage response are more difficult for the CNN (and MOO) to resolve accurately. This is particularly evident in the Mainen-Sejnowski model.
  • Efficiency Gains: Once trained, CNNs can predict parameters from new voltage traces orders of magnitude faster than MOO, making them highly scalable for large datasets.
  • Data-Driven Insights: The CNN's ability to reveal correlations between predicted parameters (as shown in correlation matrices) offers valuable insights into the interdependence of neuronal properties.

Key Results

  • High Prediction Accuracy: For the Izhikevich model (4 parameters), the CNN achieved RMS errors as low as 1-2%. For the Hodgkin-Huxley 7-parameter model, errors were below 6%, with the leak conductance being the most accurately predicted.
  • Performance with Complexity: Even for the complex Mainen-Sejnowski 10-parameter model, the CNN could predict most parameters with errors below 10%, though some parameters (like certain calcium and potassium conductances) showed higher errors (up to 29%).
  • CNN Outperforms MOO: In parameter fitting accuracy, CNNs were superior to MOO across all tested models. While MOO could sometimes generate waveforms with similar eFEL features, it often resulted in large errors in the predicted parameter values, especially for complex models.
  • Speed Advantage: CNN predictions are nearly instantaneous after training, whereas MOO can take days of computation for each new dataset.

Limitations and Future Work

  • Model Complexity Limit: The authors suggest that for very complex models with highly correlated parameters, the CNN might reach its limit when inferring from a single voltage recording site (soma) and a single stimulus.
  • Stimulus and Recording Site Dependence: The current approach relies on a specific stimulus and recording from a single location. Future work could explore using more diverse stimuli and recording from multiple locations on the neuron.
  • Spatial Resolution: The current method predicts global parameters. The authors propose extending this to infer the spatial distribution of ionic densities, which would require spatially resolved voltage measurements (e.g., from voltage imaging).
  • Generalization to Real Data: While trained on simulated data, the ultimate goal is to apply this to real experimental recordings, which would require addressing noise and variability inherent in biological data.
  • Mismatch Detection: Developing methods to indicate when an input waveform is significantly different from the training data distribution would be beneficial.

Summary updated

Abstract

Abstract The neuron is the fundamental unit of computation in the nervous system, and different neuron types produce different temporal patterns of voltage fluctuations in response to input currents. Understanding the mechanism of single neuron firing patterns requires accurate knowledge of the spatial densities of diverse ion channels along the membrane. However, direct measurements of these microscopic variables are difficult to obtain experimentally. Alternatively, one can attempt to infer those microscopic variables from the membrane potential (a mesoscopic variable), or features thereof, which are more experimentally tractable. One approach in this direction is to infer the ionic densities as parameters of a neuronal model. Traditionally this is done using a Multi-Objective Optimization (MOO) method to minimize the differences between features extracted from a simulated neuron’s membrane potential and the same features extracted from target data. Here, we use Convolutional Neural Networks (CNNs) to directly regress generative parameters (e.g., ionic conductances, membrane resistance, etc.,) from simulated time-varying membrane potentials in response to an input stimulus. We simulated diverse neuron models of increasing complexity (Izikivich: 4 parameters; Hodgkin-Huxley: 7 parameters; Mainen-Sejnowski: 10 parameters) with a large range of variation in the underlying parameter values. We show that hyperparameter optimized CNNs can accurately infer the values of generative variables for these neuron models, and that these results far surpass the previous state-of-the-art method (MOO). We discuss the benefits of optimizing the CNN architecture, improvements in accuracy with additional training data, and some observed limitations. Based on these results, we propose that CNNs may be able to infer the spatial distribution of diverse ionic densities from spatially resolved measurements of neuronal membrane potentials (e.g. voltage imaging).
BibTeX
@misc{benshalom2019inferring,
  author = {Roy Ben‐Shalom and J. Balewski and Anand Siththaranjan and Vyassa L. Baratham and Henry Kyoung and Kyung Geun Kim and Kevin J. Bender and Kristofer E. Bouchard},
  title = {{Inferring neuronal ionic conductances from membrane potentials using CNNs}},
  year = {2019},
  doi = {10.1101/727974},
  howpublished = {bioRxiv},
}
Figure