Hardware-Aware Model Inversion in Memristive Spiking Neural Networks

Pablo Sorrentino, Fernando M. Quintana, Erika Covi, Fatih Turkmen

TL;DR

This paper demonstrates that the physical "imperfections" of memristive hardware—like device variability and noise—do not inherently protect the privacy of Spiking Neural Networks (SNNs). By introducing a hardware-aware attack called Spiking Domain Model Inversion (SDMI), the authors show that certain hardware faults can actually make it up to 51.8% easier to reconstruct sensitive training data, even when the model's classification accuracy remains largely unchanged.

What Problem Does This Paper Address?

Spiking Neural Networks (SNNs) running on memristive crossbar arrays are the "holy grail" for energy-efficient edge AI. However, memristors are notoriously non-ideal: they suffer from device-to-device variability, conductance drift, and analog noise.

In the security community, there has been a lingering assumption that this hardware-level "fuzziness" might act as a natural privacy barrier, making it harder for an attacker to perform Model Inversion (MI)—an attack where one tries to reconstruct the training data (like faces or digits) just by observing the model's outputs.

The authors tackle a critical gap: Does the privacy profile of a software SNN actually represent its real-world memristive implementation? They investigate how different types of hardware faults—at the synapse, neuron, and spike levels—reshape the way information leaks from these systems.

Figure 1: Overview of model inversion in memristive SNNs. Hardware non-idealities and reliability faults can alter the ef- fective hardware state and observable model behavior, poten- tially affecting both predictive utility and model-inversion leakage. Model inversion iteratively optimizes a candidate input based on model responses.

Methods

To study this, the authors developed Spiking Domain Model Inversion (SDMI). Attacking SNNs is hard because they are non-differentiable (spikes are all-or-nothing) and memristive hardware is stochastic. SDMI overcomes these hurdles using two key techniques:

  1. Surrogate Gradients: A standard trick in SNN training that allows gradients to flow through non-differentiable spiking functions during the optimization process.
  2. Expectation over Transformation (EOT): This allows the attack to "average out" the noise from the hardware. Instead of optimizing against one specific noisy state, SDMI optimizes against the expected behavior of the noisy system, making the attack much more stable and effective.

The hardware environment was simulated using the IBM AIHWKIT, modeling realistic Resistive RAM (ReRAM) behaviors like 8-bit quantization, cycle-to-cycle noise, and conductance drift.

Figure 2: Hierarchical overview of representative system pa- rameters across three levels: memristor array (IR-drop and peripheral circuitry), device (conductance variability, drift, and noise), and SNN model (neural dynamics and temporal encoding).

Datasets

The framework was evaluated across four diverse benchmarks:

  • MNIST & Fashion-MNIST: Standard image classification tasks.
  • AT&T Faces: A biometric dataset used to test the reconstruction of sensitive human features.
  • DVS128 Gesture: A native event-based (spiking) dataset, representing how these systems process real-world temporal data.

Key Insights and Ideas

  • Privacy and Accuracy are Decoupled: A common misconception is that if a hardware fault kills a model's accuracy, it must also be destroying the information needed for model inversion. The authors found this is false. For example, spike deletion significantly hurts accuracy but barely changes how much data leaks.
  • Hardware Variability is Not a Privacy Shield: While some effects like weight noise do reduce leakage, others—specifically neuron-threshold perturbations—actually make the model more vulnerable.
  • The "Aha" Moment on Thresholds: Lowering the firing threshold of neurons increases their excitability. This changes the "activation structure" of the network in a way that makes the optimization landscape for the attacker much smoother, leading to much higher fidelity reconstructions.
  • System-Level Assessment is Mandatory: You cannot judge the privacy of an edge AI device just by looking at the software model. The specific hardware state (and its faults) dictates the actual privacy risk.
Figure 3: Hardware non-idealities and reliability faults evalu- ated at synaptic, neuron, and spike levels. Controlled sensitiv- ity sweeps do not imply equivalent physical controllability by an adversary.

Key Results

  • Reconstruction Fidelity: Neuron-threshold shifts increased the Structural Similarity Index (SSIM) of reconstructed images by up to 51.8% compared to the memristive baseline.
  • Defense Potential: Conversely, adding weight noise reduced reconstruction fidelity by 35.7%, suggesting that intentional noise injection could be a viable privacy-preserving strategy for memristive hardware.
  • Attack Stability: Using EOT (Expectation over Transformation) was crucial; removing it caused the attack's success to drop and become highly inconsistent across different hardware samples.

Limitations and Future Work

The study is primarily simulation-based. While the ReRAM models used (IBM AIHWKIT) are highly regarded, the authors note that physical chip validation is the next logical step. Additionally, the study focused on "class-representative" reconstruction (what a typical '0' or 'face' looks like) rather than the exact recovery of a specific individual's training record.

Future research directions include exploring how these privacy leaks manifest in larger, more complex SNN architectures and investigating whether "controlled noise" can be engineered into hardware as a formal privacy defense without sacrificing too much energy efficiency.

Summary updated

Abstract

Hardware-accelerated spiking neural networks (SNNs) implemented on memristive crossbar arrays offer significant gains in energy efficiency, while device variability and analog noise are sometimes assumed to hinder information extraction. However, whether these hardware effects improve, preserve, or degrade privacy after deployment remains largely unexplored. Therefore, we ask whether model-inversion leakage characterized on an SNN remains representative after the same model is mapped to a non-ideal memristive substrate, and how hardware non-idealities and reliability faults affecting synapses, neuron thresholds, and spike processing reshape that leakage. To study this problem, we introduce Spiking Domain Model Inversion (SDMI), an inversion method that combines Expectation over Transformation (EOT) with surrogate gradients to optimize inputs through stochastic analog behavior and non-differentiable spiking dynamics. We use SDMI consistently across the SNN model, its memristive SNN, and the same memristive SNN under additional hardware perturbations. Across four datasets, reconstruction leakage does not vary monotonically with model accuracy or hardware variability. At comparable accuracy levels, neuron-threshold perturbations increase reconstruction fidelity, measured by SSIM, by up to 51.8%, whereas spike-level perturbations primarily degrade utility without consistently improving reconstruction. Weight noise, in contrast, reduces leakage under the same inversion procedure. These results show that hardware variability is not inherently privacy-preserving: model inversion leakage in memristive SNNs depends on the hardware state and cannot be inferred from model accuracy alone.
BibTeX
@misc{sorrentino2026hardware,
  author = {Pablo Sorrentino and Fernando M. Quintana and Erika Covi and Fatih Turkmen},
  title = {{Hardware-Aware Model Inversion in Memristive Spiking Neural Networks}},
  year = {2026},
  eprint = {2610.39688},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2610.39688},
}
Figure