Variation-Resilient FeFET-Based In-Memory Computing Leveraging Probabilistic Deep Learning

Bibhas Manna, Arnob Saha, Zhouhang Jiang, Kai Ni, Abhronil Sengupta

TL;DR

This paper introduces a hardware-software co-design approach to make In-Memory Computing (IMC) resilient to the inherent "noise" of nanoscale devices. By characterizing the realistic, state-dependent variations of 28nm Ferroelectric Field-Effect Transistors (FeFETs) and incorporating them as "priors" in a Bayesian Neural Network (BNN), the authors achieved near-ideal accuracy on standard AI benchmarks even as device dimensions shrink.

What Problem Does This Paper Address?

In-Memory Computing (IMC) aims to speed up AI by performing calculations directly within memory arrays, avoiding the energy-intensive data movement between processor and RAM. FeFETs are a leading candidate for this because they are CMOS-compatible and can store multiple "bits" of information as different conductance levels.

However, as FeFETs are scaled down to the nanometer level, they become increasingly "unreliable." Physical variations during manufacturing (Device-to-Device) and fluctuations during operation (Cycle-to-Cycle) cause the programmed weights to drift from their intended values. Traditional neural networks are fragile; even small weight deviations can cause accuracy to plummet. Previous solutions often relied on expensive retraining or simplified noise models that don't reflect how real hardware behaves.

Methods

The authors propose a Variation-Aware Design framework that bridges the gap between device physics and deep learning algorithms:

  1. Experimental Characterization: They measured real FeFET devices fabricated on an industrial 28nm high-k metal gate (HKMG) process. They tested three different device sizes to see how scaling affects noise.
  2. Realistic Modeling: Unlike prior works that assumed a "fixed" amount of noise for all weights, the authors discovered that variation is a function of the programmed conductance state. They developed an empirical polynomial model to capture this relationship.
  3. Probabilistic Deep Learning: They utilized Bayesian Neural Networks (BNNs) trained via the "Bayes by Backprop" method. In a BNN, weights are treated as probability distributions rather than fixed numbers. By feeding the realistic FeFET variation model into the BNN as a "prior," the network learns to find weight distributions that are naturally robust to the specific noise patterns of the hardware.

Datasets

The framework was evaluated using standard machine learning benchmarks:

  • MNIST: Used for shallow networks, specifically a five-layer Multi-Layer Perceptron (MLP5) and LeNet.
  • CIFAR-10: Used for the deeper and more complex AlexNet model to test the limits of the approach.

Key Insights and Ideas

  • Noise is not Uniform: A critical "aha" moment was realizing that FeFET variation isn't constant. It changes based on the programmed conductance and the read voltage ($V_{Read}$). Smaller devices and lower read voltages lead to much higher relative variation.
  • The Power of Priors: By telling the BNN exactly what kind of noise to expect (the "prior"), the optimization process naturally steers the model toward "flatter" regions of the loss landscape where weight fluctuations don't hurt performance as much.
  • Hardware-Software Co-design: The paper proves that you don't need "perfect" hardware to get perfect results. If the algorithm understands the hardware's imperfections, it can compensate for them mathematically.

Key Results

  • Near-Ideal Accuracy: For shallow networks (MLP5 and LeNet) on MNIST, the BNN achieved performance almost identical to a software model with zero noise.
  • Massive Gains on Deep Networks: On the more challenging AlexNet/CIFAR-10 task, the proposed framework outperformed standard non-Bayesian models significantly. For the smallest device size at a low read voltage (0.6V), the BNN improved accuracy by 46.6% compared to a standard network.
  • Superiority over Generic Models: The authors showed that using their device-specific variation model was much more effective than using a generic, fixed-noise Bayesian model.

Limitations and Future Work

  • Power vs. Accuracy Trade-off: The study found that higher read voltages ($V_{Read}$) reduce noise and improve accuracy but increase power consumption. Finding the "sweet spot" remains a design challenge.
  • Spatial Correlation: The current model assumes variations between neighboring devices are independent. In real crossbar arrays, there might be spatial correlations (e.g., a cluster of devices being affected by the same manufacturing defect), which the authors suggest for future study.
  • One-Time Training: While the BNN training is more complex than standard training, the authors note this is a one-time cost that eliminates the need for expensive "on-chip" iterative retraining later.

Summary updated

Abstract

Reliability issues stemming from device level nonidealities of nonvolatile emerging technologies like ferroelectric field-effect transistors (FeFETs), especially at scaled dimensions, cause substantial degradation in the accuracy of in-memory crossbar-based AI systems. In this work, we present a variation-aware design technique to characterize the device level variations and to mitigate their impact on hardware accuracy employing a Bayesian neural network (BNN) approach. An effective conductance variation model is derived from the experimental measurements of cycle-to-cycle (C2C) and device-to-device (D2D) variations performed on FeFET devices fabricated using 28 nm high- <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\textit{k}$</tex-math> </inline-formula> metal gate technology. The variations were found to be a function of different conductance states within the given programming range, which sharply contrasts earlier efforts where a fixed variation dispersion was considered for all conductance values. Such variation characteristics formulated for three different device sizes at different read voltages were provided as prior variation information to the BNN to yield a more exact and reliable inference. Near-ideal accuracy for shallow networks (MLP5 and LeNet models) on the MNIST dataset and limited accuracy decline by <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\sim$</tex-math> </inline-formula> 3.8%–16.1% for deeper AlexNet models on CIFAR10 dataset under a wide range of variations corresponding to different device sizes and read voltages, demonstrates the efficacy of our proposed device-algorithm co-design technique.
BibTeX
@article{manna2024variation,
  author = {Bibhas Manna and Arnob Saha and Zhouhang Jiang and Kai Ni and Abhronil Sengupta},
  title = {{Variation-Resilient FeFET-Based In-Memory Computing Leveraging Probabilistic Deep Learning}},
  journal = {IEEE Transactions on Electron Devices},
  year = {2024},
  doi = {10.1109/ted.2024.3378223},
}

Loading related content...

Figure