Deep Learning-Based Decoding of Linear Block Codes for Spin-Torque Transfer Magnetic Random Access Memory (STT-MRAM)

Xingwei Zhong, Kui Cai, Zhen Mei, Tony Q. S. Quek

Introduction

Spin-Torque Transfer Magnetic Random Access Memory (STT-MRAM) has emerged as a leading candidate for next-generation non-volatile memory due to its high speed and energy efficiency. However, its widespread adoption is hindered by reliability challenges stemming from manufacturing defects and environmental factors. This paper presents a novel deep learning-based decoding framework designed to mitigate these issues by combining a soft-information generation method (SIGM) with a "deep-unfolded" neural decoder (NNORB-MS).

The Reliability Challenge: Process Variation and Thermal Fluctuation

The reliability of STT-MRAM is primarily compromised by two factors:

  1. Process Variation: Inherent manufacturing differences lead to variations in the resistance of magnetic tunneling junctions (MTJ), causing the probability density functions (PDFs) of the '0' and '1' states to overlap.
  2. Thermal Fluctuation: Temperature changes cause the resistance of the high-resistance state to drop, introducing an unknown channel offset that complicates data recovery.
Resistance distribution shifts due to process variation and thermal fluctuations.

Traditional systems rely on Hard-Decision Decoding (HDD) for short linear block codes like Hamming or BCH codes. While simple, HDD fails to account for the asymmetric nature of the STT-MRAM channel and the dynamic shifts in resistance states.

Proposed Methodology

The authors propose a comprehensive three-stage approach to enhance decoding performance:

1. Channel Symmetrization

To overcome the "curse of dimensionality" in training neural decoders—which typically requires training on all possible codewords—the researchers implemented an i.i.d. channel adapter. This "symmetrizes" the channel, allowing the neural network to be trained effectively using only the all-zero codeword, significantly reducing training complexity.

2. NN-based Soft Information Generation Method (SIGM)

To address unknown thermal offsets, a Recurrent Neural Network (RNN) is employed to estimate the optimal hard-decision threshold. A multi-bit quantizer is then constructed around this threshold to generate Log-Likelihood Ratios (LLRs), providing the "soft" information necessary for advanced decoding.

3. NNORB-MS Decoder

The core of the framework is the Neural Normalized Offset-based Min-Sum (NNORB-MS) decoder. This "deep unfolded" version of the standard Min-Sum algorithm treats decoding iterations as layers in a neural network. It introduces two learnable parameters—an offset ($\beta$) and a normalization factor ($\delta$)—which are trained to compensate for errors introduced by short cycles in the code's Tanner graph.

Experimental Results

The framework was evaluated using simulated STT-MRAM resistance data based on physical stochastic models. The (71, 64) Hamming code, a standard in commercial MRAM, was used for benchmarking.

Bit Error Rate (BER) performance comparison under unknown channel offsets.

Key findings include:

  • Performance Gain: In channels without offset, the NNORB-MS decoder improves the maximum affordable resistance spread by 1.7% at a BER of $10^{-5}$ compared to HDD.
  • Thermal Robustness: Under unknown thermal offsets, the SIGM approach significantly outperforms the conventional "reference cell" method, as shown in the performance comparison above.
  • Hardware Efficiency: The decoder is designed for practical implementation, utilizing only integer and logic operations, ensuring low latency and power consumption comparable to traditional non-DL decoders.

Conclusion and Future Directions

This work demonstrates that deep learning can significantly enhance the reliability of STT-MRAM. By symmetrizing the channel and unfolding the decoding process, the proposed framework provides a robust solution to manufacturing and thermal variations. Future research may focus on scaling this approach to longer codes like LDPC and providing detailed hardware synthesis reports to further validate its commercial viability.

Summary updated

Abstract

Thanks to its superior features of fast read/write speed and low power consumption, spin-torque transfer magnetic random access memory (STT-MRAM) has become a promising non-volatile memory (NVM) technology that is suitable for many applications. However, the reliability of STT-MRAM is seriously affected by the variation of the memory fabrication process and the working temperature, and the later will lead to an unknown offset of the channel. Hence, there is a pressing need to develop more effective error correction coding techniques to tackle these imperfections and improve the reliability of STT-MRAM. In this work, we propose, for the first time, the application of deep-learning (DL)-based algorithms and techniques to improve the decoding performance of linear block codes with short codeword lengths for STT-MRAM. We formulate the belief propagation (BP) decoding of linear block code as a neural network (NN) and propose a novel neural normalized-offset reliability-based min-sum (RB-MS) (NNORB-MS) decoding algorithm. We successfully apply our proposed decoding algorithm to the STT-MRAM channel through channel symmetrization to overcome the channel asymmetry. We also propose an NN-based soft information generation method (SIGM) to take into account the unknown offset of the channel. Simulation results demonstrate that our proposed NNORB-MS decoding algorithm can achieve significant performance gain over both the hard-decision decoding (HDD) and the regular RB-MS decoding algorithm, for cases without and with the unknown channel offset. Moreover, the decoder structure and time complexity of the NNORB-MS algorithm remain similar to those of the regular RB-MS algorithm.
BibTeX
@article{zhong2020deep,
  author = {Xingwei Zhong and Kui Cai and Zhen Mei and Tony Q. S. Quek},
  title = {{Deep Learning-Based Decoding of Linear Block Codes for Spin-Torque Transfer Magnetic Random Access Memory (STT-MRAM)}},
  journal = {IEEE Transactions on Magnetics},
  year = {2020},
  doi = {10.1109/tmag.2020.3021405},
}
Figure