RBER-Aware Lifetime Prediction Scheme for 3D-TLC NAND Flash Memory

Ruixiang Ma, Fei Wu, Meng Zhang, Zhonghai Lu, Jiguang Wan, Changsheng XieIEEE Access 2019 · OpenReview

Abstract

NAND flash memory is widely used in various computing systems. However, flash blocks can sustain only a limited number of program/erase (P/E) cycles, which are referred to as the endurance. On one hand, in order to ensure data integrity, flash manufacturers often define the maximum P/E cycles of the worst block as the endurance of flash blocks. On the other hand, blocks exhibit large endurance variations, which introduce two serious problems: over-provisioned error correcting code (ECC) and underutilized block lifespan. In this paper, to exploit the storage capacity of each flash block, we propose an RBER-aware lifetime prediction scheme based on machine learning technologies. We use incremental learning to update the model for adapting the changes at different lifetime stages. Experimental results show that the support vector machine (SVM) models based on our proposed scheme can achieve as high as 95% accuracy. Furthermore, applying this scheme to predict actual endurance at different retention times can improve the maximum P/E cycle of flash blocks from 37.5% to 86.3% on average.

Introduction: The Endurance Bottleneck

NAND flash memory is a consumable resource; every time you program or erase (P/E) data, the physical structure of the memory cell degrades. Traditionally, manufacturers define a "nominal endurance"—a maximum number of P/E cycles—after which a block is considered unreliable. However, this limit is extremely conservative. Because of manufacturing variations, some blocks are much more resilient than others. To ensure data integrity, manufacturers set limits based on the worst-performing block, leading to significant underutilization of the storage medium.

The Problem: Conservative Limits and Underutilization

Setting endurance limits based on the worst-case scenario leads to two major inefficiencies. First, most blocks are retired while they still have significant healthy life remaining. Second, Error Correcting Codes (ECC) are over-provisioned to handle these worst-case scenarios, which increases decoding latency for every read operation, even on healthy blocks.

Distribution of RBER across flash blocks, highlighting the significant variation that makes conservative limits inefficient.

As shown in the distribution of Raw Bit Error Rates (RBER), there is a wide variance in block health. The authors aim to solve this by predicting the RBER—the actual health metric—of each individual block in real-time using machine learning.

Methodology: Predicting Health in Real-Time

The researchers proposed an RBER-aware lifetime prediction scheme using four machine learning models: Support Vector Machines (SVM), Random Forests (RF), Multi-layer Perceptrons (MLP), and Long Short-Term Memory (LSTM) networks. The core of their approach involves:

  • Feature Selection: Using P/E cycles and retention time (how long data sits in the cell) as primary inputs. Retention time is critical because voltage distributions shift over time, as illustrated below.
  • Data Smoothing: Utilizing Exponentially Weighted Moving Average (EWMA) to filter out environmental noise in RBER data.
  • Incremental Learning: To combat "model aging," the system monitors prediction accuracy ($R^2$). If it drops below 0.9, the model is automatically retrained using the most recent data from the flash controller.
Probability distributions of threshold voltages before and after retention time, showing the shifts that lead to increased RBER.

Key Results and Insights

The study utilized a custom test platform with real 512G 3D-TLC NAND flash chips. Key findings include:

  • SVM Efficiency: While LSTM models were stable, they were computationally expensive. SVM provided a 95% accuracy rate with significantly lower time overhead, making it the most practical choice for integration into SSD controllers.
  • Lifespan Extension: By using predicted endurance instead of nominal limits, the usable P/E cycles improved by an average of 37.5% to 86.3% across various retention scenarios.
  • Dynamic Updating: The incremental learning strategy successfully kept the $R^2$ value above 0.9 throughout the entire lifespan, whereas static models saw accuracy plummet as blocks aged physically.

Conclusion

This research demonstrates that moving away from "one-size-fits-all" endurance limits can significantly extend the life of 3D-NAND flash. Future work may involve implementing "Adaptive ECC," where error correction strength is adjusted based on the predicted health of specific blocks, potentially reducing overall system latency. While hardware overhead remains a consideration, the potential for nearly doubling the usable lifespan of flash storage presents a compelling case for ML-integrated memory controllers.

Summary updated

Abstract

NAND flash memory is widely used in various computing systems. However, flash blocks can sustain only a limited number of program/erase (P/E) cycles, which are referred to as the endurance. On one hand, in order to ensure data integrity, flash manufacturers often define the maximum P/E cycles of the worst block as the endurance of flash blocks. On the other hand, blocks exhibit large endurance variations, which introduce two serious problems. The first problem is that the error correcting code (ECC) is often over-provisioned, as it has to be designed to tolerate the worst case to ensure data integrity, which causes longer decoding latency. The second problem is the underutilized block's lifespan due to conservatively defined block endurance. Raw bit error rate (RBER) of most blocks have not arrived the allowable RBER based on the nominal endurance point, which implies that the conventional P/E cycle-based block retirement policies may waste large flash storage space. In this paper, to exploit the storage capacity of each flash block, we propose an RBER-aware lifetime prediction scheme based on machine learning technologies. We consider the problem that the model can lose prediction effectiveness over time and use incremental learning to update the model for adapting the changes at different lifetime stages. At run time, trained data will be gradually discarded, which can reduce memory overhead. For evaluating our purpose, four well-known machine learning techniques have been compared in terms of predictive accuracy and time overhead under our proposed lifetime prediction scheme. We also compared the predicted values with the tested values obtained in the real NAND flash-based test platform, and the experimental results show that the support vector machine (SVM) models based on our proposed lifetime prediction scheme can achieve as high as 95% accuracy for flash blocks. We also apply our proposed lifetime prediction scheme to predict the actual endurance of flash blocks at four different retention times, and the experimental results show that it can significantly improve the maximum P/E cycle of flash blocks from 37.5% to 86.3% on average. Therefore, the proposed lifetime prediction scheme can provide a guide for block endurance prediction.
BibTeX
@inproceedings{ma2019rber,
  author = {Ruixiang Ma and Fei Wu and Meng Zhang and Zhonghai Lu and Jiguang Wan and Changsheng Xie},
  title = {{RBER-Aware Lifetime Prediction Scheme for 3D-TLC NAND Flash Memory}},
  booktitle = {IEEE Access},
  year = {2019},
  url = {https://openreview.net/forum?id=gKfkqDJbY1},
}

Loading related content...

Figure