Temporal correlation detection using computational phase-change memory

Abu Sebastian, Tomáš Tůma, Nikolaos Papandreou, Manuel Le Gallo, Lukas Kull, Thomas Parnell, Evangelos Eleftheriou

This paper from the IBM Research – Zurich team presents a significant milestone in the field of non-von Neumann computing. By moving beyond the "memory as a passive bucket" paradigm, the researchers demonstrate how the physical dynamics of one million phase-change memory (PCM) devices can be harnessed to perform complex statistical tasks—specifically, detecting temporal correlations—directly within the memory array.

TL;DR

Researchers have demonstrated a large-scale "computational memory" system using one million phase-change devices that detects correlations in massive data streams. By exploiting the natural crystallization physics of the memory material, they performed high-level machine learning tasks in-place, potentially offering a 200x speedup over conventional CPU/GPU architectures.

What Problem Does This Paper Address?

Modern computing is hitting a wall known as the von Neumann bottleneck. In standard computers, the processing unit (CPU) and memory are physically separate. As our tasks become more data-centric (think IoT, social media, and real-time sensors), we spend a disproportionate amount of time and energy shuttling data back and forth between these two units.

The authors propose a "computational memory" approach where the memory devices themselves perform the math. The challenge lies in finding a way to map abstract mathematical operations—like calculating a covariance matrix to find correlations—onto the messy, stochastic physics of nanoscale hardware.

Methods

The team utilized Phase-Change Memory (PCM). PCM stores data by switching a material (typically a chalcogenide glass) between an amorphous state (high resistance) and a crystalline state (low resistance).

The "secret sauce" here is the crystallization dynamics. When you apply a "SET" electrical pulse to a PCM device, the amorphous region shrinks slightly, and the device's conductance increases. The authors discovered that if you apply pulses to a device based on the "collective momentum" of multiple data streams, the resulting change in the device's conductance is mathematically equivalent to an estimate of the correlation between those streams.

They built a prototype platform featuring:

  • A 90nm CMOS chip with 3 million PCM devices.
  • FPGA-based controllers to manage data flow.
  • An algorithm that translates binary stochastic processes into specific electrical pulses (modulating either duration or amplitude).

Datasets

The researchers evaluated their system using two primary datasets:

  1. Synthetic "Einstein" Dataset: One million artificial binary stochastic processes. A subset of these (about 9.5%) were mutually correlated to form a 1000x1000 pixel image of Albert Einstein and his signature.
  2. Real-World Weather Data: Rainfall data from 270 NOAA weather stations across the USA, collected hourly over six months (approx. 4,344 time steps).

Key Insights and Ideas

  • Physics as Computation: Instead of using logic gates to solve equations, the researchers let the accumulation of atoms in a crystal lattice do the integration. The device's internal state variable (the thickness of the amorphous region) acts as a natural accumulator.
  • Massive Parallelism: Because the pulses can be applied to the entire memory array simultaneously, the system can process millions of data streams in parallel.
  • The "Collective Momentum" Trick: By calculating the sum of all active processes at a given time and using that to determine the pulse strength, the system "imprints" the correlation coefficient directly into the device conductance.
  • Robustness to Noise: Despite the inherent variability and "noise" in nanoscale devices, the statistical nature of the correlation task means the system still achieves high accuracy.

Key Results

  • Image Recovery: The system successfully identified the 95,525 correlated processes out of a million, effectively "developing" the Einstein image from what looked like pure noise.
  • Weather Correlation: In the rainfall experiment, the computational memory identified geographical clusters of weather stations. Its results matched a standard $k$-means clustering algorithm for 245 out of 270 stations, but with significantly less computational overhead.
  • Performance Leap: The authors estimate that a dedicated computational memory module could accelerate correlation detection tasks by a factor of 200x compared to a high-end system using POWER8 CPUs and Nvidia P100 GPUs.

Limitations and Future Work

While impressive, the technology faces several hurdles:

  • Dynamic Range: PCM devices eventually saturate (they become fully crystalline), meaning the "memory" of the correlation has a limited window before the device needs to be RESET.
  • Device Variability: There is significant "inter-device" variability (no two PCM devices are identical) and "intra-device" variability (conductance can drift over time).
  • Endurance: While SET pulses are less taxing than RESET pulses, the long-term reliability of these devices under constant "computational" pulsing needs further study.
  • Next Steps: The authors suggest extending this to other primitives, such as matrix-vector multiplication, and exploring "projected" PCM devices to minimize noise and drift.

Summary updated

Abstract

Conventional computers based on the von Neumann architecture perform computation by repeatedly transferring data between their physically separated processing and memory units. As computation becomes increasingly data centric and the scalability limits in terms of performance and power are being reached, alternative computing paradigms with collocated computation and storage are actively being sought. A fascinating such approach is that of computational memory where the physics of nanoscale memory devices are used to perform certain computational tasks within the memory unit in a non-von Neumann manner. We present an experimental demonstration using one million phase change memory devices organized to perform a high-level computational primitive by exploiting the crystallization dynamics. Its result is imprinted in the conductance states of the memory devices. The results of using such a computational memory for processing real-world data sets show that this co-existence of computation and storage at the nanometer scale could enable ultra-dense, low-power, and massively-parallel computing systems.
BibTeX
@inproceedings{sebastian2017temporal,
  author = {Abu Sebastian and Tomáš Tůma and Nikolaos Papandreou and Manuel Le Gallo and Lukas Kull and Thomas Parnell and Evangelos Eleftheriou},
  title = {{Temporal correlation detection using computational phase-change memory}},
  booktitle = {Nature Communications},
  year = {2017},
  doi = {10.1038/s41467-017-01481-9},
}

Loading related content...

Figure