Optoelectronic Recurrent Neural Network Using Optical–Electrical–Optical Converters With RC Delay

Masaya Arahata, Shota Kita, Kazuo Aoyama, Akihiko Shinya, Hiroshi Sawada, Masaya Notomi

TL;DR

Researchers have discovered that the inherent resistive-capacitive (RC) delay in optoelectronic converters—traditionally viewed as a performance bottleneck—can actually improve the performance of optical recurrent neural networks (RNNs). By acting as a form of temporal memory, this delay compensates for signal losses in the optical loop and stabilizes training against gradient vanishing and explosion.

What Problem Does This Paper Address?

Optical Neural Networks (ONNs) promise ultra-low latency and high energy efficiency by processing information at the speed of light. Recurrent versions (RNNs) are particularly attractive for time-series data (like speech or financial forecasting) because their feedback loops allow for compact hardware designs.

However, optical RNNs face a major hurdle: loop loss. As light circulates through the feedback loop, it attenuates. To fix this, researchers use Optical-Electrical-Optical (OEO) converters to provide gain and non-linear activation. The catch? These converters have an inherent RC delay caused by the physical capacitance and resistance of the photodetectors and modulators. Conventional wisdom suggests this delay would smear signals and degrade performance. This paper asks: Is RC delay actually an obstacle, or can we turn this physical limitation into a computational advantage?

Methods

The authors modeled an Elman-type optoelectronic RNN (OE-RNN) and conducted extensive simulations to analyze the interplay between loop gain ($\beta$) and RC delay ($\alpha$).

Key components of their architecture include:

  • Unitary Hidden Units: They used a "Clements circuit" (a mesh of Mach-Zehnder interferometers) to implement a unitary matrix $W$, which is a standard trick to keep gradients stable during training.
  • OEO Modeling: The OEO converter was modeled as a linear time-invariant system where the output signal at time $t$ is a combination of the current input and an exponentially decaying "memory" of previous inputs (the RC delay).
  • Theoretical Framework: They applied the chain rule to the network's loss function to derive a stability condition. They found that the effective transition matrix of the network is $S \equiv \beta W + \alpha I$. To prevent gradients from vanishing or exploding, the eigenvalues of $S$ should stay near an absolute value of 1.
Schematic of the OE-RNN architecture and the OEO unit with RC delay

Datasets

The team evaluated their model using two standard computer vision benchmarks adapted for time-series processing:

  1. MNIST: Handwritten digits (0-3).
  2. Fashion-MNIST: Images of clothing items.

To turn these 2D images into 1D time-series data suitable for an RNN, they performed a Fast Fourier Transform (FFT) on the images and selected the top components as sequential inputs.

Key Insights and Ideas

  • The "Memory" Effect: RC delay isn't just a lag; it's an accumulation of past time-series data. This accumulation acts as a buffer that maintains information even when the primary signal is weakened by loop losses.
  • Hardware-Software Synergy: The most striking finding is that RC delay can "rescue" a network suffering from high loop loss. Mathematically, the RC delay ($\alpha$) adds to the diagonal of the weight matrix, pushing the eigenvalues back toward the stable zone ($|\lambda| \approx 1$).
  • The Stability Region: The authors identified a specific mathematical relationship: high training accuracy is achievable when the loop gain $\beta$ and delay $\alpha$ satisfy the inequality: $$- \alpha + 1 \leq \beta \leq \alpha + 1$$ This provides a clear design rule for engineers building these circuits.
Heatmap showing the region of high test accuracy relative to loop gain and RC delay

Key Results

  • Loss Compensation: In simulations of a 4×4 OE-RNN, accuracy plummeted when loop gain was low ($\beta < 1$) and delay was zero. However, increasing the RC delay restored accuracy to nearly 80%, matching the performance of a lossless system.
  • Scalability: The researchers successfully scaled the simulation up to a 32×32 circuit. Across all scales (8×8, 16×16, and 32×32), the "compensation effect" of the RC delay remained consistent for both MNIST and Fashion-MNIST tasks.
  • Robustness: The network achieved high accuracy even when the RC delay was comparable to the time interval of the input data, proving that high-speed operation doesn't require "perfect" (zero-delay) components.
Scalability results showing consistent performance across different circuit sizes

Limitations and Future Work

  • Simulation-Based: While the authors discuss the experimental feasibility of various OEO converters (like PhC cavity-EOMs), the current results are based on numerical simulations. Physical implementation on a silicon photonic chip is the next logical step.
  • Pulse Width Assumptions: The model assumes an "impulse response" where input pulses are much shorter than the RC time constant. While they discuss finite pulse responses, real-world jitter and pulse-shaping effects need further study.
  • Task Complexity: While MNIST and Fashion-MNIST are good proofs of concept, testing the OE-RNN on more complex, "natural" time-series data (like real-time speech processing) would further validate the approach.

Summary updated

Abstract

Optical neural networks (ONNs) have been attracting attention due to their low latency and low power consumption. Optical recurrent neural networks (RNNs) enable low-power and high-speed time-series data processing, often using a compact loop structure. The loop losses then need to be efficiently compensated to maintain the time-series information during RNN operation. We thus focus on an optoelectronic RNN (OE-RNN) with optical–electrical–optical (OEO) converters to compensate for the loop losses. However, the effect of resistive–capacitive (RC) delay of the OEO converters on RNN performance is unclear. Here, we propose a scheme that involves modeling an OE-RNN equipped with OEO converters with RC delay and study its effectiveness through theoretical analysis and simulation. We confirm that the modeled OE-RNN achieves a high training accuracy of time-series data classification even when RC delay is comparably large with respect to the time interval of time-series data. Our analyses reveal that the accumulation of time-series data by RC delay does not significantly degrade RNN performance but compensates for degraded RNN performance due to loop losses even with the noise and nonlinearity of OEO converters. From the theoretical analysis on the gradient explosion and vanishing problems, we find the region related to loss and RC delay where high training accuracy can be achieved. In simulation, we confirm this compensation effect in large OE-RNN circuits up to 32×32 scale. Our proposed scheme opens a new means of time-series data processing by utilizing RC delay for optical computing and optical communication.
BibTeX
@article{arahata2025optoelectronic,
  author = {Masaya Arahata and Shota Kita and Kazuo Aoyama and Akihiko Shinya and Hiroshi Sawada and Masaya Notomi},
  title = {{Optoelectronic Recurrent Neural Network Using Optical–Electrical–Optical Converters With RC Delay}},
  journal = {Journal of Lightwave Technology},
  year = {2025},
  doi = {10.1109/jlt.2025.3629691},
}
Figure