Hypnos: A Dual-Phase End-to-End Platform for Scalable Continual Learning at the Edge

Guilherme Guedes, Marco Apolinario Lainez, Charlotte FrenkelarXiv 2026 · arXiv

TL;DR

Hypnos is an open-source platform that enables scalable continual learning on resource-constrained edge devices by mimicking the brain's wake-sleep cycles. It uses lightweight, gradient-free adaptation during daily operation ("wake") and offloads compute-intensive knowledge consolidation to a "smart charger" at night ("sleep"), achieving state-of-the-art accuracy on real-world image streams.

What Problem Does This Paper Address?

Deep learning models typically follow a "train-then-deploy" paradigm. However, real-world edge devices—like smartwatches or industrial sensors—often encounter data distributions that drift over time. To stay relevant, these devices need Continual Learning (CL): the ability to learn from new data without forgetting what they already know (a phenomenon called "catastrophic forgetting").

Porting CL to the edge is notoriously difficult for two reasons:

  1. The Online Nature of Data: Sensors produce data one sample at a time. The device must adapt on-the-fly without the luxury of massive, shuffled datasets.
  2. Resource Constraints: Traditional training via error backpropagation is too power-hungry and memory-intensive for tiny microcontrollers (MCUs).

Existing solutions either offload learning to the cloud (raising privacy and latency concerns) or try to do everything on-device at the cost of severe forgetting or massive memory overhead.

![Fig.

  1. (a) Performance/availability view of continual adaptation at the edge. Top: offline adaptation, where consolidation is offloaded to the cloud and the device is unavailable (shaded) whenever new data must be learned. Middle: fully on-device learning keeps the device available with online adaptation, at the cost of increased catastrophic forgetting. Bottom: proposed hybrid scheme, lightweight on-device learning during daily use (wake) with consolidation on the smart charger (sleep), combining the availability of online methods with offline-like accuracy. (b) Proposed device–charger system realizing hybrid adaptation, combining (i) a low-footprint edge device for online adaptation with (ii) a smart charger augmented with additional compute and memory budgets for offline consolidation.](/figures/art_8339c1dca0644f318464d058419eaa95)

Methods

The authors introduce Hypnos, a dual-phase system that splits the learning process into two distinct modes:

1. The Wake Phase (On-Device Adaptation)

During daily use, the device remains fully operational. It uses a frozen MobileNetV3 backbone to extract features. Instead of expensive backpropagation, it employs prototype-based learning. Each class is represented by a "prototype" vector in the latent space (the running mean of features seen so far). New samples are classified by finding the nearest prototype.

To prepare for the "sleep" phase, the device uses Product Quantization (PQ) to compress incoming latent features by 40$\times$, storing them in a small on-device buffer.

2. The Sleep Phase (Smart Charger Consolidation)

When the device is plugged in at night, it transfers its compressed buffer to a Smart Charger. This charger has a higher power and memory budget. It decodes the samples and performs latent replay: it interleaves new samples with a small subset of old ones to retrain the "plastic" head of the network (the embedder and classifier) using standard gradient descent. This consolidates new knowledge while preventing the model from forgetting old tasks.

Hardware-Algorithm Co-Design

The system is built on a custom System-on-Chip (SoC) featuring:

  • An X-HEEP RISC-V MCU.
  • A Quadrilatero matrix co-processor for dense point-wise convolutions.
  • A custom wake-phase accelerator designed to handle "messy" operations like depth-wise convolutions, requantization, and the PQ encoding/decoding that standard matrix engines handle inefficiently.

Datasets

The platform was evaluated using the CORe50 benchmark (specifically the NICv2-391 protocol). This dataset is designed for edge CL, featuring 50 objects recorded across different environments (varying background, lighting, and pose) delivered in a non-stationary, single-pass stream.

Key Insights and Ideas

  • The "Smart Charger" as a Compute Tier: By treating the charger as a specialized compute node, the authors bypass the battery and memory limits of the edge device without relying on the cloud.
  • Decoupling Adaptation from Consolidation: Prototype-based learning is "cheap" enough for real-time use but prone to forgetting. Latent replay is "expensive" but robust. Using both in a cycle provides the best of both worlds.
  • PQ for Latent Buffering: Product Quantization is the "aha" moment for memory management. It allows the device to store thousands of samples in just a few megabytes, making on-device buffering for later replay feasible.
  • Hardware Efficiency: The custom accelerator accounts for only 10.7% of the device area but significantly reduces the clock cycles needed for the "wake" phase by offloading vector-heavy operations from the main CPU.

Key Results

Hypnos was prototyped on a Xilinx ZCU104 FPGA and synthesized in a 28-nm process.

  • Accuracy: Achieved 78.6% to 81.6% accuracy on CORe50, setting a new state-of-the-art for edge CL systems.
  • Efficiency: Compared to standard quantized latent replay, Hypnos requires 3.8$\times$ fewer learning steps and 22$\times$ less learning compute.
  • Latency: On-device latency ranges from 7.79s to 10.54s per sample, depending on the chosen activation precision (INT8 vs. INT16).
  • Physical Footprint: The synthesized edge device occupies 9.43 mm² and consumes only 33.3 mW at 375 MHz.

Limitations and Future Work

  • Charger Dependency: The consolidation phase requires the device to be plugged into a specific "smart" charger. If a user doesn't charge the device or uses a "dumb" charger, the consolidation (and thus the long-term accuracy) could suffer.
  • Frozen Backbone: Currently, only the "head" of the network is plastic. While this is efficient, it limits the model's ability to adapt to extremely novel feature distributions that the frozen backbone might not represent well.
  • Future Directions: The authors suggest exploring more aggressive quantization and extending the platform to handle other modalities beyond image classification, such as temporal sensor data.

Summary updated

Abstract

Continual learning (CL) enables neural networks to adapt to non-stationary data streams by mitigating catastrophic forgetting, offering a path to robust, private, and adaptable edge devices. Yet, porting CL to real-world edge devices remains challenging for two reasons: (i) online operation, where sensor data arrives one sample at a time and the device must adapt on-the-fly, and (ii) the low footprint of edge devices, which makes traditional error backpropagation training prohibitive. Inspired by the brain's wake and sleep cycles, the former for rapid adaptation with minimal resources and the latter for long-term consolidation, we introduce Hypnos, an open-source dual-phase platform for efficient CL at the edge. In the wake phase (e.g., daily operation), Hypnos relies on a low-footprint system-on-chip with a RISC-V microcontroller unit (MCU) targeting efficient inference and supporting lightweight gradient-free prototype updates. In the sleep phase (e.g., night-time charging), where wall-plug energy and larger memory budgets are available, a smart charger performs rehearsal-based gradient updates for consolidation. Deployed on a ZCU104 field-programmable gate array (FPGA) and synthesized in a 28-nm process, Hypnos is benchmarked on the CORe50 NICv2-391 protocol. It sets a new state-of-the-art accuracy of 78.6%-81.6% for edge CL systems, with an on-device latency of 7.79s-10.54s per sample depending on activation precision, and requires $3.8\times$ fewer learning steps and $22\times$ less learning compute than quantized latent replay at higher accuracy and comparable latency.
BibTeX
@misc{guedes2026hypnos,
  author = {Guilherme Guedes and Marco Apolinario Lainez and Charlotte Frenkel},
  title = {{Hypnos: A Dual-Phase End-to-End Platform for Scalable Continual Learning at the Edge}},
  year = {2026},
  eprint = {2611.24637},
  archivePrefix = {arXiv},
  url = {https://arxiv.org/abs/2611.24637},
}
Figure