Introduction
Edge servers are increasingly evolving from simple inference endpoints into continuous learning hubs that retrain models locally to combat data drift. However, this evolution brings a massive data management burden. A single 1080p camera at 60fps can generate over 117 TiB of raw data daily. Archiving this data requires a "triple threat" of processing: compression, encryption, and redundancy (RAID).
On traditional edge hardware, these archival tasks consume significant CPU and DRAM resources, often starving the primary AI models of the compute they need to function. As shown in the table below, standard algorithms for encryption and compression impose a heavy toll on system resources.
Furthermore, the transition to a post-quantum security landscape necessitates computationally expensive lattice-based cryptography (LBC) to prevent "store now, decrypt later" attacks, further exacerbating the resource bottleneck.
System Architecture and Methods
Salient Store addresses these challenges through a hardware-software co-design that offloads heavy archival tasks to Computational Storage Devices (CSDs)—essentially SSDs integrated with on-board FPGAs. This shifts the architecture from a CPU-centric model to a data-centric one where storage acts as an active participant in the machine learning pipeline.
The system architecture relies on two primary pillars:
- Layered Neural Compression: Instead of using standard codecs like H.264, Salient Store reuses the feature vectors already generated by the AI inference pipeline (e.g., from a MobileNet backbone). By treating these features as a "latent space" for a neural autoencoder, the system effectively compresses video by only storing the "deltas" or residuals that the model couldn't predict.
- Accelerated Lattice-Based Cryptography (LBC): To future-proof data security, the authors implemented a quantum-safe encryption scheme on the CSD's FPGA. Custom hardware modules—High-Speed Schoolbook Polynomial Multiplication (HSPM) and Signed Double Modular Multiplication (SDMM)—handle the complex polynomial math required for LBC without slowing down the data flow.
Evaluation and Key Results
The researchers evaluated Salient Store using high-volume, real-world datasets relevant to autonomous driving and urban mobility, including the Kitti Vision Benchmark, nuScenes, Cityscapes, and the Waymo Open Dataset. The system's versatility was also tested with the Chime audio dataset.
Key performance metrics include:
- Efficiency Gains: Salient Store reduced communication latency by approximately 6.2× and decreased data volume by approximately 6.1× compared to classical storage baselines.
- Encryption Performance: The FPGA-accelerated lattice encryption provided a 3.2× speedup over its software counterpart and was 2.5× faster than software-based RSA.
- System Throughput: In a multi-node setup, the system achieved a 4.77× speedup against traditional video storage systems (VSS).
- Visual Quality: Despite high compression ratios, the neural codec maintained high video quality (measured via PSNR), outperforming H.264 and HEVC at various bitrates.
Discussion and Future Work
The core insight of Salient Store is the reuse of compute: the work done for AI inference is leveraged for storage efficiency rather than being discarded. By utilizing PCIe peer-to-peer communication, CSDs can communicate with each other and the main accelerator without constantly interrupting the host CPU.
While the performance gains are significant, the authors acknowledge limitations in hardware cost and power consumption. CSDs are currently significantly more expensive than standard SSDs or HDDs, and their FPGAs draw additional power. Future research will focus on optimizing these power demands and addressing network contention challenges in large-scale distributed data management protocols.
Summary updated