HoloCast: Graph Signal Processing for Graceful Point Cloud Delivery

Takuya Fujihashi, Toshiaki Koike-Akino, Takashi Watanabe, Philip V. Orlik

TL;DR

HoloCast is a "soft" transmission scheme for 3D point clouds that replaces traditional digital compression with Graph Fourier Transforms (GFT) and direct analog mapping. By treating 3D data as signals on a graph, it achieves "graceful degradation," where reconstruction quality improves linearly with wireless signal strength, successfully avoiding the catastrophic "cliff effect" of digital systems.

What Problem Does This Paper Address?

Streaming 3D point clouds—the data structures behind holographic displays and AR/VR—is incredibly bandwidth-intensive. A single uncompressed point cloud with 800,000 points can require nearly 38 Mbits.

Current delivery methods rely on digital compression (like octree-based PCL). These systems suffer from two major flaws in wireless environments:

  1. The Cliff Effect: Digital bitstreams are fragile. If the wireless channel quality (SNR) drops below a certain threshold, the decoder can't synchronize, and the 3D scene fails to reconstruct entirely.
  2. The Leveling Effect: Because digital systems use fixed quantization, the reconstruction quality hits a ceiling. Even if your wireless signal becomes perfect, the quality won't improve beyond the limits of the initial compression.

Furthermore, point clouds are "irregular"—unlike 2D images, the points aren't on a neat grid and are unordered. This makes standard compression transforms (like the Discrete Cosine Transform used in JPEGs) difficult to apply effectively.

Methods

The authors propose HoloCast, which shifts the paradigm from digital bits to "soft" analog-like transmission.

  • Graph Representation: They represent the point cloud as a weighted, undirected graph. Each 3D point is a vertex, and edges are drawn between nearby points using a Gaussian kernel to capture spatial correlations.
  • Graph Fourier Transform (GFT): Instead of standard video transforms, HoloCast uses GFT. This mathematical tool "compacts" the energy of the 3D coordinates and color attributes into a few spectral coefficients, even for non-uniformly distributed data.
  • No Quantization: Crucially, HoloCast skips the quantization and entropy coding steps.
  • Power Allocation & Analog Mapping: The GFT coefficients are scaled based on their power (to minimize Mean Squared Error) and then mapped directly to the In-phase (I) and Quadrature (Q) components of the wireless signal.
  • MMSE Decoding: At the receiver, a Minimum Mean-Square Error filter is used to suppress noise before performing an inverse GFT to reconstruct the 3D scene.

Datasets

The researchers evaluated HoloCast using three reference point clouds:

  • pencil_10_0: 2,731 points (used for primary SNR comparisons).
  • pencil_9_0: 6,712 points (used to test scalability).
  • office1: 307,200 points (used for visual quality demonstrations).

Key Insights and Ideas

  • Graceful Improvement: Because the system maps signals directly to the channel, the distortion at the receiver is directly proportional to the channel noise. This ensures that as your signal gets better, your 3D model looks better—no "cliffs" or "levels."
  • GFT is the Right Tool for Irregularity: The paper demonstrates that GFT can exploit correlations in non-ordered data much more effectively than DCT or no decorrelation at all.
  • Laplacian Variants Matter: The authors experimented with different types of Graph Laplacians (Regular, Normalized, Transition, and Random-walk). They found that the Random-walk Laplacian paired with standard deviation-based hyperparameters provided the best results for 3D coordinates.
  • Bilateral Kernels for Color: By using a bilateral kernel (considering both distance and color similarity to build the graph), they achieved an additional 6.64 dB gain in color reconstruction quality.

Key Results

  • Massive Gains over Digital: In noisy environments, HoloCast achieved up to a 39.45 dB improvement in coordinate accuracy and a 32.48 dB improvement in color accuracy compared to standard digital PCL-based delivery.
  • Visual Fidelity: In the office1 scenario, at a channel SNR of 20 dB, HoloCast reproduced a clean 3D scene, whereas the digital scheme (QPSK) showed significant color degradation and artifacts even at 10 dB.
  • Scalability: The benefits of HoloCast actually increased with the number of points. When moving from the smaller pencil_10_0 to the larger pencil_9_0 dataset, HoloCast showed even better reconstruction quality relative to the digital baseline.

Limitations and Future Work

  • Computational Complexity: Calculating the GFT requires eigen-decomposition of the Graph Laplacian. For massive point clouds (millions of points), this is computationally expensive and may require more efficient approximation methods.
  • Metadata Overhead: The paper notes that the graph structure (how points are connected) needs to be known by the receiver. Future work will need to address how to deliver this metadata efficiently without re-introducing the "cliff effect."
  • Optimization: The authors acknowledge that finding the absolute optimal weight matrix and Laplacian for any given point cloud remains an open research problem.

Summary updated

Abstract

In conventional point cloud delivery, a sender uses octree-based digital video compression to stream three-dimensional (3D) points and the corresponding color attributes over band-limited links, e.g., wireless channels, for 3D scene reconstructions. However, the digital-based delivery schemes have an issue called cliff effect, where the 3D reconstruction quality is a step function in terms of wireless channel quality. We propose a novel scheme of point cloud delivery, called HoloCast, to gracefully improve the reconstruction quality with the improvement of wireless channel quality. HoloCast regards the 3D points and color components as graph signals and directly transmits linear-transformed signals based on graph Fourier transform (GFT), without digital quantization and entropy coding operations. One of main contributions in HoloCast is that the use of GFT can deal with non-ordered and non-uniformly distributed multidimensional signals such as holographic data unlike conventional delivery schemes. Performance results with point cloud data show that HoloCast yields better 3D reconstruction quality compared to digital-based methods in noisy wireless environment.
BibTeX
@inproceedings{fujihashi2019holocast,
  author = {Takuya Fujihashi and Toshiaki Koike-Akino and Takashi Watanabe and Philip V. Orlik},
  title = {{HoloCast: Graph Signal Processing for Graceful Point Cloud Delivery}},
  booktitle = {ICC},
  year = {2019},
  url = {https://openreview.net/forum?id=mZALxlp3Vb},
}

Loading related content...

Figure