Orienting point clouds with dipole propagation

Gal Metzer, Rana Hanocka, Denis Zorin, Raja Giryes, Daniele Panozzo, Daniel Cohen-Or

TL;DR

This paper introduces a two-phase approach to solve the "normal orientation" problem in point clouds—determining which way is "out" for every point. By combining a neural network for local consistency with a physics-inspired "dipole propagation" for global alignment, the method produces robust, consistently oriented normals even in the presence of heavy noise, sharp features, and complex geometries.

What Problem Does This Paper Address?

In computer graphics, 3D shapes are often captured as "point clouds"—unstructured collections of $(x, y, z)$ coordinates. To turn these points into a solid surface (a process called surface reconstruction), we need to know the normal vector at each point. Specifically, these normals must be oriented consistently, meaning they all point outward from the shape's interior.

This is notoriously difficult because:

  1. Local Ambiguity: A flat patch of points looks the same whether the normal points "up" or "down." You need global context to decide.
  2. Greedy Failure: Traditional methods (like Minimum Spanning Trees) propagate orientation from point to point. If one point is oriented incorrectly due to noise, that error "bleeds" through the rest of the shape.
  3. Complex Geometry: Nearby surfaces (like the two sides of a thin leaf) or sharp corners often confuse algorithms into "short-circuiting" the orientation across the wrong gap.

Methods

The authors propose a "divide and conquer" strategy that separates local coherency from global orientation.

1. Local Phase: Coherent Neural Patches

The point cloud is partitioned into small, overlapping patches. The authors train an ensemble of PointCNN neural networks to ensure that all points within a single patch point the same way (either all in or all out). The network doesn't decide the global "truth" yet; it just ensures internal agreement and outputs a confidence score for each point.

2. Global Phase: Dipole Propagation

This is the core innovation. Instead of a greedy point-to-point walk, the authors treat each oriented patch as an electric dipole.

  • The Field: Already-oriented patches create a global electric field (a harmonic potential).
  • The Propagation: To orient a new patch, the algorithm measures its interaction with the existing field. If the patch's current orientation "disagrees" with the cumulative field of all previously oriented patches, it is flipped.
  • Stability: Because the decision is based on the entire field rather than just the nearest neighbor, the method is incredibly robust to local errors or noise.

3. Final Diffusion

After all patches are oriented, a final diffusion step uses the global field to "clean up" any individual points that the neural network might have missed or misclassified.

Datasets

  • Training: The model was trained on 60 watertight meshes (including manufactured shapes from the Thingi10K set and non-rigid human scans). This resulted in 1,410 training patches, which were heavily augmented with noise and different reference points.
  • Evaluation: The method was tested on:
  • Scanned Data: Large-scale scans from the "Three D Scans" (Laric) repository.
  • Neural-Generated Clouds: Points produced by shape generation and completion networks (like EC-Net and PC-GAN) which typically lack normal information.
  • Massive Clouds: Stress-tested on point clouds with over 10 million points.

Key Insights and Ideas

  • Physics as a Regularizer: By framing orientation as a dipole interaction, the authors tap into the properties of the Poisson equation. The resulting field naturally converges toward the "winding number" of the shape—a topological measure of what is inside vs. outside.
  • Moving Beyond Greed: Traditional MST methods are "greedy"—they make a local choice and never look back. Dipole propagation is "less greedy" because every new orientation is informed by the sum of all previous orientations.
  • Confidence Weighting: The neural network doesn't just flip points; it provides a confidence score ($c_i$). The dipole propagation weights points by this confidence, effectively letting the "certain" parts of the geometry guide the "uncertain" parts (like noisy or sparse regions).

Key Results

  • Robustness: The method successfully orients shapes where previous state-of-the-art methods (like Hoppe’s or König’s) fail, particularly near sharp features and thin, double-sided surfaces.
  • Accuracy: In quantitative benchmarks, the method achieved an average of 96% correctly oriented normals, significantly outperforming the "No Net" baseline (74%) and existing MST-based solvers.
  • Scalability: The algorithm scales linearly with the number of patches. It processed a 1-million-point scan in 13 minutes, whereas competing global optimization methods (like QPBO) took 90 minutes and produced more errors.
  • Downstream Success: Using the oriented normals from this method as input for Poisson Surface Reconstruction (PSR) resulted in much cleaner, more accurate 3D meshes compared to other orientation techniques.

Limitations and Future Work

  • Internal Structures: The current method is designed for "watertight" manifolds (shapes with a clear inside and outside). It struggles with "polygon soups"—complex models with many intersecting internal surfaces or protrusions (e.g., the complex interior of a CAD model).
  • Patch Size Sensitivity: While the method is robust, the initial voxel-based partitioning size can affect performance on extremely thin or highly detailed features.
  • Future Direction: The authors suggest combining this dipole approach with visibility-based methods (which use camera/scanner position data) to handle even more ambiguous "un-closable" surfaces.

Summary updated

Abstract

Establishing a consistent normal orientation for point clouds is a notoriously difficult problem in geometry processing, requiring attention to both local and global shape characteristics. The normal direction of a point is a function of the local surface neighborhood; yet, point clouds do not disclose the full underlying surface structure. Even assuming known geodesic proximity, calculating a consistent normal orientation requires the global context. In this work, we introduce a novel approach for establishing a globally consistent normal orientation for point clouds. Our solution separates the local and global components into two different sub-problems. In the local phase, we train a neural network to learn a coherent normal direction per patch (i.e., consistently oriented normals within a single patch). In the global phase, we propagate the orientation across all coherent patches using a dipole propagation. Our dipole propagation decides to orient each patch using the electric field defined by all previously orientated patches. This gives rise to a global propagation that is stable, as well as being robust to nearby surfaces, holes, sharp features and noise.
BibTeX
@article{metzer2021orienting,
  author = {Gal Metzer and Rana Hanocka and Denis Zorin and Raja Giryes and Daniele Panozzo and Daniel Cohen-Or},
  title = {{Orienting point clouds with dipole propagation}},
  journal = {ACM Trans. Graphics},
  year = {2021},
  doi = {10.1145/3450626.3459835},
}

Loading related content...

Figure