Introduction
3D Gaussian Splatting (3D GS) has emerged as a powerful technique for real-time neural rendering, offering an explicit and fast-to-render scene representation. However, the quality of this representation is often hampered by "messy" Gaussians—elements that are either excessively large or extremely elongated (needle-shaped). These issues lead to visual artifacts during scene editing and result in sparse, uneven point clouds. This paper presents a mathematically rigorous, closed-form algorithm designed to split these problematic Gaussians into smaller, uniform components while strictly preserving the original visual appearance.
The Challenge: Scale and Structural Inhomogeneity
While 3D GS provides high-fidelity rendering, it suffers from two primary forms of "inhomogeneity" that limit its utility for downstream geometric tasks:
- Scale Inhomogeneity: Large Gaussians can create "voids" or gaps, making it difficult to extract dense, high-quality point clouds from the model.
- Structural Inhomogeneity: Gaussians often become needle-like. During interactive editing, such as slicing an object, these elongated shapes produce blurred edges or protruding "spurs," ruining the precision of the edit.
Traditional methods for increasing Gaussian density typically involve simple copying and scaling, which fails to address these underlying shape deformities and can lead to training instability or visual artifacts during interactive manipulation.
The Proposed Splitting Algorithm
The authors introduce a novel splitting algorithm based on a 3D plane. The core principle is the conservation of visual appearance across the split. By treating the split as a conservation problem, the algorithm ensures that the resulting smaller Gaussians are visually indistinguishable from the original from any perspective. This is achieved by preserving three fundamental mathematical moments:
- Zero-order moment: Conserves cumulative distribution of opacity.
- First-order moment: Conserves the visual center (position).
- Second-order moment: Conserves the mean of the outer product matrix (covariance/shape).
By formulating these conservation laws as integral tensor equations, the researchers derived a closed-form solution. This allows for the instantaneous calculation of new parameters (opacity, position, and anisotropic covariance) without the need for iterative optimization or additional training. The implementation also includes safeguards to maintain physical validity, ensuring covariance matrices remain positive definite despite floating-point precision constraints.
Experimental Evaluation
The algorithm was benchmarked using the standard NeRF Synthetic Dataset. The results demonstrate significant improvements across three key areas: interactive editing, training quality, and geometric reconstruction.
Cleaner Editing and Rendering
In tasks involving curve removal and plane splitting, the method eliminated the "adhesion" artifacts typical of standard 3D GS. Quantitative metrics for "interval error" and "external excess" were significantly lower than baselines. Furthermore, integrating the split algorithm into the standard training loop improved rendering quality across the board:
- PSNR: Improved from 36.93 to 37.19
- SSIM: Increased from 0.9825 to 0.9839
- LPIPS (Error): Decreased from 0.0236 to 0.0216
Enhanced Point Cloud Extraction
The algorithm effectively fills gaps in untextured regions, producing point clouds that are significantly more uniform. This makes the resulting 3D GS models much more suitable for traditional geometry processing tasks, such as normal estimation and mesh conversion.
Conclusion and Future Work
By providing a mathematically grounded way to subdivide Gaussians, this work bridges the gap between high-speed neural rendering and precise geometric editing. While the current focus is on splitting, future research may explore the inverse process—merging Gaussians—to enable better model compression. Additionally, extending the planar split logic to handle complex curved surfaces directly could further enhance the precision of geometric modifications in 3D Gaussian Splatting.
Summary updated