Scale Adaptive Anti Aliasing for Gaussian Splatting

This direction is merged into another direction: multi-scale aliasing. Its last version stays readable and citable here.

Version 1 of 120 papers20 conceptsfrozen 2026-10-04

When we render a 3D scene, we often imagine a pixel as a single ray shooting into the world. In reality, a pixel is a small area—a "footprint"—that covers a specific volume of space. As a camera moves further away, that footprint expands, encompassing more of the scene. If our underlying 3D representation doesn't account for this change in scale, the resulting images suffer from aliasing: shimmering, jagged edges, or "popping" artifacts.

Recent breakthroughs in neural rendering, particularly in 3D Gaussian Splatting (3DGS), have shifted focus toward making these representations scale-adaptive. The goal is to ensure that whether you are zooming into a blade of grass or flying over a city, the rendering remains crisp and free of noise.

The Problem of Fixed Scale

Traditional 3D Gaussian Splatting, as noted in the survey by Tong Wu 0009 and Ling-Qi Yan, represents scenes using millions of explicit 3D ellipsoids. While fast, these primitives are often optimized for the specific resolutions and distances seen during training.

When you deviate from those training views, two things happen:

  1. Minification (Zooming Out): A single pixel now covers many small Gaussians. Without proper filtering, the renderer might only "see" a few of them, leading to high-frequency noise and shimmering.
  2. Magnification (Zooming In): The Gaussians become larger than pixels, revealing their underlying shapes as "spiky" or "grainy" artifacts, a problem addressed by Samuel Rota Bulò in Hardware-Rasterized Ray-Based Gaussian Splatting.

Integrating Signal Processing into Splatting

To solve this, researchers have introduced principled signal-processing filters into the splatting pipeline. The core intuition is to treat the rendering process as a low-pass filter that adapts to the pixel's size.

Zehao Yu and Andreas Geiger pioneered this with Mip-Splatting: Alias-Free 3D Gaussian Splatting. They introduced two critical filters:

  • A 3D Smoothing Filter: This limits the maximum frequency of the 3D representation based on the training resolution, preventing "needle-like" Gaussians that cause artifacts when zooming in.
  • A 2D Mip Filter: This acts in image space, effectively enlarging the Gaussians when they become smaller than a pixel to ensure they are properly integrated into the final color.

Similarly, SA-GS by Xiaowei Song provides a "plugin" approach. Instead of retraining, it uses a scale-adaptive 2D filter at test-time to match the sampling frequency of the image plane to the scene's primitives.

Hierarchies and View-Adaptive Attributes

Beyond filtering, another direction involves making the primitives themselves "aware" of the camera's position.

In Scaffold-GS, Tao Lu and Dahua Lin anchor Gaussians to a sparse grid. Instead of fixed properties, the attributes of these Gaussians are predicted dynamically based on the viewing distance and angle. This allows the model to "morph" its level of detail, providing high-fidelity close-ups while remaining efficient for distant views.

For massive environments, PyGS by Dan Xu organizes Gaussians into a pyramid. This hierarchical structure allows the renderer to select the appropriate "layer" of Gaussians for a given distance, much like mipmaps in traditional computer graphics. Jiameng Li takes this further in Mipmap-GS by allowing Gaussians to physically deform based on scale-specific mipmaps.

Generalizing to Surfaces and Time

The need for anti-aliasing isn't limited to standard 3D points. It extends to surface reconstruction and dynamic scenes:

Why It Works: The Nyquist Intuition

The shared insight across these papers—from RM-NeRF to Mip-Grid—is the Nyquist-Shannon sampling theorem. A digital image is a sampled version of a continuous 3D scene. If the scene contains details (frequencies) higher than half the sampling rate (the pixel grid), aliasing occurs.

By introducing scale-adaptive filters or hierarchical representations, these methods effectively "pre-filter" the 3D scene. They blur out the details that are too small for the current pixel to see, ensuring that the rendered signal always matches the display's capacity. This transition from "point-based" thinking to "area-based" or "volume-based" rendering is what allows neural fields to achieve cinematic quality across all scales.

Papers in this version

History & citationVersion 1 · 2026-10-04

Merged into another direction · Permanent link

View frozen version 1

Cite this direction

Latest version (a living page):

@misc{lacuna_scale_adaptive_anti_aliasing_for_gaussia_d0dcb67e,
  title = {Scale Adaptive Anti Aliasing for Gaussian Splatting},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/scale-adaptive-anti-aliasing-for-gaussian-splatting/rdr_d0dcb67e86e74986b7332edd5cbe5e92},
  note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-21},
}

This exact version (version 1, frozen text):

@misc{lacuna_scale_adaptive_anti_aliasing_for_gaussia_d0dcb67e_v1,
  title = {Scale Adaptive Anti Aliasing for Gaussian Splatting},
  author = {{Lacuna}},
  howpublished = {Lacuna research direction},
  year = {2026},
  url = {https://lacuna.tiptreesystems.com/direction/scale-adaptive-anti-aliasing-for-gaussian-splatting/rdr_d0dcb67e86e74986b7332edd5cbe5e92/v/1},
  note = {Version 1, frozen 2026-10-04. Accessed 2026-11-21},
}