Ink-painting Animation by Geometry Buffer Based Real-time 3D Rendering

Yu Gu, Naoki Ono, Kiichi Urahama2016 · DOI

Abstract

We propose a technique using geometry buffers for real-time rendering of 3D ink-wash paintings. According to the characteristics of hand-drawn ink-wash paintings, contour lines and coloring area in the ink paintings are stylized by rendering 3D models to 2D texture images. Entire rendering computation is implemented with a GPU for enabling its real-time processing on commercially available computers.

Introduction

Ink-wash painting (Sumi-e) is a traditional Asian art form characterized by abstracted lines, varying ink density, and natural diffusion on paper. While non-photorealistic rendering (NPR) has attempted to replicate this style, existing methods often struggle with real-time performance, object specificity (often being "hard-coded" for specific shapes), and temporal instability in animations. This research aims to create a generalized, high-speed rendering method that works for any 3D geometry while maintaining the aesthetic essence of ink-wash art.

Methodology

The core of the approach is the use of Geometry Buffers (G-buffers). Instead of rendering the 3D model directly to the screen, the system first renders it into four specialized 2D texture maps: Depth, Normal, Diffuse, and a custom Grayscale map.

Overview of the proposed real-time ink-painting rendering pipeline using geometry buffers.

The Rendering Pipeline

  1. Contour Extraction: The system calculates surface curvature from the normal map and uses a Laplacian filter on the depth map to identify edges. Weights are applied to ensure lines appear where the surface "bends" sharply, mimicking artistic sketching.
  2. Adaptive Stroke Pasting: To optimize computation, stroke textures are "pasted" at sampled points rather than every pixel. Adaptive spacing is used: areas near contours are sampled more densely to prevent aliasing, while flat areas use sparse sampling.
  3. Ink Diffusion & Integration: Coloring areas are rendered using alpha-blended stroke textures combined with Gaussian-blurred regions to simulate ink bleeding into paper.
  4. Temporal Smoothing: A temporal Gaussian filter is applied across frames to prevent flickering and ensure visual consistency during animation.
Visualization of ink density and diffusion effects generated through adaptive stroke pasting.

Results and Discussion

The system was evaluated on a PC with an Intel Core i7 and a GeForce GTX 970M. At 1080p resolution, the system maintained 44–49 FPS even with complex models exceeding 69,000 vertices. At lower resolutions (640x480), performance exceeded 200 FPS.

The method successfully replicates "stippling" and "dyeing" techniques with soft blurs and varied line weights. By focusing on curvature derived from normal maps, the system captures the essential "skeletal" lines of objects. Furthermore, by moving stylization into screen space via G-buffers, computational complexity becomes dependent on screen resolution rather than polygon count.

Limitations

While the method is fast, the "natural expression" of ink strokes could be further refined to appear more organic. Future work includes optimizing stroke-pasting logic for even more complex scenes and improving the simulation of ink interaction with different paper textures, such as rice paper.

Summary updated

Abstract

We propose a technique using geometry buffers for real-time rendering of 3D ink-wash paintings. According to the characteristics of hand-drawn ink-wash paintings, contour lines and coloring area in the ink paintings are stylized by rendering 3D models to 2D texture images. Entire rendering computation is implemented with a GPU for enabling its real-time processing on commercially available computers.
BibTeX
@misc{gu2016ink,
  author = {Yu Gu and Naoki Ono and Kiichi Urahama},
  title = {{Ink-painting Animation by Geometry Buffer Based Real-time 3D Rendering}},
  year = {2016},
  doi = {10.12792/icisip2016.084},
}
Figure