Programmable rendering of line drawing from 3D scenes

Stéphane Grabli, Emmanuel Turquin, Frédo Durand, François X. SillionACM Trans. Graphics 2010 · DOI

TL;DR

This paper introduces a programmable rendering system for creating stylized line drawings from 3D models, inspired by programmable shaders in traditional rendering. It offers unprecedented user control over line drawing styles by separating style from content and allowing users to define complex rendering behaviors through a modular, operator-based pipeline.

What Problem Does This Paper Address?

Traditional non-photorealistic rendering (NPR) techniques for line drawings often provide limited control over the final style. While artists have immense flexibility in their line work, existing NPR systems typically offer a fixed set of attributes that users can tweak, rather than allowing for the procedural definition of artistic intent. This paper addresses the challenge of giving users fine-grained, programmable control over line drawing styles, enabling them to articulate and reuse complex artistic styles across different 3D scenes, much like how programmable shaders allow for diverse visual appearances in photorealistic rendering.

Methods

The core of the proposed system is a programmable approach to line drawing, inspired by programmable shaders. This involves:

  • View Map: A novel data structure that represents feature lines (silhouettes, creases, etc.) from a 3D scene as a 2D planar graph. This map captures the topological arrangement of lines and ensures continuity of scene properties along them.
  • Scene Properties: A comprehensive set of properties derived from the 3D scene (e.g., depth, normal, visibility) and the drawing itself (e.g., density) are identified as crucial for driving style.
  • Style Modules: Users define styles using a set of operators (select, chain, split, shade, sort, draw) that manipulate the view map. These operators are combined into style modules, which act like layers in image editing software, allowing for complex styles to be built incrementally.
  • Programmable Operators: These are the building blocks of the style modules. They operate on the view map and are parameterized by user-defined style rules (predicates, functions, iterators). This allows for flexible control over stroke topology, geometry, and attributes.
  • Synchronization Strategies: Two synchronization mechanisms (data-based and operator-based) are employed to manage the flow of data through the operator pipeline, ensuring correct processing and enabling dynamic style adjustments based on the evolving drawing.

Datasets

Not discussed in the paper. The authors use various 3D models for generating illustrative examples, but no specific datasets for training or evaluation are mentioned.

Key Insights and Ideas

  • Programmability is Key: The paper argues that true artistic control in NPR line drawing requires a programmable approach, mirroring the success of programmable shaders in photorealistic rendering.
  • Separation of Style and Content: The system explicitly separates the definition of style from the 3D scene content, making styles reusable across different models.
  • The View Map as a Central Structure: The view map is a crucial innovation, providing a unified representation of feature lines that captures both geometric and topological information, and facilitates access to scene properties.
  • Style as a Pipeline: Decomposing the drawing process into a sequence of programmable operators allows for a modular and understandable way to construct complex styles.
  • Scene Properties Drive Style: The paper emphasizes that artistic choices in line drawing are often correlated with properties of the scene and the drawing itself, and provides a framework to exploit these correlations.

Key Results

The paper demonstrates the system's flexibility and power through numerous examples of stylized line drawings. While quantitative results are not the primary focus, the qualitative results showcase:

  • The ability to create a wide range of styles, from technical illustrations to artistic renderings.
  • Fine-grained control over attributes like stroke thickness, color, texture, and geometry.
  • Sophisticated line omission and simplification strategies driven by density measures.
  • The successful application of the system to various 3D models, demonstrating style consistency.
  • The authors also mention that their software, Freestyle, is available under the GPL license.

Limitations and Future Work

  • View Map Topology Constraint: The current system is tied to the 2D projection of the 3D scene's feature lines, limiting the ability to introduce entirely new lines or arbitrarily change topology for abstraction.
  • Still Images Only: The approach is dedicated to static images and does not inherently handle temporal coherence for animations, which is a significant challenge for view-dependent features like silhouettes.
  • Future Work:
    • Generalizing Programmability: Extending the programmable approach to other NPR aspects like stylized region rendering and programmable feature line extraction.
  • Temporal Coherence: Developing methods for users to explicitly manage temporal coherence within the style description, rather than relying on intrusive automatic techniques.
  • Interactive Style Editing: Exploring more intuitive ways for users to define styles, potentially through a combination of programming and interactive tools.
  • Multiple Parameterizations: Allowing for different parameterizations (e.g., image-space vs. world-space) for querying properties along lines.

Summary updated

BibTeX
@article{grabli2010programmable,
  author = {Stéphane Grabli and Emmanuel Turquin and Frédo Durand and François X. Sillion},
  title = {{Programmable rendering of line drawing from 3D scenes}},
  journal = {ACM Trans. Graphics},
  year = {2010},
  doi = {10.1145/1731047.1731056},
}

Loading related content...

Figure