EasyPBR: A Lightweight Physically-based Renderer

Radu Alexandru Rosu, Sven Behnke

TL;DR

EasyPBR is an open-source, lightweight rendering library that bridges the gap between simple visualization tools and complex game engines. It provides high-quality, physically-based rendering (PBR) through a user-friendly Python/C++ interface, making it an ideal tool for researchers needing to generate synthetic data or visualize 3D deep learning models with minimal boilerplate.

What Problem Does This Paper Address?

In the world of 3D research, scientists often face a frustrating trade-off. On one hand, tools like Meshlab or VTK are easy to use but often produce "flat" or unrealistic visualizations. On the other hand, professional engines like Unreal or Blender offer stunning realism but come with a steep learning curve, heavy hardware requirements, and cumbersome scripting interfaces that are difficult to integrate into a standard machine learning pipeline.

The authors introduce EasyPBR to solve this "complexity vs. quality" dilemma. It aims to provide "one-click" photorealism—automatically inferring parameters like lighting and camera clipping—while remaining lightweight enough to be imported as a simple Python module.

Methods

EasyPBR is built on a deferred rendering architecture, which separates geometry processing from shading to handle multiple lights and complex post-processing efficiently. Key technical features include:

  • PBR Pipeline: It implements the Cook-Torrance BRDF and Image-Based Lighting (IBL) with split-sum approximations, similar to the approach used in Unreal Engine 4.
  • Memory-Efficient G-Buffer: To save bandwidth, the renderer doesn't store world positions for every pixel; instead, it reconstructs them on the fly from the depth map.
  • Hybrid Primitive Support:
    • Meshes: Standard PBR workflow.
  • Point Clouds: Since point clouds often lack surface normals, EasyPBR uses Eye-Dome Lighting (EDL), a non-realistic shading technique that enhances depth perception by darkening edges based on depth discontinuities.
  • Surfels: It supports "surface elements" (oriented disks) using a weighted splatting technique that accumulates attributes in the G-Buffer before normalizing them.
  • Automation: The library includes an "automatic guess" system that sets up a standard 3-point lighting rig and adjusts camera planes based on the scene's bounding box.

Datasets

While EasyPBR is a tool rather than a trained model, the authors evaluated its performance and versatility using several assets:

  • Goliath Statue: A massive mesh with 23 million faces used for stress-testing memory and render times.
  • 3D Scanned Head: Used to compare visual fidelity against Marmoset and VTK.
  • SemanticKITTI: Used to demonstrate point cloud segmentation visualization.
  • Synthetic Drone Data: A custom-rendered dataset of DJI M100 drones used to train a real-world object detector.

Key Insights and Ideas

  • The "Low Barrier" Philosophy: The most significant "aha" moment is the realization that researchers often avoid high-quality rendering because of the setup time. By automating the lighting and camera math, EasyPBR makes "good enough" photorealism the default.
  • Deep Learning Integration: EasyPBR is designed to live inside a training loop. It provides native interfaces for PyTorch, allowing users to pass tensors directly between their neural networks and the visualizer without messy file conversions.
  • Geometry Processing Synergy: By sharing a common interface with the libigl library, EasyPBR allows users to perform complex mesh manipulations (like smoothing or decimation) and render the results instantly in the same script.

Key Results

  • Performance: On an Nvidia RTX 2060, EasyPBR renders the 23-million-face Goliath mesh in just 6.2ms. It remains competitive with or faster than Meshlab and VTK, particularly when handling large geometry that exceeds standard memory thresholds.
  • Code Efficiency: The authors demonstrate that achieving high-quality shadows and lighting in EasyPBR takes less than 10 lines of Python code, whereas a similar setup in VTK requires over 150 lines.
  • Application Success: The paper showcases a drone detector trained on EasyPBR-generated synthetic data that successfully generalizes to detecting real drones in complex outdoor environments.

Limitations and Future Work

The authors acknowledge a few areas for improvement:

  • Advanced Shaders: Currently, EasyPBR lacks sub-surface scattering (essential for realistic skin) and complex transparency handling.
  • Effects: Future versions aim to include cinematic effects like Depth of Field (DoF).
  • Real-time focus: While excellent for real-time use and synthetic data, it is not a path-tracer; users requiring perfect global illumination for offline renders might still need tools like Mitsuba or Cycles.

EasyPBR is available on GitHub at: https://github.com/AIS-Bonn/easy_pbr

Summary updated

Abstract

Modern rendering libraries provide unprecedented realism, producing real-time photorealistic 3D graphics on commodity hardware. Visual fidelity, however, comes at the cost of increased complexity and difficulty of usage, with many rendering parameters requiring a deep understanding of the pipeline. We propose EasyPBR as an alternative rendering library that strikes a balance between ease-of-use and visual quality. EasyPBR consists of a deferred renderer that implements recent state-of-the-art approaches in physically based rendering. It offers an easy-to-use Python and C++ interface that allows high-quality images to be created in only a few lines of code or directly through a graphical user interface. The user can choose between fully controlling the rendering pipeline or letting EasyPBR automatically infer the best parameters based on the current scene composition. The EasyPBR library can help the community to more easily leverage the power of current GPUs to create realistic images. These can then be used as synthetic data for deep learning or for creating animations for academic purposes.
BibTeX
@inproceedings{rosu2021easypbr,
  author = {Radu Alexandru Rosu and Sven Behnke},
  title = {{EasyPBR: A Lightweight Physically-based Renderer}},
  booktitle = {VISIGRAPP (1: GRAPP)},
  year = {2021},
  doi = {10.5220/0010268902450252},
}

Loading related content...

Figure