MIPNet: Neural Normal-to-Anisotropic-Roughness MIP Mapping
Lists
Only you see this
Abstract
We present MIPNet, a novel approach for SVBRDF mipmapping which preserves material appearance under varying view distances and lighting conditions. As in classical mipmapping, our method explicitly encodes the multiscale appearance of materials in a SVBRDF mipmap pyramid. To do so, we use a tensor-based representation, coping with gradient-based optimization, for encoding anisotropy which is compatible with existing real-time rendering engines. Instead of relying on a simple texture patch average for each channel independently, we propose a cascaded architecture of multilayer perceptrons to approximate the material appearance using only the fixed material channels. Our neural model learns simple mipmapping filters using a differentiable rendering pipeline based on a rendering loss and is able to transfer signal from normal to anisotropic roughness. As a result, we obtain a drop-in replacement for standard material mipmapping, offering a significant improvement in appearance preservation while still boiling down to a single per-pixel mipmap texture fetch. We report extensive experiments on two distinct BRDF models.
BibTeX
@article{gauthier2022mipnet,
author = {Alban Gauthier and Robin Faury and Jérémy Levallois and Theo Thonat and Jean-Marc Thiery and Tamy Boubekeur},
title = {{MIPNet: Neural Normal-to-Anisotropic-Roughness MIP Mapping}},
journal = {ACM Trans. Graphics},
year = {2022},
url = {https://openreview.net/forum?id=ifyMrtscGP},
}Loading related content...