| CARVIEW |
Uncertainty results
We show that our formulation for uncertainty using entropy matches with errors resulting from an optimization with Mitsuba.
We observe that where there is error, entropy tends to be higher. We also show a mask for above-average MSE and entropy. The Mask Coverage column shows which regions of the MSE mask are not covered by the entropy mask and should, ideally, be completely black.
Relighting results
Ours, 5.27s
Ours + Mitsuba, 19.87s
Mitsuba, 69.96s
NVDiffRec, 142.14s
Ours, 5.27s
Ours + Mitsuba, 19.87s
Mitsuba, 69.96s
NVDiffRec, 142.14s
Ours, 5.27s
Ours + Mitsuba, 19.87s
Mitsuba, 69.96s
NVDiffRec, 142.14s
We optimize a PBR texture (base color, metallicity, roughness) on multi-view captures from Stanford ORB and relight the resulting object in Blender. More results in the supplemental material and the paper.
Method
Uncertainty as Entropy
We use statistical entropy on the likelihood of BRDF parameters to quantify uncertainty. While other methods test the likelihood function around a found optimum, our method takes a global perspective on all possible BRDF parameter combinations. This is tractable due to frequency analysis.
We show three examples of likelihood functions for different incoming and outgoing radiance. The red dot marks the ground-truth BRDF parameters and the title (H=...) shows the entropy.
The left likelihood function shows incoming light for a dirac delta light source (constant in the spherical harmonic domain) and we see that entropy is low (H=0.25); we can be very certain about the BRDF recovery.
In the center likelihood function, the light only has amplitude in low frequencies and many roughness values are equally likely. The higher entropy (H=0.69) is associated with higher uncertainty, which is in line with the conclusions from Ramamoorthi and Hanrahan (2001).
The right likelihood function corresponds to a material with very low specular reflectance, resulting in high entropy (H=0.87) and thus high uncertainty.
Computing entropy can be extremely expensive, since we need to evaluate the entire parameter space for all viewpoints. Therefore, we propose to accelerate this evaluation in the frequency domain.
Frequency Analysis
Reflection as Convolution
The signal processing framework for inverse rendering (Ramamoorthi and Hanrahan, 2001) shows that the reflection equation can be approximated as a rotational convolution of the BRDF kernel with the incoming light over the incoming- and outgoing light directions at a point on the surface. This perspective allows us to study inverse rendering in the frequency domain, here the spherical harmonics domain.
Robust Spherical Harmonics Transform
Our first contribution is a method to estimate the spherical harmonics coefficients for the incoming- and outgoing radiance field, for sparse and irregularly distributed viewing positions. We achieve this by a least-squares fit with a weighted L2 regularization.
BRDF Recovery with Shadowing and Masking
Our second contribution is to use these coefficients in a BRDF optimization pipeline to estimate parameters for an analytic microfacet BRDF (Disney principled BRDF). We improve the accuracy of the convolution model by incorporating shadowing and masking.
Power Spectrum Approximation
Our third contribution is to develop an extremely light-weight approximation of the convolution model that operates completely in the power spectrum of the spherical harmonics. This allows us to explore hundreds of BRDF parameter combinations in a couple of milliseconds. Moreover, the power spectrum is invariant to rotations of local coordinate frame (here, rotated normals).
Find out more
BibTeX
@inproceedings{wiersma2025svbrdfuncertainty,
author = {Wiersma, Ruben and Philip, Julien and Hašan, Miloš and Mullia, Krishna and Luan, Fujun and Eisemann, Elmar and Deschaintre, Valentin},
title = {Uncertainty for SVBRDF Acquisition using Frequency Analysis},
year = {2025},
isbn = {979-8-4007-1540-2/2025/08},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
url = {https://doi.org/10.1145/3721238.3730592},
doi = {10.1145/3721238.3730592},
booktitle = {SIGGRAPH Conference Papers '25},
location = {Vancouver, BC, CA},
series = {SIGGRAPH Conference Papers '25}
}