Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH...
Transcript of Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH...
![Page 1: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/1.jpg)
S. Herholz: A Unified Manifold Framework for Efficient BRDF Sampling …
Sebastian Herholz1 Yangyang Zhao2 Oskar Elek3
Derek Nowrouzezahrai 2 Hendrik P. A. Lensch1 Jaroslav Křivánek3
Volumetric Zero-Variance-Based
Path Guiding
1University of Tübingen 2McGill University Montreal 3Charles University Prague
![Page 2: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/2.jpg)
MOTIVATION
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding2
![Page 3: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/3.jpg)
MOTIVATION
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding3
![Page 4: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/4.jpg)
MOTIVATION
• A correct physically-based simulation of volumetric effects is crucial for rendering realistic scenes
• In the recent years, brute-force path tracing these effects startedto become applicable in production environments ([Fong2017], [Novak2018])
• Increased complexity of the light transport makes it still challenging
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding4
![Page 5: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/5.jpg)
5
No guiding Guiding
(Our)
10 min10 min
![Page 6: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/6.jpg)
VOLUMETRIC MONTE-CARLO PATH TRACING
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding6
𝑓 𝑋
p 𝑋
• The variance is defined by how well we can generate
random paths proportional to the volumetric light transport:
𝜎2 = 𝑉𝑓(𝑋)
𝑝(𝑋)
𝐼 = න𝑓 𝑋 𝑑𝑋
![Page 7: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/7.jpg)
VOLUMETRIC MONTE-CARLO PATH TRACING: ZERO-VARIANCE
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding7
𝑓 𝑋
p𝑧𝑣 𝑋 (optimal)
𝐼 = න𝑓 𝑋 𝑑𝑋
• If the PDF for all paths is proportional to the light transport function
we would get a perfect zero-variance estimator:
𝜎2 = 𝑉𝑓(𝑋)
𝑝𝑧𝑣(𝑋)= 0
We need to know the
shape of 𝒇 𝑿 !
![Page 8: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/8.jpg)
THE 4 SAMPLING DECISIONS:
1. Scatter: 𝑃𝑚 𝒙𝑗 , 𝜔𝑗
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding8
3. Direction: 𝑝𝜔 𝜔𝑗+1|𝒙𝑗+1, 𝜔𝑗 4. Termination: 𝑃𝑅𝑅 𝒙𝑗 , 𝜔𝑗−1
2. Distance: 𝑝𝑑 𝑑𝑗+1|𝒙𝑗 , 𝜔𝑗
![Page 9: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/9.jpg)
VOLUMETRIC RANDOM WALK - DECISIONS
𝑥0
𝜔0
𝑥𝑗
𝜔𝑗
𝑥𝑗+1
𝜔𝑗+1
𝑥𝑀−1
𝜔𝑀−1
𝑥𝑗+2
𝜔𝑗+2
• Path PDF :
𝑝 𝑿 = ෑ
𝑗=1
𝑀−1
𝑃𝑚 … ∙ 𝑝𝑑 … ∙ 𝑝𝜔 … ∙ 1 − 𝑃𝑅𝑅 …
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding9
Source of variance
Path segment PDF
![Page 10: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/10.jpg)
VOLUME RENDERING EQUATION
• Incident radiance (volume):
• In-scattered radiance:
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding10
𝐿 𝑥, 𝜔 = 𝑇 … ⋅ 𝐿𝑜(… ) + න𝑇 … ⋅ 𝜎𝑠(… ) ⋅ 𝐿𝑖(… )d𝑑
𝐿𝑖 … = න𝑓 … ⋅ 𝐿(… )d𝜔′
Surface contribution Volume contribution
![Page 11: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/11.jpg)
VOLUME RENDERING EQUATION
• Incident radiance (volume):
• In-scattered radiance:
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding11
𝐿 𝑥, 𝜔 = 𝑇 … ⋅ 𝐿𝑜(… ) + න𝑇 … ⋅ 𝜎𝑠(… ) ⋅ 𝐿𝑖(… )d𝑑
𝐿𝑖 … = න𝑓 … ⋅ 𝐿(… )d𝜔′
Known Local
Quantities
Transmittance
Phase function
![Page 12: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/12.jpg)
VOLUME RENDERING EQUATION
• Incident radiance (volume):
• In-scattered radiance:
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding12
𝐿 𝑥, 𝜔 = 𝑇 … ⋅ 𝐿𝑜(… ) + න𝑇 … ⋅ 𝜎𝑠(… ) ⋅ 𝐿𝑖(… )d𝑑
𝐿𝑖 … = න𝑓 … ⋅ 𝐿(… )d𝜔′
Unknown Light
Transport Quantities
Incident radiance
In-scattered radiancesurface radiance
![Page 13: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/13.jpg)
STANDARD SAMPLING
13
𝑥𝑗+1𝑥𝑗 𝜔𝑗 𝑥𝑗+1 𝜔𝑗𝑥𝑗+1
𝜔𝑗+1
1+2 Scatter and Distance:
• Based on the transmittance
3 Direction:
• Based on the phase function
![Page 14: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/14.jpg)
STANDARD SAMPLING
14
• Based on local albedo or throughput
4 Termination:
𝑥𝑗
𝜔𝑗𝑥𝑗+1
![Page 15: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/15.jpg)
CHALLENGES FOR VOLUME SAMPLINGWhy do we need volumetric path guiding?
15
![Page 16: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/16.jpg)
LIGHT SHAFTS
• Light shafts:
- We need to scatter inside the light shaft.
- We need to follow the direction of the light shaft.
- We need to scatter towards the light shaft.
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding16
![Page 17: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/17.jpg)
LIGHT SHAFTS
• Light shafts:
- We need to scatter inside the light shaft.
- We need to follow the direction of the light shaft.
- We need to scatter towards the light shaft.
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding17
![Page 18: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/18.jpg)
LIGHT SHAFTS
• Light shafts:
- We need to scatter inside the light shaft.
- We need to follow the direction of the light shaft.
- We need to scatter towards the light shaft.
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding18
![Page 19: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/19.jpg)
No guiding (1024 spp) Our guiding (1024 spp)
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding19
![Page 20: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/20.jpg)
SUB-SURFACE-SCATTERING
𝑥
𝜔
• Sub-Surface-Scattering:
- We ‘often’ need stay close to the surface
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding20
![Page 21: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/21.jpg)
SUB-SURFACE-SCATTERING
𝑥
𝜔
• Sub-Surface-Scattering:
- We ‘often’ need to stay close to the surface
- We need to leave the object with the right direction
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding21
![Page 22: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/22.jpg)
No guiding (256 spp) Our guiding (256 spp)
22
![Page 23: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/23.jpg)
DENSE MEDIA
• Dense media (back illuminated):
- We may need to ‘avoid’ generating a scattering
event even if the transmittance is low
(e.g. strong light source behind the volume).
𝑥
𝜔
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding23
![Page 24: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/24.jpg)
No guiding (256 spp) Our guiding (256 spp)
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding24
![Page 25: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/25.jpg)
NON-DENSE MEDIA
• Non-dense media (no back illumination):
- We may need to ‘force’ a scattering event
even if the transmittance is high.
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding25
![Page 26: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/26.jpg)
No guiding (256 spp) Our guiding (256 spp)
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding26
![Page 27: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/27.jpg)
SPECIALIZED SOLUTIONS: SHORTCOMINGS
• Many individual solutions:
• Equiangular Sampling: [Kulla2012]
• Joint-Importance Sampling: [Georgiev2012]
• Zero-Variance Dwivedi Sampling: [Krivanek2014]
[Meng2016]
• Directional (illumination-based) guiding: [Pegoraro2008][Bashford2012]
• Only considering sub-sets or special cases:
• Surface-bounded volumes
• Homogenous or isotropic volumes
• Single scattering
• None of the current methods importance samples the full volumetric light transport!
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding27
![Page 28: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/28.jpg)
SPECIALIZED SOLUTIONS: SHORTCOMINGS
• Many individual solutions:
• Equiangular Sampling: [Kulla2012]
• Joint-Importance Sampling: [Georgiev2012]
• Zero-Variance Dwivedi Sampling: [Krivanek2014]
[Meng2016]
• Directional (illumination-based) guiding: [Pegoraro2008][Bashford2012]
• Only considering sub-sets or special cases:
• Surface-bounded volumes
• Homogenous or isotropic volumes
• Single scattering
• None of the current methods importance samples the full volumetric light transport!
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding28
![Page 29: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/29.jpg)
SPECIALIZED SOLUTIONS: SHORTCOMINGS
• Many individual solutions:
• Equiangular Sampling: [Kulla2012]
• Joint-Importance Sampling: [Georgiev2012]
• Zero-Variance Dwivedi Sampling: [Krivanek2014]
[Meng2016]
• Directional (illumination-based) guiding: [Pegoraro2008][Bashford2012]
• Only considering sub-sets or special cases:
• Surface-bounded volumes
• Homogenous or isotropic volumes
• Single scattering
• None of the current methods importance samples the full volumetric light transport!
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding29
![Page 30: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/30.jpg)
ZERO-VARIANCE-BASEDVOLUMETRIC PATH GUIDING
30
TUE: 30TH JULY TIME: 9:00 AMROOM: 152
TECH TALK:
![Page 31: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/31.jpg)
[Hoogenboom 2008]
ZV-BASED VOLUMETRIC PATH GUIDING: GOALS
• Leverage recent success of local surface guiding methods:
• Extend the concept to volumes
• Consider the complete volumetric light transport:
• No prior assumptions or special cases
• Guide based on the optimal zero-variance decisions
• Replace unknown quantities by estimates:
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding31
𝐿 𝒙, 𝜔 = ෨𝐿 𝒙, 𝜔 𝐿𝑖 𝒙,𝜔 = ෨𝐿𝑖 𝒙,𝜔
[Vorba2014],
[Herholz2016],
[Mueller2017]
![Page 32: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/32.jpg)
ZV-BASED VOLUMETRIC PATH GUIDING: CONTRIBUTIONS
• Guiding all local sampling decisions:
• 1+2 Guided product distance sampling:
• 3 Guided product directional sampling:
• 4 Guided Russian roulette and Splitting:
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding32
![Page 33: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/33.jpg)
ZV-BASED VOLUMETRIC PATH GUIDING: CONTRIBUTIONS
• Guiding all local sampling decisions:
• 1+2 Guided product distance sampling:
• 3 Guided product directional sampling:
• 4 Guided Russian roulette and Splitting:
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding33
![Page 34: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/34.jpg)
ZV-BASED VOLUMETRIC PATH GUIDING: CONTRIBUTIONS
• Guiding all local sampling decisions:
• 1+2 Guided product distance sampling:
• 3 Guided product directional sampling:
• 4 Guided Russian roulette and Splitting:
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding34
![Page 35: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/35.jpg)
VOLUME RADIANCE ESTIMATES
35
![Page 36: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/36.jpg)
VOLUME RADIANCE ESTIMATES
• Spatial caches via BSP-tree: max. 2K photons per node:
• Similar 3D structure as PPG [Mueller2017]
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding36
![Page 37: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/37.jpg)
VOLUME RADIANCE ESTIMATES
• Pre-processing step to fit estimates from photons (50M):
• EM-fitting of von Mises-Fisher mixtures (similar to [Vorba2014]’s GMMs)
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding37
![Page 38: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/38.jpg)
VON MISES-FISHER MIXTURE MODELS
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding38
• Spherical Distribution:
• Features (closed-form):
- Sampling
- Convolution
- Product
𝑉 𝜔|Θ =
𝐾
𝜋𝑖𝑣(𝜔|𝜇𝑖 , 𝜅𝑖)
![Page 39: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/39.jpg)
RADIANCE ESTIMATES
• Incident Radiance Distribution • In-Scattered Radiance Distribution
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding39
![Page 40: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/40.jpg)
INCIDENT RAD. TO IN-SCATTERED RAD. TRANSFORMATION
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding40
• Convolution between incident radiance 𝐿 and the phase function 𝑓
⊛
![Page 41: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/41.jpg)
INCIDENT RADIANCE ESTIMATES
Ground truth (2K spp) Our estimates (VMM)
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding41
![Page 42: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/42.jpg)
IN-SCATTERED RADIANCE ESTIMATES
Ground truth (2K spp) Our estimates (VMM)
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding42
![Page 43: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/43.jpg)
GUIDED SAMPLING DECISIONS
43
![Page 44: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/44.jpg)
DISTANCE SAMPLING
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding44
2. Scatter distance
1. Volume or surface decision
![Page 45: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/45.jpg)
DISTANCE SAMPLING
• Standard distance PDF:
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding45
1+2. Event distance
𝑝𝑑𝑠𝑡𝑑 … ∝ 𝑇 … ⋅ 𝜎𝑠 …
![Page 46: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/46.jpg)
GUIDED PRODUCT DISTANCE SAMPLING
• Our guided PDF:
𝑝𝑑𝑧𝑣 … =
𝑇 … ⋅ 𝜎𝑠 … ⋅ ෨𝐿𝑖(… )
෨𝐿(… )Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding46
1+2. Event distance
Our estimates
![Page 47: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/47.jpg)
NAÏVE TABULATED APPROACH
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding47
• Naïve tabulated approach:
• Step through the complete volume and build a tabulated PDF
• Inefficient (large scenes dense media):
• we always need to evaluated all bins first
![Page 48: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/48.jpg)
OUR INCREMENTAL GUIDED PRODUCT DISTANCE SAMPLING
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding48
• Incremental approach:
• At each step make a local decision, if we scatter inside the bin
• We only need to step until the scattering event happens
![Page 49: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/49.jpg)
Full CDF (30min) Our incremental (30min)
49
Spp: 548
Avg. steps: 18
Spp: 1140
Avg. steps: 4
![Page 50: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/50.jpg)
45 min
![Page 51: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/51.jpg)
No guiding
Spp: 960
relMSE: 1.342
45 min
![Page 52: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/52.jpg)
No guiding Distance guiding
Spp: 960
relMSE: 1.342Spp: 424
relMSE: 0.901
45 min
![Page 53: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/53.jpg)
No guiding (256 spp) Distance guiding (256 spp)
53
• Here, distance sampling is not the main cause of variance!!
![Page 54: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/54.jpg)
DIRECTIONAL SAMPLING
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding54
3. Scatter direction
𝜔𝑗𝑥𝑗+1
• Standard PDF:
𝑝𝜔𝑠𝑡𝑑 … ∝ ሚ𝑓 …
![Page 55: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/55.jpg)
GUIDED PRODUCT DIRECTIONAL SAMPLING
• Our guided PDF:
𝑝𝜔𝑧𝑣 … ∝ ሚ𝑓 … ∙ ෨𝐿(… )
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding55
3. Scatter direction
𝜔𝑗𝑥𝑗+1 𝜔𝑗+1
Our estimates
![Page 56: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/56.jpg)
OUR GUIDED PRODUCT DIRECTIONAL SAMPLING
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding56
Incident radiance VMM
![Page 57: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/57.jpg)
OUR GUIDED PRODUCT DIRECTIONAL SAMPLING
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding57
Incident radiance VMM Phase function VMM
![Page 58: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/58.jpg)
OUR GUIDED PRODUCT DIRECTIONAL SAMPLING
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding58
Product sampling VMM
![Page 59: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/59.jpg)
30 min
59
![Page 60: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/60.jpg)
30 min No guiding
Spp: 2212
relMSE: 0.376
![Page 61: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/61.jpg)
Directional guiding
Spp: 1756
relMSE: 0.048
30 min No guiding
Spp: 2212
relMSE: 0.376
![Page 62: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/62.jpg)
Directional guiding Dist + Direct
Spp: 1756
relMSE: 0.048Spp: 1228
relMSE: 0.034
30 min No guiding
Spp: 2212
relMSE: 0.376
![Page 63: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/63.jpg)
No Guiding
(256 spp)
Product Guiding
(256 spp)
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding63
Illum Guiding
(256 spp)
IMPORTANCE OF THE PRODUCT FOR DENSE ANISOTROPIC MEDIA
![Page 64: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/64.jpg)
GUIDED RUSSIAN ROULETTE AND SPLITTING
4a. Termination 4b. Splitting Distance
Directional
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding64
![Page 65: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/65.jpg)
GUIDED RUSSIAN ROULETTE AND SPLITTING
• Post-sampling compensation strategies:
• Identify, if we did a sub-optimal sampling decision
• Terminate: to increase performance
• Split: bound/reduce sample variance
4b. Splitting
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding65
4a. Termination
![Page 66: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/66.jpg)
GUIDED RUSSIAN ROULETTE AND SPLITTING
• Path contribution: 𝐸[𝑋]• The expected contribution
if we continue the path
• Reference solution: 𝐼• the final pixel value
𝑞 =𝐸 𝑋
𝐼
Path contribution
Reference solution
survival prob /
splitting factor
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding66
![Page 67: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/67.jpg)
GUIDED RUSSIAN ROULETTE AND SPLITTING
• Path contribution: 𝐸[𝑋]• The expected contribution
if we continue the path
• Reference solution: 𝐼• the final pixel value
𝑞 =𝐸 𝑋
𝐼= 1
Path contribution
Reference solution
survival prob /
splitting factor
Zero-Variance
Estimator
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding67
![Page 68: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/68.jpg)
GUIDED RUSSIAN ROULETTE AND SPLITTING
• If 𝑞 ≤ 1: Russian Roulette
• Terminates low contributing paths
• Survival probability: 𝑞
• If 𝑞 > 1: Splitting
• Splits an under sampled paths with
a potential high contribution (𝑞 times)
𝑞 =𝐸 𝑋
𝐼
Path contribution
Reference solution
survival prob /
splitting factor
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding68
![Page 69: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/69.jpg)
ESTIMATED PATH CONTRIBUTION
• See course notes or paper for more details
෨𝐿𝑖
𝑿
𝐸 𝑿 = 𝑎′(𝑿) ⋅ ෨𝐿𝑖 𝑥𝑗 , 𝜔𝑗−1
Path throughput: 𝑓(𝑿)/𝑝(𝑿) In-scattered radiance estimate
𝑥𝑗
𝜔𝑗−1
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding69
![Page 70: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/70.jpg)
GUIDED RUSSIAN ROULETTE AND SPLITTING: PIXEL ESTIMATE
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding71
• Ray marched cache to integrate: 𝑇 ⋅ 𝜎𝑠 ⋅ ෨𝐿𝑖
![Page 71: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/71.jpg)
No RR
Spp: 468
relMSE: 0.454
45 min
![Page 72: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/72.jpg)
No RR Guided RR
Spp: 468
relMSE: 0.454Spp: 1500
relMSE: 0.174
45 min
![Page 73: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/73.jpg)
No RR Guided RR
Spp: 468
relMSE: 0.454Spp: 1500
relMSE: 0.174
45 min
+ Guided splitting
Spp: 1340
relMSE: 0.066
![Page 74: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/74.jpg)
Guided RR + Guided splitting
Spp: 1500
relMSE: 0.174
Spp: 1340
relMSE: 0.06675
![Page 75: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/75.jpg)
No guiding
Time: 60 min
Spp: 10644
relMSE: 11.58
![Page 76: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/76.jpg)
Distance guiding
Time: 60 min
Spp: 4624
relMSE: 3.520
![Page 77: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/77.jpg)
Distance + directional guiding
Time: 60 min
Spp: 4448
relMSE: 0.468
![Page 78: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/78.jpg)
Distance + directional guiding + GRRS
Time: 60 min
Spp: 3796
relMSE: 0.321
![Page 79: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/79.jpg)
OPEN PROBLEMS AND LIMITATIONSOpen Challenges to make it bullet proof
80
![Page 80: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/80.jpg)
SPATIAL CACHE STRUCTURE
• Naive approach to define the resolution:
• Heuristic based on sample numbers
• Takes time or many samples to model/separate fine features (e.g. thin shafts or caustics)(PPG by [Mueller2017] has the same problem)
• Influences the performance of some sampling methods (e.g. distance)
• Ideal structure should adjust to the light transport characteristics
81
![Page 81: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/81.jpg)
INSUFFICIENT CACHE SIZES
• Shared problem with other 3D caching based guiding approaches(e.g. [Vorba2014], [Mueller2017], …)
• By merging the samples of a spatial cache we blur the directional distribution
• Can lead to incorrect estimates of 𝐿 and 𝐿𝑖
82
Ground truth Our estimate Spatial avg. ground truth
![Page 82: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/82.jpg)
PRODUCTION CHALLENGESHow can we get good guiding estimates?
83
![Page 83: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/83.jpg)
VMM PHASE FUNCTION FITTING: PRE-PROCESSING STEP
• Pre-processing step:• Fitting a VMM for each phase function
• Fitting up to K = 4 components• Details in the course notes
• Open Challenge:• Procedural phase functions or
procedural mixtures?
• How to deal with changing mean cosines (roughening/mollification)?
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding84
![Page 84: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/84.jpg)
VMM PHASE FUNCTION FITTING: PRE-PROCESSING STEP
• Pre-processing step:• Fitting a VMM for each phase function
• Fitting up to K = 4 components• Details in the course notes
• Open Challenge:• Procedural phase functions or
procedural mixtures?
• How to deal with changing mean cosines (roughening/mollification)?
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding85
![Page 85: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/85.jpg)
FITTING/LEARNING THE INCIDENT RADIANCE MIXTURES
Pros:
• Photons directly represents the light transport
• Spatial distribution corresponds to important features (light shaft)
• Number of traced photons can be fixed
• No additional fitting during rendering
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding86
Photon-based pre-processing ([Herholz2019][Vorba2014])
![Page 86: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/86.jpg)
FITTING/LEARNING THE INCIDENT RADIANCE MIXTURES
Cons:
• Pre-processing step:
• Long time to first render iteration
• Complex scenes need bidirectional learning:
• Ping-Pong style [Vorba2014]
• It is not the ideal solution for artists in production
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding87
Photon-based pre-processing ([Herholz2019][Vorba2014])
![Page 87: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/87.jpg)
FITTING/LEARNING THE INCIDENT RADIANCE MIXTURES
Pros:
• First experiments show promising results
• No pre-processing
• Refines spatial and directional distributions in each iteration
• Sample data gets more reliable
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding88
Progressive learning (PPG-style [Mueller2017])
![Page 88: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/88.jpg)
FITTING/LEARNING THE INCIDENT RADIANCE MIXTURES
Cons (open challenges):
• Sample count grows exponential:
• Memory and fitting time increases
• Shorter update rates ?
• Online fitting for mixtures?
• Spatial structure adapts slowly to LT:
• Important for distance sampling
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding89
Progressive learning (PPG-style [Mueller2017])
![Page 89: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/89.jpg)
CONCLUSION
• Even approximate local sampling decisions lead to a good approximation of the globally optimal guiding distribution (and thus significantly reducing MC variance)
• Converges to optimal ZV estimator in the hypothetical limit (i.e., if the approximations were perfect)
• Solely based one guiding structure for alldecisions (incident radiance VMMs)
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding90
![Page 90: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/90.jpg)
THANK YOU
91
![Page 91: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/91.jpg)
REFERENCES
• [Fong2017]: “Production volume rendering”
• [Novak2018]: “Monte Carlo methods for volumetric light transport simulation”
• [Kulla2012]: “Importance sampling techniques for path tracing in participating media”
• [Georgiev2012]: “importance sampling of low-order volumetric scattering”
• [Krivanek2014]: “A zero-variance-based sampling scheme for Monte Carlo subsurface scattering”
• [Meng2016]: “Improving the Dwivedi sampling scheme”
• [Vorba2014]: “Online learning of parametric mixture models for light transport simulation”
• [Vorba2016]: “Adjoint-driven Russian roulette and splitting in light transport simulation”
• [Herholz2016]: “Product importance sampling for light transport path guiding”
• [Koerner2016]: “Subdivision next-event estimation for path-traced subsurface scattering”
• [Mueller2017]: “Practical path guiding for efficient light-transport simulation”
• [Hoogenboom2008]: “Zero-varianceMonte Carlo schemes revisited”
• [Pegoraro2008]:” Sequential Monte Carlo integration in low-anisotropy participating media”
• [Bashford2012]: “A significance cache for accelerating global illumination”
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding92
![Page 92: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/92.jpg)
ADJOINT ESTIMATE ACCURACY
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding93
![Page 93: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/93.jpg)
COMPARING AGAINST EQUIANGULAR SAMPLING
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding94
![Page 94: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/94.jpg)
BUMPY SPHERE
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding95
![Page 95: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/95.jpg)
INCREMENTAL GUIDED DISTANCE SAMPLING
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding96
![Page 96: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/96.jpg)
INCREMENTAL GUIDED DISTANCE SAMPLING
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding97
![Page 97: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/97.jpg)
INCREMENTAL GUIDED DISTANCE SAMPLING
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding98
![Page 98: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/98.jpg)
VMM PHASE FUNCTION FITTING: PRE-PROCESSING STEP
• Using up to K = 4 components
• Optimization Problem:
arg mi𝑛Θ𝑓
𝑛=1
𝑁
ℒlog(𝑓 𝜔𝑛, … , 𝑉(𝜔𝑛, Θ𝑓))2
ℒlog(𝑑,𝑚) = log 𝑑 + 𝜖 − log 𝑚 + 𝜖
𝜖 = (1𝑒 − 4) ∙ max(𝑑1, … , 𝑑𝑛)
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding99
![Page 99: Volumetric Zero-Variance-Based Path Guidingjirka/path-guiding-in...VOLUMETRIC MONTE-CARLO PATH TRACING 6 Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding 𝑋 p𝑋](https://reader033.fdocuments.net/reader033/viewer/2022050102/5f40e7b140b3585b82560456/html5/thumbnails/99.jpg)
VMM PHASE FUNCTION FITTING
• Manifold representation of the VMM parameters for an HG phase function model for different mean cosines
Sebastian Herholz | Volumetric Zero-Variance-Based Path Guiding100