Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2...
-
Upload
rogelio-manson -
Category
Documents
-
view
216 -
download
3
Transcript of Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2...
![Page 1: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/1.jpg)
Understanding the role of phase function in translucent appearance
Ioannis Gkioulekas1 Bei Xiao2 Shuang Zhao3
Edward Adelson2 Todd Zickler1 Kavita Bala3
1Harvard 3Cornell2MIΤ
1
![Page 2: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/2.jpg)
Translucency is everywhere
food skin
jewelry architecture
2
![Page 3: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/3.jpg)
Subsurface scattering
radiative transfer equation
Chandrasekhar 1960
phase function pabsorption coefficient σa
extinction coefficient σt
3
isotropic
incident direction
outgoing direction
(λ)(λ)
(λ)
![Page 4: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/4.jpg)
Phase function is important
thick parts (diffusion)
thin parts4
![Page 5: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/5.jpg)
Common phase functions
single-parameter family:
Henyey-Greenstein (HG) lobes
g=𝜇1
5 Henyey and Greenstein 1941
average cosine
g∈ (−1,1 )❑
![Page 6: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/6.jpg)
What can we represent with HG?
microcrystalline wax
6
marble white jade
Jensen 2001
![Page 7: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/7.jpg)
Henyey-Greenstein is not enough
soap
microcrystalline wax
photo HG
setup
7
![Page 8: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/8.jpg)
Goals
8
expanded phase function space role in translucent appearance
??
![Page 9: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/9.jpg)
Expanded phase function space
single-parameter family:
Henyey-Greenstein (HG) lobes
g=𝜇1
9
average cosine second moment
von Mises-Fisher (vMF) lobes
single-parameter family:𝜅=2𝜇1/ (1−𝜇2 )
![Page 10: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/10.jpg)
Expanded phase function space
soap
microcrystalline wax
photo HG
setup
vMF
10
![Page 11: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/11.jpg)
Expanded phase function space
single-parameter family:
Henyey-Greenstein (HG) lobes von Mises-Fisher (vMF) lobes
single-parameter family:
Linear mixtures:HG + HG HG + vMF vMF + vMF
11
g=𝜇1 𝜅=2𝜇1/ (1−𝜇2 )
![Page 12: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/12.jpg)
f( ) f( )
Redundant phase function space
≈
≠12
≈
![Page 13: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/13.jpg)
Related work
13
• Fleming and Bülthoff 2005, Motoyoshi 2010
• Pellacini et al. 2000, Wills et al. 2009
• many perceptual cues• do not study phase function
• gloss perception• much smaller space
• Ngan et al. 2006 • gloss perception• navigation of appearance space
![Page 14: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/14.jpg)
Our approach1. Computational
processing2. Psychophysical
validation3. Analysis of
results
image-driven analysis tractable experiment visualization, perceptual parameterization
14
![Page 15: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/15.jpg)
Scene design
mostly low-order scattering
mostly high-order scattering
side-lighting
thick body and base
thin parts and fine details
15
![Page 16: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/16.jpg)
von Mises-Fisher (vMF) lobes
Linear mixtures:HG + HG HG + vMF
Henyey-Greenstein (HG) lobes
Expanded phase function space
16
sample 750+ phase functions
3000 machine hours
750+ HDR images
![Page 17: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/17.jpg)
Psychophysics
Paired-comparison experiments
Hmm, left
17
![Page 18: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/18.jpg)
Psychophysics
750 images = 200 million comparisons
18
![Page 19: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/19.jpg)
d( , ) ǁ - ǁ𝟑√¿∨¿𝟑√¿∨¿
Image-driven analysis
≈
19
![Page 20: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/20.jpg)
two-dimensional appearance spacetwo-dimensional
embedding
Computational processing
750 HDR images
ǁ - ǁ𝟑√¿∨¿𝟑√¿∨¿
multidimensional scaling
20
≈
![Page 21: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/21.jpg)
Our approach1. Computational
processing2. Psychophysical
validation
image-driven analysis tractable experiment
21
3. Analysis of results
visualization, perceptual parameterization
![Page 22: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/22.jpg)
40 representative images
Psychophysical validation
ǁ - ǁ𝟑√¿∨¿𝟑√¿∨¿
clustering
two-dimensional appearance space
22
![Page 23: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/23.jpg)
Psychophysical validation
750 phase functions = 200 million comparisons40 phase functions = 30,000 comparisons23
![Page 24: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/24.jpg)
computational embedding
Psychophysical validation
25
≈perceptual embedding
• use computational embedding as proxy for psychophysics
• generalize to all 750 images
(non-metric MDS on psych. data) (MDS using image metrics)
![Page 25: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/25.jpg)
Our approach1. Computational
processing2. Psychophysical
validation
image-driven analysis tractable experiment
26
3. Analysis of results
visualization, perceptual parameterization
![Page 26: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/26.jpg)
What we know so far
translucent appearance space• two-dimensional• perceptual• consistent across variations of
material, shape, illumination
27
see paper for: 5000+ images, 9 more computational embeddings, 2 more psychophysical experiments including backlighting, analysis and statistics
![Page 27: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/27.jpg)
Moving around the space
28
![Page 28: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/28.jpg)
Moving around the space
moving vertically more diffused appearance30
![Page 29: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/29.jpg)
Moving around the space
moving horizontally more glass-like appearance32
![Page 30: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/30.jpg)
we can move anywhere
Moving around the space
33
![Page 31: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/31.jpg)
What can we render with…
single forward lobesforward + isotropic mixturesforward + backward mixtures
35
![Page 32: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/32.jpg)
What can we render with…marble
white jade
marble white jadewith vMF + vMF
best approximationwith HG + isotropic
36
≠
![Page 33: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/33.jpg)
Editing the phase function
move horizontally move vertically37
1/√1−𝜇2𝜇1
2more glass-like
mor
e di
ffuse
d
![Page 34: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/34.jpg)
g
Perceptual parameterization
move vertically0.8
0.4
0
38
HG:
![Page 35: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/35.jpg)
HG:
0.32
Perceptual parameterization
move vertically0.64
g239
0
![Page 36: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/36.jpg)
HG:
Perceptual parameterization
40
move vertically
0
g
0.8
0.40.32
0.64
g2
HG:
![Page 37: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/37.jpg)
Discussion
41
• handling other parameters of appearance: σt, σa, color
• more general or data-driven phase function models
• use in translucency editing and design user interfaces
• need to (further) scale up methodology
• see our SIGGRAPH Asia 2013 paper!
![Page 38: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/38.jpg)
Three take-home messages
• HG is not enough• expanded space
• computation + psychophysics• large-scale perceptual studies
• 2D appearance space• uniform parameterization
42
white jademarble
![Page 39: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/39.jpg)
Acknowledgements
• Wenzel Jakob• Bonhams
Funding:• NSF • NIH • Amazon
white jademarble
43 http://tinyurl.com/s2013-translucency
Dataset of 5000+ images:
![Page 40: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/40.jpg)
Computational embeddings
material variation shape variation lighting variation
5000+ more HDR images
![Page 41: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/41.jpg)
Scene design
45
![Page 42: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/42.jpg)
computational embedding
Psychophysical validation
46
≈perceptual embedding(non-metric MDS on psych. data) (MDS using image metrics)
![Page 43: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/43.jpg)
Computational metrics
L1-normL2-normcubic root
![Page 44: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/44.jpg)
Perceptual image metrics
material variation shape variation lighting variation
![Page 45: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/45.jpg)
Embedding stability
original perturbation 1 perturbation 2
perturbation 3 perturbation 4 perturbation 5
![Page 46: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/46.jpg)
Distance metric
MDS
Davis et al. 2007
sample 750+ phase functions
MDS
![Page 47: Understanding the role of phase function in translucent appearance Ioannis Gkioulekas 1 Bei Xiao 2 Shuang Zhao 3 Edward Adelson 2 Todd Zickler 1 Kavita.](https://reader037.fdocuments.net/reader037/viewer/2022110205/56649cb65503460f9497b813/html5/thumbnails/47.jpg)
Non-metric MDS
Wills et al. 2009
Learning from relative comparisons
non-metric MDS
d >d
Hmm, left
min𝐾 ≥ 0
λ‖𝐾‖∗+1𝑆∑
𝑠=1
𝑆
𝐿 (𝑑𝐾 (𝑖𝑠 ,𝑘𝑠 )−𝑑𝐾 (𝑖𝑠 , 𝑗𝑠 )+𝑏)