Photorealistic Rendering of Rain Streaks
-
Upload
giselle-dodson -
Category
Documents
-
view
105 -
download
1
description
Transcript of Photorealistic Rendering of Rain Streaks
![Page 1: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/1.jpg)
Photorealistic Rendering of Rain Streaks
Department of Computer Science
Columbia University
Kshitiz Garg Shree K. Nayar
SIGGRAPH ConferenceJuly 2006, Boston, USA
Sponsors: NSF, ONR
![Page 2: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/2.jpg)
A Rain Scene from “The Matrix Revolutions”
![Page 3: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/3.jpg)
A Rain Scene from “The Matrix Revolutions”
Frame 1 Frame 2 Frame 3
![Page 4: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/4.jpg)
Rendering Streaks using Simple Brightness Model
Commercial Software Heuristic-based
Hybrid-Spectral Method ATI ToyShop Demo
[Starik and Werman 03]
[Langer et al. 04] [N. Tataturschuk et al. 05]
![Page 5: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/5.jpg)
Original Image Courtesy Andy Lomas Hand Drawn Textures
Original Image Courtesy Warner Bros.Frame from “The Matrix Revolutions”
Rendering Streaks using Hand Drawn Textures
![Page 6: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/6.jpg)
Study of Visual Appearance of Rain Streaks
• Rain Streak Appearance Model
• Rain Streak Texture Database
• Image-Based Rain Rendering Algorithm
![Page 7: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/7.jpg)
Oscillations in a Rain Drop
A Falling Rain Drop
[Beard and Kubesh 1989Andsager et al. 1992]
Turbulent Flow of air
Turbulent Flow of air
![Page 8: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/8.jpg)
Oscillations in a Rain Drop
Oblate-Prolate Mode Transverse Mode
Oscillations in a Rain Drop
[Beard and Kubesh 1989Andsager et al. 1992]
![Page 9: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/9.jpg)
Appearance of a Rain Drop
Refraction
n̂
)ˆ(nL
)ˆ(sLe
)ˆ( pLe
Internal Reflection
S
P
)ˆ(nL )ˆ( pLP e)ˆ(sLS e)ˆ(rLR e
Specular Reflection
R
)ˆ(rLe
N
![Page 10: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/10.jpg)
Appearance of a Non-Oscillating Rain Drop
n̂
)ˆ(nL N
P
R
S
Rain Streak
Instant Time Shots
FallingDrop
Non-Oscillating Rain Drop
![Page 11: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/11.jpg)
)ˆ(nL
n̂
N
P
R
S
Rain Streak
Instant Time Shots
FallingDrop
P
R
S
Appearance of an Oscillating Rain Drop
Oscillating Rain Drop
![Page 12: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/12.jpg)
Rain Streak Appearance Model
Oblate-ProlateMode
Transverse Mode
1,3A0,2A? ?
Shape of Rain Drop:
Fall Direction
Not Rotationally Symmetric
[Beard and Kubesh 1989Andsager et al. 1992]
drop = (00 – 3600)
![Page 13: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/13.jpg)
Measurement of Rain Streak Appearances
Drop generator
Height: 15 m
-z
x
xdrop
y,ydrop
droplight
viewlight
light = (500, 900, 1300)
light = (100 , 300,…, 1700)
view = (700, 900, 1100)
(A2,0 A3,1 drop) =(10 images per light & view)
Lighting and Viewing Configuration
Experimental Setup
Oscillation Parameters
![Page 14: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/14.jpg)
Estimation Result
1,3A0,2A
;)1.0,2.0(),( 1,30,2 AA )1.0,1.0(
90 70
130 50 130 90 50 130 90 50
light
view
light
110
90
130 10 70 30 10 150 30 10 110 50 170 30 170 90 110 50 130 30
Estimating the Oscillation Amplitudes
Measu
red
Oscillation Amplitudes:
![Page 15: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/15.jpg)
Comparison of Actual vs. Rendered Rain Streaks
90 70
130 50 130 90 50 130 90 50
light
view
light
110
90
130 10 70 30 10 150 30 10 110 50 170 30 170 90 110 50 130 30
Ren
dere
dM
easu
red
![Page 16: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/16.jpg)
Precomputed Database of Streak Textures
Lighting and Viewing Direction
Oscillations Parameters
Database contains 6300 HDR Rain Streak Textures (400 MB)
Rain Drop Size
Source and Camera Distance
Camera Parameter
Factors Affecting the Appearance
( Publicly available: Please send email to [email protected] )
Render Online (Algorithm)
Render Offline (Database)
![Page 17: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/17.jpg)
User Input
Scene Image/Video
Camera and Rain
Parameters
Coarse Depth Map
Light SourceProperties
Scene Image/Video
With Rain
Raindrop Distribution
and Trajectories
Using Particle System
Render Streak Appearance
Scale
Rotate
PerspectiveEffects
CameraEffects
ExposureCrop/Blend
DefocusBlur
Rain Dynamics
Rain Rendering PipelineRender Novel
Streak Textures
Rain Streak Database
Streak texture(Source 1)
Streak texture(Source n)
+
+Streak texture
(Ambient)
![Page 18: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/18.jpg)
Rendered Rain with Varying Light Direction
-150o150o
Light Source Direction
![Page 19: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/19.jpg)
Constant Brightness Streak Model
![Page 20: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/20.jpg)
-150o 150o
Light Source Direction
Comparison with Constant Brightness Model
Streak Appearance Model Constant Brightness Model
![Page 21: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/21.jpg)
Night Scene with Isotropic Source
Coarse Depth Map
Image of the Scene
![Page 22: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/22.jpg)
Night Scene with Isotropic Source
Rendered Rain
![Page 23: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/23.jpg)
Night Scene with Isotropic Source
Defocus Effects
![Page 24: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/24.jpg)
Scene with Multiple Sources
Scene with Colored and Anisotropic Sources
Coarse Depth Map
![Page 25: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/25.jpg)
Scene with Colored and Anisotropic Sources
Rendered Rain
![Page 26: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/26.jpg)
Scene with Colored and Anisotropic Sources
Streak Appearance ModelConstant Brightness Model
![Page 27: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/27.jpg)
Scene with Changing Sky Illumination
Input Scene Video
![Page 28: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/28.jpg)
Scene with Changing Sky Illumination
Rendered Rain
![Page 29: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/29.jpg)
A Scene with Moving Light Sources
Input Scene Video
![Page 30: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/30.jpg)
Rendered Video
A Scene with Moving Light Sources
![Page 31: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/31.jpg)
Future Extensions
• Real-time Implementation of Rendering Algorithm
• Incorporating the Effects of Wind and Turbulence
![Page 32: Photorealistic Rendering of Rain Streaks](https://reader038.fdocuments.net/reader038/viewer/2022102617/56813064550346895d963a07/html5/thumbnails/32.jpg)
Ren
der
edR
ain
Stre
aks
Rea
l Im
ages
of
Rai
n St
reak
s
Lighting Angle
Viewing Angle
Ren
der
edR
ain
Stre
aks
Rea
l Im
ages
of
Rai
n St
reak
s
Lighting Angle
Viewing Angle
Summary
Image-Based Rain Rendering Algorithm
Rain Streak Texture Database ( Publicly available: [email protected] )
Rain Streak Appearance Model
1,3A0,2A