Computer Graphics - Volume Rendering · Computer Graphics - Volume Rendering - Pascal Grittmann...

Computer Graphics

- Volume Rendering -

Pascal Grittmann

Using pictures from: Monte Carlo Methods for Physically Based Volume Rendering; SIGGRAPH 2018 Course; Jan Novák, Iliyan Georgiev, Johannes Hanika, Jaroslav Křivánek, Wojciech Jarosz

Overview• So far:

• Light interactions with surfaces• Assume vacuum in and around objects

• This lecture:• Participating media• How to represent volumetric data• How to compute volumetric lighting effects• How to implement a very basic volume renderer

06.12.2018 CG - Volume Rendering - Pascal Grittmann 2

Fundamentals

Volumetric Effects• Light interacts not only with surfaces but everywhere inside!

• Volumes scatter, emit, or absorb light

http://coclouds.com http://wikipedia.org http://commons.wikimedia.org

Approximation: Model Particle Density• Modeling individual particles of a volume is, of course, not practical

• Instead, represent statistically using the average density

• (Same idea as, e.g., microfacet BSDFs)

Volume Representation• Many possibilities (particles, voxel octrees, procedural,…)

• A common approach: Scene objects can “contain” a volume

Volume Representation• Homogeneous:

• Constant density• Constant absorption, scattering, emission, • Constant phase function (later)

• Heterogeneous:• Coefficients and/or phase function vary across the volume• Can be represented using 3D textures• (e.g., voxel grid, procedural)

http://wikipedia.org

Data Acquisition• Real-world measurements via tomography

• Simulation, e.g.,• Fluids,• Fire and smoke,• Fog

https://docs.blender.org

Simulating VolumesMathematical Formulation of Volumetric Light Transport

• Compute 𝐿𝑜(𝑥, 𝜔𝑜) using the rendering equation

So far: Assume Vacuum

• Only a fraction 𝑇 𝑎, 𝑏 𝐿𝑜 𝑥, 𝜔𝑜 arrives at the eye

Volume Absorbs and Scatters Light

𝑥𝑎 𝑏

• Every point 𝑧 between 𝑎 and 𝑏 might emit light

Volume Emits Light

𝑥𝑎 𝑏

• Every point 𝑧 between 𝑎 and 𝑏 might emit light

• Every point 𝑧 might be illuminated through the volume

Volume Scatters Light

𝑥𝑎 𝑏

AttenuationComputing Absorption and Out-Scattering

𝑥𝑎 𝑏

𝐿𝑖 = ?𝐿0 𝑥

http://commons.wikimedia.org

Attenuation = Absorption + Out-Scattering• Every point in the volume might absorb light or scatter it in other directions

• Modeled by absorption and scattering densities: 𝜇𝑎 𝑧 and 𝜇𝑠 𝑧

• Might depend on position, direction, time, wavelength,…

• For simplicity: we assume only positional dependence

𝑥𝑎 𝑏

Computing Absorption – Intuition • Consider a small segment Δ𝑧

• Along that segment, radiance is reduced from 𝐿 to 𝐿′

• 𝐿′ = 𝐿 − 𝜇𝑎 𝐿 Δ𝑧

• Where 𝜇𝑎 is the percentage of radiance that is absorbed (per unit distance)

𝑎 𝑏Δ𝑧

𝐿𝐿′

Computing Absorption – Intuition • Consider a small segment Δ𝑧

• Along that segment, radiance is reduced from 𝐿 to 𝐿′

• 𝐿′ = 𝐿 − 𝜇𝑎 𝐿 Δ𝑧

• Where 𝜇𝑎 is the percentage of radiance that is absorbed (per unit distance)

• Lets rewrite this:

• Δ𝐿 = 𝐿′ − 𝐿 = −𝜇𝑎 𝐿 Δ𝑧

𝑎 𝑏Δ𝑧

𝐿𝐿′

Computing Absorption – Exponential Decay • Δ𝐿 = −𝜇𝑎 𝐿 Δ𝑧

• For infinitely small Δ𝑧, this becomes

• 𝑑𝐿 = −𝜇𝑎 𝐿 𝑑𝑧

• A differential equation that models exponential decay!

• Solution: 𝐿 𝑎 = 𝐿𝑜 𝑥 𝑒− 𝑏𝑎𝜇𝑎 𝑡 𝑑𝑡

𝐿 𝑏 = 𝐿𝑜 𝑥

𝐿 𝑎

𝑎 𝑏Δ𝑧

𝐿𝐿′

Computing Out-Scattering• Same as absorption, only different factor!

• 𝜇𝑠 𝑧 : percentage of light scattered at point 𝑧

• 𝐿 𝑎 = 𝐿𝑜 𝑥 𝑒− 𝑏𝑎𝜇𝑠 𝑡 𝑑𝑡

𝑥𝑎 𝑏

Computing Attenuation• Fraction of light that is neither absorbed nor out-scattered

• 𝜇𝑡 = 𝜇𝑎 + 𝜇𝑠

• 𝐿 𝑎 = 𝐿𝑜 𝑥 𝑒− 𝑏𝑎(𝜇𝑎 𝑡 +𝜇𝑠 𝑡 ) 𝑑𝑡

• Attenuation: 𝑇 𝑎, 𝑏 = 𝑒− 𝑏𝑎𝜇𝑡 𝑡 𝑑𝑡

𝑥𝑎 𝑏

Computing Attenuation – Homogeneous • Simple case: constant density / attenuation

• 𝜇𝑡 𝑧 = 𝜇𝑡 ∀𝑧

• 𝑇 𝑎, 𝑏 = 𝑒− 𝑏𝑎𝜇𝑡 𝑡 𝑑𝑡 = 𝑒−(𝑎−𝑏)𝜇𝑡

𝑥𝑎 𝑏

Estimating Attenuation• We need to solve another integral:

• 𝑇 𝑎, 𝑏 = 𝑒− 𝑏𝑎𝜇𝑡 𝑡 𝑑𝑡

• Many solutions, e.g., Monte Carlo integration (next semester)

• Simple solution: Quadrature

Estimating Attenuation – Ray Marching• We need to solve another integral:

• 𝑇 𝑎, 𝑏 = 𝑒− 𝑏𝑎𝜇𝑡 𝑡 𝑑𝑡

• Simple solution: Quadrature

• Ray marching: evaluate at discrete positions (fixed stepsize Δ𝑧)

• 𝑏𝑎𝜇𝑡 𝑡 𝑑𝑡 ≈ σ𝑖 𝜇𝑡(𝑧𝑖) Δ𝑧

𝑥𝑎 𝑏

𝑧1 𝑧2 𝑧3

Δ𝑧 Δ𝑧 Δ𝑧Δ𝑧

EmissionExplosions!

𝑎 𝑏

http://wikipedia.org

Every Point Might Emit Light• Assume 𝑧 emits 𝐿𝑒 𝑧 towards 𝑎

• Some of that light might be absorbed or out-scattered: It is attenuated

• 𝐿 𝑎 = 𝐿𝑒 𝑧 𝑇 𝑧, 𝑎

𝑎 𝑏

Every Point Might Emit Light• Assume 𝑧 emits 𝐿𝑒 𝑧 towards 𝑎

• Some of that light might be absorbed or out-scattered: It is attenuated

• 𝐿 𝑎 = 𝐿𝑒 𝑧 𝑇 𝑧, 𝑎

• Happens at every point along the ray!

• 𝐿 𝑎 = 𝑎𝑏𝐿𝑒 𝑧 𝑇 𝑧, 𝑎 𝑑𝑧

• Another integral…

𝑎 𝑏

Ray Marching for Emission• Same as before: integrate via quadrature

• 𝑎𝑏𝐿𝑒 𝑧 𝑇 𝑧, 𝑎 𝑑𝑧 ≈ σ𝑖 𝐿𝑒 𝑧𝑖 𝑇 𝑧𝑖 , 𝑎 Δ𝑧

• Attenuation 𝑇 𝑧𝑖 , 𝑎 estimated as before

𝑥𝑎 𝑏

𝑧1 𝑧2 𝑧3

Ray Marching for Emission• Same as before: integrate via quadrature

• 𝑎𝑏𝐿𝑒 𝑧 𝑇 𝑧, 𝑎 𝑑𝑧 ≈ σ𝑖 𝐿𝑒 𝑧𝑖 𝑇 𝑧𝑖 , 𝑎 Δ𝑧

• Attenuation can be incrementally updated:• 𝑇 𝑧𝑖 , 𝑎 = 𝑇 𝑧𝑖−1, 𝑎 𝑇 𝑧𝑖 , 𝑧𝑖−1• (because it is an exponential function)

𝑥𝑎 𝑏

𝑧1 𝑧2 𝑧3

In-ScatteringAccounting for Reflections Inside the Volume

𝑎 𝑏

Direct Illumination• Account for the (attenuated) direct illumination at every point 𝑧

• Similar to the rendering equation:

• 𝐿𝑜 𝑧, 𝜔𝑜 = Ω 𝐿𝑖 𝑥, 𝜔𝑖 𝑓𝑝 𝜔𝑖 , 𝜔𝑜 𝑑𝜔𝑖

• Integration over the whole sphere Ω

• The phase function 𝑓𝑝 takes on the role of the BSDF

𝑎 𝑏

𝜔𝑖

𝜔𝑜

Phase Functions• 𝐿𝑜 𝑧, 𝜔𝑜 = Ω 𝐿𝑖 𝑥, 𝜔𝑖 𝒇𝒑 𝝎𝒊, 𝝎𝒐 𝑑𝜔𝑖

• Describe what fraction of light is reflected from 𝜔𝑖 to 𝜔𝑜

• Similar to BSDF for surface scattering

• Simplest example: isotropic phase function• 𝑓𝑝 𝜔𝑖 , 𝜔𝑜 =

• (energy conservation: Ω1

4𝜋𝑑𝜔 = 1)

Phase Functions: Henyey-Greenstein• Widely used

• Easy to fit to measured data

• 𝑓𝑝 𝜔𝑖 , 𝜔𝑜 =1

1−𝑔2

1+𝑔2+2𝑔 cos 𝜔𝑖,𝜔𝑜

• 𝑔: asymmetry (scalar)

• cos 𝜔𝑖 , 𝜔𝑜 : cosine of the angle formed by 𝜔𝑖 and 𝜔𝑜

Henyey-Greenstein: Asymmetry Parameter• 𝑔 = 0: isotropic

• Negative 𝑔: back scattering

• Positive 𝑔: forward scattering

http://coclouds.com

Forward Scattering

http://commons.wikimedia.org

Back Scattering

How to Estimate Volume Direct Illumination• Reflected radiance at a point 𝑧: 𝐿𝑜 𝑧, 𝜔𝑜 = Ω 𝐿𝑖 𝑥, 𝜔𝑖 𝑓𝑝 𝜔𝑖 , 𝜔𝑜 𝑑𝜔𝑖

• In our framework:• Sum over all point lights (as for surfaces)• Trace shadow ray (as for surfaces)• Estimate attenuation along the shadow ray (as for surfaces)

𝑎 𝑏

𝜔𝑖

𝜔𝑜

Ray Marching to Compute In-Scattering• Same as for emission

• Goal: estimate the integral 𝑎𝑏𝑇 𝑧, 𝑎 𝜇𝑠 𝑧 𝐿𝑖 𝑧 𝑓𝑝 𝑑𝑧

• Quadrature:

• 𝑎𝑏𝑇 𝑧, 𝑎 𝜇𝑠 𝑧 𝐿𝑖 𝑧 𝑓𝑝 𝑑𝑧 ≈ σ𝑖 𝑇 𝑧𝑖 , 𝑎 𝜇𝑠 𝑧 𝐿𝑖 𝑧𝑖 𝑓𝑝 Δ𝑧

𝑎 𝑏

𝑧1 𝑧2 𝑧3

Ray Marching to Compute In-Scattering• Same as for emission

• Goal: estimate the integral 𝑎𝑏𝑇 𝑧, 𝑎 𝐿𝑖 𝑧 𝑓𝑝 𝑑𝑧

• Quadrature:

• 𝑎𝑏𝑇 𝑧, 𝑎 𝐿𝑖 𝑧 𝑓𝑝 𝑑𝑧 ≈ σ𝑖 𝑇 𝑧𝑖 , 𝑎 𝐿𝑖 𝑧𝑖 𝑓𝑝 Δ𝑧

• Attenuation can be incrementally updated:• 𝑇 𝑧𝑖 , 𝑎 = 𝑇 𝑧𝑖−1, 𝑎 𝑇 𝑧𝑖 , 𝑧𝑖−1• (because it is an exponential function)

𝑎 𝑏

𝑧1 𝑧2 𝑧3

Putting it all TogetherA Simple Volume Integrator

A Simple Volume Integrator• Estimate direct illumination at x (as before)

• If volume: continue straight ahead until no volume (yields intersections y, z)

𝑥 𝑦 𝑧

• Ray marching to estimate attenuation, emission,

𝑥 𝑦 𝑧

• Ray marching to estimate attenuation, emission, and in-scattering• Shadow rays to the lights + ray marching to compute attenuation

𝑥 𝑦 𝑧

• Compute illumination at z (as before)

𝑥 𝑦 𝑧

• Add together:• Attenuated illumination from z• Volumetric emission along 𝑥𝑦• In-scattering along 𝑥𝑦• Direct illumination at 𝑥

𝑥 𝑦 𝑧

• Add together:• Attenuated illumination from z• Volumetric emission along 𝑥𝑦• In-scattering along 𝑥𝑦• Direct illumination at 𝑥

𝑥 𝑦 𝑧

{Multiply by BTDF!

Computer Graphics - Volume Rendering · Computer Graphics - Volume Rendering - Pascal Grittmann...

Documents

Transcript of Computer Graphics - Volume Rendering · Computer Graphics - Volume Rendering - Pascal Grittmann...

Volume Rendering & Shear-Warp Factorization Joe Zadeh January 22, 2002 CS395 - Advanced Graphics.

3D Graphics Rendering

Practical Volume Rendering in mobile devices · dering methods on a subset of the most relevant graphics hardware available in modern mobile devices. 2 Previous Work 2.1 Volume Rendering

Computer Graphics - Max Planck Societyresources.mpi-inf.mpg.de/departments/d4/teaching/ws200708/cg/sli… · Computer Graphics WS07/08 – Volume Rendering Indirect Volume Rendering

INVERSE RENDERING F OR COMPUTER GRAPHICS

Volume Rendering using Graphics Hardware

(~ Computer Graphics, Volume 23, Number 3, July 1989david/Classes/CS586/Papers/p271-kajiya.… · Computer Graphics, Volume 23, Number 3, July 1989 RENDERING FUR WITIt THREE DIMENSIONAL

advanced computer graphics - Rendering

3D Graphics Rendering and Terrain Modeling

Computer Graphics, Volume 21, Number 4, July 1987cs5610/handouts/reeves87.pdf~ Computer Graphics, Volume 21, Number 4, July 1987 III III Rendering Antialiased Shadows with Depth Maps

Computer Graphics, Volume 23, Number 3, July 1989 · @ ~)" Computer Graphics, Volume 23, Number 3, July 1989 • i The Synthesis and Rendering of Eroded Fractal Terrains F. Kenton

Illumination Networks: Fast Realistic Rendering with ... · PDF file~ Computer Graphics, Volume 23, ... Illumination Networks: Realistic Rendering with General Reflectance Functions

Real-Time Volume Graphics [03] GPU-Based Volume Rendering

Accelerating Vector Graphics Rendering using the Graphics Hardware Pipeline

The Graphics Pipeline and OpenGL IV - Stanford … · The Graphics Pipeline and OpenGL IV: Stereo Rendering, Depth of Field Rendering, Multi-pass Rendering! Gordon Wetzstein! Stanford

Hauptseminar – Computer Graphics Oliver Meister computer graphics & visualization HS Computer Graphics Cloud Rendering.

Volume Rendering Volume Modeling Volume Rendering Volume Modeling Volume Rendering 20 Apr. 2000.

Computer Graphics Classic Rendering Pipeline Overview.

19/18/2015 08:34 Graphics II 91.547 Volume Rendering Session 10.

Volume Rendering using Graphics Hardware - Penn Engineering