Rendering Outdoor Light Scattering in Real Time - AMDdeveloper.amd.com/wordpress/media/2012/10/GDC_02_HoffmanPreeth… · make better games Atmospheric Light Scattering • Is caused

makebettergames

Rendering Outdoor Light Scattering in Real Time

Naty HoffmanWestwood [email protected]

Arcot J PreethamATI Research

[email protected]

makebettergames

Outline– Basics

• Atmospheric Light Scattering• Radiometric Quantities• From Radiance to Pixels

– Scattering Theory• Absorption, Out-Scattering, In-Scattering• Rayleigh and Mie Scattering

– Implementation• Aerial Perspective, Sunlight, Skylight• Vertex Shader

– Future Work

makebettergames

Atmospheric Light Scattering• Is caused by a variety of particles

– Molecules, dust, water vapor, etc.

• These can cause light to be:– Scattered into the line of sight (in-scattering)

– Scattered out of the line of sight (out-scattering)

– Absorbed altogether (absorption)

Atmospheric Light Scattering• Illuminates the sky

Atmospheric Light Scattering• Attenuates and colors the Sun

Atmospheric Light Scattering• Attenuates and colors distant objects

Atmospheric Light Scattering• Varies by

– Time of Day– Weather– Pollution

Atmospheric Light Scattering• Varies by

– Time of Day– Weather– Pollution

Atmospheric Light Scattering• Varies by

– Time of Day– Weather– Pollution

Atmospheric Light Scattering• Varies by

– Time of Day– Weather– Pollution

Atmospheric Light Scattering• Varies between planets

makebettergames

Atmospheric Light Scattering• Extinction (Absorption, Out-scattering)

– Phenomena which remove light– Multiplicative:

• In-scattering:– Phenomenon which adds light– Additive:

• Combined:

0exextinction LFL =

inL

in0exscattering LLFL +=

makebettergames

Radiometric Quantities• Radiant Flux• Radiance• Irradiance

makebettergames

Radiometric Quantities• Radiant Flux

– Quantity of light through a surface– Radiant power (energy / time)– Watt

Φ

makebettergames

Radiometric Quantities

• Radiance L– Quantity of light in a single ray– Radiant flux / area / solid angle– Watt / (meter2 * steradian)

makebettergames

Radiometric Quantities

• Irradiance E– Quantity of light incident to a surface point– Incident radiant flux / area (Watt / meter2)– Radiance integrated over hemisphere

makebettergames

From Radiance to Pixels• Compute radiance incident to eye

through each screen pixel

makebettergames

From Radiance to Pixels• Pixel value based on radiance• But radiance is distributed

continuously along the spectrum– We need three numbers: R, G, B

makebettergames

From Radiance to Pixels• SPD (Spectral Power Distribution) to RGB

– Fast approach:• Do all math at R, G, B sample wavelengths

– Correct approach:• Use SPDs, convert final radiance to RGB

400nm 500nm 600nm 700nm

S

M L

makebettergames

Absorption• Absorption cross section

– Absorbed radiant flux per unit incident irradiance

– Units of area (meter2)

abσ

EΦ

abσ

makebettergames

Absorption• Absorption cross section

abσE=Φabσ

EΦ=abσ

abσ

makebettergames

Absorption• Absorption coefficient

– Particle density times absorption cross section

– Units of inverse length (meter-1)

abβabρ

abσ

makebettergames

Absorption• Total absorption cross section:

• Probability of absorption:

A

ds

dsA A ababab ρσ=

ababababab AAP βρσ === ds

makebettergames

Absorption• Attenuation of radiance from travel

through a constant-densityabsorptive medium:

( ) seLsL ab0

β−=

L0 L(s)s

makebettergames

Out-Scattering• Exactly as in the absorption case

– Scattering cross section– Scattering coefficient– Attenuation due to out-scattering in

a constant-density medium:

( ) seLsL sc0

β−=

scσscscsc σρβ =

scσ

makebettergames

Extinction• Both absorption and out-scattering

attenuate light• They can be combined as extinction• Extinction coefficient• Total attenuation from extinction

( ) seLsL ex0

β−= ( ) sesF exex

β−=

scabex βββ +=

makebettergames

In-Scattering• Light is scattered into a view ray

from all directions– From the sun– From the sky– From the ground

• We will only handle in-scattering from the sun

makebettergames

In-Scattering• Where does a scattered photon go?

– Scattering phase function• If a photon is scattered, gives the

probability it goes in direction• Most atmospheric particles are spherical

or very small:

( )ϕθ ,f

ϕθ ,

( ) ( )θϕθ ff =,

θ

makebettergames

In-Scattering• How do we use for in-scattering?

– In-scatter probability:– In-scatter radiance :

Eye ray

Sun

( )θf( ) sunωθf

( ) ( ) sunsunsun EfLf θωθ =

sunω

θ

makebettergames

In-Scattering• In-scattering over a path

– Radiance from a single event:

– Over a distance ds:

• Angular scattering coefficient

– In-scattering over ds:– Units of : meter-1 * steradian-1

( ) ( )θβθβ fscsc =

( ) sunEf θ( ) dsEf scsunβθ

( )dsE θβscsun

( )θβ sc

makebettergames

In-Scattering• Added radiance from solar in-

scattering through a constant-density scattering medium:

( ) ( )( )seEsL ex11, scsunex

inβθβ

βθ −−=

s( )θ,in sL

θ

makebettergames

Extinction and In-Scattering

( ) ( ) ( )θθ ,F, inex0 sLsLsL +=( ) ses ex

exF β−= ( ) ( )( )seEsL ex11, scsunex

inβθβ

βθ −−=

s( )θ,sL0L θ

makebettergames

Extinction and In-Scattering

( ) ( ) ( )θθ ,F, inex0 sLsLsL +=• Compare to hardware fog:

– Monochrome extinction– Added color completely non-

directional

( ) ( )( ) ( )sCsLs ff-1 fog0 +=L

makebettergames

Rayleigh Scattering• Small particles

• is proportional to

( )λ05.0<rscβ 4−λ

makebettergames

Rayleigh Scattering• Phase function:

( ) ( )θπ

θ 2R cos1

163

+=f

θ

Rayleigh Scattering

makebettergames

Mie Scattering• Larger, spherical particles• Phase function approximation:

– Henyey-Greenstein

( ) ( )( )( ) 2/32

2

HGcos214

1θπ

θgggf

−+

−=

0 -0.5 -0.750.50.75

makebettergames

Mie Scattering• Wavelength dependence

– Complex and depends on exact size of particle

– In practice, air usually contains a mix of various sizes of Mie particles• In the aggregate these tend to average

out any wavelength dependence

Mie Scattering

makebettergames

Combined Scattering• In practice, air contains both

Rayleigh and Mie scatterers• Absorption is usually slight• We will use:

Miesc

Rayleighscex βββ +=

( ) ( ) ( )θβθβθβ HGMiescR

Rayleighscsc ff +=

makebettergames

Parameters• Atmospheric parameters:

• Constant?– Affected by extinction

• Constant:

MiescβRayleigh

scβ HGg

sunE

0sunE

Implementation

How ?

Without scattering With scattering

Implementation• Aerial Perspective

– Extinction & Inscattering– Rays low in atmosphere– Constant density good approximation

s

θ

• Sunlight

– is white– Density is not constant!

– Use a more accurate model for Fex?

Implementation

ex0sun

groundsun FEE =

0sunE

groundsunE

0sunE

Implementation• Sunlight:

– Virtual sky dome, use simple model

density

distance( )θR

( )θR( )θsθθ

• Sky color:– Density is not constant! – More accurate model too expensive

• Many computations needed per frame

• Sky geometry– Virtual sky dome

Implementation( ) ( )ϕθϕθ ,, insky FL =

makebettergames

Implementation• Compute:

– Can be done with textures• 1D texture for

– Texture coordinate is a function of s• 2D texture for

– Texture coords are functions of s,• Combine in pixel shader

– We decided on a different approach

( ) ( ) ( )θθ ,F, inex0 sLsLsL +=

exF

inLθ

makebettergames

Implementation• Compute:

– Use vertex shader to compute– Apply as vertex interpolated colors

• In pixel shader, or even fixed pipeline

– Pros:• Doesn’t use valuable texture slots• Can change atmosphere properties

– Cons:• Somewhat dependent on tessellation

inex ,F L( ) ( ) ( )θθ ,F, inex0 sLsLsL +=

makebettergames

Vertex Shader

Rβ

HGg

extF oD0 =

Position

Mβin oD1 L=

Sun Direction

Eye Position

VertexShader

Transform Matrix

Constants:

sunE Outputs:

makebettergames

Vertex Shader

( ) ( )ses MRexF ββ +−=

( ) ( ) ( ) ( )( )seEsL MR1, sunMR

MRin

ββ

ββθβθβθ +−−

++

=

( ) ( ) ( )θθ ,F, inex0 sLsLsL +=

( ) ( )θβπ

θβ 2RR cos1

163 +=

( ) ( )( )( ) 2/32

2

MMcos21

141

θβ

πθβ

ggg

−+

−=

makebettergames

Vertex Shader• Current Implementation:

– 33 Instructions• Not including macro expansion• Could probably be optimized

– 8 registers

Pixel ShaderL = L0 * Fex + Lin

L0 =X

L0 * Fex

Fex

Pixel ShaderL = L0 * Fex + Lin

L0 * Fex + =

L = L0 * Fex + Lin

Lin

Results

Rayleigh Scattering - highMie Scattering - lowSun Altitude - high

Rayleigh Scattering - lowMie Scattering - highSun Altitude - high

Rayleigh Scattering - mediumMie Scattering - mediumSun Altitude - low

Planet Mars like scattering

Demo

makebettergames

Conclusion

• Scattering is easy to implement.• Easy to add to an existing

rendering framework– compute Fex and Lin

– apply these to existing color to get final color

makebettergames

Future Work• In-scattering from sky• Clouds (scattering and extinction)• Volumetric cloud shadows• Non-uniform density distributions• Full-spectrum math?

makebettergames

Acknowledgements• We would like to thank

– Kenny Mitchell for the terrain engine used in our demo

– Solomon Srinivasan for help with the demo movie

makebettergames

References[Blinn1982] J. F. Blinn. Light Reflection Functions for Simulation of Clouds and

Dusty Surfaces. [Dutré2001] P. Dutré. Global Illumination Compendium.[Henyey1941] L. G. Henyey and J. L. Greenstein. Diffuse Reflection in the

Galaxy.[Hoffman2001] N. Hoffman and K. J. Mitchell. Photorealistic Terrain Lighting in

Real Time.[Klassen1987] R. V. Klassen. Modeling the Effect of the Atmosphere on Light.[Mie1908] G. Mie. Bietage zur Optik truber Medien Speziell Kolloidaler

Metallosungen.[Preetham1999] A. J. Preetham, P. Shirley, B. E. Smits. A Practical Analytic

Model for Daylight.[Rayleigh1871] J. W. Strutt (Lord Rayleigh). On the light from the sky, its

polarization and colour.[Yee2002] H. Yee, P. Dutré, S. Pattanaik. Fundamentals of Lighting and

Perception: The Rendering of Physically Accurate Images.

makebettergames

THANK YOU