Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common...

137
Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington 6 July 2011 Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 1 / 50

Transcript of Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common...

Page 1: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Strengths and Weaknesses of Common NumericalMethods for Simulating Atmospheric Flows

Dale DurranUniversity of Washington

6 July 2011

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 1 / 50

Page 2: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Introduction

Broad Categories

Spatially discreteFinite differenceFinite volume

Series expansions

Orthogonal expansion functionsFinite elements

Hybrids

Spectral element and discontinuous Galerkin

Fluid dynamical viewpoint

EulerianLagrangianSemi-Lagrangian

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 2 / 50

Page 3: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Introduction

Broad Categories

Spatially discreteFinite differenceFinite volume

Series expansionsOrthogonal expansion functionsFinite elements

Hybrids

Spectral element and discontinuous Galerkin

Fluid dynamical viewpoint

EulerianLagrangianSemi-Lagrangian

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 2 / 50

Page 4: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Introduction

Broad Categories

Spatially discreteFinite differenceFinite volume

Series expansionsOrthogonal expansion functionsFinite elements

HybridsSpectral element and discontinuous Galerkin

Fluid dynamical viewpoint

EulerianLagrangianSemi-Lagrangian

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 2 / 50

Page 5: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Introduction

Broad Categories

Spatially discreteFinite differenceFinite volume

Series expansionsOrthogonal expansion functionsFinite elements

HybridsSpectral element and discontinuous Galerkin

Fluid dynamical viewpointEulerianLagrangianSemi-Lagrangian

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 2 / 50

Page 6: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Introduction

Illustrative Equation

Transport in 2D nondivergent flow.

Advective form:∂ψ

∂t+ u

∂ψ

∂x+ v

∂ψ

∂y= 0.

Flux form, an equivalent expression obtained using continuity:

∂ψ

∂t+∂uψ∂x

+∂vψ∂y

= 0.

Flux form facilitates the construction of schemes with local(cell-wise) and global conservation.Advective form helps preserve uniform ψ in non-trivial velocityfields

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 3 / 50

Page 7: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Introduction

Illustrative Equation

Transport in 2D nondivergent flow.

Advective form:∂ψ

∂t+ u

∂ψ

∂x+ v

∂ψ

∂y= 0.

Flux form, an equivalent expression obtained using continuity:

∂ψ

∂t+∂uψ∂x

+∂vψ∂y

= 0.

Flux form facilitates the construction of schemes with local(cell-wise) and global conservation.Advective form helps preserve uniform ψ in non-trivial velocityfields

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 3 / 50

Page 8: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Introduction

Illustrative Equation

Transport in 2D nondivergent flow.

Advective form:∂ψ

∂t+ u

∂ψ

∂x+ v

∂ψ

∂y= 0.

Flux form, an equivalent expression obtained using continuity:

∂ψ

∂t+∂uψ∂x

+∂vψ∂y

= 0.

Flux form facilitates the construction of schemes with local(cell-wise) and global conservation.

Advective form helps preserve uniform ψ in non-trivial velocityfields

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 3 / 50

Page 9: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Introduction

Illustrative Equation

Transport in 2D nondivergent flow.

Advective form:∂ψ

∂t+ u

∂ψ

∂x+ v

∂ψ

∂y= 0.

Flux form, an equivalent expression obtained using continuity:

∂ψ

∂t+∂uψ∂x

+∂vψ∂y

= 0.

Flux form facilitates the construction of schemes with local(cell-wise) and global conservation.Advective form helps preserve uniform ψ in non-trivial velocityfields

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 3 / 50

Page 10: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Finite difference notation

δnx f (x) =f (x + n∆x/2)− f (x − n∆x/2)

n∆x

Example:

δx fj =fj+ 1

2− fj− 1

2

∆xLocal conservation:

dφi,j

dt+ δx (ui,jφi,j) + δy (vi,jφi,j) = 0

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 4 / 50

Page 11: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Finite difference notation

δnx f (x) =f (x + n∆x/2)− f (x − n∆x/2)

n∆xExample:

δx fj =fj+ 1

2− fj− 1

2

∆x

Local conservation:

dφi,j

dt+ δx (ui,jφi,j) + δy (vi,jφi,j) = 0

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 4 / 50

Page 12: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Finite difference notation

δnx f (x) =f (x + n∆x/2)− f (x − n∆x/2)

n∆xExample:

δx fj =fj+ 1

2− fj− 1

2

∆xLocal conservation:

dφi,j

dt+ δx (ui,jφi,j) + δy (vi,jφi,j) = 0

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 4 / 50

Page 13: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Finite-Difference Methods

Unknowns are

values at points on a grid: φnj ≈ ψ(j∆x ,n∆t)

Can approximate flux or advective formBasic methods are quite simple:(

dψdx

)j

= δ2xφj+O[(∆x)2],

(dψdx

)j

=43δ2xφj−

13δ4xφj+O[(∆x)4]

More advanced approach: a 4th-order compact scheme

124

[5(

dψdx

)j+1

+ 14(

dψdx

)j

+ 5(

dψdx

)j−1

]=

112(11δ2xφj + δ4xφj

)

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 5 / 50

Page 14: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Finite-Difference Methods

Unknowns are values at points on a grid: φnj ≈ ψ(j∆x ,n∆t)

Can approximate flux or advective formBasic methods are quite simple:(

dψdx

)j

= δ2xφj+O[(∆x)2],

(dψdx

)j

=43δ2xφj−

13δ4xφj+O[(∆x)4]

More advanced approach: a 4th-order compact scheme

124

[5(

dψdx

)j+1

+ 14(

dψdx

)j

+ 5(

dψdx

)j−1

]=

112(11δ2xφj + δ4xφj

)

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 5 / 50

Page 15: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Finite-Difference Methods

Unknowns are values at points on a grid: φnj ≈ ψ(j∆x ,n∆t)

Can approximate flux or advective form

Basic methods are quite simple:(dψdx

)j

= δ2xφj+O[(∆x)2],

(dψdx

)j

=43δ2xφj−

13δ4xφj+O[(∆x)4]

More advanced approach: a 4th-order compact scheme

124

[5(

dψdx

)j+1

+ 14(

dψdx

)j

+ 5(

dψdx

)j−1

]=

112(11δ2xφj + δ4xφj

)

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 5 / 50

Page 16: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Finite-Difference Methods

Unknowns are values at points on a grid: φnj ≈ ψ(j∆x ,n∆t)

Can approximate flux or advective formBasic methods are quite simple:(

dψdx

)j

= δ2xφj+O[(∆x)2],

(dψdx

)j

=43δ2xφj−

13δ4xφj+O[(∆x)4]

More advanced approach: a 4th-order compact scheme

124

[5(

dψdx

)j+1

+ 14(

dψdx

)j

+ 5(

dψdx

)j−1

]=

112(11δ2xφj + δ4xφj

)

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 5 / 50

Page 17: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Finite-Difference Methods

Unknowns are values at points on a grid: φnj ≈ ψ(j∆x ,n∆t)

Can approximate flux or advective formBasic methods are quite simple:(

dψdx

)j

= δ2xφj+O[(∆x)2],

(dψdx

)j

=43δ2xφj−

13δ4xφj+O[(∆x)4]

More advanced approach: a 4th-order compact scheme

124

[5(

dψdx

)j+1

+ 14(

dψdx

)j

+ 5(

dψdx

)j−1

]=

112(11δ2xφj + δ4xφj

)

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 5 / 50

Page 18: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Phase Speed Error in 1D Advection

Semi-discrete approximation to∂ψ

∂t+ c

∂ψ

∂x= 0.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 6 / 50

Page 19: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Utility of High Order

High order schemes converge more rapidly as the grid is refined whenthe solution is already almost correct.

They are essential for efficiency when really trying to converge.Convergence is never achieved in high Reynolds numberatmospheric flow. (Why not?)

Exception: all those complicated linear solutions for nontrivial basicstates!

In atmospheric applications, errors are generally dominated by themost poorly resolved scales.High-order schemes may treat the marginally resolved scalesbetter.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 7 / 50

Page 20: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Utility of High Order

High order schemes converge more rapidly as the grid is refined whenthe solution is already almost correct.

They are essential for efficiency when really trying to converge.

Convergence is never achieved in high Reynolds numberatmospheric flow. (Why not?)

Exception: all those complicated linear solutions for nontrivial basicstates!

In atmospheric applications, errors are generally dominated by themost poorly resolved scales.High-order schemes may treat the marginally resolved scalesbetter.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 7 / 50

Page 21: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Utility of High Order

High order schemes converge more rapidly as the grid is refined whenthe solution is already almost correct.

They are essential for efficiency when really trying to converge.Convergence is never achieved in high Reynolds numberatmospheric flow. (Why not?)

Exception: all those complicated linear solutions for nontrivial basicstates!

In atmospheric applications, errors are generally dominated by themost poorly resolved scales.High-order schemes may treat the marginally resolved scalesbetter.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 7 / 50

Page 22: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Utility of High Order

High order schemes converge more rapidly as the grid is refined whenthe solution is already almost correct.

They are essential for efficiency when really trying to converge.Convergence is never achieved in high Reynolds numberatmospheric flow. (Why not?)

Exception: all those complicated linear solutions for nontrivial basicstates!

In atmospheric applications, errors are generally dominated by themost poorly resolved scales.High-order schemes may treat the marginally resolved scalesbetter.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 7 / 50

Page 23: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Utility of High Order

High order schemes converge more rapidly as the grid is refined whenthe solution is already almost correct.

They are essential for efficiency when really trying to converge.Convergence is never achieved in high Reynolds numberatmospheric flow. (Why not?)

Exception: all those complicated linear solutions for nontrivial basicstates!

In atmospheric applications, errors are generally dominated by themost poorly resolved scales.

High-order schemes may treat the marginally resolved scalesbetter.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 7 / 50

Page 24: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Utility of High Order

High order schemes converge more rapidly as the grid is refined whenthe solution is already almost correct.

They are essential for efficiency when really trying to converge.Convergence is never achieved in high Reynolds numberatmospheric flow. (Why not?)

Exception: all those complicated linear solutions for nontrivial basicstates!

In atmospheric applications, errors are generally dominated by themost poorly resolved scales.High-order schemes may treat the marginally resolved scalesbetter.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 7 / 50

Page 25: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Utility of High Order II

Is it best to approximate all terms with differences having the sameorder of accuracy?

Yes – if you are trying to achieve convergence.Not particularly if you are trying to improve the representation ofpoorly resolved scales.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 8 / 50

Page 26: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Utility of High Order II

Is it best to approximate all terms with differences having the sameorder of accuracy?

Yes – if you are trying to achieve convergence.

Not particularly if you are trying to improve the representation ofpoorly resolved scales.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 8 / 50

Page 27: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Utility of High Order II

Is it best to approximate all terms with differences having the sameorder of accuracy?

Yes – if you are trying to achieve convergence.Not particularly if you are trying to improve the representation ofpoorly resolved scales.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 8 / 50

Page 28: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Example: Staggered Meshes

Arakawa C-grid

um+ 1 , n 2

wm,n+ 1

2

∆z

∆x

Pm,n bm,n

um– 1 , n 2

wm,n– 1

2

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 9 / 50

Page 29: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Example: Staggered Meshes II

Phase speeds using staggered (S) or unstaggered (U) 2nd- or 4th-order differences

0 π/4∆ π/2∆ 3π/4∆ π/∆WAVE NUMBER

50∆ 10∆ 6∆ 4∆ 3∆ 2∆WAVELENGTH

0

c

PHAS

E S

PEED

E

2S

2U4U

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 10 / 50

Page 30: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Trouble with 2∆x-Waves

Finite-difference methods do not propagate 2∆x-waves on anunstaggered mesh. Why not?

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 11 / 50

Page 31: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Trouble with 2∆x-Waves

Finite-difference methods do not propagate 2∆x-waves on anunstaggered mesh. Why not?

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 11 / 50

Page 32: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

2∆x-Waves and Negative Group Velocities

Animation of 2∆x-wide spike simulated by upstream and by explicitcentered 2nd and 4th-order finite differences.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 12 / 50

Page 33: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

2∆x-Waves and Negative Group Velocities

Group velocity is ∂(frequency)∂(wavenumber)

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 13 / 50

Page 34: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Killing Off 2∆x-Waves

2∆x waves are in serious errorVery short waves can generate aliasing error

Remove the very short waves via:A scale-selective global filter

(Nonlinear) local filters that become active only in regions withlarge-amplitude short-waves

e.g., WENO finite difference methodsMajor focus of finite-volume methods

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 14 / 50

Page 35: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Killing Off 2∆x-Waves

2∆x waves are in serious errorVery short waves can generate aliasing error

Remove the very short waves via:A scale-selective global filter

(Nonlinear) local filters that become active only in regions withlarge-amplitude short-waves

e.g., WENO finite difference methodsMajor focus of finite-volume methods

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 14 / 50

Page 36: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Killing Off 2∆x-Waves

2∆x waves are in serious errorVery short waves can generate aliasing error

Remove the very short waves via:A scale-selective global filter(Nonlinear) local filters that become active only in regions withlarge-amplitude short-waves

e.g., WENO finite difference methodsMajor focus of finite-volume methods

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 14 / 50

Page 37: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Killing Off 2∆x-Waves

2∆x waves are in serious errorVery short waves can generate aliasing error

Remove the very short waves via:A scale-selective global filter(Nonlinear) local filters that become active only in regions withlarge-amplitude short-waves

e.g., WENO finite difference methods

Major focus of finite-volume methods

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 14 / 50

Page 38: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Killing Off 2∆x-Waves

2∆x waves are in serious errorVery short waves can generate aliasing error

Remove the very short waves via:A scale-selective global filter(Nonlinear) local filters that become active only in regions withlarge-amplitude short-waves

e.g., WENO finite difference methodsMajor focus of finite-volume methods

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 14 / 50

Page 39: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Finite Volume Methods

Unknowns are cell averages:

φnj ≈

1∆x

∫ xj +∆x/2

xj−∆x/2ψ(x ,n∆t) dx

Essential for the simulation of shocksWeak solutions satisfy integral form of conservation law

Approximations most naturally in flux formFluxes at cell boundaries computed from sub-cell reconstructionsLeads directly to two-level forward-in-time schemes

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 15 / 50

Page 40: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Finite Volume Methods

Unknowns are cell averages:

φnj ≈

1∆x

∫ xj +∆x/2

xj−∆x/2ψ(x ,n∆t) dx

Essential for the simulation of shocksWeak solutions satisfy integral form of conservation law

Approximations most naturally in flux formFluxes at cell boundaries computed from sub-cell reconstructionsLeads directly to two-level forward-in-time schemes

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 15 / 50

Page 41: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Finite Volume Methods

Unknowns are cell averages:

φnj ≈

1∆x

∫ xj +∆x/2

xj−∆x/2ψ(x ,n∆t) dx

Essential for the simulation of shocksWeak solutions satisfy integral form of conservation law

Approximations most naturally in flux form

Fluxes at cell boundaries computed from sub-cell reconstructionsLeads directly to two-level forward-in-time schemes

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 15 / 50

Page 42: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Finite Volume Methods

Unknowns are cell averages:

φnj ≈

1∆x

∫ xj +∆x/2

xj−∆x/2ψ(x ,n∆t) dx

Essential for the simulation of shocksWeak solutions satisfy integral form of conservation law

Approximations most naturally in flux formFluxes at cell boundaries computed from sub-cell reconstructions

Leads directly to two-level forward-in-time schemes

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 15 / 50

Page 43: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Finite Volume Methods

Unknowns are cell averages:

φnj ≈

1∆x

∫ xj +∆x/2

xj−∆x/2ψ(x ,n∆t) dx

Essential for the simulation of shocksWeak solutions satisfy integral form of conservation law

Approximations most naturally in flux formFluxes at cell boundaries computed from sub-cell reconstructionsLeads directly to two-level forward-in-time schemes

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 15 / 50

Page 44: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Sub-Cell Reconstructions

f

x0 2π

f

x0 2π

(a)

(b)

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 16 / 50

Page 45: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Avoiding overshoots and undershoots

When it it important?

When simulating shocks. Consistent monotonemethods in flux form converge to the entropy consistent solution.

φn+1j = H(φn

j−p, . . . , φnj+q+1),

is monotone if∂ H(φj−p, . . . , φj+q+1)

∂φi≥ 0

for each integer i in the interval [j − p, j + q+1].

Monotone schemesDo not produce spurious ripples.Are first-order accurate.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 17 / 50

Page 46: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Avoiding overshoots and undershoots

When it it important? When simulating shocks. Consistent monotonemethods in flux form converge to the entropy consistent solution.

φn+1j = H(φn

j−p, . . . , φnj+q+1),

is monotone if∂ H(φj−p, . . . , φj+q+1)

∂φi≥ 0

for each integer i in the interval [j − p, j + q+1].

Monotone schemesDo not produce spurious ripples.Are first-order accurate.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 17 / 50

Page 47: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Avoiding overshoots and undershoots

When it it important? When simulating shocks. Consistent monotonemethods in flux form converge to the entropy consistent solution.

φn+1j = H(φn

j−p, . . . , φnj+q+1),

is monotone if∂ H(φj−p, . . . , φj+q+1)

∂φi≥ 0

for each integer i in the interval [j − p, j + q+1].

Monotone schemesDo not produce spurious ripples.Are first-order accurate.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 17 / 50

Page 48: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Avoiding overshoots and undershoots

When it it important? When simulating shocks. Consistent monotonemethods in flux form converge to the entropy consistent solution.

φn+1j = H(φn

j−p, . . . , φnj+q+1),

is monotone if∂ H(φj−p, . . . , φj+q+1)

∂φi≥ 0

for each integer i in the interval [j − p, j + q+1].

Monotone schemesDo not produce spurious ripples.Are first-order accurate.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 17 / 50

Page 49: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Advection of a Step Function

0.5 1 0.5 1x x

(a) (b)

Left: 2nd-order centered with global 4th-derivative smoother

Right: Upstream and Lax-Friedrichs (red) monotone methods

Strategy: Scheme becomes monotone near discontinuities and ishigh-order elsewhere.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 18 / 50

Page 50: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Advection of a Step Function

0.5 1 0.5 1x x

(a) (b)

Left: 2nd-order centered with global 4th-derivative smoother

Right: Upstream and Lax-Friedrichs (red) monotone methods

Strategy: Scheme becomes monotone near discontinuities and ishigh-order elsewhere.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 18 / 50

Page 51: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Avoiding overshoots and undershoots

When is it important in problems without shocks?

Chemically reactingflow

∂ψ1

∂t+ c

∂ψ1

∂x= −rψ1ψ2,

∂ψ2

∂t+ c

∂ψ2

∂x= rψ1ψ2.

ψ1

ψ2

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 19 / 50

Page 52: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Avoiding overshoots and undershoots

When is it important in problems without shocks? Chemically reactingflow

∂ψ1

∂t+ c

∂ψ1

∂x= −rψ1ψ2,

∂ψ2

∂t+ c

∂ψ2

∂x= rψ1ψ2.

ψ1

ψ2

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 19 / 50

Page 53: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Avoiding overshoots and undershoots

When is it important in problems without shocks? Chemically reactingflow

∂ψ1

∂t+ c

∂ψ1

∂x= −rψ1ψ2,

∂ψ2

∂t+ c

∂ψ2

∂x= rψ1ψ2.

ψ1

ψ2

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 19 / 50

Page 54: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Avoiding overshoots and undershoots

When is it important in problems without shocks? Chemically reactingflow

∂ψ1

∂t+ c

∂ψ1

∂x= −rψ1ψ2,

∂ψ2

∂t+ c

∂ψ2

∂x= rψ1ψ2.

ψ1

ψ2

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 20 / 50

Page 55: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Minmod limiter

One local-smoothing strategy to prevent growth of ripples.

x

φ~

If sgn(φj+1 − φj) 6= sgn(φj − φj−1) slope in cell j is zeroOtherwise | slope | is min(|φj+1 − φj |, |φj − φj−1|)

Scheme is TVD, but not monotone.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 21 / 50

Page 56: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Minmod limiter

One local-smoothing strategy to prevent growth of ripples.

x

φ~

If sgn(φj+1 − φj) 6= sgn(φj − φj−1) slope in cell j is zeroOtherwise | slope | is min(|φj+1 − φj |, |φj − φj−1|)

Scheme is TVD, but not monotone.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 21 / 50

Page 57: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Limiters in Action

Minmod (long-dashed), MC (red), Superbee (short-dashed)

(a) (b)

2 3x

0 30∆x

Nice job at jump, but messes up smooth extremum.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 22 / 50

Page 58: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Limiters in Action

Minmod (long-dashed), MC (red), Superbee (short-dashed)

(a) (b)

2 3x

0 30∆x

Nice job at jump, but messes up smooth extremum.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 22 / 50

Page 59: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Order of Accuracy

Scheme Estimated Order of AccuracyUpstream 0.9

Minmod Limiter 1.6Superbee Limiter 1.6

Zalesak FCT 1.7MC Limiter 1.9

Lax–Wendroff 2.0

Table: Empirically determined order of accuracy for constant-wind-speedadvection of a sine wave

Avoid limiting smooth extrema!

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 23 / 50

Page 60: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Spatially Discrete

Order of Accuracy

Scheme Estimated Order of AccuracyUpstream 0.9

Minmod Limiter 1.6Superbee Limiter 1.6

Zalesak FCT 1.7MC Limiter 1.9

Lax–Wendroff 2.0

Table: Empirically determined order of accuracy for constant-wind-speedadvection of a sine wave

Avoid limiting smooth extrema!

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 23 / 50

Page 61: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Series Expansions

Orthogonal Expansion Functions

Unknowns are coefficients of expansion functions ak (t)

φ(x , t) =N∑

k=1

ak (t)ϕk (x)

Evolution equations for ak obtained viaGalerkin requirement that residual be orthogonal to all ϕk (x)

“Spectral"Global conservation of φ and φ2

Collocation requirement that sets the residual to zero at a set ofgrid points

“Pseudo-spectral"50% faster than spectralLose conservation

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 24 / 50

Page 62: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Series Expansions

Orthogonal Expansion Functions

Unknowns are coefficients of expansion functions ak (t)

φ(x , t) =N∑

k=1

ak (t)ϕk (x)

Evolution equations for ak obtained viaGalerkin requirement that residual be orthogonal to all ϕk (x)

“Spectral"Global conservation of φ and φ2

Collocation requirement that sets the residual to zero at a set ofgrid points

“Pseudo-spectral"50% faster than spectralLose conservation

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 24 / 50

Page 63: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Series Expansions

Orthogonal Expansion Functions

Unknowns are coefficients of expansion functions ak (t)

φ(x , t) =N∑

k=1

ak (t)ϕk (x)

Evolution equations for ak obtained viaGalerkin requirement that residual be orthogonal to all ϕk (x)

“Spectral"Global conservation of φ and φ2

Collocation requirement that sets the residual to zero at a set ofgrid points

“Pseudo-spectral"50% faster than spectralLose conservation

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 24 / 50

Page 64: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Series Expansions

Orthogonal Expansion Functions – II

Using orthogonal expansion functionsDecouples the evolution equations for the ak (good for explicit timedifferencing).

Computation of the forcing for all N of the ak involves O(N2)operations (Fourier methods can be O(N log N)).“Spectral accuracy" when approximating smooth functions — errorgoes to zero faster than any finite power of the effective gridspacing.Not conducive to preserving positivity or treating steep gradients

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 25 / 50

Page 65: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Series Expansions

Orthogonal Expansion Functions – II

Using orthogonal expansion functionsDecouples the evolution equations for the ak (good for explicit timedifferencing).Computation of the forcing for all N of the ak involves O(N2)operations (Fourier methods can be O(N log N)).

“Spectral accuracy" when approximating smooth functions — errorgoes to zero faster than any finite power of the effective gridspacing.Not conducive to preserving positivity or treating steep gradients

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 25 / 50

Page 66: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Series Expansions

Orthogonal Expansion Functions – II

Using orthogonal expansion functionsDecouples the evolution equations for the ak (good for explicit timedifferencing).Computation of the forcing for all N of the ak involves O(N2)operations (Fourier methods can be O(N log N)).“Spectral accuracy" when approximating smooth functions — errorgoes to zero faster than any finite power of the effective gridspacing.

Not conducive to preserving positivity or treating steep gradients

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 25 / 50

Page 67: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Series Expansions

Orthogonal Expansion Functions – II

Using orthogonal expansion functionsDecouples the evolution equations for the ak (good for explicit timedifferencing).Computation of the forcing for all N of the ak involves O(N2)operations (Fourier methods can be O(N log N)).“Spectral accuracy" when approximating smooth functions — errorgoes to zero faster than any finite power of the effective gridspacing.Not conducive to preserving positivity or treating steep gradients

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 25 / 50

Page 68: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Series Expansions

Global Overshoots and Undershoots with PoorResolution

(b)(a)

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 26 / 50

Page 69: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Series Expansions

Global Spectral Model

Expansion functions are spherical harmonics.Avoids problems with short time steps at poles.

Efficient semi-implicit approximation of the pressure gradientterms.Common choice for the dynamical variables in global hydrostaticmodels.Moisture variables often finite volume or finite difference.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 27 / 50

Page 70: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Series Expansions

Global Spectral Model

Expansion functions are spherical harmonics.Avoids problems with short time steps at poles.Efficient semi-implicit approximation of the pressure gradientterms.

Common choice for the dynamical variables in global hydrostaticmodels.Moisture variables often finite volume or finite difference.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 27 / 50

Page 71: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Series Expansions

Global Spectral Model

Expansion functions are spherical harmonics.Avoids problems with short time steps at poles.Efficient semi-implicit approximation of the pressure gradientterms.Common choice for the dynamical variables in global hydrostaticmodels.

Moisture variables often finite volume or finite difference.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 27 / 50

Page 72: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Series Expansions

Global Spectral Model

Expansion functions are spherical harmonics.Avoids problems with short time steps at poles.Efficient semi-implicit approximation of the pressure gradientterms.Common choice for the dynamical variables in global hydrostaticmodels.Moisture variables often finite volume or finite difference.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 27 / 50

Page 73: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Series Expansions

Finite Element Methods

Piecewise linear elements (chapeau functions)

x0 2π

0

16

0

17

0

15

0

18

0

13

0

14

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 28 / 50

Page 74: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Series Expansions

Finite Element Methods

Expansion functions have compact supportEvaluation of the forcing for all N of the ak involves only O(N)operations.

The evolution equations for the ak are coupledImplicit solve every time stepVery inefficient for wave-propagation problems

Implicit coupling in quadratic or cubic finite element methodsmakes them completely impractical for the simulation of waves.Higher-order finite element methods are the nevertheless thestandard approach for solving may elliptic problems.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 29 / 50

Page 75: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Series Expansions

Finite Element Methods

Expansion functions have compact supportEvaluation of the forcing for all N of the ak involves only O(N)operations.The evolution equations for the ak are coupled

Implicit solve every time stepVery inefficient for wave-propagation problems

Implicit coupling in quadratic or cubic finite element methodsmakes them completely impractical for the simulation of waves.Higher-order finite element methods are the nevertheless thestandard approach for solving may elliptic problems.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 29 / 50

Page 76: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Series Expansions

Finite Element Methods

Expansion functions have compact supportEvaluation of the forcing for all N of the ak involves only O(N)operations.The evolution equations for the ak are coupled

Implicit solve every time stepVery inefficient for wave-propagation problems

Implicit coupling in quadratic or cubic finite element methodsmakes them completely impractical for the simulation of waves.

Higher-order finite element methods are the nevertheless thestandard approach for solving may elliptic problems.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 29 / 50

Page 77: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Series Expansions

Finite Element Methods

Expansion functions have compact supportEvaluation of the forcing for all N of the ak involves only O(N)operations.The evolution equations for the ak are coupled

Implicit solve every time stepVery inefficient for wave-propagation problems

Implicit coupling in quadratic or cubic finite element methodsmakes them completely impractical for the simulation of waves.Higher-order finite element methods are the nevertheless thestandard approach for solving may elliptic problems.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 29 / 50

Page 78: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Series Expansions

Finite Element versus Compact Differencing in 1D

1D advection equation∂ψ

∂t+ c

∂ψ

∂x= 0

Piecewise linear finite-elements:

ddt

(aj+1 + 4aj + aj−1

6

)+ c

(aj+1 − aj−1

2∆x

)= 0

4th-order compact scheme:

dφj

dt+ c

(dψdx

)j

= 0

16

[(dψdx

)j+1

+ 4(

dψdx

)j

+

(dψdx

)j−1

]=φj+1 − φj−1

2∆x

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 30 / 50

Page 79: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Series Expansions

Finite Element versus Compact Differencing in 1D

1D advection equation∂ψ

∂t+ c

∂ψ

∂x= 0

Piecewise linear finite-elements:

ddt

(aj+1 + 4aj + aj−1

6

)+ c

(aj+1 − aj−1

2∆x

)= 0

4th-order compact scheme:

dφj

dt+ c

(dψdx

)j

= 0

16

[(dψdx

)j+1

+ 4(

dψdx

)j

+

(dψdx

)j−1

]=φj+1 − φj−1

2∆x

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 30 / 50

Page 80: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Series Expansions

Finite Element versus Compact Differencing in 1D

1D advection equation∂ψ

∂t+ c

∂ψ

∂x= 0

Piecewise linear finite-elements:

ddt

(aj+1 + 4aj + aj−1

6

)+ c

(aj+1 − aj−1

2∆x

)= 0

4th-order compact scheme:

dφj

dt+ c

(dψdx

)j

= 0

16

[(dψdx

)j+1

+ 4(

dψdx

)j

+

(dψdx

)j−1

]=φj+1 − φj−1

2∆x

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 30 / 50

Page 81: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Series Expansions

Finite Element versus Compact Differencing in 1D

Schemes are identical!

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 31 / 50

Page 82: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Series Expansions

Finite Element versus Compact Differencing in 2D

4th-order compact scheme:

dφi,j

dt+ u

(dψdx

)i,j

+ v(

dψdy

)i,j

= 0

16

[(dψdx

)i+1,j

+ 4(

dψdx

)i,j

+

(dψdx

)i−1,j

]=φi+1,j − φi−1,j

2∆x

16

[(dψdy

)i,j+1

+ 4(

dψdy

)i,j

+

(dψdy

)i,j−1

]=φi,j+1 − φi,j−1

2∆y

Finite-elements: huge implicit mess (element couples with itself and 8neighbors).

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 32 / 50

Page 83: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Series Expansions

Finite Element versus Compact Differencing in 2D

4th-order compact scheme:

dφi,j

dt+ u

(dψdx

)i,j

+ v(

dψdy

)i,j

= 0

16

[(dψdx

)i+1,j

+ 4(

dψdx

)i,j

+

(dψdx

)i−1,j

]=φi+1,j − φi−1,j

2∆x

16

[(dψdy

)i,j+1

+ 4(

dψdy

)i,j

+

(dψdy

)i,j−1

]=φi,j+1 − φi,j−1

2∆y

Finite-elements: huge implicit mess (element couples with itself and 8neighbors).

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 32 / 50

Page 84: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Hybrid Methods

The Challenge

How do weExtend finite-volume methods to high order (beyond piecewiseparabolic or cubic)?

Extend finite-element methods to high order while avoiding implicitcoupling (and other bad behaviors)?Avoid the global coupling and O(N2) operation counts to update aset of expansion coefficients in spectral or pseudo-spectralmethods?

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 33 / 50

Page 85: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Hybrid Methods

The Challenge

How do weExtend finite-volume methods to high order (beyond piecewiseparabolic or cubic)?Extend finite-element methods to high order while avoiding implicitcoupling (and other bad behaviors)?

Avoid the global coupling and O(N2) operation counts to update aset of expansion coefficients in spectral or pseudo-spectralmethods?

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 33 / 50

Page 86: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Hybrid Methods

The Challenge

How do weExtend finite-volume methods to high order (beyond piecewiseparabolic or cubic)?Extend finite-element methods to high order while avoiding implicitcoupling (and other bad behaviors)?Avoid the global coupling and O(N2) operation counts to update aset of expansion coefficients in spectral or pseudo-spectralmethods?

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 33 / 50

Page 87: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Hybrid Methods

One Solution

Use h-p methods – break domain into h elements and represent thesolution within each element by orthogonal polynomials of maximumorder p.

Spectral element methods – solution is continuous at cellboundaries (good for approximating 2nd-order derivatives).Discontinuous Galerkin methods – solution is discontinuousacross cell boundaries (localizes communication between cells).

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 34 / 50

Page 88: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Hybrid Methods

One Solution

Use h-p methods – break domain into h elements and represent thesolution within each element by orthogonal polynomials of maximumorder p.

Spectral element methods – solution is continuous at cellboundaries (good for approximating 2nd-order derivatives).

Discontinuous Galerkin methods – solution is discontinuousacross cell boundaries (localizes communication between cells).

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 34 / 50

Page 89: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Hybrid Methods

One Solution

Use h-p methods – break domain into h elements and represent thesolution within each element by orthogonal polynomials of maximumorder p.

Spectral element methods – solution is continuous at cellboundaries (good for approximating 2nd-order derivatives).Discontinuous Galerkin methods – solution is discontinuousacross cell boundaries (localizes communication between cells).

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 34 / 50

Page 90: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Hybrid Methods

Discontinuous Galerkin Method

Enforce Galerkin criterion locally, within each element.

Polynomial structure within each element is eitherModal variant: Legendre polynomials

Orthogonal on [−1,1] with weight function unity

Nodal variant: Lagrange polynomials interpolating theGauss-Legendre-Lobatto (GLL) points

Most accurate node placement for quadrature when there is a nodeat each end of the intervalPolynomials are not truly orthogonalDiscrete integrals are orthogonal due to the approximatequadrature on the GLL nodes

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 35 / 50

Page 91: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Hybrid Methods

Discontinuous Galerkin Method

Enforce Galerkin criterion locally, within each element.

Polynomial structure within each element is eitherModal variant: Legendre polynomials

Orthogonal on [−1,1] with weight function unity

Nodal variant: Lagrange polynomials interpolating theGauss-Legendre-Lobatto (GLL) points

Most accurate node placement for quadrature when there is a nodeat each end of the intervalPolynomials are not truly orthogonalDiscrete integrals are orthogonal due to the approximatequadrature on the GLL nodes

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 35 / 50

Page 92: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Hybrid Methods

Discontinuous Galerkin Method

Enforce Galerkin criterion locally, within each element.

Polynomial structure within each element is eitherModal variant: Legendre polynomials

Orthogonal on [−1,1] with weight function unityNodal variant: Lagrange polynomials interpolating theGauss-Legendre-Lobatto (GLL) points

Most accurate node placement for quadrature when there is a nodeat each end of the intervalPolynomials are not truly orthogonalDiscrete integrals are orthogonal due to the approximatequadrature on the GLL nodes

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 35 / 50

Page 93: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Hybrid Methods

Modal DG

First 5 Legendre Polynomials

(a)-1 -0.5 0 0.5 1

-1

-0.5

0

0.5

1

-0.5

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 36 / 50

Page 94: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Hybrid Methods

Nodal DG

Lagrange Polynomials Interpolating 5 GLL Nodes

(b)-1 -0.5 0 0.5 1

-0.5

0

0.5

1

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 37 / 50

Page 95: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Hybrid Methods

Convergence as a Function of Resolution

Nodal DG errors as a function of execution time

0 0.2 0.4 0.6 0.8 1 1.2 1.4 1.610-12

10-10

10-8

10-6

10-4

10-2

100

4

5

6

7

8

3

3

4

5

6

7

6

8 elements12 elements16 elements

Execution Time (nondimensional)

Erro

r

Most efficient way to reduce error is to increase the polynomial order.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 38 / 50

Page 96: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Hybrid Methods

Convergence as a Function of Resolution

Nodal DG errors as a function of execution time

0 0.2 0.4 0.6 0.8 1 1.2 1.4 1.610-12

10-10

10-8

10-6

10-4

10-2

100

4

5

6

7

8

3

3

4

5

6

7

6

8 elements12 elements16 elements

Execution Time (nondimensional)

Erro

r

Most efficient way to reduce error is to increase the polynomial order.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 38 / 50

Page 97: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Hybrid Methods

DG Considerations

Advantages:Suitable for massively parallel computing

Communicates via fluxes with nearest neighbors onlyFor high order polynomials, solution relatively insensitive to fluxformulationLots of work to do within each element

Rapid convergence for smooth solutions

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 39 / 50

Page 98: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Hybrid Methods

DG Considerations

Advantages:Suitable for massively parallel computing

Communicates via fluxes with nearest neighbors only

For high order polynomials, solution relatively insensitive to fluxformulationLots of work to do within each element

Rapid convergence for smooth solutions

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 39 / 50

Page 99: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Hybrid Methods

DG Considerations

Advantages:Suitable for massively parallel computing

Communicates via fluxes with nearest neighbors onlyFor high order polynomials, solution relatively insensitive to fluxformulation

Lots of work to do within each element

Rapid convergence for smooth solutions

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 39 / 50

Page 100: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Hybrid Methods

DG Considerations

Advantages:Suitable for massively parallel computing

Communicates via fluxes with nearest neighbors onlyFor high order polynomials, solution relatively insensitive to fluxformulationLots of work to do within each element

Rapid convergence for smooth solutions

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 39 / 50

Page 101: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Hybrid Methods

DG Considerations

Advantages:Suitable for massively parallel computing

Communicates via fluxes with nearest neighbors onlyFor high order polynomials, solution relatively insensitive to fluxformulationLots of work to do within each element

Rapid convergence for smooth solutions

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 39 / 50

Page 102: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Hybrid Methods

DG Considerations II

Disadvantages:Requires very short time step

Grid spacing reduced toward element boundaries

DiscontinuitiesCan be accommodated across element boundaries by limiting thefluxes

Cannot naturally be accommodated within each element

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 40 / 50

Page 103: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Hybrid Methods

DG Considerations II

Disadvantages:Requires very short time step

Grid spacing reduced toward element boundariesDiscontinuities

Can be accommodated across element boundaries by limiting thefluxes

Cannot naturally be accommodated within each element

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 40 / 50

Page 104: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Hybrid Methods

DG Considerations II

Disadvantages:Requires very short time step

Grid spacing reduced toward element boundariesDiscontinuities

Can be accommodated across element boundaries by limiting thefluxesCannot naturally be accommodated within each element

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 40 / 50

Page 105: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Eulerian

Accelerations evaluated at fixed points.

+ Easily adapted to many grid structures- Need to evaluate nonlinear advection terms (u∂v/∂x).- Impossible to eliminate numerical diffusion in high Reynoldsnumber flow

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 41 / 50

Page 106: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Eulerian

Accelerations evaluated at fixed points.+ Easily adapted to many grid structures

- Need to evaluate nonlinear advection terms (u∂v/∂x).- Impossible to eliminate numerical diffusion in high Reynoldsnumber flow

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 41 / 50

Page 107: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Eulerian

Accelerations evaluated at fixed points.+ Easily adapted to many grid structures- Need to evaluate nonlinear advection terms (u∂v/∂x).

- Impossible to eliminate numerical diffusion in high Reynoldsnumber flow

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 41 / 50

Page 108: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Eulerian

Accelerations evaluated at fixed points.+ Easily adapted to many grid structures- Need to evaluate nonlinear advection terms (u∂v/∂x).- Impossible to eliminate numerical diffusion in high Reynoldsnumber flow

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 41 / 50

Page 109: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Lagrangian

Accelerations evaluated along fluid parcel trajectories

+ Can completely eliminate numerical diffusion+ No nonlinear advection terms to evaluate+ Some processes (like advection) Doppler shift to lowerfrequencies (allowing larger time steps).- Trajectory for each fluid parcel must be evaluated- Fluid parcels tend to become unevenly distributed.- Awkward to compute gradients of field variables (∂p/∂x)

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 42 / 50

Page 110: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Lagrangian

Accelerations evaluated along fluid parcel trajectories+ Can completely eliminate numerical diffusion

+ No nonlinear advection terms to evaluate+ Some processes (like advection) Doppler shift to lowerfrequencies (allowing larger time steps).- Trajectory for each fluid parcel must be evaluated- Fluid parcels tend to become unevenly distributed.- Awkward to compute gradients of field variables (∂p/∂x)

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 42 / 50

Page 111: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Lagrangian

Accelerations evaluated along fluid parcel trajectories+ Can completely eliminate numerical diffusion+ No nonlinear advection terms to evaluate

+ Some processes (like advection) Doppler shift to lowerfrequencies (allowing larger time steps).- Trajectory for each fluid parcel must be evaluated- Fluid parcels tend to become unevenly distributed.- Awkward to compute gradients of field variables (∂p/∂x)

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 42 / 50

Page 112: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Lagrangian

Accelerations evaluated along fluid parcel trajectories+ Can completely eliminate numerical diffusion+ No nonlinear advection terms to evaluate+ Some processes (like advection) Doppler shift to lowerfrequencies (allowing larger time steps).

- Trajectory for each fluid parcel must be evaluated- Fluid parcels tend to become unevenly distributed.- Awkward to compute gradients of field variables (∂p/∂x)

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 42 / 50

Page 113: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Lagrangian

Accelerations evaluated along fluid parcel trajectories+ Can completely eliminate numerical diffusion+ No nonlinear advection terms to evaluate+ Some processes (like advection) Doppler shift to lowerfrequencies (allowing larger time steps).- Trajectory for each fluid parcel must be evaluated

- Fluid parcels tend to become unevenly distributed.- Awkward to compute gradients of field variables (∂p/∂x)

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 42 / 50

Page 114: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Lagrangian

Accelerations evaluated along fluid parcel trajectories+ Can completely eliminate numerical diffusion+ No nonlinear advection terms to evaluate+ Some processes (like advection) Doppler shift to lowerfrequencies (allowing larger time steps).- Trajectory for each fluid parcel must be evaluated- Fluid parcels tend to become unevenly distributed.

- Awkward to compute gradients of field variables (∂p/∂x)

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 42 / 50

Page 115: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Lagrangian

Accelerations evaluated along fluid parcel trajectories+ Can completely eliminate numerical diffusion+ No nonlinear advection terms to evaluate+ Some processes (like advection) Doppler shift to lowerfrequencies (allowing larger time steps).- Trajectory for each fluid parcel must be evaluated- Fluid parcels tend to become unevenly distributed.- Awkward to compute gradients of field variables (∂p/∂x)

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 42 / 50

Page 116: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Semi-Lagrangian

Fluid parcels arrive at every node on the specified mesh at the end ofeach time step.

Semi-Lagrangian approximation to the advection equation is

φ(xj , tn+1)− φ(x̃nj , t

n)

∆t= 0,

where x̃nj denotes the departure point of a trajectory originating at time

tn and arriving at (xj , tn+1).

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 43 / 50

Page 117: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Semi-Lagrangian

Fluid parcels arrive at every node on the specified mesh at the end ofeach time step.

Semi-Lagrangian approximation to the advection equation is

φ(xj , tn+1)− φ(x̃nj , t

n)

∆t= 0,

where x̃nj denotes the departure point of a trajectory originating at time

tn and arriving at (xj , tn+1).

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 43 / 50

Page 118: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Semi-Lagrangian II

For constant U > 0x̃n

j = xj − U∆t .

Let p be the integer part of U∆t/∆x , then

xj−p−1 ≤ x̃nj < xj−p

7.1 The Scalar Advection Equation 359

investigate the additional considerations that arise when variations in the velocityfield make the backward trajectory calculation nontrivial.

7.1.1 Constant Velocity

A semi-Lagrangian approximation to the advection equation for a passive tracer canbe written in the form

!.xj ; tnC1/ ! !. Qxnj ; tn/

"tD 0; (7.4)

where Qxnj again denotes the departure point of a trajectory originating at time tn and

arriving at .xj ; tnC1/. If the velocity is constant, the backward trajectory computa-tion is trivial, and letting U denote the wind speed,

Qxnj D xj ! U"t:

Let p be the integer part of U"t="x and without loss of generality suppose thatU " 0; then Qxn

j lies in the interval xj !p!1 # x < xj !p , as shown in Fig. 7.1.Defining

˛ Dxj !p ! Qxn

j

"x

and approximating !. Qxnj ; tn/ by linear interpolation, (7.4) becomes

!nC1j D .1 ! ˛/!n

j !p C ˛!nj !p!1; (7.5)

where !nj D !.xj ; tn/. Note that if "t is small enough that

0 # U"t

"x# 1;

(7.5) reduces to the formula for Eulerian upstream differencing.

x

t

UD t

!Dxtn+1

tn

xj!p!1 xj!p xj

Fig. 7.1 Backward trajectory from .xj ; tnC1/ to . Qxnj ; tn/

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 44 / 50

Page 119: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Semi-Lagrangian II

For constant U > 0x̃n

j = xj − U∆t .

Let p be the integer part of U∆t/∆x , then

xj−p−1 ≤ x̃nj < xj−p

7.1 The Scalar Advection Equation 359

investigate the additional considerations that arise when variations in the velocityfield make the backward trajectory calculation nontrivial.

7.1.1 Constant Velocity

A semi-Lagrangian approximation to the advection equation for a passive tracer canbe written in the form

!.xj ; tnC1/ ! !. Qxnj ; tn/

"tD 0; (7.4)

where Qxnj again denotes the departure point of a trajectory originating at time tn and

arriving at .xj ; tnC1/. If the velocity is constant, the backward trajectory computa-tion is trivial, and letting U denote the wind speed,

Qxnj D xj ! U"t:

Let p be the integer part of U"t="x and without loss of generality suppose thatU " 0; then Qxn

j lies in the interval xj !p!1 # x < xj !p , as shown in Fig. 7.1.Defining

˛ Dxj !p ! Qxn

j

"x

and approximating !. Qxnj ; tn/ by linear interpolation, (7.4) becomes

!nC1j D .1 ! ˛/!n

j !p C ˛!nj !p!1; (7.5)

where !nj D !.xj ; tn/. Note that if "t is small enough that

0 # U"t

"x# 1;

(7.5) reduces to the formula for Eulerian upstream differencing.

x

t

UD t

!Dxtn+1

tn

xj!p!1 xj!p xj

Fig. 7.1 Backward trajectory from .xj ; tnC1/ to . Qxnj ; tn/Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 44 / 50

Page 120: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Semi-Lagrangian III

Interpolate the grid-point values to x̃nj .

If U∆t/∆x ≤ 1Linear interpolation gives upstream schemeQuadratic interpolation gives Lax-Wendroff

Interpolation introduces numerical diffusionUse at cubic interpolation (cheat in 2 or 3D)Take the largest possible time step. What limits ∆t?

Accuracy of the trajectory calculationFrequency of the forcing in the Lagrangian frame

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 45 / 50

Page 121: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Semi-Lagrangian III

Interpolate the grid-point values to x̃nj .

If U∆t/∆x ≤ 1Linear interpolation gives upstream schemeQuadratic interpolation gives Lax-Wendroff

Interpolation introduces numerical diffusionUse at cubic interpolation (cheat in 2 or 3D)Take the largest possible time step. What limits ∆t?

Accuracy of the trajectory calculationFrequency of the forcing in the Lagrangian frame

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 45 / 50

Page 122: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Semi-Lagrangian III

Interpolate the grid-point values to x̃nj .

If U∆t/∆x ≤ 1Linear interpolation gives upstream schemeQuadratic interpolation gives Lax-Wendroff

Interpolation introduces numerical diffusionUse at cubic interpolation (cheat in 2 or 3D)Take the largest possible time step. What limits ∆t?

Accuracy of the trajectory calculationFrequency of the forcing in the Lagrangian frame

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 45 / 50

Page 123: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Semi-Lagrangian III

Interpolate the grid-point values to x̃nj .

If U∆t/∆x ≤ 1Linear interpolation gives upstream schemeQuadratic interpolation gives Lax-Wendroff

Interpolation introduces numerical diffusionUse at cubic interpolation (cheat in 2 or 3D)Take the largest possible time step. What limits ∆t?

Accuracy of the trajectory calculation

Frequency of the forcing in the Lagrangian frame

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 45 / 50

Page 124: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Semi-Lagrangian III

Interpolate the grid-point values to x̃nj .

If U∆t/∆x ≤ 1Linear interpolation gives upstream schemeQuadratic interpolation gives Lax-Wendroff

Interpolation introduces numerical diffusionUse at cubic interpolation (cheat in 2 or 3D)Take the largest possible time step. What limits ∆t?

Accuracy of the trajectory calculationFrequency of the forcing in the Lagrangian frame

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 45 / 50

Page 125: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

CFL Condition

Time step can be very large when simulating advection of a passivescalar (e.g., U∆t/∆x = 4). Do SL methods avoid the CFL condition?

Courant-Freidrichs-Levy Condition: the numerical domain ofdependence must include the domain of dependence of the truesolution. (Necessary but not sufficient for stability.)

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 46 / 50

Page 126: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

CFL Condition

Time step can be very large when simulating advection of a passivescalar (e.g., U∆t/∆x = 4). Do SL methods avoid the CFL condition?

Courant-Freidrichs-Levy Condition: the numerical domain ofdependence must include the domain of dependence of the truesolution. (Necessary but not sufficient for stability.)

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 46 / 50

Page 127: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Eulerian CFL

Upstream differencing, constant-windspeed advection

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 47 / 50

Page 128: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Semi-Lagrangian CFL

Linear interpolation to departure point, constant-windspeed advection

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 48 / 50

Page 129: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Eulerian vs Semi-Lagrangian

Semi-Lagrangian widely used for global-scale models, seldom used onthe mesoscale.

SL very effective for dealing with the pole problem in globalmodels.Large-scale dynamics mostly advection of PV.

Trajectories smooth compared to advected field.

Typical CFL number of 4 in global models is determined byjet-stream max.

Max ≈ 160 m s−1; most winds < 40 m s−1, so CFL over most of thedomain < 1

Vertical advection often associated with limiting CFL in simulationsof convection.

Trajectory morphology not simpler than the advected fields.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 49 / 50

Page 130: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Eulerian vs Semi-Lagrangian

Semi-Lagrangian widely used for global-scale models, seldom used onthe mesoscale.

SL very effective for dealing with the pole problem in globalmodels.

Large-scale dynamics mostly advection of PV.

Trajectories smooth compared to advected field.

Typical CFL number of 4 in global models is determined byjet-stream max.

Max ≈ 160 m s−1; most winds < 40 m s−1, so CFL over most of thedomain < 1

Vertical advection often associated with limiting CFL in simulationsof convection.

Trajectory morphology not simpler than the advected fields.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 49 / 50

Page 131: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Eulerian vs Semi-Lagrangian

Semi-Lagrangian widely used for global-scale models, seldom used onthe mesoscale.

SL very effective for dealing with the pole problem in globalmodels.Large-scale dynamics mostly advection of PV.

Trajectories smooth compared to advected field.Typical CFL number of 4 in global models is determined byjet-stream max.

Max ≈ 160 m s−1; most winds < 40 m s−1, so CFL over most of thedomain < 1

Vertical advection often associated with limiting CFL in simulationsof convection.

Trajectory morphology not simpler than the advected fields.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 49 / 50

Page 132: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Eulerian vs Semi-Lagrangian

Semi-Lagrangian widely used for global-scale models, seldom used onthe mesoscale.

SL very effective for dealing with the pole problem in globalmodels.Large-scale dynamics mostly advection of PV.

Trajectories smooth compared to advected field.

Typical CFL number of 4 in global models is determined byjet-stream max.

Max ≈ 160 m s−1; most winds < 40 m s−1, so CFL over most of thedomain < 1

Vertical advection often associated with limiting CFL in simulationsof convection.

Trajectory morphology not simpler than the advected fields.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 49 / 50

Page 133: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Eulerian vs Semi-Lagrangian

Semi-Lagrangian widely used for global-scale models, seldom used onthe mesoscale.

SL very effective for dealing with the pole problem in globalmodels.Large-scale dynamics mostly advection of PV.

Trajectories smooth compared to advected field.Typical CFL number of 4 in global models is determined byjet-stream max.

Max ≈ 160 m s−1; most winds < 40 m s−1, so CFL over most of thedomain < 1

Vertical advection often associated with limiting CFL in simulationsof convection.

Trajectory morphology not simpler than the advected fields.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 49 / 50

Page 134: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Eulerian vs Semi-Lagrangian

Semi-Lagrangian widely used for global-scale models, seldom used onthe mesoscale.

SL very effective for dealing with the pole problem in globalmodels.Large-scale dynamics mostly advection of PV.

Trajectories smooth compared to advected field.Typical CFL number of 4 in global models is determined byjet-stream max.

Max ≈ 160 m s−1; most winds < 40 m s−1, so CFL over most of thedomain < 1

Vertical advection often associated with limiting CFL in simulationsof convection.

Trajectory morphology not simpler than the advected fields.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 49 / 50

Page 135: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Eulerian vs Semi-Lagrangian

Semi-Lagrangian widely used for global-scale models, seldom used onthe mesoscale.

SL very effective for dealing with the pole problem in globalmodels.Large-scale dynamics mostly advection of PV.

Trajectories smooth compared to advected field.Typical CFL number of 4 in global models is determined byjet-stream max.

Max ≈ 160 m s−1; most winds < 40 m s−1, so CFL over most of thedomain < 1

Vertical advection often associated with limiting CFL in simulationsof convection.

Trajectory morphology not simpler than the advected fields.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 49 / 50

Page 136: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Eulerian vs Semi-Lagrangian

Semi-Lagrangian widely used for global-scale models, seldom used onthe mesoscale.

SL very effective for dealing with the pole problem in globalmodels.Large-scale dynamics mostly advection of PV.

Trajectories smooth compared to advected field.Typical CFL number of 4 in global models is determined byjet-stream max.

Max ≈ 160 m s−1; most winds < 40 m s−1, so CFL over most of thedomain < 1

Vertical advection often associated with limiting CFL in simulationsof convection.

Trajectory morphology not simpler than the advected fields.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 49 / 50

Page 137: Strengths and Weaknesses of Common Numerical Methods for ... · Strengths and Weaknesses of Common Numerical Methods for Simulating Atmospheric Flows Dale Durran University of Washington

Fluid Dynamical Viewpoint

Reference

Durran, D.R., 2010: Numerical Methods for Fluid Dynamics: WithApplications to Geophysics. 2nd Ed. Springer.

Dale Durran (Atmospheric Sci.) BIRS 2011 University of Washington 50 / 50