Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather...
Transcript of Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather...
![Page 1: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/1.jpg)
Towards the Probabilistic Weather
and Climate Prediction Simulator:
T.N.Palmer
University of Oxford
ECMWF
![Page 2: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/2.jpg)
The first real-The first real-
time ensemble
forecast, for
commercial
customers
![Page 3: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/3.jpg)
Hannah Arnold
![Page 4: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/4.jpg)
Hurricane-Superstorm Sandy : Predictable
20°N
30°N
40°N
100°W
100°Wtracks: black=OPER, green=CTRL, blue=EPS numbers: observed positions at t+..hProbability that KATRINA will pass within 120km radius during the next 120 hours
20050825 0 UTC
Hurricane Katrina: Semi-Predictable
000
-48-48-48-48 -36-36-36-36 -24-24-24-24 -12-12-12-12 000000
10°N10°N
20°N20°N
30°N30°N
40°N40°N
50°N50°N
100°W
100°W80°W80°W
60°W 60°W40°W40°W
tracks: black=OPER, green=CTRL, blue=EPS numbers: observed positions at t+..hProbability that SANDY will pass within 120km radius during the next 120 hours
20121025 0 UTC
5 10 20 30 40 50 60 70 80 90 100
00-12
00
20°N
30°N
40°N
80°W
80°W60°W
60°Wtracks: black=OPER, green=CTRL, blue=EPS numbers: observed positions at t+..hProbability that KATRINA will pass within 120km radius during the next 120 hours
20050825 0 UTC
5 1 2 3 4 5 6 7 8 9 1
000
-180-180-180-180
-168-168-168-168
-156-156-156-156
-144-144-144-144
-132-132-132-132 -120
-120-120-120 -108
-108-108-108
-96-96-96-96-84-84-84-84
-72-72-72-72-72-72-72-72-72
-60-60-60-60 -48 -36-36-36-36 -24-24-24-24 -12-12-12-12 000000
20°N20°N
30°N30°N
40°N40°N
50°N50°N
60°W
60°W40°W40°W
20°W 20°W0°0°
tracks: black=OPER, green=CTRL, blue=EPS numbers: observed positions at t+..hProbability that NADINE will pass within 120km radius during the next 120 hours
20120920 0 UTC
5 10 20 30 40 50 60 70 80 90 100
Hurricane Nadine: Unpredictable
![Page 5: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/5.jpg)
Electricity Production vs Windspeed
![Page 6: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/6.jpg)
Forecast windspeed.
Small uncertainty
Forecast windspeed.
Large uncertainty
![Page 7: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/7.jpg)
U x( ) ≡ U (x) p(x)dx ≠ U x( )
x∫
Utility Function
Ensemble Prediction for Decision Making
Meteorological VariablesExpected utility – this is what decision makers should use to make
decisions!
![Page 8: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/8.jpg)
Pdf of climate sensitivity
Source: 100000 PAGE09 runs
Chris Hope, U. Cambridge
![Page 9: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/9.jpg)
Based on the most likely climate change only:Expected damage/ impacts = $ 150 trillion
Based on the probability distribution of possible climate change:
Cost of mitigation ≈ $ 150 trillion
Chris Hope, U. Cambridge
climate change:Expected damage/ impacts = $ 314 trillion
![Page 10: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/10.jpg)
Reliability of ECMWF Ensemble Prediction System
50 members, T639 ( c. 30km) resolution
![Page 11: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/11.jpg)
Beyond the
medium range,
precipitation
forecasts start
to loose
reliability.
This is also a
problem for
short-range
prediction of
extreme
precipitation
events
![Page 12: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/12.jpg)
How Can We Improve our Forecasts?
• More and Better Observations. Better ways to
Assimilate Observations into models
• Higher resolution models, improved
parametrisations
• Better representations of the inherent uncertainty
in the observations and the models.
![Page 13: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/13.jpg)
Traditional computational ansatz for weather/climate simulators
1X 2X 3X nX... ...
2. pt
ρ ρ ν∂ + ∇ = − ∇ + ∇ ∂ u u g uEg
Deterministic local bulk-formula parametrisation
Increasing scale
( );nP X α
Eg momentum“transport” by:
•Turbulent eddies in boundary layer
•Orographic gravity wave drag.
•Convective clouds
![Page 14: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/14.jpg)
grid box grid box
Deterministic bulk-formula parametrisation is based on the notion of averaging over some putative ensemble of sub-grid processes in
quasi-equilibrium with the resolved flow (eg Arakawa and Schubert, 1974)
![Page 15: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/15.jpg)
However, reality is more consistent with
grid box grid box
![Page 16: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/16.jpg)
Stochastic Parametrisation
• More consistent with power-law behaviour
• Describes the sub-grid tendency in terms of a pdfconstrained by the resolved-scale flow.
• Provides stochastic realisations of the sub-grid flow, not some putative bulk average effect. some putative bulk average effect.
• Can incorporate physical processes (eg energy backscatter) not easily described in conventional parametrisations.
• Parametrisation development can be informed by coarse-graining budget analyses of very high resolution (eg cloud resolving) models.
![Page 17: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/17.jpg)
Experiments with the Lorenz ‘96 System
( ) ∑+−=
+−− −+−−−=kJ
kkJjjkkkk
k Yb
hcFXXXX
dt
dX
)1(121
( ) ]1/)1int[(121 +−−++ +−−−= Jjjjjjj X
b
hccYYYcbY
dt
dY
Assume Y
unresolved
Approximate
sub-grid
tendency by UForecast Skill
Better RPSStendency by U
Deterministic: U = Udet
Additive: U = Udet + ew,r
Multiplicative: U = (1+er) Udet
Where:
Udet = cubic polynomial in X
ew,r = white / red noise
Fit parameters from full model
Forecast Skill
Arnold et al, Phil Trans Roy Soc
![Page 18: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/18.jpg)
From Hannah ArnoldFrom Hannah Arnold
![Page 19: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/19.jpg)
Palmer, 1997, 2001: Buizza et al, 1999….
![Page 20: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/20.jpg)
lead time: 1 month
T2m precip
May Nov May Nov
cold warm cold warm dry wet dry wet
MME 0.178 0.195 0.141 0.159 0.085 0.079 0.080 0.099
Brier Skill Score: ENSEMBLES MME vs ECMWF
stochastic physics ensemble (SPE)
MME 0.178 0.195 0.141 0.159 0.085 0.079 0.080 0.099
SPE 0.194 0.192 0.149 0.172 0.104 0.118 0.095 0.114
CTRL 0.147 0.148 0.126 0.148 0.044 0.061 0.058 0.075
Weisheimer et al GRL (2011)
Hindcast period: 1991-2005
SP version 1055m007
![Page 21: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/21.jpg)
Performance of stochastic parametrisation in data assimilation
mode. M. Bonavita, personal communication.
![Page 22: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/22.jpg)
![Page 23: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/23.jpg)
• The ice strength parameter P* is a key
parameter in dynamic-thermodynamic sea ice
models. Controls the threshold for plastic
deformation. Value affected by the liquid
content in the sea ice. Cannot be measured
directly.
• A stochastic representation of P* is developed
in a finite element sea-ice-ocean model,
based on AR1 multiplicative noise and spatial
autocorrelation between nodes of the finite
element grid
• Despite symmetric perturbations, the
stochastic scheme leads to a substantial
increase in sea ice volume and mean increase in sea ice volume and mean
thickness
• An ensemble of eight perturbed simulations
generates a spread in the multiyear ice
comparable with interannual variability in the
model.
• Results cannot be reproduced by a simple
constant global modification to P*
Impact of different versions of
stochastic P* with respect to a
reference run. Top: Sea ice thickness.
Bottom: sea ice concentration.
![Page 24: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/24.jpg)
Spectral Dynamical Core
Parametrisation
ζ = ζ m,neimλPn
m φ( )m,n
∞
∑
Triangular Truncation
![Page 25: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/25.jpg)
Stochastic Parametrisation
Triangular Truncation
Partially Stochastic
If parametrisation is partially stochastic, are we “over-engineering” our
dynamical cores by using double precision bit-reproducible computations
for wavenumbers near the truncation scale?
If we could relax the precision of the calculations near the truncation
scale, would this allow EPS system to progress to high (10km, 1km…)
resolution, reaping the benefits of high resolution, without the punitive
computational costs?
![Page 26: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/26.jpg)
In terms of speed, energy consumption and size, inexact computer chips like this prototype, are about 15 times more efficient than today's microchips.
Superefficient inexact chips
Krishna Palem. Rice, NTU
http://news.rice.edu/2012/05/17/computing-experts-unveil-superefficient-inexact-chip/
This comparison shows frames produced with video-processing software on traditional processing elements (left), inexact processing hardware with a relative error of 0.54 percent (middle) and with a relative error of 7.58 percent (right). The inexact chips are smaller, faster and consume less energy. The chip that produced the frame with the
most errors (right) is about 15 times more efficient in terms of speed, space and energy than the chip that produced the pristine image (left).
Rice, NTU Singapore
![Page 27: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/27.jpg)
Towards the Stochastic Dynamical Core?
Efficiency/speed/inexactness of chip
Stochastic Parametrisation
Triangular Triangular Truncation
and precision at which the data is stored and passed between processors.
At Oxford we are beginning to work with IBM Zurich, Technical Uni
Singapore and U Illinois to develop these ideas…
![Page 28: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/28.jpg)
Will bit-reproducible computation continue to be a sine qua non in HPC?
In a recent presentation on Challenges in Application Scaling in an ExascaleEnvironment, IBM’s Chief Engineer for HPC, Don Grice, noted that:
“Increasingly there will be a tension between energy efficiency and error detection”,
and asked whether :
“…there needs to be a new software construct which identifies critical sections of code where the right answer must be produced” – implying that outside these critical sections errors can (in some probabilistic sense) be
tolerated.
(http://www.ecmwf.int/ newsevents/meetings/workshops/2010/high performance computing 14th/index.html)
![Page 29: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/29.jpg)
3221313
3123
2122
3221311
49.043.01363.0
14.049.049.07.262
57.049.02.63.2
aaaaaaa
aaaaaa
aaaaaaa
++−−=+−+−−=
−−−=
&
&
&
Integrate 3rd equation on emulator
of stochastic chip. Represent a3. by stochastic noise
Peter Düben
![Page 30: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/30.jpg)
20 Years Ago
Dynamics ParametrisationDynamics Parametrisation
O(100km
)
![Page 31: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/31.jpg)
Now
Dynamics ParametrisationDynamics Parametrisation
O(10km)
![Page 32: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/32.jpg)
In 20 years
Dynamics ParametrisationDynamics Parametrisation
O(1km)
![Page 33: Towards the Probabilistic Weather and Climate Prediction ... · Towards the Probabilistic Weather and Climate Prediction Simulator: T.N.Palmer University of Oxford ECMWF](https://reader034.fdocuments.net/reader034/viewer/2022042102/5e7f892decdbd0558d2e4ef1/html5/thumbnails/33.jpg)
Edward Norton Lorenz (1917-2008)
I believe that the ultimate climate models..will be
stochastic, ie random numbers will
ECMWF
numbers willappear somewhere in the time derivatives
Lorenz (1975).