1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User...

40
1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain

Transcript of 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User...

Page 1: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

1

The EXIM (Extrapolated Imagery) products

Alexander JannZAMG, Vienna, Austria

NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain

Page 2: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

2

Goal of EXIM

Provide

forecast satellite images forecast NWCSAF products

•through kinematic extrapolation•for lead times ≤ 1 hour

Page 3: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

Heritage (MFG IR, +2h)

3

Page 4: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

Forecast Cloud Type 12/12/2008, 11.00 + 15min

Page 5: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

Forecast Cloud Type 12/12/2008, 11.00 + 30min

Page 6: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

Forecast Cloud Type 12/12/2008, 11.00 + 45min

Page 7: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

Forecast Cloud Type 12/12/2008, 11.00 + 60min

Page 8: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

8

Outline of the algorithm

Interpolate (irregularly distributed) HrW product down to pixel level

Apply the vector field on every pixel n times (n results from user’s specifications plus the limitation of max. + 1 hour)

Construct the predicted image / NWCSAF product by putting pixels at their predicted positions

Fill gaps through nearest-neighbour or average interpolation

Other post-processing, e.g. applying land-sea mask or writing NODATA at the edge of the image

Page 9: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

9

Assumptions...

…that might be worth some discussion: We take every piece of HrW information that we can get, i.e. we eventually mix HrW vectors from those channels which the user selected in the HrW configuration file.We make predictions at multiples of slot intervals, i.e. for MSG in nominal mode: +15, +30, +45 and +60. Thus, we “have” images / products earlier than without EXIM, yet we don’t produce imagery for times where we have no actual satellite images.

Page 10: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

10

Input fields we already tried

SEVIRI: WV6.2, WV7.3, IR8.7, IR9.7, IR10.8, IR12.0, IR13.4 (yes, VIS0.6-IR3.9 work technically just as well but there are

doubts whether we should enable their forecasting in the first version) Cma CT CTTH_HEIGHT, CTTH_PRE PC_PR1 and PCPh_PC CRR and CRPh_CRR SPhR_BL, ML, HL, KI, LI, SHW, TPW

Page 11: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

11

Output files we envisage

One file per channel / product per forecast date Mimicking output format for analysis output as perfect

as possible. Ideally, EXIM products can be distinguished from their analysis counterparts only through the filename and the directory where they are dumped

“DATABUF” for satellite imagery, netCDF for products

Page 12: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

12

Output files we envisage (2)

Relevant quality flags shall be extrapolated as well and

be included in the forecast netCDF The EXIM-specific quality flag (“actually extrapolated”

vs. “achieved through post-processing / gap-filling”, applicable to both SEVIRI and product forecasts, hence one per forecast date) is dumped as DATABUF

Page 13: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

13

Validation

The SAFNWC PRT defines EXIM’s threshold accuracy as: on average better than persistence forecast

Target accuracy is: always better than persistence forecast

Hence, the validation approach is quite obvious:Compare the EXIM forecast with what was actually observed 15, 30,… minutes later and verify that the displacement actually did anything positive on the skill score (we use Peirce’s [abbr. PSS] and, for the CT product, its multicategorical variant, “R” “verification” ”multi.cont”)

Page 14: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

14

Validation

The following slides show PSS time series

Extracted every 2 hoursOver ~3.5 months (Sep 14 – Jan 15)from ZAMG’s operational NWCSAF v2013+ suite, meaning in particular

the HrW default model configuration file was used 3-hourly NWP data, ECMWF, 1 degree resolution European area

Page 15: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

15

Geographical coverage

Page 16: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

SEVIRI

16

Page 17: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

17

Page 18: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

18

Page 19: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

19

Page 20: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

20

Page 21: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

NWCSAF PRODUCTS

21

Page 22: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

22

Page 23: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

23

Page 24: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

24

Page 25: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

25

Page 26: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

26

Page 27: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

27

Page 28: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

28

Page 29: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

29

Page 30: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

30

Page 31: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

31

Page 32: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

32

Page 33: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

33

Page 34: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

34

Page 35: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

35

Conclusions - SEVIRI

Release of EXIM certainly OK for

IR WV

Perhaps it would be OK even for the entire spectrum, but the lack of modelling the solar radiation impact for 0.6 – 3.9 means: Risk!

Page 36: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

36

Page 37: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

37

Conclusions – NWCSAF products

Release of EXIM certainly OK for

CMa CT CTTH CRR

Page 38: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

38

Conclusions – NWCSAF products

Big question-mark on PC with its pronounced dependence on illumination conditions (recommended to users only during high-summer season?).

For PCPh and CRPh, stringent validation difficult (uncertainties about areas where one can have 100% confidence). Statistics nevertheless indicate that there is value in the extrapolation (and things should improve with the 24h products announced by AeMet).

Page 39: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

39

Conclusions – SPhR (future TqPh)

SPhR and extrapolation with the atmospheric flow do not seem to go well together:For the stability indices sub-group, this could have been expected.For the moisture parameter subgroup, we have evidence that - to a large degree - the task is to predict the outcome of temporal NWP interpolation, at least for NWP intervals ≥ 3 hours → Leave it in the portfolio for those who wish to experiment with 1-hr NWP (actually recommended by SPhR developers)??

Page 40: 1 The EXIM (Extrapolated Imagery) products Alexander Jann ZAMG, Vienna, Austria NWCSAF User Workshop, 24-26 February 2015, AEMET HQ, Madrid, Spain.

40

Future developments

Until v1.0:Consolidate the software (in particular working on the new netCDF output format)Incorporating User WS outcome that can be accommodated fairly quicklyContinue validation

Afterwards:Incorporating User WS outcome that is rather challenging to be implementedTake new NWCSAF/GEO products on board (we are always “day-2”)MTG