Data Assimilation Theory CTCD Data Assimilation Workshop Nov 2005
1 Reanalysis: Data assimilation aspects Paul Poli [email protected] ECMWF Meteorological Training...
-
Upload
aidan-bell -
Category
Documents
-
view
237 -
download
2
Transcript of 1 Reanalysis: Data assimilation aspects Paul Poli [email protected] ECMWF Meteorological Training...
![Page 1: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/1.jpg)
1
Reanalysis: Data assimilation aspects
Paul Poli [email protected]
ECMWF
Meteorological Training CourseData Assimilation and Use of Satellite
Data29 April 2009
![Page 2: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/2.jpg)
Outline
I. Definition
II. Data assimilation in reanalysis• Analysis scheme• Bias correction• Error assignment• Data usage
III. Reanalysis in the real world• Projects• Users• European Reanalysis: ERA-Interim
IV. Conclusions and Future prospects
![Page 3: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/3.jpg)
WHY Reanalysis ? (+ a short definition)
• Cannot use operational NWP products for long studies!
32 MPI Validation Report
Figure 1 - Latitude-time section (1979-1993) of the zonally averaged vertical velocity in 500 hPa. Upper panel:ECMWF operational analyses, lower panel: ECMWF reanalyses. Units: mPa/s.
ECMWF operational system 1979-1993
RE-analyse past observations with a fixed data assimilation system and model reanalysis
![Page 4: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/4.jpg)
Other strong underlying reasons for reanalysis
• Advantages of concentrating and analyze all sources of information [observations] in a unified framework:– We should be able to draw more benefits from all this
information than from one subset of it– We don’t have too many observations of the Earth system to
help solve the puzzle of natural variability
• Reanalyses produce four-dimensional fields which are consistent– In space and in time– Between the various geophysical parameters– Discrepancies point to un-understood areas
• The validity of this approach is proven– By validating reanalysis products with independent observations
![Page 5: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/5.jpg)
Outline
I. Definition
II. Data assimilation in reanalysis• Analysis scheme• Bias correction• Error assignment• Data usage
III. Reanalysis in the real world• Projects• Users• European Reanalysis: ERA-Interim
IV. Conclusions and Future prospects
![Page 6: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/6.jpg)
1. Data– Observing system (instrumentation – raw data)– Forcing data: SST, sea-ice, greenhouse gases…– Data processing
2. Data assimilation– Analysis scheme– Bias correction– Data usage: blacklist, thinning, active/passive (! )– Observation error assignment (! )
3. NWP forecast model– Physics– Dynamics– Resolution– Misc: computer (! ), code (! ), compiler (! ),
settings (! )
Changes in operational NWP systems and input that affect product quality (usually for the better)
Changes that can be minimized in a reanalysis
Requires additional efforts and collaboration
![Page 7: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/7.jpg)
Reanalysis in practical terms: NWP forecast model
• Use a fixed version (dynamics, physics)– To benefit from the best available parametrizations and
modeling
• Use a fixed resolution– Must be computationally affordable to cover say 20 years– Implies to run about 10 days of assimilation and forecast per
day of reanalysis run
• Practical choice, before starting reanalysis production:– Use the near-latest operational model version– Use the resolution that was operational 6-8 years ago
• Do not change setup during the run• Be extra careful when changing machine, compiler…
In a reanalysis, one picks a model configuration version and resolution which is best for the purpose – and one tries to stick to it!!
![Page 8: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/8.jpg)
Data assimilation combines information from
• Observations
• A short-range “background” forecast that carries forward the information extracted from prior observations
• Error statistics
• Dynamical and physical relationships
h(x)yRh(x)yx)(xBx)(xJ(x) 1Tb
1Tb
background constraint observation constraint
(x)hh(x) Μ simulates the observations
This produces the “most probable” atmospheric state (maximum-likelihood estimate)***
***if background and observation errors are Gaussian,
unbiased, uncorrelated with each other; all error covariances are correctly specified; model errors are negligible within the 12-h analysis window
4DVAR
Reanalysis in practical terms: data assimilation system
In a reanalysis, one tries to use the best data assimilation approach available
![Page 9: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/9.jpg)
4D-Var CONTROL
3D-Var 4D-Var
15 February 2005 00 UTC
Reanalysis in practical terms: data assimilation system
All observations
Surface pressureObservations only
Advances in data assimilation can help extract more information from historic data that could ever be thought possible at the time the observations were collected
![Page 10: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/10.jpg)
Data assimilation combines information from
• Observations
• A short-range “background” forecast that carries forward the information extracted from prior observations
• Error statistics
• Dynamical and physical relationships
h(x)yRh(x)yx)(xBx)(xJ(x) 1Tb
1Tb
background constraint observation constraint
(x)hh(x) Μ simulates the observations
This produces the “most probable” atmospheric state (maximum-likelihood estimate)***
***if background and observation errors are Gaussian,
unbiased, uncorrelated with each other; all error covariances are correctly specified; model errors are negligible within the 12-h analysis window
***if background and observation errors are Gaussian,
unbiased, uncorrelated with each other; all error covariances are correctly specified; model errors are negligible within the 12-h analysis window
4DVAR
Reanalysis in practical terms: data assimilation system
![Page 11: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/11.jpg)
Reanalysis in practical terms: bias correction
• Variational bias correction (see lecture by Niels Bormann)– Aims at correcting observation and observation operator
biases in an automatic, consistent and time-smooth manner– Requires data that are considered not biased:
• All in situ: surface stations, radiosondes, aircraft
• GPS radio occultation (see lecture by Sean Healy)
– So far, only applied to satellite radiance data in reanalysis– Caveat: Not designed to handle model biases!
Variational bias correction has become an important component of global reanalysis because it minimizes the impact of changes in radiance data (new instruments, re-calibration during flight…)
![Page 12: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/12.jpg)
Example 1 of variational bias correction: Instrument recalibration
Instrument recalibration (AMSU-A sensor on METOP-A) changes mean behaviour of the instrument automatically corrected by the variational bias correction scheme.
An example where the bias correction is responding to instrument recalibration
global
(AQUA)
![Page 13: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/13.jpg)
Example 2 of variational bias correction: Bias in the observations
Before bias correction After bias correction
From Grody, Vinnikov, Goldberg, Sullivan, and Tarpley
Satellite orbit drift changes sun angle on the satellite changes satellite heat budget changes in-satellite blackbody used for warm target calibration automatically corrected by the variational bias correction scheme.
An example where the bias correction is acting properly – and for the good reason
global global
![Page 14: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/14.jpg)
Example 3 of variational bias correction: MSU instrument bias due to satellite reference calibration blackbody fluctuations
Variational bias estimates for NOAA-14
Actual warm-target temperatures on board NOAA-14 (Grody et al. 2004)
This illustrates the power of reanalysis in identifying instrument errors based on all available information [model and observations]
![Page 15: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/15.jpg)
Example 4 of variational bias correction: Bias in the forecast model
Before bias correction After bias correction
Mt Pinatubo eruption introduced aerosols in stratosphere stratosphere got warmer Forecast model uses fixed quantity of aerosols bias considered to be an observation bias by the bias correction scheme, and hence was corrected for.
An example where the bias correction is reacting – but for the wrong reason
tropics tropics
![Page 16: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/16.jpg)
Reanalysis in practical terms: data usage
• Usage / no usage of data, besides variational QC and first-guess checks, is controlled using simple switches:– Data extraction– Thinning/sub-sampling– Blacklisting/whitelisting
• Each of these steps can be a source of error in a reanalysis which concentrates many varied sources of information, whose observation characteristics sometimes even vary over time
Observation monitoring is critical in a reanalysis: it is there to try to catch all the possible things that can go wrong with data usage
![Page 17: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/17.jpg)
Observations assimilated in ERA-Interim 4DVAR
Total number of observations over 20 years: exceeds 30x109
Reanalyses have to deal with very large numbers of observations, whose quantity vary over time
![Page 18: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/18.jpg)
Key changes to the observing system
1979: Improved sounding from polar orbiters Winds from geostationary orbit More data from commercial aircraft Drifting buoys
1957: Radiosonde network enhanced in Southern Hemisphere for International Geophysical Year
1973: NOAA-2 – First operational sounding of temperature and humidity from polar-orbiting satellite NOAA-2
15 Oct 1972
Today: Additional satellite, aircraft and buoy data. Poorer radiosonde coverage, but better quality
The input data change all the time … but the root problem doesn’t: obtain the best estimate of the atmosphere given all available observations
![Page 19: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/19.jpg)
Time coverage of in situ surface data
1989 2009
![Page 20: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/20.jpg)
Average number of soundings per day: 1609
AB
C
D
EH
I
J
K
M
N
P
Q
UV
Radiosonde coverage for 1958
Ships maintaining fixed locations
![Page 21: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/21.jpg)
Average number of soundings per day: 1626
AB
C
D
EH
I
J
K
M
N
P
Q
UV
Average number of soundings per day: 1626
Radiosonde coverage for 1979
![Page 22: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/22.jpg)
Average number of soundings per day: 1189
Radiosonde coverage for 2001
![Page 23: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/23.jpg)
Time coverage of Atmospheric Motion Vector (AMV) data1989 2009
![Page 24: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/24.jpg)
Example of improved data coverage: Reprocessed Atmospheric Motion Vectors from Meteosat
Early 1980s Expanded Low-resolution Winds
![Page 25: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/25.jpg)
Time coverage of radiance data
Comparatively fewer sources
Comparatively many more sources …
1989 2009
![Page 26: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/26.jpg)
Observations available for ERA-Interim 4DVAR
Drifting buoysGPS radio occultation
Radiosondes (wind only)
Atmospheric motion vectors
RadiancesTOTALRadiosondes
Scatterometers
Surface pressure pseudo-observations from Australian Bureau of Meteorology (PAOB)
Aircraft
“Conventional” “Satellite”
Surface
![Page 27: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/27.jpg)
Percentage of data assimilated in ERA-Interim
Sat Sat Sat SatConv Conv Conv Conv Conv
A large number of satellite data are still not assimilated – these represent as many yet untapped resources for future reanalyses of the present
![Page 28: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/28.jpg)
Outline
I. Definition
II. Data assimilation in reanalysis• Analysis scheme• Bias correction• Error assignment• Data usage
III. Reanalysis in the real world• Projects• Users• European Reanalysis: ERA-Interim
IV. Conclusions and Future prospects
![Page 29: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/29.jpg)
• Has its origins in datasets produced for the Global Weather Experiment (FGGE)
– Widely used, but superseded by use of multi-year operational NWP analyses
• Proposed by Roger Daley in 1983 for monitoring the impact of forecasting system changes on the accuracy of forecasts
– Adrian Simmons (personal communication)
• Proposed for climate-change studies in two journal articles:
– Bengtsson and Shukla (1988), Trenberth and Olson (1988)
Atmospheric reanalysis: Starting points
![Page 30: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/30.jpg)
• Three centres took initiative in mid 1990s– ERA-15 (1979 - 1993) from Europe – with significant funding from USA
– NASA/DAO (1980 - 1993) from USA
– NCEP/NCAR (1948 - present) from USA
• Second round followed– ERA-40 (1958 - 2001) from Europe – with significant funding from FP5
– JRA-25 (1979 - 2004) from Japan
– NCEP/DOE (1979 - present) from USA
• Now in third generation of comprehensive global reanalysis– ERA-Interim (1989 - present) from Europe
– JRA-50 (1958 - 2012) from Japan
– NASA/GMAO-MERRA (1979 - present) from USA
– NCEP-CFSRR (1979 - 2008) from USA
Atmospheric reanalysis: Global products
![Page 31: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/31.jpg)
• Many users:– 12000 registered users of ERA
public data server– ≳5M fields retrieved daily by
ECMWF and Member-State users
– National mirror sites for ERA in many countries
• And many citations:– Paper on NCEP/NCAR reanalysis
is most cited paper in geosciences
– Paper on ERA-40 is most cited recently in the geosciences
– Many references in IPCC Fourth Assessment report
Atmospheric reanalysis: The user base
![Page 32: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/32.jpg)
• Regional reanalysis and downscaling
• Long-term reanalysis using only surface-pressure observations
• Short-term reanalysis for chemical composition
Atmospheric reanalysis: Becoming more diverse
North American Regional Reanalysis Maximum gusts
26 December 1999
2m temperature6UTC, 1 January 1999
![Page 33: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/33.jpg)
• Monitoring of the observing system– Providing feedback on observational quality, bias corrections and a basis for
homogenization studies of long data records that were not assimilated
• Development of climate models– Providing data for verification, diagnosis, calibrating output,, …
• Driving data for users’ models/applications– For smaller-scales (global→regional; regional→local), ocean circulation,
chemical transport, nuclear dispersion, crop yield, health warnings, …
• Providing climatologies for direct applications– Ocean waves, resources for wind and solar power generation, …
• Study of short-term atmospheric processes and influences– Process of drying of air entering stratosphere, bird migration, …
• Study of longer-term climate variability/trends– Preferably used with caution in conjunction with observational studies
Atmospheric reanalysis: Some uses
![Page 34: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/34.jpg)
ERA-Interim: after ERA-40 and before the next reanalysis
![Page 35: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/35.jpg)
Under the hood of the ERA-Interim reanalysis
• Grab observations from archive• Basic pre-processing
• Ingest observations to assimilation database• Run 4DVAR (atmosphere) and surface/sea/snow data assimilations• Run the forecast model
Generate monitoring and diagnostics plots
![Page 36: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/36.jpg)
Reanalysis and climate monitoring
Benefits of reanalysis products as a proxy for observations are well established
Reanalysis for climate monitoring: physically consistent ECVs (essential climate variables)
In the climate community, reanalysis is still regarded as unsuitable for trend estimation (IPCC)
This view evolves as reanalyses become more consistent and rely on more observations
![Page 37: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/37.jpg)
Global water cycle
ERA-40: Excessive precipitation over tropical oceans, exacerbated by Pinatubo eruption
Pinatubo eruption
(“Atmospheric reservoir”)
![Page 38: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/38.jpg)
Drifts in AMSU-A tropospheric radiance data
• There are clear inconsistencies among the AMSU-A observations -> some instrument issues • Decreasing bias estimates: Reanalysis trend > AMSU-A trend• This is not a drift toward the model climate (model has a cold bias in the troposphere)
Why is the reanalysis getting warmer rather than colder?
Globally averaged bias estimates for AMSU-A radiances
AQUA
![Page 39: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/39.jpg)
Anchoring data for the troposphere: Radiosondes
Global mean departures and data counts for radiosonde temperature data
NOAA-15
NOAA-16Warm bias relative to radiosondes
Data count
![Page 40: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/40.jpg)
Anchoring data for the troposphere: Aircraft reports
Global mean departures and data counts for aircraft temperature data
NOAA-15
NOAA-16Unbiased relative to aircraft reports
Aircraft data biased?
Data count
![Page 41: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/41.jpg)
Conclusions on the AMSU-A bias drifts
ERA-Interim ERA-40 JRA-25 NCEP
Global mean temperature anomaliesDrift in NOAA-15 Ch6 (0.5K per decade) is probably due to instrument errors(Mears et al 2008)
Smaller drifts in other channels are due to warm bias in aircraft reports (Ballish and Kumar 2008)
Slight excess warming in the upper troposphere is probably present in all reanalyses
Aircraft data needbias correction
![Page 42: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/42.jpg)
Validation: Fit to radiosonde wind observations
![Page 43: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/43.jpg)
Updated by Simmons, from Simmons & Hollingsworth (2002)
%
Validation: Forecast skill
Operations
ERA-Interim
Anomaly Correlation (%) for the 500 hPa Geopotential
Height
100% = perfect forecast
60% = limit of use
%
![Page 44: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/44.jpg)
Validation: Fit to 2m land temperature anomalies (K)
ERA sampled as CRUTEM3 (Brohan et al., 2006) following Simmons et al. (2004)
Differences of monthly values from CRUTEM3
CRUTEM3
K
![Page 45: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/45.jpg)
Validation: Fit to temperature profiles from radiosondes
analysis departures background departures
Fit to temperature observations for ERA-Interim and ERA-40
Based on January 2000 radiosonde temperature reports north of 70N
![Page 46: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/46.jpg)
Progress in time consistency: analysis increments
Zonal mean temperature analysis increments for August 2001
ERA-Interim ERA-40
![Page 47: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/47.jpg)
Outline
I. Definition
II. Data assimilation in reanalysis• Analysis scheme• Bias correction• Error assignment• Data usage
III. Reanalysis in the real world• Projects• Users• European Reanalysis: ERA-Interim
IV. Conclusions and Future prospects
![Page 48: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/48.jpg)
Summary & Important concepts
• Reanalysis does not produce “gridded fields of observations”– But it enables to extract information from observations in one,
unique, theoretically consistent framework
• Reanalysis sits at the end of the meteorological research and development chain that encompasses– observation collection [measurement],– observation processing,– numerical weather prediction modelling, and– data assimilation
• Unlike NWP, a very important concept in reanalysis is the consistency in time
• Reanalysis is bridging slowly, but surely, the gap between the “weather scales” and the “climate scales”– Resolution gets finer– Covers longer time periods
![Page 49: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/49.jpg)
Current status of reanalysis & Future outlook
• Reanalysis has developed into a powerful tool for many users and applications
– It relies on the combined expertise of a large user community and feedback– An extended reanalysis project such as ERA-40 takes 7-10 years to complete
• It is worth repeating as all ingredients continue to evolve:– Models are getting better– Data assimilation methods are getting better– Observation processing is improving– The technical/scientific infrastructure for running & monitoring improves constantly
• With ERA-Interim, we made good progress in key problematic conceptual areas:
– Dealing with biases and changes in the radiance observing system
• Major challenges for a future reanalysis project:– Bringing in additional observations (not dealt with in ERA-Interim)– Dealing with model bias (ultimately responsible for problems with trends)– Coupling with ocean and land surface– Providing meaningful uncertainty estimates for the reanalysis products
![Page 50: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/50.jpg)
Further reading and on-line material
• European reanalysis (ERA):http://www.ecmwf.int/research/era
• Uppala et al. (2005), “The ERA-40 reanalysis”, Q. J. R. Meteorol. Soc., 131 (612), 2961-3012, doi:10.1256/qj.04.176
• NCEP/NCAR reanalysis:http://www.cdc.noaa.gov/data/reanalysis/reanalysis.shtml
• SciDAC Review (2008), “Bridging the gap between weather and climate”, on the web at http://www.scidacreview.org/0801/pdf/climate.pdf with contributions from G. P. Compo and J. S. Whitaker
• Japanese 25-year reanalysis (JRA-25):http://jra.kishou.go.jp
• NASA GMAO Modern Era Retrospective-analysis for Research and Applications (MERRA) http://gmao.gsfc.nasa.gov/research/merra/
• Bengtsson et al. (2007), “The need for a dynamical climate reanalysis”, Bull. Am. Meteor. Soc., 88 (4), 495-501
![Page 51: 1 Reanalysis: Data assimilation aspects Paul Poli paul.poli@ecmwf.int ECMWF Meteorological Training Course Data Assimilation and Use of Satellite Data.](https://reader035.fdocuments.net/reader035/viewer/2022062219/55154bfa55034673228b628a/html5/thumbnails/51.jpg)
ERA-Interim product availability
• Currently 1989 Jan until 2009 Feb, with monthly updates • Resolution: T255L60, 6-hourly (3-hourly for surface)• Analysis + forecast products; monthly averages• Access to products:
– Member state users: full access via MARS
– All users: web access via ECMWF Data Serverhttp://data-portal.ecmwf.int/data/d/interim_daily/