ECMWF NAEDEX 2012 – ECMWF Status Report – Stephen Engilsh ECMWF Status Report Stephen English ECMWF.
Progress on TIGGE Archive Center in CMA - ECMWF
Transcript of Progress on TIGGE Archive Center in CMA - ECMWF
THORPEX Interactive Grand Global Ensemble (TIGGE)
Feifei Yang
China Meteorological Administration
April 3, 2019 Reading
Progress on TIGGE Archive
Center in CMA
Current Situation
TIGGE Archive Centres and Data Providers
➢ TIGGE project contains data from 11 centers and which is backed up by two global
archiving centers, ECMWF and CMA.
BoM (Australia), CMA (China), ECCC (Canada), ECMWF (European Center), NCEP (USA),
UKMO (UK), Météo France (France), JMA (Japan), KMA (Korea), CPTEC (Brazil), NCMRWF
(India)
3
Test platform
established
2006.7: Infrastructure(LDM Server, Internet) ready.
Cooperation between CMA, ECMWF & NCAR
MARS system
localized2007.07-2008.12: Localized MARS
system and data environment
- R O A D M A P T I G G E - C M A -
1 32
5 6 7
LDM server
upgraded2008.10-2009.04: Hardware upgrade &
software update for multi-receiving
System Upgraded for
better data management2010.10: LDM hardware upgrade &
data management system upgrade
Network Performance
Upgrade2010.10-2011.10: Network Performance
Upgrade to Ensure the Integrity of
Received Data
TIGGE-Cloud
migration2018.03-2018.12: TIGGE archiving with
QC from LDM to FTP, and now to cloud
4
MARS for
Data archiving2009.05
Progress overview
Data and Service
Total received Data by Centers
2007-2018 (TB)
➢The total TIGGE data of CMA from 2007 to 2018 is 1671.83 TB.
1206.88
43.45 22.27
125.3
8.99 32.75 22.7873.27
131.88
4.260
200
400
600
800
1000
1200
1400
ecmf kwbc cwao egrr ammc sbsj rjtd rksl babj lfpw
Archived data volume
Archived Data Integrity Diagram (TB)
104.70
87.50
128.10
167.10
234.30
221.80 224.20 215.60
206.20
189.10
39.80
0
50
100
150
200
250
2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017
Data and Service
Weather Forecast Department of National Meteorological Center, CMA
Mid-Term Weather Forecast Operational Users
Hong Kong Observatory
Korea Meteorological Administration
Nanjing University
NWP Center of National Meteorological Center
Institute of Atmosphere, Chinese Academy of Sciences
Guangdong Tropical Institute
Real-time data service User
Offline data service User
Typhoon and Marine Meteorological Forecast Center
Sichuan Meteorological Service
Application
➢ June 2008, TIGGE was widely used extreme precipitation in South China, medium-term
precipitation forecast in Jiangsu Province, Persistent Extreme Precipitation Incentered
Eastern China, Rainfall Forecast in Qinghe Basin and Flood Forecasting for Chaihe River
Basin.
➢ The TIGGE application in multi-model integrated forecasting of subtropical westerly jet in
East Asia, tropical cyclone in West Pacific and subtropical cyclone is significant.
Application of TIGGE
Data Update
EC
CMA
Problem and Background
➢ TIGGE data was transmitted and interacted to ECMWF by
LDM before 2018.
➢ Due to the limitation of LDM software mechanism on system
performance, in January 2018, ECMWF contacted CMA and
suggested to adopt FTP to replace LDM in TIGGE system.
➢ In April, ECMWF and CMA determined the adjustment
requirements for TIGGE data.
➢ In September, the ECCODES tool was introduced to solve the
problem of invalid messages in TIGGE-BABJ.
Design, Adjustment of TIGGE Data Format and Establishment of Quality Control Process in Non-LDM Environment
Center Times Files Number/Times
Data volume per day
File type
BABJ 00/12 1 54G tar
Center Times Files Number/Times
Data volume per day
File type
BABJ 00/12 30 54G Grib2
➢ Old data format
➢ New data format
➢ In 2018, TIGGE-BABJ sent 19.25TB
data. After data quality control, the error
rate of sending data was 0, and the
data integrity reached 99.9%. This
effectively guaranteed the operation of
ECWMF.
Complete the adjustment and implementation of TIGGE data format and the establishment of quality control process in non-LDM environment.
20182018.09-11
2018.8.22
LDM services should be
discontinued, and this system
serves as the only channel to
provide TIGGE-BABJ data in
a new data format to EC
2018.4.25
The new data began to
be transmitted
continuously on April
25 and exchanged with
EC
2018
LDM
transmission
2019-2023
By WMO's requirements
of TIGGE project five-
year expansion , the
filing center will continue
to perform its duties.
Complete the installation,
deployment and secondary
development of ECMWF-
ECCODES. At present,
ECMWF-ECCODES is used
to check the quality of the
data issued at each timeFTP
transmission
TIGGE-BABJ
(00/12 hours/day,
1 TAR file/day)
TIGGE-BABJ
(00/12/day, 30
GRIB2 files/day)
Data process
Data exchange cluster
Outside network DMZ area
TIGGE data flow in CMA before
Storage area
MARSPortal
Online data
Online data
CMAUSERS
Data service
Data receive
Data send
Data Source
INTERNET USERS
INTER
NET
WEB/FTP
MARS
Inside network
Data process
Storage area
Offline data
HPC system
WEB/FTP
10
Flow chart after data upgrate
Data Resource
Multi-moda Data Extraction and Analysis
TIGG
E D
ata
S2S D
ata
...Oth
er M
od
el
Cloud analysis
Download on demand For Users
Meteorological Big Data Cloud Platform
Open Capability
Resource SharingData resource
Algorithm resource
Interface resource
meteorological data
Industry data
Society DataMeteorological
algorithm
Mining analysis
visualizationComputing interface
Storage interface
Access interface
converge converge converge
Satellite DetectionWeather/Climate
Service ResearchGovernme
nt affair
Interchangeable
ComputableSelf-
Manageable
ServiceableOther Model
Data
Architecture Diagram of Upgraded CMA Data Process Deployment
WIS2.0
- The End -