ESA Report to DAI/IPR WG Gian Maria Pinna DAI/IPR meeting Toulouse 2-5 November 2004.
-
Upload
elwin-bryan -
Category
Documents
-
view
215 -
download
0
Transcript of ESA Report to DAI/IPR WG Gian Maria Pinna DAI/IPR meeting Toulouse 2-5 November 2004.
ESA Report to DAI/IPR WG
Gian Maria Pinna
DAI/IPR meeting
Toulouse
2-5 November 2004
Products
Metadata
GFE
MUIS Orders
DataProducers
InteractiveUser Services
MasterCatalogue
Metadata
Products
Outputproducts
PFD
Orders
Production Orders
AMS
POHProcessors
Browses
MUIS
Browses
DataConsumers
CENTRAL INFRASTRUCTURE
Multi-Mission Facility Infrastructure
QC
MMOHS
Products
Statuses
SS
E
MMFI Elements
MMFI Deployment
• MultiMission Facility Infrastructure deployment is on-going
• Tape robotics installation completed in the 6 centres– STK Powderhorn 9310, with 2000 slots (400TB each, max 1.2 PB)
– STK L700e, with ~700 slots (140TB)
• 8 TB NAS for data storage on line, accessed via AMS, and MMFI central data cache
• Fast disk arrays for AMASS cache (~1.2 TB) extensive testing, presently under deployment at remote facilities
• Documentation under completion (ADD, ICD, Technical Baseline Description)
HARM(Historical Archive Rationalization and Management)
• Transcription HW&SW from old media (D1, DLT) to AMS (StorageTek T9940B based)
• Orbits stitching (reducing overlap between acquisition stations)
• Rationalization in thematic archives
• SAFE (Standard Archive Format for Europe)– Based on previous experiences (Wilma, CEOS ICF, Cryosat)
– XML metadata
– Self-descriptive
– Pointers to binary data structures
– Draft 1.3 available for review (see SB’s presentation)
– Efforts for XFDU compatibility
• Transcription of data on the AMS in original format started
FEOMI(Facility Evolution into an Open Multimission Infrastructure)
• Contract awarded and project started (KO: September, 9th)
• Porting of Envisat, ERS and TPM ground segments to MMFI
• Upgrade of mission specific elements to interface with MMFI
• Phase out of mission specific elements where same functionality can be ensured by MMFI elements
• Will bring to operations costs reduction starting from 2006
• Phase 1 (User/System Requirements, AD) to be completed by end January 2005
Network rationalization and upgrade(LAN, WAN)
• Production LAN upgrades to Gbit under completion at all centres
• Networking our facilities with 34+ Mbps links via European academic network
• To be used for data circulation inside ground segments• Also to be used to ensure better service to users for
access to products on-line (automatic and transparent re-routing)
New EO Missions
• In line with Oxygen, all new EO missions will rely at various levels on the MMFI architecture and components– GOCE LTA development started
– AEOLUS and SMOS LTA development to be started
– SENTINEL missions concept under finalisation. Based on MMFI
– New processing systems under development will have MMFI interface (e.g. new Linux-based Envisat processors)
GOCE LTA Architecture
MUS
LTAREPROCESSOR
MMFIPDS
GFE
GOCE LTA
PFD
POH
MMOHSdistribution
request
retrievaldirective
distributionexecution
LTAEXPORT
ReprocessedProducts
PDSProducts
& Support Files
Products& Support Files
Inventory Info
download file
Inventory Synch
End User Product
USERS
DataManager
HPF
CMF
browsing
AMS
distribution requestDistribution
directive
SDF
IPF #1LEVEL 0
AUX DATAFILES
LEVEL 1b
IPF-THINLAYER
LEVEL 1BSCIENCE
PROCESSOR(s)
ORDERMANAGER
REPROMANAGER
IPF #2LEVEL 0
AUX DATAFILES
LEVEL 1b
IPF-THINLAYER
LEVEL 1BSCIENCE
PROCESSOR(s)
reprocessingcommand
FTP
LE
VE
L 1b
LocalCatalogue
CatalogueBrowser
Products
Products
MMMC
Catalogue updates
PV -2004
• “Ensuring the Long-Term Preservation and Adding Value to the Scientific and Technical Data”– 5-7 October in ESRIN– 37 papers– 80+ registered participants
Future PVs?
• Lessons learnt– Parallel big workshop (IAC) in Vancouver– Similar conference (CODATA) one month later– CODATA meets every two years– Suggestion to make PV a regular venue on
alternate years with CODATA
• Previous contacts with DLR to host PV-2005. Unfortunately they declined
• Looking for volunteering organizations