Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques...
-
Upload
andrew-little -
Category
Documents
-
view
213 -
download
0
Transcript of Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques...
![Page 1: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/1.jpg)
Workshop on Information Access EnablersMétéo France Strategy
Geneva
17-18 May 2010
Jacques Roumilhac
![Page 2: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/2.jpg)
Information access in Météo France
Stage 1: Current status– Okapi production platform (finalized products) with a Web portal
– IAA (Random Access on Legacy databases) with a bespoke language via ftp
Stage 2: Information system evolution– SOA (with a part of OGC services)
– Information model with geographic references
– Spatial databases
– Light and smart client (forecaster station project)
Stage 2 bis: WIS solution– OpenWIS developed with UKMO
– Metadata generator
![Page 3: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/3.jpg)
Stage 1: Production Service Okapi - IAA
OKAPI: Three software bricks, loosely linked :
– Okapi production platform (products factory).
– Internal production portal : Okapimet (For web and webservice customers).
– production portal : Climatheque (For web and webservice customers).
IAA– Random access– On the legacy databases– Archive access possible– With a bespoke language
![Page 4: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/4.jpg)
System schema
![Page 5: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/5.jpg)
orchestration, traffic shaping
Traffic shaping mechanisms Balanced charge. Product factory (close WTS) Identity management (authorization,
authentication)
![Page 6: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/6.jpg)
Stage 2: New project Synopsis: Forecaster tools based on SOA
Two main requirements SOA
– Development efforts factorization
– Processing and data pool access
– Standard interfaces
– Management of different topologies (local or remote server, standalone)
– WMO needs and INSPIRE recommendation
Client station– Last technologies
– Deployment and support easy
– Light or smart client
– Scalable, efficient
– Multi-platforms
![Page 7: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/7.jpg)
Technical choices
Synopsis Server :
– Linux 64 bits :• Re-use of current services in different systems• Use of programs and libraries of ECMWF
– Use of bricks OpenSource• Databases: PostgreSQL, PostGIS• Image processing: GDAL, Proj4• Mapserver : services OGC• Geonetwork for the catalogue
![Page 8: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/8.jpg)
The services
Different service levels– Metadata access (catalogue)– Data access– Business processing (graphic processing)– Presentation services (images, maps, graphics…);
Interoperability for the map services– So : WMS (Web Map Service) et CSW (Web Catalog Service)
For INSPIRE, interoperability also on data and processing services (transformation and downloading)
– So : WCS (Web Coverage Service) WFS (Web feature Service), WPS (Wep processing Service) ….
![Page 9: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/9.jpg)
SOA : Reference architecture
Application composite
Business process
Engine Orchestration
BPM
Supervision
SAM BAM
Data access
CRUD CRUD CRUD
Application composite
Administration Plate-Form
Business services
Processing / Transformation
Bus for messages
Legacy databases
Application composite
Services Registry
SAM : Service Activity Monitoring
BAM : Business Activity Monitoring
BPM : Business Process Management
CRUD : Create Read Update Delete
![Page 10: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/10.jpg)
Interoperability
Strategic target Use of the standards OGC standards for geo-referenced data
Web MapServer
Web CoverageServer
Web FeatureServer
Web Map Service (WMS) Web Feature Service (WFS)Web Coverage Service (WCS)Catalogue (CSW)Geography Markup Language (GML) Web Map Context (WMC)OGC KMLOthers…
![Page 11: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/11.jpg)
SOA : Architecture interoperability on legacy databases with geographic extension
Client SYNOPSIS Java Web StartSupervision
Plate form
Interface HPOV
Data Service
WFS WCS
Client SYNOPIS Full Web
Administration Plate-Form
Bus of messages JMS
Other applications composites Catalogue
CSW
SOS
Processing service Presentation service
FPSWMSWPS SPS
BDMO
Geo-extension
BDMO
Ref)
Legacy databases
BDAP
Ref
BDI
Ref
BDEPI
Ref
BDE
Ref
BDI BDEPI BDE BDAP
Geo-ext
![Page 12: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/12.jpg)
Data Access Services
Services de DONNEES
WCS WFS SOS
WFS
Web Feature
Service
Coast map lines
Objects : Anasyg
Pi, Sympo2,
Aeronautic
OACI Annex 3
![Page 13: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/13.jpg)
Portrayal Services
Services PRESENTATION
FPSWMS
Observation
Objects : Anasyg
Pi, Sympo2,
WMS
Web Map
Service
Static geographic layers
Models plots
Aeronautic
OACI Annex 3
Images
Radar, Sat
![Page 14: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/14.jpg)
Different clients
Client SYNOSIS Smart
Data access services
(CRUD)
WCS WFS
Client SYNOPIS
Light (Full Web)
Presentation services
WMSFPSSOS
Processing services
WPS SPS
CATALOGUE Service
CSW
OKAPI
BDMO
Extension
BDMO
Ref)
Legacy databases
BDAP
Ref
BDI
Ref
BDEPI
Ref
BDE
Ref
BDI
Extension
BDEPI
Extension
BDE
Extension
BDAP
Extension
VGISC
Client VGISCAdvanced Production INSPIRE
answer
![Page 15: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/15.jpg)
General Architecture
Data and services catalogue (standard)– On line products and services discovery.– Message bus
• Balanced flow (cluster services)• Loosely link between server and client
Spatial database– Using MapServer and other OGC implementations
Standard interfaces used by the clients– Possibility to access to extern services (without guarantee of
performances)– Useful for a wandering forecaster
![Page 16: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/16.jpg)
Prototype Architecture
Middleware ( bus JMS )Middleware ( bus JMS )
Frontal SYNOPSIS (SynFront) HTTP -> JMS
Network (IP)Network (IP)
MetadataISO 19115ISO 19119
BD Spatiale(SynBase)
PosGIS
Services on Services on clustercluster
WMSWMS
(cartes)(cartes)
CATALOGUEGeonetwork
ISO 19115-19119
CSWCSW
MapServerM
agics+
+M
agics+
+
Business serviceMapScript Servlet
Executable CGI
Server SYNOPSIS (SynServ) JMSWMSWMS
SopranoSoprano
TransmetTransmet
RetimRetim
File System
Client Client SYNOPSIS SYNOPSIS Full WebFull Web
Client SYNOPSIS Client SYNOPSIS JAVA Web StartJAVA Web Start
Alimentation BD (SynDATA)
![Page 17: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/17.jpg)
Premières maquettes
![Page 18: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/18.jpg)
Premières maquettes
![Page 19: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/19.jpg)
Architecture Target (Back Office)
““Backbone” of servicesBackbone” of services(ESB ?)(ESB ?)MonitoringMonitoring
AdministrationAdministrationSécuritySécurity
Front End
WMSWMSPrésentationPrésentation
cartescartes
WPSWPSProcessingProcessing
CRS transf.CRS transf.
… …
CATALOGUEGeonetwork
ISO 19115-19119
CSWCSW
Serveur SYNOPSIS Serveur SYNOPSIS
Servers
CEP WEB High availability
Obs Front End
WMS WMS PrésentationPrésentation
Cartes Cartes
SOS SOS SPSSPS
bus JMS internalbus JMS internal
BD’s SOPRANO
BDMBDCLIMBDAP
BDI
Front End CBD [OKAPI ?]
SOS SOS AccessAccess
Obs Obs validatedvalidated
BD spatiale(SynBase)
PostGIS
BD’s Spatiales PostGIS
BDEPIBDE
BDI « new »
ClientsClientsWCSWCSAccess Access
ImagesImages
ModèlesModèles
WMS WMS PrésentationPrésentation
Maps Maps
WPSWPSProcessingProcessing
StatsStats
Client Synopsis Client Synopsis JAVAJAVA
Client Client Synopsis Synopsis WEBWEB
Client Client ProductionProduction
Obs & time seriesObs & time series
CLUSTER CLUSTER
WFSWFSObject accessObject access
PI, SYMPO2PI, SYMPO2
AERO (WXXM)AERO (WXXM)
RMDCNRMDCN
![Page 20: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/20.jpg)
Stage 2 bis: WIS Approach
OpenWIS development :
– Information fetching: Different use cases
– OpenWIS: Open interfaces
– Request or subscription
– Météo France use two diffusion systems
Metadata GTS generator– To populate the WIS catalogue– Mapping between Volume C1 and Core Metadata Profile– Close the prompting question on information sources
![Page 21: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/21.jpg)
5: Storage in the shopping cart for an online distrbution, or preparation of the dissemination instructions: they are constructed from the user profile, among other elements.
DAR
3: the user composes an ad-hoc request for the product type. The user specifies which products are of interest, and the chosen dissemination options.
Portal
subscriptions(user profile)
4: The product type is part of the global dataset. The requested products are extracted from the Cache.
Routing
MSS FSS
6: the products and instructions are forwarded.
7: Dissemination according to instructions.
7bis: the user receives the products.
Ad-hoc Request for a product in the Cache – dissemination via the FSS (GISC function)
OpenWIS
1: the user discovers local product type in the catalogue
2: the user is authenticated (several steps)
5bis: the user obtains the products from the shopping cart.
![Page 22: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/22.jpg)
6: Storage in the online shopping cart, or preparation for dissemination.
DAR
Portal
subscriptions(user profile)
4: the product type is owned by a local NC or DCPC.
Routing
MSS FSS
6bis: the user obtains the products from the shopping cart.
SOURCE
5: the required products are extracted and returned.
Ad-hoc Request for a local product – dissemination via the FSS (NC or DCPC function)
OpenWIS
1: the user discovers local product type in the catalogue
2: the user is authenticated (several steps)
3: the user composes an ad-hoc request for the product type. The user specifies which products are of interest, and the chosen dissemination options.
8bis: the user receives the products.
7: the products and instructions are forwarded.
8: Dissemination according to instructions.
![Page 23: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/23.jpg)
4: Storage in an online shopping cart or preparation for dissemination: construction of the dissemination instructions.
DAR
Portail
subscriptions(user profile)
3: Is someone subscribed to this type of product ?
Routing
MSS FSS
1: the MSS receives a new product
5: the product and instructions are forwarded
2: the MSS routes the product according to its
routing table
2bis: the product is collected and inserted in the GISC Cache
4bis: the user obtains the product from the shopping cart.
6: Dissemination according to instructions.
6bis: the user receives the product.Arrival of a new GTS product at the MSS (GISC function)
OpenWIS
![Page 24: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/24.jpg)
5: Storage in an online shopping cart or preparation for dissemination: construction of the dissemination instructions.
OpenWIS
DAR
Portal
subscriptions(user profile)
3: Is someone subscribed to this type of product ?
Routage
TRANSMET FSS
6: the product and instructions are forwarded
2: Notification of the product availability
5bis: the user obtains the product from the shopping cart.
7: Dissemination according to instructions.
7bis: the user receives the product.
SOURCE
1: New local product
4: the required products are extracted and returned.
New local product available (NC or DCPC WIS function)
![Page 25: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/25.jpg)
External Interface
Metadata service Data service
User Interface (web portal)
DARMet
User & Data Policies
MetadataCatalogue
Cache
A7
A1 A3 A5 A1 A3
A1 A3 A5
A2 A4 A6
A1 A5 A5A1
Make / FollowRequest
Browse /Search DAR
Admin /Monitoring
Authentication
Authorisation
ManageRequests
CatalogueAccess
Monitoring
Administration
CollectionSynchro &Harvesting « Ad Hoc »
Routine« Push »
DIFFMSS/FSS
Local System
POSSIBLE CHOICES
SIMDAT base
Sun OpenSSO baseGeoNetwork base
MSSSMART / GEMS
OpenWISUK MetOffice
Replication
![Page 26: Workshop on Information Access Enablers Météo France Strategy Geneva 17-18 May 2010 Jacques Roumilhac.](https://reader036.fdocuments.net/reader036/viewer/2022081602/551544b755034685568b5016/html5/thumbnails/26.jpg)
GTS Metadata GeneratorClose to prompting question on digitization