The NATURE-SDI plus Solution for Data Harmonisation
description
Transcript of The NATURE-SDI plus Solution for Data Harmonisation
co-funded by the European Community eContentplus programme
The NATURE-SDIplus Solution
for Data Harmonisation
2
PRESENTATION OVERVIEW The DH-TWG The DH methodology The procedure for data transformation The procedure for metadata transformation The guidelines The matching tables The transformation tools A practical example of data remodeling The methodology to facilitate and to monitor the status of
the DH process
3
Data harmonisation process involves: Different players (data providers, technological
partners, research partners) Operational implementation of DH impacts on
different tasks
WHY A DH-TWG?
3
Need of a dedicated technical coordination DH-TWG
4
T5.2: Data accessibility and usability evaluation
(Fraunhofer)
T2.3: Data set analysis and systematisation
(UNIABDN)
T3.1: Mmultilingual and multicultural issue
(CNR-IMATI)
T3.2: Metadata profile (IRD)
T4.1 Harmonised datasets (Tracasa )
T5.1: Data interoperability validation (NEN)
T5.3: Quality evaluation and datasets generalization
(AGI)
T4.2: Geoportal specification (GT)
T 3.3 Data model (Tracasa)
T3.4:Procedures for metadata and model implementation
(Tracasa)
T4.3: Geoportal (INGR)
WP2WP2
WP4WP4
WP5WP5
WP3WP3
WFS
WMS
T6.1: Guidelines for service provision (INGR)
WP6WP6
CSW
LINKED TASKS
THE OVERALL DH METHODOLOGY (1/3)
SOURCE SIDE TARGET SIDE
Selection of the target schema
Analysis of the target schema
Creation of the Matching table
Matching analysis
Data transformation
HARMONISED DATASET
TOOLSGUIDELINES
&PROCEDURES
Selection of the sample DS
Analysis and schematisationof the sample DS
5
THE OVERALL DH METHODOLOGY (2/3)
Provider A Data Model
Geoportal
.SHP
.TAB
...
Provider A Provider B Provider C
Tool CTool A Tool B
OGC Services: WMS,WFS, ...
GeoDataBase CGeoDataBase B
GeoDataBase A
<GML><GML>
OG
C S
ervi
ces
(WM
S, W
FS
, ..)
.
OG
C S
ervi
ces
(WM
S, W
FS, .
.).
OGC Services (WMS, W
FS, ..).
SOURCE DATA MODEL
TRANSFORMATION TOOLS
NATURE SDI+ DATA MODEL
NATURE SDI+ Intranet
Dow
nload (GM
L, ZIP)
Dow
nloa
d (G
ML,
ZIP
)
Download (GML, ZIP)
GeoDataBase A
<GML><GML>
<GML><GML>
Web Map Server Web Map Server Web Map Server
Downlo
ad (G
ML,
ZIP
)
(*)(*)(*)
(*) : The best data format for creating services Depending on:
- Trasnformation tool - the Web Map Server software
6
THE OVERALL DH METHODOLOGY (3/3) The services we have created:
Web Map Services (WMS) and Web Feature Services (WFS) for the Data
Catalogue Web Services (CSW) for the Metadata Once processed, harmonised, transformed and made
accessible through the Geoportal, spatial datasets, metadata and network services (accessibility and usability) have been validated
7
THE PROCEDURE FOR DATA TRANSFORMATION Identify source
data model
Data Model? Create a simple
GeoData Structure
Fill Matching Table
Matcheable?
Perform Transformation
Publish Harmonised Data
Document
NatureSDIplus Data Model
An
y kind
D
ata
Mo
de
lWithout
Data Model
NO
YE
S
Start Harmonisation Process
Finish Harmonisation Process
Choose Transformation Tool
Store Tranformation Tools for Reuse
Create the Matching Table
Create the Matching Table
Step
1 S
tep 2
Step
4 S
tep 3
Step
5
Identify a source data model Create a simple geodata
structure Fill the Data matching table Document the process Choose Transformation Tool Perform Transformation Store Transformation Rules Publish harmonised Data
8
Identify source metadata profile
Metadata?
Fill Matching Table
Matcheable?
Create or UpdateMetadata
Publish Harmonised
Metadata
Document
NatureSDIplus Metadata Profile
An
y m
eta
da
tap
rofile
No Metadata
NO
YE
S
Start Harmonisation Process
Finish Harmonisation Process
Choose MetadataEditor
Store Tranformation Tools for Reuse
Create the Matching Table
Create the Matching Table
Ste
p 2
S
tep
3
Ste
p 4
Ste
p 1
Identify a source metadata profile
Fill the Metadata matching table
Document the process Choose Metadata Editor Create or Update Metadata Store Transformation Rules Publish harmonised Metadata
THE PROCEDURE FOR METADATA TRANSFORMATION
9
THE GUIDELINES
Procedures for metadata profile and data model implementation, including Quality control for the
harmonisation process
10
Spatial Datasets: Final Matching table for PS (Annex I) Final Matching Tables for BR, HB, SD (Annex III)
Metadata: Final Matching table for PS (Annex I) Final Matching Tables for BR, HB, SD (Annex III)
THE MATCHING TABLES (1/3)
11
THE TRANSFORMATION TOOLS
Transformation tools for metadata: MDweb (IRD), INSPIRE Metadata Editor,
CatMDEdit, GeoNetwork, MIG Metadata Editor, disy Preludio.
Transformation tools for spatial datasets: GeoConverter, GeoMedia Fusion, Humboldt
Alignement Editor, Go Publisher
Tools surveyed, investigated and under testing by Technical Partners, used by DPs
14
Tool capabilities surveyed1. Reading non ISO 19115 profile
2. Reading ISO 19115 profile
3. Allowing to define / load specific profiles (in our cases Nature-SDIplus)
4. Allowing manual / semiautomatic / automatic mapping processes
5. Allowing save and reuse automatic process
6. Perform quality mapping control: Any? Specify
7. Publish metadata catalogue (CSW)
8. Allowing multilingualism
9. License
10. Allowing different export formats
11. Other interesting characterises
12. System Requirements Software, Hardware
SURVEY OF THE TOOLS FOR METADATA TRANSFORMATION
15
Tool capabilities surveyed1. Enumerate input formats
2. Enumerate output formats
3. Read input data
4. Change Coordinate reference System
5. Allowing to define / load specific target model
6. Allowing manual / semiautomatic / automatic mapping
7. Allowing to save transformation process
8. Any transformation quality control. Specify
9. Allowing multilingualism
10. License
11. System Requirements Software, Hardware
SURVEY OF THE TOOLS FOR DS TRANSFORMATION
16
EXAMPLE OF APPLICATION OF DH PROCEDURE – STEP 1
STEP 1.1: Selection of thesample source dataset
Natura2000 dataset of Greece,source: EIONET; free download
STEP 1.2: Deep analysisof the source dataset
cntrygr_ENG_SCI-SPA_Aug_2009.mdb
(MS Access mdb)
GR_Natura2000_v27.shp +
Commission Decision 97/266/EC of18.12.1996 concerning
a site information formatfor proposed Natura2000 sites
17
EXAMPLE OF APPLICATION OF DH PROCEDURE – STEP 5
WFS deployment withGO Publisher WFS
Harmonised PSdatasets
viewed with Gaia
18
MONITORING DH PROCESS
Prepared a template to collect feedback from DP about Data Harmonisation
Prepared a template to collect feedback from DP about Metadata Harmonisation
Prepared a tool (excel spreadsheet based) to monitor the status of the DH proces
19