Data harmonization aspects of the Irish pilot project for...

33
Data harmonization aspects of the Irish pilot project for INSPIRE data publishing and Network Services Gareth John (Department of Environment, Community and Local Government) Sören Dupke (con terra)

Transcript of Data harmonization aspects of the Irish pilot project for...

Data harmonization aspects of the Irish pilot project for INSPIRE data publishing and Network Services Gareth John (Department of Environment, Community and Local Government) Sören Dupke (con terra)

INSPIRE Pilot project 2012 - objectives (1)

Assess the effort involved in transforming Protected Sites spatial data under the administration of the Department of Arts, Heritage and the Gaeltacht and the Marine Institute (MI) and other public bodies into the INSPIRE Protected Sites Data Specification model.

Assess the effort required to represent and maintain the Protected Sites Data Specification model on the internet as INSPIRE Network Services.

Evaluate the effectiveness of the ArcGIS for INSPIRE software for delivering a compliant solution to meet Irish public bodies obligations for INSPIRE Data Specifications and Network Services.

Examine the feasibility of a cost-efficient ‘Shared Service’ approach for INSPIRE network services and ISDI delivery.

Test the Network Services and hosting solutions against the Quality of Service requirements of the INSPIRE Network Services Regulation and INSPIRE Technical Guidance documents.

Investigate licensing and security options for INSPIRE Network Services.

Use the experience gained in this pilot to advise other Irish Spatial Data Infrastructure partners on the level of effort required to conform with the INSPIRE Directive and associated regulations.

Leverage the investment made in INSPIRE implementation to improve spatial data sharing and modelling in the Irish public sector.

INSPIRE Pilot Project 2012 - objectives (2)

INSPIRE Pilot Project - Deliverables

Pilot delivery areas:

INSPIRE Data Specification Audit INSPIRE Data Specification Transformation INSPIRE Network Services Publishing INSPIRE Service Metadata publishing INSPIRE Data Sharing and Licensing arrangements INSPIRE Compliance Testing Recommendations for INSPIRE/ISDI Implementation and Shared Service approach

Pilot Project – report published

http://www.environ.ie/en/Publications/DevelopmentandHousing/Planning/FileDownLoad,31327,en.pdf

Final pilot recommendations were made based on: • Experience gained from Pilot project • International best practice • Irish eGovernment Strategy 2012-2015

Pilot project recommendations

Publish INSPIRE Spatial Data Through Shared Services Create INSPIRE Theme Delivery Plans Publish Local Authority INSPIRE Data at National Level Publish INSPIRE Data as Open Data Publish INSPIRE Data as Linked Data Evaluate INSPIRE Publishing Software Align work of ISDI/INSPIRE Committee with eGovt Spatial Information Working Group and also open data PSI sharing actions

GeoPortal.ie

© con terra GmbH 8

ISDI pilot – Actors (data harmonization)

Legally mandated organizations

Technology providers

© con terra GmbH 9

INSPIRE Data Specification Audit INSPIRE Data Specification Transformation INSPIRE Network Services Publishing INSPIRE Service Metadata publishing INSPIRE Data Sharing and Licensing arrangements INSPIRE Compliance Testing Recommendations for INSPIRE/ISDI Implementation and Shared Service approach

Project Deliverables

© con terra GmbH 10

INSPIRE Data Specification Audit > List of spatial data sets and spatial data objects for each INSPIRE

Data Specification in the pilot INSPIRE Data Specification Transformation > Source data sets are transformed into the required INSPIRE Data

Specification compliant GML schema. > ISDI re-use cases in other public bodies examined

Project Deliverables

© con terra GmbH 11

Datasets Public body Spatial data set identified Relevant Legislation Department of Arts, Heritage and the Gaeltacht

Special Areas of Conservation (SAC) Habitats Directive 1992 (Natura 2000)

Department of Arts, Heritage and the Gaeltacht

Special Protection Area (SPAs) Birds Directive 1979 (Natura 2000)

Department of Arts, Heritage and the Gaeltacht

Natural Heritage Area (NHAs) Wildlife Amendment Act 2000

Department of Arts, Heritage and the Gaeltacht

Sites and Monuments Record/ Record of Monuments and Places National Monuments Act(s)

Local Authorities (many) Record of Protected Structures Planning and Development Act 2000

Local Authorities (many) Architectural Conservation Areas Planning and Development Act 2000

Local Authorities (many) Tree Preservation Orders Planning and Development Act 2000

Geological Survey of Ireland Geological Heritage Sites Habitats Directive 1992 (Natura 2000)/ Wildlife Amendment Act 2000

Marine Institute Biologically Sensitive Area Marine Strategy Framework Directive (2008)

Marine Institute Designated Marine Protected Area Habitats Directive 1992 (Natura 2000)

Marine Institute Offshore Special Areas of Conservation (SAC) Habitats Directive 1992 (Natura 2000)

Department of Arts, Heritage and the Gaeltacht / Marine Institute

Onshore Special Areas of Conservation (SAC) Habitats Directive 1992 (Natura 2000)

© con terra GmbH 12

Target Schema

Feature Type Attribute Obligation (Mandatory/ Optional)

Voidable Yes /No

Description

Protected Site

Geometry M N

inspireID M N Global Unique identifier with a versioning element

legalFoundationDate M Y Real world object date

legalFoundationDocument M Y URL to relevant Protected Sites legislation

siteDesignation M Y INSPIRE Protected Sites classification code list of different designations e.g. Natura 2000, UNESCO, Ramsar, etc.

siteName O Y Name of site. May be expressed in different languages.

siteProtectionClassification M Y Code list to classify the Protected Site feature type i.e. natureConservation, archaeological, cultural, ecological Landscape, environment, geological

© con terra GmbH 13

ArcGIS for INSPIRE INSPIRE Solution Pack for FME

INSPIRE –Workflow

ETL

INSPIRE Datapecifications & Services

INSPIRE Consumer

European SDI

Internal Information Resources and Databases

© con terra GmbH 14

The Target Enterprise Geodatabase Schema

INSPIRE Application schemas

Geodatabase (GDB-XML) Workspace Document

GML application schemas (XSD)

Encoding rule to create the GML application

schema

Encoding rules to create the geodatabase

schema

Encoding for Storage Encoding when provided via Services

© con terra GmbH 15

INSPIRE Schema-Mapping

- Internal data models - Meta information - Data history - Data Quality - Expert knowledge

(Domain)

- INSPIRE specifications - INSPIRE data models - INSPIRE legislation - INSPIRE requirements - Expert knowlege (Annex 1)

INSPIRE Solution Pack

INSPIRE Expert knowledge and domain expertise are neccessary High complexity of source data and INSPIRE data models Special characteristics are important (quality, history, content)

© con terra GmbH 16

Extract-Transform-Load

Example Mapping

Extract source data

Transform to target schema Load INSPIRE Data Repository

Quality Control Checks

Conflict detection & diff. updates

Data fusion

FME data mapping process

© con terra GmbH 17

import source data

import destination schema

load data to INSPIRE GDB

automated

INSPIRE Solution Pack

schema mapping

FME data import process

ETL Workflow Description

© con terra GmbH 18

Template Workspaces for all Annex I-Themes

ETL-Process supported by INSPIRE Solution Pack for FME

© con terra GmbH 19

ETL-Process supported by INSPIRE Solution Pack for FME

INSPIRE relevant source data requires individual mapping

Indi

vidu

al M

appi

ng

Pre-

defin

ed M

appi

ng

© con terra GmbH 20

Template Protected Sites Simple

© con terra GmbH 21

Final FME Workspace

© con terra GmbH 22

Final FME Workspace

© con terra GmbH 23

Final FME Workspace

© con terra GmbH 24

Final FME Workspace

© con terra GmbH 25

© con terra GmbH 26

© con terra GmbH 27

Steps to create an INSPIRE Network Service…

Create map layout msd file

Publish INSPIRE Network Service

2 3

ArcMap ArcCatalog/

ArcGIS Server

ANNEX-Theme Layer creation

1

ArcMap

© con terra GmbH 28

Screenshots service creation with ArcGIS 4 INSPIRE

Services

© con terra GmbH 29

© con terra GmbH 30

INSPIRE Theme Delivery Plans > One lead authority per each theme > Typically the data provider for the theme

Results – Recommendations - Outcome

© con terra GmbH 31

Publishing workflow and system architecture Data Provider Working Group Identification of ISDI re-use cases Inspire theme data update cycle Data exchange formats and system interfaces Quality control ISDI data improvement plans INSPIRE auditing

Theme delivery plans

© con terra GmbH 32

Publish local authority INSPIRE data sets at national level

© con terra GmbH 33

Hamburg

Hannover

Münster

Bonn

Wiesbaden

Leipzig

Zürich

Burgdorf Nyon

Kranzberg

con terra – Gesellschaft für Angewandte Informationstechnologie Martin-Luther-King-Weg 24 48155 Münster Telefon +49 251 747 45 2200 Telefax +49 251 747 45 2111

Köln

Questions? – [email protected]