ArcGIS for INSPIREDevelop ETL process to populate the INSPIRE geodatabase Use the geodatabase...
15
ArcGIS for INSPIRE Paul Hardy [email protected] EuroGeographics INSPIRE KEN (Schema Transformation) 8/9 October 2013, Marne la Vallée ArcGIS for INSPIRE Enables Esri ArcGIS users to implement and comply with INSPIRE INSPIRE Data Themes • Annex I • Coordinate reference systems • Geographical grid systems • Geographical names • Administrative units • Addresses • Cadastral parcels • Transport networks • Hydrography • Protected sites • Annex II • Elevation • Land cover • Ortho-imagery • Geology • Annex III • Statistical units • Buildings • Soil • Land use • Human health and safety • Utility and governmental services • Environmental monitoring facilities • Production and industrial facilities • Agricultural and aquaculture facilities • Population distribution and demography • Area management/restriction/regulation zones & reporting units • Natural risk zones • Atmospheric conditions • Meteorological geographical features • Oceanographic geographical features • Sea regions • Bio-geographical regions • Habitats and biotopes • Species distribution • Energy Resources • Mineral resources ArcGIS for INSPIRE • ArcGIS for INSPIRE provides - Compliant services - Data models - Integrated tools • Reduces complexity of implementing compliant nodes ArcGIS ArcGIS for INSPIRE View Discovery Download
Transcript of ArcGIS for INSPIREDevelop ETL process to populate the INSPIRE geodatabase Use the geodatabase...
ArcGIS for INSPIRE
Paul [email protected]
EuroGeographics INSPIRE KEN(Schema Transformation)
8/9 October 2013, Marne la Vallée
ArcGIS for INSPIREEnables Esri ArcGIS users to implement and comply with INSPIRE
INSPIRE Data Themes
• Annex I
• Coordinate reference systems• Geographical grid systems• Geographical names• Administrative units• Addresses• Cadastral parcels• Transport networks• Hydrography• Protected sites
• Annex II• Elevation• Land cover• Ortho-imagery• Geology
• Annex III• Statistical units• Buildings• Soil• Land use• Human health and safety• Utility and governmental services• Environmental monitoring facilities• Production and industrial facilities• Agricultural and aquaculture facilities• Population distribution and demography• Area management/restriction/regulation
zones & reporting units• Natural risk zones• Atmospheric conditions• Meteorological geographical features• Oceanographic geographical features• Sea regions• Bio-geographical regions• Habitats and biotopes• Species distribution• Energy Resources• Mineral resources
ArcGIS for INSPIRE
• ArcGIS for INSPIRE provides- Compliant services- Data models- Integrated tools
• Reduces complexity of implementing compliant nodes
ArcGIS
ArcGIS for INSPIRE
View
Discovery
Download
ArcGIS for INSPIRE Extends ArcGIS Discovery Services, View Services, Download Services, Metadata, Data Models
INSPIRE GeoportalDesktop GISWeb GIS Mobile GIS
- ESA- Eurostat- EEA- …
LMOs – e.g. National Mapping Agencies EU Agencies
NLD
FGB
E
PI
…
View Services
Download Services
Discovery Services
MonitoringServices
ArcGIS for INSPIRE: What’s Included
INSPIRE Web PortalWeb Map Viewer
GeodatabaseTemplates
MetadataCatalog
ArcGIS DesktopExtension for datamanagement and authoring services
ArcGIS ServerExtension for View and Download Service
Geoportal Server for Discovery Service
Software requirements
• ArcGIS for INSPIRE requires- ArcGIS Desktop 10.x- ArcGIS Server 10.x Standard or Advanced
• Supported DBMS include:- PostgreSQL 9- Oracle 11g- Microsoft SQL Server 2008
• See Online help for details -http://resources.arcgis.com/en/help/arcgis-for-inspire/10.1/index.html#/System_Requirements/014m000000pn000000/.
ArcGIS for INSPIRE – http://esri.com/INSPIRE
ArcGIS for INSPIRE - ResourcesINSPIRE Compliance
INSPIRE Implementing Rule Implemented in ArcGIS 10.1 for INSPIRE
Regulation on INSPIRE Network Services - INSPIRE View Service
Technical Guidance for the implementation of INSPIRE View Services 3.1
Regulation on INSPIRE Network Services -INSPIRE Download Service
Technical Guidance Download Services 3.0
Regulation on INSPIRE Network Services -INSPIRE Discovery Service
Technical Guidance for the implementation of INSPIRE Discovery Service 3.1
Regulation on INSPIRE MetadataTechnical Guidelines based on EN ISO 19115 and EN ISO 19119 (Version 1.2)
Regulation on interoperability of spatial data sets and services
Technical Guidance on Annex I data themes (Administrative Units, Cadastral Parcels, Geographical Names, Hydrography, Protected Sites, Transport Networks, Addresses, Coordinate Reference Systems, Geographical Grid Systems) 3.0.1
ArcGIS for INSPIRE Implementation Pattern
1. Integration into business processes and transformation of data to INSPIRE
Existing Information/Storage Systems
Consumers
3. Delivery via INSPIRE network services
2. Data repository for spatial data sets optimized for INSPIRE data specifications
ArcGIS for INSPIRE Data Models and Web Services
ETL European SDI
ArcGIS for INSPIRE – quick start
1. Install Software2. Load geodatabase with INSPIRE schemas3. Populate the geodatabase (ETL)4. Create INSPIRE network services5. Create and publish metadata6. Discover and consume INSPIRE resources7. Tune performance for Quality of Service Requirements
ArcGIS for INSPIRE – Schema XML ArcGIS for INSPIRE – Installing schema template
ArcGIS for INSPIRE – Installing schema template …contMapping INSPIRE schema to Geodatabase schema
• To Feature Class if object has geometry, object class if not- Single geometry type, so mixed geometry to xxxP, xxxL, xxxS
• Names limited to 30 characters- AdministrativeUnits::AdministrativeUnit becomes auAdmUnitS
• Attributes with a maximum multiplicity greater than one are converted into their own object class.
- Attribute values are associated through foreign key references (fields RID to IFCID).
- Attribute “name” of AdministrativeUnits::AdministrativeUnit is converted to the object class auAdmUnitS_name
• Attributes that are voidable have additional field with the suffix “_void” to distinguish unknown/unpopulated/missing
• Code Lists -> database domains + URL of reference list• …
ArcGIS for INSPIRE Help – Geodatabase modelling
Link
Populate the geodatabase
1. Understand source and target data models2. Develop ETL process to populate the INSPIRE geodatabase
Use the geodatabase documentation to learn about the target geodatabase schema with INSPIRE data models for Annex I
The INSPIRE geodatabase schema designed and optimizedfor publishing INSPIRE services, it is not optimal for being the geodatabase used to collect and update the information
ArcGIS for INSPIRE – Schema documentation
• Several possible solutions:1. ArcGIS Bulk import (ArcCatalog or ArcMap)2. ArcGIS geoprocessing tools (and ModelBuilder/Python Scripts)3. ArcGIS Data Interoperability Extension4. FME Esri Edition5. INSPIRE Solution Pack for FME (con terra)
• Choice depends on the frequency of the schema translation process and the complexity of the models
Spatial ETL – Extract Transform Load
Loading data via ArcCatalog, or by GP tool
1
2
Build GP tools into geoprocessing models for reuse
Python scripting of geoprocessing tools Geoprocessing tools for schema manipulation
Load data via Workbench ETL – using DIE(Data Interoperability Extension)
3
Load data via Workbench ETL (DIE) - continued
Load data via FME for ArcGISOptionally add INSPIRE Solution Pack from con terra
4+5
ArcGIS for INSPIRE add-ons from partners
• con terra‘s sdi.suite add-ons for ArcGIS for INSPIRE
- sdi.suite securityManager:access control, security, single sign on
- sdi.suite licenseManager:eCommerce and eLicensing for INSPIRE
- sdi.suite serviceMonitor:Monitoring & Reporting
• Also INSPIRE Solution Pack for FME ArcGIS
ArcGIS for INSPIRE
Discovery
Add-Ons
MonitoringReportingeCommerceAccess
Control
View Download
INSPIRE Schema needs table joins INSPIRE and ArcGIS Online
ArcGIS for INSPIRE
Services and Appsfor GIS professionals, Citizens, Developers …
Data View and Download services ArcGIS for INSPIRE Other
INSPIRE Services
Where Is This? ArcGIS Online providing context to INSPIRE data
• INSPIRE View Service (Administrative Boundaries)• Plus Geocoding Service• Plus imagery• Plus Protected Sites
INSPIRE@work
Luxembourghttp://www.geoportal.lu/Portail
Germanyhttp://geoportal.sachsen.de
Polandhttp://geoportal.gov.pl
Lithuaniahttp://www.geoportal.lt
Estoniahttp://inspire.maaamet.ee
Portugalhttp://snig.igeo.pt/portal
Spainhttp://idena.navarra.es
Austriahttp://www.gis.steiermark.at
Italyhttp://geoviewer.isprambiente.it
Istituto Superiore per la Protezione e la Ricerca Ambientale - ISPRA(Institute for Environmental Protection and Research)
Sloveniahttp://gis.arso.gov.si/geoportal
Romaniahttp://geoportal.ancpi.ro
ArcGIS Online and Romanian INSPIREGeoportal
Northern Irelandhttps://www.spatialni.gov.uk/geoportal
Irelandhttps://www.geoportal.ie
Ireland – Cadastral ParcelsIreland – Protected Sites
Conclusions
• Schema transformation to INSPIRE is not trivial• ArcGIS for INSPIRE can help with
- INSPIRE-aware services for discover, view, download- template geodatabase schemas and documentation- Transformation tools (internal and partners)- Modelbuilder models to automate, document, update- Best practice examples
• Helps to think as ‘pull’ rather than ‘push’ process- (suck into INSPIRE from source schema)
2013 Esri International User ConferenceJuly 8–12, 2013 | San Diego, California
Benefiting from INSPIRE – the Northern Ireland approach
Michael Byrnestanding in for Trevor Steenson
The challenge => INSPIREBe compliant!
• Synchronise• Discover• Share
Benefiting from INSPIRE – the Northern Ireland approach
But also……
…national SDI?
The choices!Essentially, just 2 of them…
DataProducers
DataProducers
DataProducers
DataProducers
DataProducers
DataProducers
Consumer or
DataProducers
DataProducers
DataProducers
DataProducers
DataProducers
DataProducers
ConsumerLPS
Federated? Centralised?
or
COTS
Benefiting from INSPIRE – the Northern Ireland approach
INSPIRE Annex Data
INSPIRE ETAL (FME) INSPIRE
Data Models
“Other” Northern Ireland SDI data
3rd PartyWeb Services
CS‐W CatalogGeoportal ServerArcGIS for Server
ArcGIS for
Desktop
Web Services Bus
ArcGIS for INSPIRE
KML Services
REST Services
OGC(WMS/
WFS/WCS) Services
INSPIRE View
Services
INSPIRE Download Services
INSPIRE Discovery Services
sdi.suite (serviceMonitor, securityManager, licenceManager)
Google Earth/Maps
Web 2.0External Catalogs
Spatial NIPortalWebsite
Administrator Pages
Geoportal Viewer
Metadata Editor Search Pages
LPS Sources
Spatial NI - conceptual architectureSpatial NI - physical architecture
Benefiting from INSPIRE – the Northern Ireland approach
Spatial NI usageAs per Google Analytics!
• mid May- mid June- ~ 4,150 unique visitors- ~ 10 minute stay- ~ 23% new visitors
Benefiting from INSPIRE – the Northern Ireland approach
Spatial NI use caseG8 summit
• Civil contingency…what if?
Benefiting from INSPIRE – the Northern Ireland approach
Spatial NI resultsDelivering the original need!
Metadata and discovery servicesView servicesDownload services
Data transformation servicesLicencing servicesDelivering quality of service
Delivering INSPIRE
Benefiting from INSPIRE – the Northern Ireland approach
Spatial NISummary
• Savings (£)• Quick deployment• Ease of use• Expansion• Opportunity
Benefiting from INSPIRE – the Northern Ireland approach
• Key? = INSPIRE and beyond!
