Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud...
Transcript of Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud...
![Page 1: Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud Richard Rombouts - Snowflake Software Ltd. & Keiran Millard – SeaZone Solutions Ltd.](https://reader031.fdocuments.net/reader031/viewer/2022040312/5e0524a1346c1c436d2c45c9/html5/thumbnails/1.jpg)
www.snowflakesoftware.com www.seazone.com
Marine and Coastal Data Services in the Cloud
Richard Rombouts - Snowflake Software Ltd. &
Keiran Millard – SeaZone Solutions Ltd.
![Page 2: Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud Richard Rombouts - Snowflake Software Ltd. & Keiran Millard – SeaZone Solutions Ltd.](https://reader031.fdocuments.net/reader031/viewer/2022040312/5e0524a1346c1c436d2c45c9/html5/thumbnails/2.jpg)
www.snowflakesoftware.com www.seazone.com
![Page 3: Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud Richard Rombouts - Snowflake Software Ltd. & Keiran Millard – SeaZone Solutions Ltd.](https://reader031.fdocuments.net/reader031/viewer/2022040312/5e0524a1346c1c436d2c45c9/html5/thumbnails/3.jpg)
www.snowflakesoftware.com www.seazone.com
Marine Geospatial Data
Inspired Marine Data?
![Page 4: Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud Richard Rombouts - Snowflake Software Ltd. & Keiran Millard – SeaZone Solutions Ltd.](https://reader031.fdocuments.net/reader031/viewer/2022040312/5e0524a1346c1c436d2c45c9/html5/thumbnails/4.jpg)
www.snowflakesoftware.com www.seazone.com
SeaZone HydroSpatial
• Global • Base
• One
Content
Cove
rage
![Page 5: Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud Richard Rombouts - Snowflake Software Ltd. & Keiran Millard – SeaZone Solutions Ltd.](https://reader031.fdocuments.net/reader031/viewer/2022040312/5e0524a1346c1c436d2c45c9/html5/thumbnails/5.jpg)
www.snowflakesoftware.com www.seazone.com
Becoming Inspired
Discover Metadata
HydroSpatial Base
INSPIRE
MEDIN
Application Schema
INSPIRE Themes
Feature Catalogue
ISO 19131
HS Base
Build
Use Available for others to use
![Page 6: Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud Richard Rombouts - Snowflake Software Ltd. & Keiran Millard – SeaZone Solutions Ltd.](https://reader031.fdocuments.net/reader031/viewer/2022040312/5e0524a1346c1c436d2c45c9/html5/thumbnails/6.jpg)
www.snowflakesoftware.com www.seazone.com
HydroSpatial Base and INSPIRE
Hydrography8.24%
Transport Networks13.48%
Land Cover8.99%
Elevation1.87%Geology
4.87%
Agricultural and aquaculture facilities
3.37%
Area management/restriction/re
gulation zones and reporting units
11.24%
Buildings8.61%
Habitats and biotopes
3.00%Human health and safety
2.62%
Land Use
0.75%
Species distribution
2.62%
Natural Risk Zones3.00%
Utility and governmental services10.49%
Production and industrial facilities16.48%
Sea Regions0.37%
![Page 7: Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud Richard Rombouts - Snowflake Software Ltd. & Keiran Millard – SeaZone Solutions Ltd.](https://reader031.fdocuments.net/reader031/viewer/2022040312/5e0524a1346c1c436d2c45c9/html5/thumbnails/7.jpg)
www.snowflakesoftware.com www.seazone.com
How to expose INSPIRE features?
Hydrography8.24%
Transport Networks13.48%
Land Cover8.99%
Elevation1.87%Geology
4.87%
Agricultural and aquaculture facilities
3.37%
Area management/restriction/re
gulation zones and reporting units
11.24%
Buildings8.61%
Habitats and biotopes
3.00%Human health and safety
2.62%
Land Use
0.75%
Species distribution
2.62%
Natural Risk Zones3.00%
Utility and governmental services10.49%
Production and industrial facilities16.48%
Sea Regions0.37%
WFS
SR:Coastline
EL:Bathymetry HY:InterTidalArea
TN:ShipRoute
![Page 8: Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud Richard Rombouts - Snowflake Software Ltd. & Keiran Millard – SeaZone Solutions Ltd.](https://reader031.fdocuments.net/reader031/viewer/2022040312/5e0524a1346c1c436d2c45c9/html5/thumbnails/8.jpg)
www.snowflakesoftware.com www.seazone.com
Cloud Data Services • Data as a Service (DaaS) is not new!
Do it yourself
Partner
Out-source
![Page 9: Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud Richard Rombouts - Snowflake Software Ltd. & Keiran Millard – SeaZone Solutions Ltd.](https://reader031.fdocuments.net/reader031/viewer/2022040312/5e0524a1346c1c436d2c45c9/html5/thumbnails/9.jpg)
www.snowflakesoftware.com www.seazone.com
Cloud Data Service Infrastructure
WFS WFS WFS WFS
API Management
Administration Services Data Publication Services
Data Maintenance
Transform Publish Validate
Receive Validate Load
Hydro spatial
Service Monitoring & Testing
Performance & Capability (Ad-hoc)
Availability
(Continuous)
Workflow
Validation fails
![Page 10: Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud Richard Rombouts - Snowflake Software Ltd. & Keiran Millard – SeaZone Solutions Ltd.](https://reader031.fdocuments.net/reader031/viewer/2022040312/5e0524a1346c1c436d2c45c9/html5/thumbnails/10.jpg)
www.snowflakesoftware.com www.seazone.com
Data Maintenance Infrastructure
WFS WFS WFS WFS
API Management
Data Publication Services
HydroSpatial
Hydrographical Offices
OGR2OGR Esri
FileGeoDB
Current configuration
![Page 11: Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud Richard Rombouts - Snowflake Software Ltd. & Keiran Millard – SeaZone Solutions Ltd.](https://reader031.fdocuments.net/reader031/viewer/2022040312/5e0524a1346c1c436d2c45c9/html5/thumbnails/11.jpg)
www.snowflakesoftware.com www.seazone.com
Data Maintenance Infrastructure
WFS WFS WFS WFS
API Management
Data Publication Services
HydroSpatial
Hydrographical Offices
Workflow
Transform, Validate, Publish
Workflow
Validate, Load
Planned configuration
![Page 12: Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud Richard Rombouts - Snowflake Software Ltd. & Keiran Millard – SeaZone Solutions Ltd.](https://reader031.fdocuments.net/reader031/viewer/2022040312/5e0524a1346c1c436d2c45c9/html5/thumbnails/12.jpg)
www.snowflakesoftware.com www.seazone.com
Database Cluster • Configuration
– Postgres database cluster (EnterpriseDB) on Amazon Web Services
• Benefits of Cluster: – Can start with two database instances and increase number of
instances as demand increases – Data automatically replicated between instances – Can establish database instances in different geographic regions
(e.g. Europe, North America, Middle East) to ensure QoS
![Page 13: Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud Richard Rombouts - Snowflake Software Ltd. & Keiran Millard – SeaZone Solutions Ltd.](https://reader031.fdocuments.net/reader031/viewer/2022040312/5e0524a1346c1c436d2c45c9/html5/thumbnails/13.jpg)
www.snowflakesoftware.com www.seazone.com
Configuring the Data Services • Publishing from single source to multiple
schemas (eg. INSPIRE, S-100) • Using off-the-shelf software • Rapid configuration and deployment of
new data services
![Page 14: Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud Richard Rombouts - Snowflake Software Ltd. & Keiran Millard – SeaZone Solutions Ltd.](https://reader031.fdocuments.net/reader031/viewer/2022040312/5e0524a1346c1c436d2c45c9/html5/thumbnails/14.jpg)
www.snowflakesoftware.com www.seazone.com
DEMONSTRATION Configuring Data Services with GO Publisher
![Page 15: Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud Richard Rombouts - Snowflake Software Ltd. & Keiran Millard – SeaZone Solutions Ltd.](https://reader031.fdocuments.net/reader031/viewer/2022040312/5e0524a1346c1c436d2c45c9/html5/thumbnails/15.jpg)
www.snowflakesoftware.com www.seazone.com
Deploying Data Services • Once schema transformation configured –
project is deployed within WFS • But first need to configure WFS settings:
– GetCapabilities – Encoding format (compressed/uncompressed) – Servlet pattern
• Finally, generate WFS war and deploy to application server
![Page 16: Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud Richard Rombouts - Snowflake Software Ltd. & Keiran Millard – SeaZone Solutions Ltd.](https://reader031.fdocuments.net/reader031/viewer/2022040312/5e0524a1346c1c436d2c45c9/html5/thumbnails/16.jpg)
www.snowflakesoftware.com www.seazone.com
Deploying Data Services
Desktop
Server
HydroSpatial
Translation configuration
Data Request
Schema translation
Data Request
Schema translation
Database Records
Database Records
SQL Query
SQL Query
Database table information
![Page 17: Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud Richard Rombouts - Snowflake Software Ltd. & Keiran Millard – SeaZone Solutions Ltd.](https://reader031.fdocuments.net/reader031/viewer/2022040312/5e0524a1346c1c436d2c45c9/html5/thumbnails/17.jpg)
www.snowflakesoftware.com www.seazone.com
DEMONSTRATION Deploying Data Services with GO Publisher
![Page 18: Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud Richard Rombouts - Snowflake Software Ltd. & Keiran Millard – SeaZone Solutions Ltd.](https://reader031.fdocuments.net/reader031/viewer/2022040312/5e0524a1346c1c436d2c45c9/html5/thumbnails/18.jpg)
www.snowflakesoftware.com www.seazone.com
API Management Services • Security:
• Firewalls, ports • usernames/password
• Analytics and Reporting • Billing and Payments • Bad requests
• Malformed/Malicious • Request the world or data
outside allowable area of interest
![Page 19: Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud Richard Rombouts - Snowflake Software Ltd. & Keiran Millard – SeaZone Solutions Ltd.](https://reader031.fdocuments.net/reader031/viewer/2022040312/5e0524a1346c1c436d2c45c9/html5/thumbnails/19.jpg)
www.snowflakesoftware.com www.seazone.com
API Management Services WFS Proxy
![Page 20: Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud Richard Rombouts - Snowflake Software Ltd. & Keiran Millard – SeaZone Solutions Ltd.](https://reader031.fdocuments.net/reader031/viewer/2022040312/5e0524a1346c1c436d2c45c9/html5/thumbnails/20.jpg)
www.snowflakesoftware.com www.seazone.com
Administrator Services Service Monitoring & Testing
Performance & Capability (Ad-hoc )
Availability (Continuous)
Requirements: • GetCapabilities & DescribeFeatureType
Response: <10 seconds • GetFeature: Bounding Box for 1 feature ≤
30 seconds • 50 simultaneous users
Measurement: • 10 requests submitted per second for 50
simultaneous users • Combination of GetCapabilities,
DescribeFeatureType & GetFeature • Sustained for 1 min
Requirements: • Available 99% of time • Max unplanned downtime = 3.63 days/yr • Periods of planned downtime for are
maintenance excluded
Measurement: • 10 requests submitted per hour • Monitoring is continuous for lifetime of service • Combination of requests
![Page 21: Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud Richard Rombouts - Snowflake Software Ltd. & Keiran Millard – SeaZone Solutions Ltd.](https://reader031.fdocuments.net/reader031/viewer/2022040312/5e0524a1346c1c436d2c45c9/html5/thumbnails/21.jpg)
www.snowflakesoftware.com www.seazone.com
Using the Data Services
![Page 22: Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud Richard Rombouts - Snowflake Software Ltd. & Keiran Millard – SeaZone Solutions Ltd.](https://reader031.fdocuments.net/reader031/viewer/2022040312/5e0524a1346c1c436d2c45c9/html5/thumbnails/22.jpg)
www.snowflakesoftware.com www.seazone.com
DEMONSTRATION Using the Data Services in Quantum GIS
![Page 23: Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud Richard Rombouts - Snowflake Software Ltd. & Keiran Millard – SeaZone Solutions Ltd.](https://reader031.fdocuments.net/reader031/viewer/2022040312/5e0524a1346c1c436d2c45c9/html5/thumbnails/23.jpg)
www.snowflakesoftware.com www.seazone.com
![Page 24: Marine and Coastal Data Services in the Cloud · Marine and Coastal Data Services in the Cloud Richard Rombouts - Snowflake Software Ltd. & Keiran Millard – SeaZone Solutions Ltd.](https://reader031.fdocuments.net/reader031/viewer/2022040312/5e0524a1346c1c436d2c45c9/html5/thumbnails/24.jpg)
www.snowflakesoftware.com www.seazone.com
Richard Rombouts
[email protected] @RichRombouts ; @Sflakesoftware
Keiran Millard [email protected] @SeaZoneDotCom