Geodata-Management in the Th¼nen- Institute

Dr. Frank Tottewitz

Till KirchnerThünen-Institute for Forest Ecosystems, Eberswalde

Eberswalde, 08.03.2013

Geodata-Management in the Thünen-Institute

Till Kirchner

The Thünen-Institute

• Works directly for the german „Federal Ministry of Food, Agriculture and Consumer Protection“

• Responsible for the coordination / enforcement of national monitoring-programs in the fields of:

• Fisheries

• Forests

• Agriculture

• Produce data / facts for Scientific Policy Advice

08.03.2013 Internationaler GIS'EM IP KursSeite 3

Till Kirchner

The Thünen-Institute – Specialty Institutes

• Is subdivided in 15 Specialty Institutes:


Thünen-Institute for Forest Ecosystems (WO) – Ebeswalde

Till Kirchner

The Thünen-Institute – Monitoring Programs

• National Forest Inventory – WO

• Intensiv Forest Monitoring (Level II) – WO

• National Soil Inventory in the Forest – WO

• National Agricultural Soil Inventory

• Reporting on Green House Gas Emissions – WO

• Red deer Monitoring (Telemetry / GPS) – WO

• Fishery Monitoring Programs (e. g., Radioactivity Measurement)


Till Kirchner

The Thünen-Institute – Monitoring Programs

We go out → measure the environment – collect data

Validate the data

Extrapolate the data (e.g., amount of pine wood in a certain age class in Brandenburg)

Publish the data for

• decision-making (political / economic)

• further research


Till Kirchner

Example: National Forest Inventory


Brandenburg

Eberswalde

• About 50,000 Forest Plots in Germany

• Measured each 10 years

• Based on a systematic Sample (Grid 4x4km)

Till Kirchner



• Data is stored in an object-relational Database System (DBMS: MSSQL Server)

• Several databases (operational / testing – development / backup / aggregated data)

Measurement Workflow:

• Field Troops check out plots to measure from the central database

• Go out to measure these plots with field laptops – direct data check routines

• Import the measured data into the central database

!!! Complete Dataset is directly available after field measurement !!!

Till Kirchner



What is needed:

• Complex database design (several hundred Tabels)

• Sophisticated and highly specialized software tool for

• field measurements

• Data aggregation

• Hundreds of check routines

• Powerful hardware

Till Kirchner



Conducted each 10 years!

What does that mean for the IT-components?

Which hardware / software was available 10 years ago?

Which hardware / software will be available in 10 years?

• Mobile Internet

• Location based Services

• Grid / Cloud Computing

• ...

Till Kirchner



Hardware and Software is just used ones!!!

Collecting enviromental data is very expensive!!!

Data should be handled with care!!!

Till Kirchner

Third Party Data


The Thünen-Institute uses many data sources from other Organisations

Examples:

• CORINE Landcover

• Boundaries of adminstrative units (Federal States / communities / …)

• Cadastral data

• Boundaries of protected Areas (National Parks / ...)

Till Kirchner

Data Management System


A System is needed which allows to:

• Store the data secure (long-term archiving)

• Distribute data in a standardized way

• Presentation

• Sharing with partners

• Document data (Metadata)

Till Kirchner

Data Storage


Data belongs into a Database System!!!

Multi User Access:

• Several people have to work with the same data

Transactions:

• Everything or Nothing → avoids data inconstancies

Backup Concepts:

• Save daily changed data each night

Till Kirchner

Data Storage


Database Management Systems (DBMS):

Which one to choose?

Till Kirchner

Data Storage


Database Management Systems (DBMS):

Several different DBMS are used in the Thünen-Institute

• National Soil Inventory in the forest – ACCESS

• National Forest Inventory – MSSQL Server

• Intensiv Forest Monitoring (Level II) – ORACLE

• Reporting on Green House Gas Emissions – PostgreSQL / PostGIS

Till Kirchner

Geodata


WHAT IS GEODATA?

Till Kirchner

Geodata


WHAT IS GEODATA?

Data which can be directly or indirectly referenced to a certain position on earth or a geographic region

Till Kirchner

Geodata – an Example

Mzuzu has about 130 thousand habitants


Till Kirchner



Capital of theNorthern Region of Malawi!


Till Kirchner





Till Kirchner



Mosambique

Zambia Tansania



Till Kirchner

Geodata


Which data do you work with which is no geodata?

Till Kirchner

Geodata


All of the data the Thünen-Institute uses is geodata!

Till Kirchner

Distributed Data Management

08.03.2013Seite 27

No Direct Connection

Complex Technical Data in a DB

shpdbf

shx

Shape file

Geodata file-based

Internationaler GIS'EM IP Kurs

Till Kirchner08.03.2013 Internationaler GIS'EM IP KursSeite 28

Object Oriented Geometry Storage

Object Oriented Intergated Data Management

Advantages:

• DB-techniques can be used to keep data consitent(e.g., Trigger / Rules)

• A unique query logic con be used for all data→ Spatial SQL

Till Kirchner

Spatial Database Systems


A modern object-relational spatial Database System is the best choice to handle and store bigger amount of complex spatial data!

Till Kirchner

Spatial Database Systems


The most advanced open source system:PostgreSQL / PostGIS

Till Kirchner

Thünen-Institute: Geodata Storage


Projects Central Geodata Storage

Data Migration

Extract-Tranform-Load-Jobs

Till Kirchner






• Presentation



Till Kirchner

Standardized Data Distribution


Would it make sense to give everybody (direct) access to the Central Geodatabase of the Thünen-Institute?

Till Kirchner

Open Web Services (OWS)


Do you know any OWS? Like WMS or WFS?

Till Kirchner



What is a GeoWebservice?

• A standardized gateway to visualize or download geodata!

OR

• A standardized dialog between two programs (client and server)

Till Kirchner



Client Server

GetCapabilities

Description of the Service

1.

Client Server

„GetData“ / „ExecuteProcess“

Geodata / Map

2.

Till Kirchner


Internationaler GIS'EM IP Kurs

ClientGeoserver

Shape /GML

GeoDB

Shapefile

GeoTiff

08.03.2013Seite 37

Till Kirchner


Internationaler GIS'EM IP Kurs08.03.2013Seite 38

GetCapabilities – Service Description<WMS_Capabilities version="1.3.0" ... xsi:schemaLocation="http://... .xsd">

<Service><Name>...</Name><Title>...</Title><Abstract>...</Abstract><KeywordList>

<Keyword>...</Keyword>…

</KeywordList><OnlineResource xlink:href="https://.../geoserver/"/><ContactInformation>

…</ContactInformation><Fees>NONE</Fees><AccessConstraints>NONE</AccessConstraints>

</Service>

...

Name of the Service

Abstract

Keywords

Contact

Fees

Access Use Constraints

Till Kirchner



GetCapabilities – Layer Description

<Layer queryable="1"><Name>...</Name><Title>...</Title><Abstract>...</Abstract><KeywordList>...</KeywordList><CRS>EPSG:4258</CRS><GeographicBoundingBox>...</GeographicBoundingBox><Style><Name>wuchsgebiete</Name><Title>...</Title><Abstract>...</Abstract><LegendURL width="20" height="20"><Format>image/png</Format><OnlineResource ... /></LegendURL></Style><Style>…</Style>

</Layer>

Queryable

Name / Title

Abstract

Keywords

Spatial Extend

Available Styles

Till Kirchner

Open Web Services (OWS) – Web Map Service


Request:https://gdi.vti.bund.de/geoserver/wgwb/ows?service=WMS&Version=1.1.0&request=GetMap&

layers=wgwb:wuchsgebiete_2005,wgwb:forstl_gl_2005&

Styles=wuchsgebiete_trans,polygon_transparent_red&

Bbox=3280362.603,5237569.428,3921528.131,6103250.662&Width=600&Height=800&srs=EPSG:31467&format=image/png

Till Kirchner






• Presentation



Till Kirchner

Data Documentation


What is metadata?

Till Kirchner

Data Documentation


Where is metadata used?

Till Kirchner

Data Documentation


What do we need metadata for?

Till Kirchner

Data Documentation


Which aspects should be described by metadata?

Till Kirchner

Data Documentation


Looking for data

neu

Data-Searcher

Person A

Person B

Person C

Request

ZIP

Data

altThünen-Institute (WO)

Till Kirchner

Data Documentation


Person C runs an update

Data-Searcher

Person A

Person B

Person C

Neu

Thünen-Institute (WO)

Neu

AltAlt 1

Alt 2

Till Kirchner

Data Documentation


Data-Searcher

Person A


MetadataServer

Person B Person CRequest

URL Metadata Service

Till Kirchner

Data Documentation


Data-Searcher

Person A

MetadataServer

Person B Person C

Geoserver DatabaseServer

Metadata


Till Kirchner

Data Documentation


Daten-Searcher

Person A

MetadataServer

Person B Person C

Geoserver DatabaseServer

UPDATE


Geodata-Management in the Th¼nen- Institute

Documents

Transcript of Geodata-Management in the Th¼nen- Institute