Cerba ppt gi2011-harmonization-of-spatial-planning-data_final

Spatial Data HarmonizationOn how to realize it in Spatial Planning

1http://portal.sdi-edu.zcu.cz

University of West Bohemia

Karel JANECKA, Otakar CERBA,

Karel JEDLICKA, Jan JEZEK

Harmonization and its role in spatial planning

Spatial data harmonization

• Providing access to data through network services in arepresentation that allows for combining it with other INSPIRE datain a coherent way by using within the European Spatial DataInfrastructure (ESDI) a common set of data product specifications.

• This includes agreements about coordinate reference systems,classification systems, application schemes, etc.



Components of harmonization:

• INSPIRE principles

• Reference model

• Data translation model

• Portrayal model

• Application schemes and feature catalogues

• Dictionaries

• Metadata

• Maintenance

• Quality

• Data transfer

• Derived reporting & multiple representations

• Consistency between data

• Data Capturing


An example of Spatial Data Harmonization using PostgreSQL + PostGIS


HARMONIZATION

Source data model Target data model

Zemgale urban

planing

(specific data model)

CORINE land

cover

Geometry

Reclassification

HARMONIZATION


HARMONIZATION STEPS

Definition of reclassification rules

Data reclassification

Union of touching geometries in same class

Transformation from multipolygon to polygons


HARMONIZATION STEPS IN

Definition of reclassification rules → Create mapping table

Data reclassification → SQL JOIN using mapping table

Union of touching geometries in same class → Spatial aggregatefunction Union

Transformation from multipolygon to polygons → Spatial functiondump for converting multipolygon to polygon


ZEMGALE DATA MODEL

Atribute Field Explanation Type

VEIDS Planed land use type (see possible values down) Text 50

INDEKSS Area with speciffic restrictions Text 10

PLATIBA Area(m2) Long Integer

TER_VIEN territorial unit Text 50

ADM_TER administrative area Text 50

LAYER Layer number in CAD systems Text 50

PIEZIMES notes Text 100


LAND COVER DATA MODEL

CORINE land

cover11http://portal.sdi-edu.zcu.cz

RECLASSIFICATION RULES

1 DzM Low-rise residential dwellings → 11 Urban fabric

2 DzV Multi-residential dwellings → 11 Urban fabric

3 P Public Building → 11 Urban fabric

4 RR Production facilities and warehouses → 121 Industrial or commercial units

5 RD Mining area → 131 Mineral extraction sites

6 T Technical Building → 12 Industrial, commercial...

7 Ū Waters → 5 Water bodies

8 M Forests → 31 Forests

9 ZĪ Outstanding foliage sites No corresponding class

10 ZC Other groomed greenery space → 141 Green urban areas

11 L Rural Land → 2 Agriculture areas

12 No data No corresponding class

ZEMGALE CLASSIFICATION → CORINE NOMENCLATURE


Database tables

plan_zonejums_part – orginal dataset (imported from

shapefile)

lc_original - original classification for land cover

lc_standardized – standardized classification for land cover

standardized_to_original – classification mapping

plan_zonejums_part_harm – reclassified data


Database schema


Harmonization query

We have: plan_zonejums_part, lc_original, lc_standardized,

standardized_to_original

We need: plan_zonejums_part_harm

SQL Query:

CREATE TABLE plan_zonejums_part_harm AS

SELECT nextval('gid_seq'::regclass) AS gid, orig.gid AS original_gid,

orig.the_geom, orig.veids, orig.standardized_cl, lc_standardized.lc_class

FROM lc_standardized, ( SELECT plan_zonejums_part.gid,

plan_zonejums_part.the_geom, plan_zonejums_part.veids,

standardized_to_original.standardized_cl

FROM plan_zonejums_part

RIGHT JOIN standardized_to_original ON plan_zonejums_part.veids =

standardized_to_original.original_cl) orig

WHERE orig.standardized_cl::text = lc_standardized.classification::text;


Database tables

plan_zonejums_part – orginal dataset (imported from

shapefile)

lc_original – original classification for land cover

lc_standardized – standardized classification for land cover

standardized_to_original – classification mapping

plan_zonejums_part_harm – reclassified data


RECLASSIFIED DATA SET


Next step – union of adjacent features with same class

SELECT

NEXTVAL('gid_seq'::regclass)::integer AS gid,

(ST_Dump(foo.the_geom)).geom AS the_geom, standardized_cl,

lc_class FROM (

SELECT

ST_union(the_geom) AS the_geom, standardized_cl, lc_class

FROM plan_zonejums_part_harm

WHERE the_geom IS NOT NULL

GROUP BY standardized_cl, lc_class) AS foo

WHERE foo.the_geom IS NOT NULL;


Final dataset


An example of Spatial Data Harmonization using commercial

GIS software - ArcGIS


Using ArcGIS Model Builder for transformations between

data modelsP4A Land Cover example


Understanding target data

• Plan4all Land Cover data model



Simple feature classLandCoverOriginalArea Contains Z values

Contains M valuesGeometry Polygon

NoYes

Data typeField namePrec-ision Scale LengthDomainDefault value

Allow nulls

OBJECTID Object ID

SHAPE Geometry Yes

inspireId String Yes 15

source String Yes 50

classification String Yes 21

classificationLink String Yes 50

SHAPE_Length Double Yes 0 0

SHAPE_Area Double Yes 0 0

Simple feature classLandCoverStandardisedArea Contains Z values


NoYes


Allow nulls

OBJECTID Object ID

SHAPE Geometry Yes



classification String Yes CorineLandCoverCode 21

beginLifespanVersion Date Yes 0 0 8

endLifespanVersion Date Yes 0 0 8



Relationship class

Name

Primary key

Foreign key

Type

Cardinality

Notification

Forward label

Backward label

No relationship rules defined.

StandardisedArea_OriginalArea

Origin feature class Destination feature class

Simple

One to many

None

OriginalArea

StandardArea

StandardArea

inspireId

inspireId

OriginalAreaName

Coded value domain

CorineLandCoverCodeDescription

Field type

Split policy

Merge policy

CorineLandCoverCod

e

String

Default value

Default value DescriptionCode

1 Artificial surfaces

2 Agricultural areas

3 Forest and semi natural areas

4 Wetlands

5 Water bodies

11 Urban fabric

12Industrial, commercial and

transport units13

Mine, dump and construction

sites14

Artificial, non-agricultural

vegetated areas21 Arable land

22 Permanent crops

23 Pastures

24 Heterogeneous agricultural areas

31 Forests

32Scrub and/or herbaceous

vegetation associations33

Open spaces with little or no

vegetation41 Inland wetlands

42 Maritime wetlands

51 Inland waters

52 Marine waters

111 Continuous urban fabric

112 Discontinuous urban fabric

121 Industrial or commercial units

122Road and rail networks and

associated land123 Port areas

124 Airports

131 Mineral extraction sites

132 Dump sites

133 Construction sites

141 Green urban areas

142 Sport and leisure facilities

211 Non-irrigated arable land

212 Permanently irrigated land

213 Rice fields

221 Vineyards

222 Fruit trees and berry plantations

223 Olive groves

231 Pastures

241Annual crops associated with

permanent crops242 Complex cultivation patterns

243

Land principally occupied by

agriculture, with significant areas

of natural vegetation244 Agro-forestry areas

311 Broad-leaved forest

312 Coniferous forest

313 Mixed forest

321 Natural grasslands

322 Moors and heathland

323 Sclerophyllous vegetation

324 Transitional woodland-shrub

331 Beaches, dunes, sands

332 Bare rocks

333 Sparsely vegetated areas

334 Burnt areas

335 Glaciers and perpetual snow

411 Inland marshes

412 Peat bogs

421 Salt marshes

422 Salines

423 Intertidal flats

511 Water courses

512 Water bodies

521 Coastal lagoons

522 Estuaries

523 Sea and ocean

No corresponding cla* No corresponding class

• Plan4all Land Cover data model – ERA diagram of database schema in ESRI Geodatabase.





NoYes


Allow nulls

OBJECTID Object ID

SHAPE Geometry Yes









NoYes


Allow nulls

OBJECTID Object ID

SHAPE Geometry Yes








Relationship class

Name

Primary key

Foreign key

Type

Cardinality

Notification

Forward label

Backward label




Simple

One to many

None

OriginalArea

StandardArea

StandardArea

inspireId

inspireId

OriginalAreaName

Coded value domain


Field type

Split policy

Merge policy

CorineLandCoverCod

e

String

Default value





4 Wetlands

5 Water bodies

11 Urban fabric


transport units13


sites14



22 Permanent crops

23 Pastures


31 Forests






51 Inland waters

52 Marine waters






124 Airports


132 Dump sites






213 Rice fields

221 Vineyards


223 Olive groves

231 Pastures



243






313 Mixed forest






332 Bare rocks


334 Burnt areas


411 Inland marshes

412 Peat bogs

421 Salt marshes

422 Salines


511 Water courses

512 Water bodies

521 Coastal lagoons

522 Estuaries

523 Sea and ocean


• Plan4all Land Cover data model




NoYes


Allow nulls

OBJECTID Object ID

SHAPE Geometry Yes









NoYes


Allow nulls

OBJECTID Object ID

SHAPE Geometry Yes








Relationship class

Name

Primary key

Foreign key

Type

Cardinality

Notification

Forward label

Backward label




Simple

One to many

None

OriginalArea

StandardArea

StandardArea

inspireId

inspireId

OriginalAreaName

Coded value domain


Field type

Split policy

Merge policy

CorineLandCoverCod

e

String

Default value





4 Wetlands

5 Water bodies

11 Urban fabric


transport units13


sites14



22 Permanent crops

23 Pastures


31 Forests






51 Inland waters

52 Marine waters






124 Airports


132 Dump sites






213 Rice fields

221 Vineyards


223 Olive groves

231 Pastures



243






313 Mixed forest






332 Bare rocks


334 Burnt areas


411 Inland marshes

412 Peat bogs

421 Salt marshes

422 Salines


511 Water courses

512 Water bodies

521 Coastal lagoons

522 Estuaries

523 Sea and ocean


Understanding source data

• Zemgale (Latvia) data model

Simple feature classplan_zonejums_JelgavaSurroundings Contains Z values


NoNo


Allow nulls

OBJECTID Object ID

Shape Geometry Yes

gid Double Yes 0 0

veids String Yes 21

indekss String Yes 254

platiba String Yes 21

pasv String Yes 254

piezimes String Yes 254

map_leaf String Yes 254

dept String Yes 254

Shape_Length Double Yes 0 0

Shape_Area Double Yes 0 0

Atribute Field Explanation Type

VEIDS Planed land use type (see possible values down) Text 50

INDEKSS Area with speciffic restrictions Text 10

PLATIBA Area(m2) Long Integer

TER_VIEN territorial unit Text 50

ADM_TER administrative area Text 50

LAYER Layer number in CAD systems Text 50

PIEZIMES notes Text 100


Attribute mapping

1 DzM Low-rise residential dwellings → 11 Urban fabric

2 DzV Multi-residential dwellings → 11 Urban fabric

3 P Public Building → 11 Urban fabric

4 RR Production facilities and warehouses → 121 Industrial or commercial units

5 RD Mining area → 131 Mineral extraction sites

6 T Technical Building → 12 Industrial, commercial...

7 Ū Waters → 5 Water bodies

8 M Forests → 31 Forests

9 ZĪ Outstanding foliage sites No corresponding class

10 ZC Other groomed greenery space → 141 Green urban areas

11 L Rural Land → 2 Agriculture areas

12 No data No corresponding class

ZEMGALE CLASSIFICATION → CORINE NOMENCLATUREZEMGALE CLASSIFICATION → CORINE NOMENCLATURE


Transformation steps

• Understanding both source and target data– A necessary condition!

1. Transform source data to WGS 84.

2. Transform the source data geometry and attributes to match the target scheme.

3. Apply domain.


Transformation of coordinate system

1. Transform source data to WGS 84.– Explore source coordinate system,

– Run transformation


Transformation of geometry and attributes

2. Transform the source data geometry and attributes to match the target scheme.

– Create classes:

• LandCoverOriginalArea,

• LandCoverStandardisedArea.

– Fill them with data.

– Create relationship between them.


Transformation of geometry and attributes


Applying a domain

3. Apply a StandardClassification domain to LandCoverStandardisedArea.


Result


References

• JEDLICKA, K.: Using ArcGIS Model Builder for transformations between data models- P4A Land Cover example. In: PLAN4ALL workshop on spatial data harmonization.Riga, 2011.

• JEZEK, J.: Technological aspect of spatial data harmonization.

[ONLINE] http://prezi.com/ro8cfb114n2d/harmonization/

• Project HUMBOLDT

http://www.esdi-humboldt.eu/home.html

• Project PLAN4ALL

http://portal.plan4all.eu

• Project SDI-EDU

http://portal.sdi-edu.zcu.cz

http://portal.sdi-edu.zcu.cz 33

http://prezi.com/ro8cfb114n2d/harmonization/






















http://portal.plan4all.eu/









http://portal.sdi-edu.zcu.cz/











Cerba ppt gi2011-harmonization-of-spatial-planning-data_final

Technology

Transcript of Cerba ppt gi2011-harmonization-of-spatial-planning-data_final