Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History...

24
ohsome Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha Fendrich, Fabian Kowatsch, Sabrina Marx, Martin Raifer, Moritz Schott, Rafael Troilo, Alexander Zipf

Transcript of Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History...

Page 1: Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha

ohsome

Comprehensive OpenStreetMap History Data Analyses

- for and with the OSM community

Michael Auer, Melanie Eckle, Sascha Fendrich, Fabian Kowatsch, Sabrina Marx, Martin Raifer, Moritz Schott, Rafael Troilo, Alexander Zipf

Page 2: Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha

ohsome ?

1. OhSoMe: OpenStreetMap

2. OHsome: OpenStreetMap History (something)

3. Ohsome: sounds just „awesome“

2

Page 3: Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha

29.07.2018 3

Workshop NEXT SESSION!

Exploring OSM's history

using the "ohsome" data analysis platform

14:00h S.1.5

Page 4: Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha

29.07.2018 4

Disaster and

humanitarian

management

Big Spatial

Data

Analytics

ohsome

Page 5: Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha

OSM History Data Analysis

•What can we learn from the History?

• Development of the data

• Development of the users

• Development of spatial/thematic(sub-)communities

29.07.2018 5

data user

time

DATA QUALITY

COMMUNITY DYNAMICS

Page 6: Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha

OSM History Data Analysis

• The Challenge?• Make the whole data treasure available to the public

• Queries of arbitrary temporal and spatial resolution

• No pre-filtering / no clean-up

• BIG DATA

• High performance (parallel and distributed)

• Flexible (run it on local PC or on computing cluster)

• Usability (Easy to use for different target groups)

• Different API Levels

29.07.2018 6

Page 7: Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha

Examples: Data Quality

29.07.2018 7

Auer, M., Eckle, M, Fendrich, S., Griesbaum, L., Kowatsch, F., Marx,

S., Raifer, M., Schott, M., Troilo,R. & Zipf, A. (2018):

Towards Using the Potential of

OpenStreetMap History for

Disaster Activation Monitoring

Proceedings of the 15th ISCRAM Conference – Rochester, NY, USA May 2018

Page 8: Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha

Examples: Data Quality

29.07.2018 8

Auer et al. 2018

Page 9: Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha

Examples: Data Quality

29.07.2018 9

Auer et al. 2018

Page 10: Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha

Examples: Data Quality

29.07.2018 10

Auer et al. 2018

Page 11: Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha

Commnunity Dynamics

11

Page 12: Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha

Examples: Community Dynamics

29.07.2018 12

Page 13: Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha

Examples: Community Dynamics

29.07.2018 13

Page 14: Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha

Can I use it?

29.07.2018 15

ohsome API

Flexibility

Usability

OSHDB API

OSHDB*

* OSHDB = OpenStreetmap History Database

Page 15: Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha

Can I use it?

• OSHDB API: Current version 0.4 available on Github

https://github.com/giscience/oshdb

• ohsome API: https://api.ohsome.org

(global coverage coming soon!)

• KLL Nepal Dashboard

29.07.2018 16

Workshop NOW!

14:00h S.1.5

Page 16: Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha

OSHDB API

29.07.2018 17

Page 17: Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha

ohsome API

https://api.ohsome.org

29.07.2018 18

Web API documentation with example requests

Page 18: Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha

Webapp using ohsome API: Nepal-Dashboard

19

https://ohsome.org/apps/kll-dashboard-preview/

Page 19: Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha

Webapp using ohsome API: Nepal-Dashboard

20

Page 20: Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha

The end

Thank you for your attention!

29.07.2018 21

Workshop NOW!

Exploring OSM's history

using the "ohsome" data analysis platform

14:00h S.1.5

[email protected]

Page 21: Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha

Examples: Community Dynamics

29.07.2018 22

Page 22: Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha

Examples: Community Dynamics

29.07.2018 23

Page 23: Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha

OSM

id = 1234 type = WAY

timestamp = n -1

version = 2

tags = [building=yes,

addr:housenumber=42]

nodes = [3, 2, 1]

Zoom 0

Zoom 1

Zoom 2

timestamp = n

version = 1

tags = [building=yes]

nodes = [3, 2, 1]

. . .

OSM

OSH OSH

OSH

OSH

OSH

OSH

OSH

OSH OSH

OSH

OSHId = 1234

type = WAY

Grid-Partitionierung der Welt

in gleich große Zellen

OSHWayGridCell enthält

OSHEntity Objekte in einem räumlichen Index

OSHEntity enthält

OSMEntity Objekte

OSH

Page 24: Comprehensive OpenStreetMap History Data Analyses - for ......Comprehensive OpenStreetMap History Data Analyses - for and with the OSM community Michael Auer, Melanie Eckle, Sascha

Keytables

0 = building

1 = highway

2 = addr:housenumber

...

OSH OSH

OSH

OSH

OSM

id = 1234 type = WAY

timestamp = n -1

version = 2

tags = [1, 5]

nodes = [3, 2, 1]

Zoom 0

Zoom 1

Zoom 2

timestamp = n

version = 1

tags = [1]

nodes = [3, 2, 1]

OSMOSH

OSH

OSH

OSH OSH

OSH

1 = [0,6]

5 = [2,4]

1 = 900

2 = 1000

3 = 1001

member ids =

tag ids =

. . .

OSHId = 1234

type = WAY

members OSHEntity

Valuetables

(0, 0) = yes

(0, 1) = residential

(2, 0) = 2

...

OSH

Grid-Partitionierung der Welt

in gleich große Zellen

OSHWayGridCell enthält

OSHEntity Objekte in einem räumlichen Index

OSHEntity enthält

OSMEntity Objekte