Data mining in big databases with geo reference and easy web publishing and sharing of maps,...

40
Intevation GmbH - Ingo Weinzierl <[email protected]> Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements DIVE4Elements as Business Intelligence tool DIVE4Elements as Business Intelligence tool MapWindow Open Source GIS Conference 2012, Velp

Transcript of Data mining in big databases with geo reference and easy web publishing and sharing of maps,...

Page 1: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Data mining in big databases with

geo reference and easy web publishing

and sharing of maps, diagrams and models

with DIVE4Elements

DIVE4Elements as Business Intelligence tool

DIVE4Elements as Business Intelligence tool

MapWindow Open Source GIS Conference 2012, Velp

Page 2: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Intevation GmbH – the company

Core qualities

Development of future oriented IT concepts

Based on Open Source Software

Manufacturer independent

Focused on quality and sustainability

Know How in many domains

Page 3: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

DIVE4Elements – what is it?

Core Idea:

Exploration of huge and complex geographic data

Digging

Investigation

Viewing

Exporting

4 Elements (Fire, Air, Earth, Water)

Page 4: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

For Users:

Tool for investigating huge amounts of data

Tool for visualization specialized data

Analysis tool

Interface for raw and processed data

Tool for preparing publications

For Providers:

Dynamic product generator for specialized data

DIVE4Elements – what is it?

Page 5: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Creation of specialized workflows (wizard)

Integration of specialized calculation and modelling algorithms

Enormous set of visualization options

various charts (png, svg, pdf)

maps (WMS / WFS)

Enormous set of data exports

CSV, PDF

specialized exports (WST, AT)

Integration of external clients with open interfaces (RESTful)

Some Core Features

Page 6: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Continuously growing amount of data (in data warehouses)

Different structures of specialized data

Varying workflows / parameterizations

Integration in proprietary software stacks

... as web application with short latencies !

Where are the challenges ?!

Page 7: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Initial Situation

http://www.bmu.de/files/bilderdatenbank/image/pjpeg/fi010_bms.jpg

http://upload.wikimedia.org/wikipedia/commons/1/14/Cuxhaven_atair_hamburg.jpg

Page 8: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

What can You do with DIVE4Elements ?!

-

Some Samples

Page 9: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Data Exploration / Selection

Page 10: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Data Exploration / Selection

Page 11: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Data Exploration / Selection

Page 12: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Data Exploration / Selection

Page 13: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Data Exploration / Selection

Page 14: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Data Exploration / Selection

Page 15: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Data Exploration / Selection

Page 16: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Data Exploration / Selection

Page 17: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Data Exploration / Selection

Page 18: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Found your requested data ?

View the result !

Page 19: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Page 20: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Statistics

Page 21: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Histograms

Page 22: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Data Export

Page 23: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Another Data Export

Page 24: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Visualization - Graphical Exports

Page 25: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Further specialized analysis

Page 26: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Vertical Profiles

Page 27: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Horizontal Profiles

Page 28: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Horizontal Cross Section

Page 29: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Profil Section

Page 30: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Horizontal Section

Page 31: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

New Features

New Web-2.0 Client (based on Ajax/GWT)

„Datacage“: adding context sensitive data to visualizations

Integration of a project management system (users can save and open old projects / parameterizations)

Automatic generation of products with a command line tool

Integration in Single sign-on (SSO) authentication

Today

Page 32: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Web-2.0 Client

Page 33: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Web-2.0 Client

Page 34: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Web-2.0 Client

Page 35: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Web-2.0 Client

Page 36: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Web-2.0 Client

Page 37: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

… the technical stuff ...

Page 38: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Software Architecture

Page 39: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

Workflow

State: determines required data; defines Outputs

Transition: definition of target and destination State

Artifact

Lightweight representation of a parameterization

API: “describe“, “feed“, “advance“, “out“, “endOfLife”

has States (current and old states)

Collection

exists of one or more Artifacts

API: “out”

saves user settings specific to visualizations

Service

direct access meta information

Main Components

Page 40: Data mining in big databases with geo reference and easy web publishing and sharing of maps, diagrams and models with DIVE4Elements by Ingo Weinzierl

Intevation GmbH - Ingo Weinzierl <[email protected]>

... to presentation

... to customized and ongoing software stacks

... to software solutions based on Free Software / Open Source Software

Contact

Ingo Weinzierl, Intevation GmbH

Email: [email protected]

Phone: +49 541 – 335083 773

Questions ?