Open Source Toolsfor BI, Data Warehousing

and Open Data

... and why they are the answer to our government's demand for the processing, analysis, reporting and publishing of data

Presenter

● Cedric De Vroey● 25yr● Freelance BI/DWH Consultant● Love for Open Source and Data

Cedric De Vroey @cedricdevroey cedric.devroey@gmail.com

BI, Data Analysis, Open Data...It's all about the same problem

Source Systems Extract

Data Warehouse

Transform

Data marts

Load

Output

Extraction, Transformation and Loading (ETL) requires tools

Biggest in the industry: Good tools but expensive licensing models

Smaller budget for implementation and

services

The alternative: Open Source

No licensing cost

More budget for implementation and services

Higher Return

● Extraction, Transformation and Loading ● Reporting

■ Static reports in PDF, Excel, ...■ Online reporting using dashboards■ Online analytical reporting

● Integration possible through the use of APIs● Open Source● Large Community of developers

Demo challenge

● Source○ Open Data from the City of Ghent

Delivered by API provided by The DataTank● Processing

○ Pentaho Data Integration (AKA Kettle)● Reporting

○ Load results into Google Documents Table○ Visualise results on Google map

Demo challenge: Source

● http://appsforghent.be/api-tdt/

Demo challenge: Processing

Demo challenge: Reporting

Google Documents Table

Demo challenge: Reporting

Demo Challenge: Costs

Licensing: 0.00 EUR

Development: 1 hr

Try it yourself

The demo is available at http://bit.ly/Apps4GhentResults Pentaho Data Integration is available athttp://kettle.pentaho.com/