Waternomics: Making Sense of Data
-
Upload
wassim-derguech -
Category
Data & Analytics
-
view
50 -
download
0
Transcript of Waternomics: Making Sense of Data
@WATERNOMICS_EU www.waternomics.eu
Project co-funded by the European Commission within the 7th Framework Program (Grant Agreement No. 619660)
MAKING SENSE OF WATER DATA
WASSIM DERGUECH
Waternomics End of Project Meeting 30/01/2017Galway, Ireland
@WATERNOMICS_EU www.waternomics.eu2
EVERYTHING IS BECOMING SMART
2
Everything can be sensed and measured
Everything is connected: people,
systems, objects, etc.
Decision support systems can analyze, optimize, predict, etc.
Adapted from Cameron Brooks, Lets Build a Smarter Planet: IBM Smarter Water Management, Water Resources Conference, 2010
@WATERNOMICS_EU www.waternomics.eu3
SMART SYSTEMS FOR EVERYTHING
3
SMART Water SMART Transport SMART Energy
Water
Energy
ChemicalsPublic
Transport
Traffic
Energy
Energy Grid
Sources ofEnergy
Smart Homes
CO2
CO2
Apply ICT for monitoring, analysis, prediction, quality control, …
Adapted from Cameron Brooks, Lets Build a Smarter Planet: IBM Smarter Water Management, Water Resources Conference, 2010
From Sensors to Apps
4
SmartSensors/Meters
PredictiveAnalytics Leak
Detection
CostCalculation
CO2Emission
SensorDataManagement
Data Modeling
Collection
Aggregation
Enrichment
Linking
ClassificationCleaning
Integration
Storing
Querying
Objective: prepare the data for application developers
@WATERNOMICS_EU www.waternomics.eu5
OVERALL ARCHITECTURE
@WATERNOMICS_EU www.waternomics.eu6
Installed in
3/4Pilot Sites
43Sensors
HIGHLIGHTS (HARDWARE)
3Types of Sensors
@WATERNOMICS_EU www.waternomics.eu7
OVERALL ARCHITECTURE
@WATERNOMICS_EU www.waternomics.eu8
MULTIPLE SOURCES OF DATA
IoT Sensors
BuildingData
EnterpriseData
Open Data8
@WATERNOMICS_EU www.waternomics.eu9 9Img credit (flickr) Dominik Staszowski
@WATERNOMICS_EU www.waternomics.eu10
A POTENTIAL SOLUTION: LINKED DATA
10
@WATERNOMICS_EU www.waternomics.eu11
LINKED DATA AN EXAMPLE
@WATERNOMICS_EU www.waternomics.eu12
MINIMAL VOCABULARY FOR ENTITIES
@WATERNOMICS_EU www.waternomics.eu13
WKAN AS A DATA CATALOG
Powered by
• single search & browse interface for data
sources, datasets, entities, and open data
related to Waternomics Project
• metadata available through API in standard web
format
@WATERNOMICS_EU www.waternomics.eu14
SEARCH SERVICE
@WATERNOMICS_EU www.waternomics.eu15
OPENCUBE AS WATER DATA EXPLORER
• Search & browse entities and aggregates
• Make entity metadata and aggregate data
available as Linked Data
@WATERNOMICS_EU www.waternomics.eu16
LAMBDA ARCHITECTURE
@WATERNOMICS_EU www.waternomics.eu17
REAL-TIME LINKED WATER DATASPACE
@WATERNOMICS_EU www.waternomics.eu18
@WATERNOMICS_EU www.waternomics.eu19
HISTORICAL DATA PROCESSING
@WATERNOMICS_EU www.waternomics.eu20
REAL-TIME DATA PROCESSING
@WATERNOMICS_EU www.waternomics.eu21
LINKED WATER DATASPACE
The Waternomics dataspace is designed to scale and deal with big data through the use of Druid,
Kafka, Spark, etc.
Technology used by big data companies
@WATERNOMICS_EU www.waternomics.eu22
LINKED WATER DATASPACE
• A dataspace as one stop shop for all data• Easy integration of new data sources• Reduced data integration costs• Pay As You Go data management• Use of standards and Open Data
KeyBenefits
KeyTechnologies
• Lambda Architecture• Semantic Web• Linked Data• Real-time data ingestion• Historical data integration• Open Data
@WATERNOMICS_EU www.waternomics.eu23
IMPACT
• One dataspace for all apps
• Open Source for all the dataspace components
• Training and Education
• Use of Open Data
@WATERNOMICS_EU www.waternomics.eu24
OVERALL ARCHITECTURE
@WATERNOMICS_EU www.waternomics.eu25
NEXT: BUILDING SMART WATER APPLICATIONS
25
@WATERNOMICS_EU www.waternomics.eu26
20+Water Applications
28Datasets
10+Support Services and
Libraries
HIGHLIGHTS (APPLICATIONS)
@WATERNOMICS_EU www.waternomics.eu27
waternomics.eu @waternomics_eu
@WATERNOMICS_EU www.waternomics.eu28
This project has received funding from the European Union’s Seventh Framework Programme for research, technological development and demonstration under grant agreement no 619660.
waternomics.eu @waternomics_eu
This project is member of and