CSIRO/AURIN Water, Energy Consumption and Supply Data Hub
-
Upload
jonathan-yu -
Category
Data & Analytics
-
view
382 -
download
3
Transcript of CSIRO/AURIN Water, Energy Consumption and Supply Data Hub
Data standards for Water/ Energy Supply and Consumption (WESC)
CSIRO LAND AND WATER
13 May 2015
Jonathan Yu | Data standards for water and energy consumption and supply
CSIRO-AURIN Project Team
2 |
Clockwise - Felix Lipkin, Magnus Moglia, Ben Leighton, Fareed Mirza, Jonathan Yu, Matthew Inman, Richard Goh, Ramneek Singh, Bruce Simons, Ben Caradoc-Davies
CSIRO Project Team – across Cities and Water Resources Management Program
AURIN Team: Chris Pettit, Emma Joughin, Martin Tomko, Luca Morandini, Serryn Eagleson, Rachel Lerm, Phil Delaney, Jack Barton, Emma Williams, Stewart Wallace and others…
Jonathan Yu | Data standards for water and energy consumption and supply
Outline
1. Background and data challenges
2. Protocols to integrate urban water data with energy + other urban data
3. WESC data standard and data hub
3 |
Jonathan Yu | Data standards for water and energy consumption and supply
Australian Urban Research Infrastructure Network
Federally funded $24 million project from the Department of Education, lead by the University of Melbourne.
Provides a secure online data portal for researchers and government staff to access quality data for research and policy decisions.
This site is not public and can not be used for commercial purposes.
https://aurin.org.au
4 |
Jonathan Yu | Data standards for water and energy consumption and supply
AURIN Lens 6
AURIN “Lens” • address issues of national significance • facilitate urban research, modelling and policy- &
decision-making
Lens 6: Water and energy supply & consumption(WESC)
Facilitate urban research for WESC at as fine-scale as possible (focus on protocols and datasets)
Data aspirations• fine scale spatially (individual property)• collected typically 1-3 month (or hourly if smart-meter)
5 |
Jonathan Yu | Data standards for water and energy consumption and supply
Need consumption data!I’ll ring Bob, he ‘Has Data’
*RING RING*
Hi Bob, I need some consumption data for my urban model. Any ideas?
Utiilty Bob
Oh yes, we have some but I’ll need to dig it up.I’ll send it through when I have it…1 week later…
To: John01/04/09, 5.2, 3, 101/07/09, 3.1, 3, 1
10 minutes…*RING RING*
Ok. Got the data. Where are the meter readings located?
Oh, it’s for Brunswick.
How many meters?Ummm. (papers shuffle)5,272 meters
Units? Megalitres, gigalitres, or ?
Ehh.. Megalitres
All residential or also commercial?
Oh that’s not what I want…can I just have residential?
Umm......
BOB?
Researcher John
*CLICK*
Umm...... mixed
6 |
Jonathan Yu | Data standards for water and energy consumption and supply7 |
Discover, access, interpret
Use (and re-use, re-use, re-use)
Discover, access, interpret Use
Search for data Data licence Get data (csv)
Data cleansing Clarify terms, fields, definitions, methods Do research/analysis
Jonathan Yu | Data standards for water and energy consumption and supply
What kinds of research/policy analysis? (1)
In terms of understanding demand profiles, what are the regional variations in water and energy consumption?
8 |
Greater Melbourne Electricity Consumption Water vs Electricity consumption by suburb
Jonathan Yu | Data standards for water and energy consumption and supply
What kinds of research/policy analysis? (2)
What are the consumption patterns for specific building types and how they will have changed over time to better target policies regarding energy and water consumption?
9 |
+ + =
Jonathan Yu | Data standards for water and energy consumption and supply
What kinds of research/policy analysis? (3)
What is the impact of climate on water and energy demand in Australian cities?
10 |
+ =+
Jonathan Yu | Data standards for water and energy consumption and supply
What datasets exist? Consumption / household
11 |
ElectricitySmart Meters
Minute intervalsLimited national coverage
Water Meters
Manual readsBroad national coverage
Old schoolElectricity meters
Manual readsBroad national
coverage
Water AMR’s
Jonathan Yu | Data standards for water and energy consumption and supply
What datasets exist? Water supply
12 |
http://urbanwatercyclesolutions.com/blog/
Jonathan Yu | Data standards for water and energy consumption and supply
What datasets exist? Electricity supply – generation/distribution
13 |
http://www.qca.org.au/Electricity/Further-Info/Electricity-facts
Jonathan Yu | Data standards for water and energy consumption and supply
WESC Challenge
1. How do we enable consistent comparisons between WESC datasets?
2. How do we facilitate data integration across WESC and other domains?
14 |
Jonathan Yu | Data standards for water and energy consumption and supply
WESC data protocols to integrate water/energy and other urban datasets
WESC data hub
15 |
Jonathan Yu | Data standards for water and energy consumption and supply
CSIRO-AURIN Lens 6/2 Project – Phase 1
Develop protocols to streamline access and use of WESC datasets by harmonization (via data standards & data services)
Enabling consistent comparisons between WESC datasets• Data formats• Standardised access methods• Semantics and definitions
Enabling integration with other urban datasets• Population• Buildings• Household
Discover, access, interpret
Use (and re-use, re-use, re-use)
16 |
Jonathan Yu | Data standards for water and energy consumption and supply
WESC Data Protocol Development
17 |
Combined Meter
Readings
Utility Supply Data
Water Supply
Electricity Supply
Conceptual models Vocabulary def’s Harmonising access to data
Jonathan Yu | Data standards for water and energy consumption and supply
WESC Conceptual Modelling
Aggregated consumption data – water/electricity meter readings (typically billing data)
Utility supply data to a region for various resources
(We’ve also modelled a more complex version but not in scope… see http://wescml.org)
18 |
Combined Meter
Readings
Utility Supply Data
Water Supply
Electricity Supply
Jonathan Yu | Data standards for water and energy consumption and supply
Aggregated Consumption model (SF-0 model) - CombinedMeterReading
19 |
Postcode/ Locality/ABSGeographies
Jonathan Yu | Data standards for water and energy consumption and supply
Supply Model – Water and electricity
20 |
Jonathan Yu | Data standards for water and energy consumption and supply
WESC Controlled vocabularies
21 |
http://wescml.org/vocab
Jonathan Yu | Data standards for water and energy consumption and supply
wescml.org
WESC Data Service
22 |
WESCData service
WESC XML Schema
WESC Conformance
Tests
WESC Controlled
Vocabularies
WESC Info Model
AURIN
AURIN Portal
PostGISDB
WESC Data Service Deployment
Researcher/Policy Analyst
Postcode/ Locality/ABSGeographies
Water/Elec.Data
Jonathan Yu | Data standards for water and energy consumption and supply
WESC Data Hub
23 |
AURIN
Researcher/Policy Analyst
Via the WESC data
protocol
Jonathan Yu | Data standards for water and energy consumption and supply
National scale datasets
AURIN 6/2 Data contributors/collaborators
24 |
Jonathan Yu | Data standards for water and energy consumption and supply
Dataset summary
25 |
Aggregation Water Electricity
National National Water Commission Energy Supply Assoc. Aust.
LGA Central Highlands Water (Ballarat)Sydney Water
Ausgrid (Sydney)
ABS SA2 ABS BSREDEE Household Survey
Locality YVW, SEW*, CWW(Melb)QUU* (SE QLD)SEQ Water** (SE QLD)ICON Water* (CBR)
ACTEW* (CBR)
Postcode YVW, SEW, CWW (Melb)QUU* (SE QLD)Mackay Reg. Council*
Energex (SE QLD)Jemena* via MEFL (Melb)
Jonathan Yu | Data standards for water and energy consumption and supply
AURIN Lens 6/2 – building bridges
26 |
AURIN
Policy makers
End users
Govt. Agencies
Data Providers
Utilities
Jonathan Yu | Data standards for water and energy consumption and supply
WESC Data Visualisations
27 |
Jonathan Yu | Data standards for water and energy consumption and supply
Data charts from NPR Water Consumption dataset
28 |
Australia
n Capital T
erritory
New South Wales
Northern Terri
tory
Queensland
South Australia
Tasmania
Victoria
Western Austr
alia0
200000
400000
600000
Tot al annual re s ide ntial wate r cons umption by s tate
2005–06 2006–07 2007–08 2008–092009–10 2010–11 2011–12 2012–13
ML
Total Residential Water consumption by state
Australian Capital Territory New South WalesNorthern Territory QueenslandSouth Australia TasmaniaVictoria Western Australia
Australia
n Capital T
erritory
New South Wales
Northern Terri
tory
Queensland
South Australia
Victoria
Western Austr
alia0
100200300400500600
Mean an n u al r esid en tial wat er c o n su mp tio n b y st at e
2005–06 2006–07 2007–08 2008–092009–10 2010–11 2011–12 2012–13
kL/p
rope
rty
Jonathan Yu | Data standards for water and energy consumption and supply
CBR – Water consumption visualisation
29 |
ACTEW Water consumptionSA2 2013Q1
Jonathan Yu | Data standards for water and energy consumption and supply
CBR – Electricity consumption visualisation
30 |
ACTEW AGL2013Q1
Jonathan Yu | Data standards for water and energy consumption and supply
CBR – Water + Electricity consumption visualisation
31 |
ACTEW Water+ ACTEW AGL consumption2013Q1
Jonathan Yu | Data standards for water and energy consumption and supply
Brisbane – Res electricity consumption
32 |
Jonathan Yu | Data standards for water and energy consumption and supply33 |
Melb – Res water consumption by postcode
Jonathan Yu | Data standards for water and energy consumption and supply34 |
Melb – Res electricity consumption vs Res water consumption by postcode
Jonathan Yu | Data standards for water and energy consumption and supply
Melb - Electricity consumption vs # separate houses
35 |
Source:
Electricity consumption (ABS household electricity 2011)
Number of Separate houses (ABS Dwelling structure from 2011 survey)
Jonathan Yu | Data standards for water and energy consumption and supply36 |
Jonathan Yu | Data standards for water and energy consumption and supply37 |
Jonathan Yu | Data standards for water and energy consumption and supply
Project Roadmap and Future work1. Uptake for research/policy applications across
universities, government (fed/state/local) and industry
2. Fostering community around this data/research• Refinement of WESC controlled vocabularies• Greater negotiation of ASGS aligned data
3. Build out - extend coverage of the WESC data hub• Call for contributions: SA, WA, TAS, NT & regional
Events• May/June ‘15: Online webinar/tutorial• July ‘15: AURIN-2 Stakeholders workshop• June 2016-2017: Potential follow-on project
38 |
Jonathan Yu | Data standards for water and energy consumption and supply
Summary
• Challenges and use cases –around compare between WESC datasets and data integration with other domains
• AURIN Lens 6/2 project, WESC data standard and AURIN/CSIRO WESC data hub established
• Exploring future opportunities – uptake, fostering community, calling for collaborators
39 |
Jonathan Yu | Data standards for water and energy consumption and supply
Acknowledgements
40 |
LAND AND WATER
Land and Water FlagshipJonathan YuResearch Software Engineert +61 3 9252 6440e [email protected] www.csiro.au/clw
Land and Water FlagshipMatthew InmanResearch Consultantt +61 2 9490 5499e [email protected] www.csiro.au/ces
Land and Water FlagshipBruce SimonsInformation Modellert +61 3 9252 6514e [email protected] www.csiro.au/clw
http://wescml.org http://aurin.org.au