CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

41
Data standards for Water/ Energy Supply and Consumption (WESC) CSIRO LAND AND WATER 13 May 2015

Transcript of CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Page 1: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Data standards for Water/ Energy Supply and Consumption (WESC)

CSIRO LAND AND WATER

13 May 2015

Page 2: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

CSIRO-AURIN Project Team

2 |

Clockwise - Felix Lipkin, Magnus Moglia, Ben Leighton, Fareed Mirza, Jonathan Yu, Matthew Inman, Richard Goh, Ramneek Singh, Bruce Simons, Ben Caradoc-Davies

CSIRO Project Team – across Cities and Water Resources Management Program

AURIN Team: Chris Pettit, Emma Joughin, Martin Tomko, Luca Morandini, Serryn Eagleson, Rachel Lerm, Phil Delaney, Jack Barton, Emma Williams, Stewart Wallace and others…

Page 3: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

Outline

1. Background and data challenges

2. Protocols to integrate urban water data with energy + other urban data

3. WESC data standard and data hub

3 |

Page 4: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

Australian Urban Research Infrastructure Network

Federally funded $24 million project from the Department of Education, lead by the University of Melbourne.

Provides a secure online data portal for researchers and government staff to access quality data for research and policy decisions.

This site is not public and can not be used for commercial purposes.

https://aurin.org.au

4 |

Page 5: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

AURIN Lens 6

AURIN “Lens” • address issues of national significance • facilitate urban research, modelling and policy- &

decision-making

Lens 6: Water and energy supply & consumption(WESC)

Facilitate urban research for WESC at as fine-scale as possible (focus on protocols and datasets)

Data aspirations• fine scale spatially (individual property)• collected typically 1-3 month (or hourly if smart-meter)

5 |

Page 6: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

Need consumption data!I’ll ring Bob, he ‘Has Data’

*RING RING*

Hi Bob, I need some consumption data for my urban model. Any ideas?

Utiilty Bob

Oh yes, we have some but I’ll need to dig it up.I’ll send it through when I have it…1 week later…

To: John01/04/09, 5.2, 3, 101/07/09, 3.1, 3, 1

10 minutes…*RING RING*

Ok. Got the data. Where are the meter readings located?

Oh, it’s for Brunswick.

How many meters?Ummm. (papers shuffle)5,272 meters

Units? Megalitres, gigalitres, or ?

Ehh.. Megalitres

All residential or also commercial?

Oh that’s not what I want…can I just have residential?

Umm......

BOB?

Researcher John

*CLICK*

Umm...... mixed

6 |

Page 7: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply7 |

Discover, access, interpret

Use (and re-use, re-use, re-use)

Discover, access, interpret Use

Search for data Data licence Get data (csv)

Data cleansing Clarify terms, fields, definitions, methods Do research/analysis

Page 8: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

What kinds of research/policy analysis? (1)

In terms of understanding demand profiles, what are the regional variations in water and energy consumption?

8 |

Greater Melbourne Electricity Consumption Water vs Electricity consumption by suburb

Page 9: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

What kinds of research/policy analysis? (2)

What are the consumption patterns for specific building types and how they will have changed over time to better target policies regarding energy and water consumption?

9 |

+ + =

Page 10: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

What kinds of research/policy analysis? (3)

What is the impact of climate on water and energy demand in Australian cities?

10 |

+ =+

Page 11: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

What datasets exist? Consumption / household

11 |

ElectricitySmart Meters

Minute intervalsLimited national coverage

Water Meters

Manual readsBroad national coverage

Old schoolElectricity meters

Manual readsBroad national

coverage

Water AMR’s

Page 12: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

What datasets exist? Water supply

12 |

http://urbanwatercyclesolutions.com/blog/

Page 13: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

What datasets exist? Electricity supply – generation/distribution

13 |

http://www.qca.org.au/Electricity/Further-Info/Electricity-facts

Page 14: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

WESC Challenge

1. How do we enable consistent comparisons between WESC datasets?

2. How do we facilitate data integration across WESC and other domains?

14 |

Page 15: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

WESC data protocols to integrate water/energy and other urban datasets

WESC data hub

15 |

Page 16: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

CSIRO-AURIN Lens 6/2 Project – Phase 1

Develop protocols to streamline access and use of WESC datasets by harmonization (via data standards & data services)

Enabling consistent comparisons between WESC datasets• Data formats• Standardised access methods• Semantics and definitions

Enabling integration with other urban datasets• Population• Buildings• Household

Discover, access, interpret

Use (and re-use, re-use, re-use)

16 |

Page 17: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

WESC Data Protocol Development

17 |

Combined Meter

Readings

Utility Supply Data

Water Supply

Electricity Supply

Conceptual models Vocabulary def’s Harmonising access to data

Page 18: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

WESC Conceptual Modelling

Aggregated consumption data – water/electricity meter readings (typically billing data)

Utility supply data to a region for various resources

(We’ve also modelled a more complex version but not in scope… see http://wescml.org)

18 |

Combined Meter

Readings

Utility Supply Data

Water Supply

Electricity Supply

Page 19: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

Aggregated Consumption model (SF-0 model) - CombinedMeterReading

19 |

Postcode/ Locality/ABSGeographies

Page 20: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

Supply Model – Water and electricity

20 |

Page 21: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

WESC Controlled vocabularies

21 |

http://wescml.org/vocab

Page 22: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

wescml.org

WESC Data Service

22 |

WESCData service

WESC XML Schema

WESC Conformance

Tests

WESC Controlled

Vocabularies

WESC Info Model

AURIN

AURIN Portal

PostGISDB

WESC Data Service Deployment

Researcher/Policy Analyst

Postcode/ Locality/ABSGeographies

Water/Elec.Data

Page 23: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

WESC Data Hub

23 |

AURIN

Researcher/Policy Analyst

Via the WESC data

protocol

Page 24: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

National scale datasets

AURIN 6/2 Data contributors/collaborators

24 |

Page 25: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

Dataset summary

25 |

Aggregation Water Electricity

National National Water Commission Energy Supply Assoc. Aust.

LGA Central Highlands Water (Ballarat)Sydney Water

Ausgrid (Sydney)

ABS SA2 ABS BSREDEE Household Survey

Locality YVW, SEW*, CWW(Melb)QUU* (SE QLD)SEQ Water** (SE QLD)ICON Water* (CBR)

ACTEW* (CBR)

Postcode YVW, SEW, CWW (Melb)QUU* (SE QLD)Mackay Reg. Council*

Energex (SE QLD)Jemena* via MEFL (Melb)

Page 26: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

AURIN Lens 6/2 – building bridges

26 |

AURIN

Policy makers

End users

Govt. Agencies

Data Providers

Utilities

Page 27: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

WESC Data Visualisations

27 |

Page 28: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

Data charts from NPR Water Consumption dataset

28 |

Australia

n Capital T

erritory

New South Wales

Northern Terri

tory

Queensland

South Australia

Tasmania

Victoria

Western Austr

alia0

200000

400000

600000

Tot al annual re s ide ntial wate r cons umption by s tate

2005–06 2006–07 2007–08 2008–092009–10 2010–11 2011–12 2012–13

ML

Total Residential Water consumption by state

Australian Capital Territory New South WalesNorthern Territory QueenslandSouth Australia TasmaniaVictoria Western Australia

Australia

n Capital T

erritory

New South Wales

Northern Terri

tory

Queensland

South Australia

Victoria

Western Austr

alia0

100200300400500600

Mean an n u al r esid en tial wat er c o n su mp tio n b y st at e

2005–06 2006–07 2007–08 2008–092009–10 2010–11 2011–12 2012–13

kL/p

rope

rty

Page 29: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

CBR – Water consumption visualisation

29 |

ACTEW Water consumptionSA2 2013Q1

Page 30: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

CBR – Electricity consumption visualisation

30 |

ACTEW AGL2013Q1

Page 31: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

CBR – Water + Electricity consumption visualisation

31 |

ACTEW Water+ ACTEW AGL consumption2013Q1

Page 32: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

Brisbane – Res electricity consumption

32 |

Page 33: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply33 |

Melb – Res water consumption by postcode

Page 34: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply34 |

Melb – Res electricity consumption vs Res water consumption by postcode

Page 35: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

Melb - Electricity consumption vs # separate houses

35 |

Source:

Electricity consumption (ABS household electricity 2011)

Number of Separate houses (ABS Dwelling structure from 2011 survey)

Page 36: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply36 |

Page 37: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply37 |

Page 38: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

Project Roadmap and Future work1. Uptake for research/policy applications across

universities, government (fed/state/local) and industry

2. Fostering community around this data/research• Refinement of WESC controlled vocabularies• Greater negotiation of ASGS aligned data

3. Build out - extend coverage of the WESC data hub• Call for contributions: SA, WA, TAS, NT & regional

Events• May/June ‘15: Online webinar/tutorial• July ‘15: AURIN-2 Stakeholders workshop• June 2016-2017: Potential follow-on project

38 |

Page 39: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

Summary

• Challenges and use cases –around compare between WESC datasets and data integration with other domains

• AURIN Lens 6/2 project, WESC data standard and AURIN/CSIRO WESC data hub established

• Exploring future opportunities – uptake, fostering community, calling for collaborators

39 |

Page 40: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

Jonathan Yu | Data standards for water and energy consumption and supply

Acknowledgements

40 |

Page 41: CSIRO/AURIN Water, Energy Consumption and Supply Data Hub

LAND AND WATER

Land and Water FlagshipJonathan YuResearch Software Engineert +61 3 9252 6440e [email protected] www.csiro.au/clw

Land and Water FlagshipMatthew InmanResearch Consultantt +61 2 9490 5499e [email protected] www.csiro.au/ces

Land and Water FlagshipBruce SimonsInformation Modellert +61 3 9252 6514e [email protected] www.csiro.au/clw

http://wescml.org http://aurin.org.au