Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience...

65
Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor Robert Barr OBE Cabinet Office – Open Data User Group Manchester Geomatics and University of Liverpool m anchester .geom atics THEO R Y IN TO PR A C TIC E

Transcript of Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience...

Page 1: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Delivering Public Sector Core Reference Information as sustainable Open Data

The UK Experience

Geospatial World ForumRotterdam

15th May 2013

Professor Robert Barr OBE Cabinet Office – Open Data User GroupManchester Geomatics and University of Liverpool

manchester.geomatics THEORY INTO PRACTICE

Page 2: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Where I’m going…..

A ChronologyOpen Data White PaperAn idea who’s time has come?What should be open?What do we have to gain?Funding Open DataODUGConclusions

Page 3: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

A Chronology

Page 4: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Chronology1979 Rayner review commissioned by incoming Conservative Government1980’s Tradable Information Initiative1999 Ordnance Survey becomes Trading Fund2000 Crown Copyright review 2000 – 2010 “Address Wars” Local Government Ordnance Survey Royal Mail2009 OS Open Data announced by Prime Minister2012 Open Data White Paper2012 Digital Strategy Board2012 Public Data Group2013 Shakespeare Review of PSI

Page 5: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Open DataTradeableinformation

Berlin Wall

Page 6: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

HM Stationery Office, London, April 2000

Page 7: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.
Page 8: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.
Page 9: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

A breakthrough

Page 10: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.
Page 11: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.
Page 12: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Raw data now!

Page 13: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Open Data White Paper

Page 14: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.
Page 15: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Unleashing the potential

1. Building a transparent society2. Enhanced access3. Building trust4. Making smarter use of data5. The future – a truly transparent society

Page 16: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

An idea who’s time has come?

Page 17: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

What should be open?

• Core reference data– Data which is used to link data sets together– Data which is used to identify individuals, places,

organizations• e.g. NI numbers, Company numbers, Addresses

• Data which is part of a statutory register• Data which has to be collected to complete a

Public Task, regardless of whether it is re-sold or re-used

Page 18: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

What do we have to gain?

• Economic growth– Businesses can be built on the back of Open Data

• Efficiency gains– Data is more likely to be used if it is Open– Many interactions are simply meeting a request

for data or information• Reduced duplication

– Collect once use many times (Inspire principle)• Simplicity

Page 19: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.
Page 20: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.
Page 21: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Funding Open Data

Page 22: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Funding Open Data

• Registration charges• Existing public task expenditure• Volunteered information• Sponsors

Page 23: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Funding Open Data

Avoiding the data use prevention costs:•Complicated licensing and legal protection•Marketing•Distribution•Invoicing•Pricing

Page 24: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Open Successes

Page 25: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.
Page 26: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.
Page 27: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.
Page 28: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.
Page 29: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

ODUG

Page 30: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

ODUG

• Open Data User Group– Set up as a result of the Open Data White Paper– An independent group serviced by the Cabinet

Office– Acts as a sub-committee of the Data Strategy

Board, to which it reports through its chair Heather Savory

– First recommendation to release a single definitive open National Address Dataset accepted “in principle”

Page 31: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.
Page 32: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Priorities

• Determined by requests through data.gov.uk• The most requested data is national address

data and addresses subsets, such as all schools– Campaigning on PAF, NLPG and AddressBase

• Requests for boundaries– Mostly already available

• HMLR – INSPIRE land parcels• Public Rights of Way

Page 33: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.
Page 34: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Principles - 1

Core reference data must support an existing Public Task

That task must be necessary and in the public interest

Page 35: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Principles - 2

Core reference data should be definitive

Only one correct version should exist which can be verified at a canonical source. It should be collected once and used many times.

Page 36: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Principles - 3

Core reference data must be sustainably financed

Normally from the budget allocated to the public taskAlternatively from registration charges on those who cause the data to change

Page 37: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Principles - 4

Core reference data provision must be regulated through a lightweight regulatory or governance structure with clear responsibility and accountability

Normally from the budget allocated to the public taskAlternatively from registration charges on those who cause the data to change

Page 38: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

AGI Mission

'The Mission of the AGI is to maximise the use of geographic information (GI) for the benefit of the citizen, good governance and commerce.'

Page 39: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Cost Recovery Mission

To maximise the revenue from high value customers for geographic information (GI) in order to achieve earliest cost recovery and additional required trading surplus

Page 40: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Cost Recovery Mission-implications

• Initial high pricing• Aggressive protection of IPR• Cost reduction threatens cost recovery• Low value markets exploited through “value

subtracted” offerings• Use maximisation cannot be guaranteed and

is unlikely

Page 41: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

What needs to be recognised

Core Reference Geographies:1. Are definitive2. Should be collected and maintained once and used

many times3. Are Natural monopolies4. Have variable value in different applications5. Have highly elastic demand

Page 42: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

The candidates

• Geodetic Framework• Topographic Mapping (including height)• Geographic Names• Addresses• Streets• Land and Property Ownership• Hydrology / Hydrography• Statistical Boundaries• Administrative Boundaries

Page 43: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

The candidates

• Geodetic Framework • Topographic Mapping (including height)• Geographic Names• Addresses• Streets• Land and Property Ownership• Hydrology / Hydrography• Statistical Boundaries• Administrative Boundaries

Page 44: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

The candidates

• Geodetic Framework • Topographic Mapping (including height) • Geographic Names• Addresses• Streets• Land and Property Ownership• Hydrology / Hydrography• Statistical Boundaries• Administrative Boundaries

Page 45: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

The candidates

• Geodetic Framework • Topographic Mapping (including height) • Geographic Names • Addresses• Streets• Land and Property Ownership• Hydrology / Hydrography• Statistical Boundaries• Administrative Boundaries

Page 46: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

The candidates

• Geodetic Framework • Topographic Mapping (including height) • Geographic Names • Addresses • Streets• Land and Property Ownership• Hydrology / Hydrography• Statistical Boundaries• Administrative Boundaries

Page 47: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

The candidates

• Geodetic Framework • Topographic Mapping (including height) • Geographic Names • Addresses • Streets • Land and Property Ownership• Hydrology / Hydrography• Statistical Boundaries• Administrative Boundaries

Page 48: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

The candidates

• Geodetic Framework • Topographic Mapping (including height) • Geographic Names • Addresses • Streets • Land and Property Ownership • Hydrology / Hydrography• Statistical Boundaries• Administrative Boundaries

Page 49: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

The candidates

• Geodetic Framework • Topographic Mapping (including height) • Geographic Names • Addresses • Streets • Land and Property Ownership • Hydrology / Hydrography • Statistical Boundaries• Administrative Boundaries

Page 50: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

The candidates

• Geodetic Framework • Topographic Mapping (including height) • Geographic Names • Addresses • Streets • Land and Property Ownership • Hydrology / Hydrography • Statistical Boundaries • Administrative Boundaries

Page 51: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

The candidates

• Geodetic Framework • Topographic Mapping (including height) • Geographic Names • Addresses • Streets • Land and Property Ownership • Hydrology / Hydrography • Statistical Boundaries • Administrative Boundaries

Page 52: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

STOP PRESS

Page 53: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Stop Press! Published by the UK Data Strategy Board 09.30 BST 15th May 2013

Page 54: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Shakespeare Review Recommends

Recommendation 1 The government should produce and take forward a clear, predictable, accountable ‘National Data Strategy’ which encompasses PSI in its entirety.

Page 55: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Shakespeare Review Recommends

Recommendation 2 A National Data Strategy for publishing PSI should include a twin-track policy for data-release, which recognises that the perfect should not be the enemy of the good: a simultaneous 'publish early even if imperfect’ imperative AND a commitment to a 'high quality core'.

Page 56: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Shakespeare Review Recommends

Recommendation 3 There should be clear leadership for driving the implementation of the National Data Strategy throughout the public sector.

Page 57: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Shakespeare Review Recommends

Recommendation 4 One would be hard-pressed to find any expert who, asked to create new structures for core reference data from scratch, would advocate the current Trading Fund model (for Companies House, Land Registry, the Met Office and Ordnance Survey) in today’s world of open data….

Page 58: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Shakespeare Review Recommends

Recommendation 4 ….To promote and support a more

beneficial economic model for Trading Fund data government should review how the Trading Funds are recognised and rewarded for their activities to stimulate innovation and growth in the wider markets they serve

Page 59: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Shakespeare Review Recommends

Recommendation 5 We should have a clear pragmatic policy on privacy and confidentiality that increases protections for citizens while also increasing the availability of data to external users.

Page 60: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Shakespeare Review Recommends

Recommendation 6 Building on existing activities around capability, there should be a focused programme of investment to build skill-sets in basic data science through our academic institutions, covering both genuinely unfettered 'basic research' and research of 'practical immediate value' to the national data strategy.

Page 61: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Conclusions

Page 62: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Conclusions

Open data appears to have the wind in its sails:•European PSI re-use regulation•Open by default policy•Technology, cloud and broadband, supports it•Government funding and encouraging lobbying groups ODUG and ODI•Public expectation

Page 63: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Conclusions

However:•Vested interests must not be underestimated•In the UK parts of Treasury and Shareholder Executive holding back momentum•Some data holding agencies, particularly Royal Mail and Ordnance Survey resisting•Many parts of government have other priorities

Page 64: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

Conclusions

• Open data may become the norm• …. but • The case still needs to be made• The benefits need to be demonstrated and

monitored• ODUG needs evidenced cases for data release• Sustainable funding must be identified and

sourced

Page 65: Delivering Public Sector Core Reference Information as sustainable Open Data The UK Experience Geospatial World Forum Rotterdam 15th May 2013 Professor.

That’s it

Professor Robert Barr OBE@DrBobBarr

[email protected]

manchester.geomatics THEORY INTO PRACTICE