Integrating new, emerging and traditional sources of data...

29
Integrating new, emerging and traditional sources of data to produce time-specific gridded population maps Samantha Cockings, David Martin EFGS, Dublin, 3 Nov 2017

Transcript of Integrating new, emerging and traditional sources of data...

Page 1: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

Integrating new, emerging and traditional sources of data to produce time-specific gridded population maps

Samantha Cockings, David MartinEFGS, Dublin, 3 Nov 2017

Page 2: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

2

Why do we need space-time specific population estimates?• For decision-making, planning and policy formulation in

many sectors– E.g. emergency planning/response, health, national security

• How many people in specific places and specific times?

• How this varies by time e.g. hourly, daily, weekly, seasonal, one-off events/scenarios

• Ideally, retrospective and (near) real-time

• Census data inadequate (even with recent improvements in workplace, daytime populations etc)– Static, residential-based, every 10 years

Page 3: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

3

The problem … A typical small area population map

Page 4: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

4

Ph

oto

s: D

av

id M

art

in

© Samantha Cockings

© Samantha Cockings

© Samantha Cockings

© Samantha Cockings

Page 5: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

Inadequate spatio-temporal resolution

5

• Conventional population map interpreted over time

Ho

me R

esid

ence

Offic

e W

ork

Outd

oors

Work

All E

mp

loym

ent

Oth

er W

ork

Ed

ucation b

y S

tage

All E

ducation

Oth

ers

Ro

ad

s

Tra

nsport

Hubs

0%

20%

40%

60%

80%

100%

00:00

02:00

04:00

06:00

08:00

10:00

12:00

14:00

16:00

18:00

20:0022:0000:00

Po

pu

lati

on

Dis

trib

uti

on

(%

)

Time(Hour)

Page 6: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

Required spatio-temporal resolution

6

• Integrated multi-source datasets interpreted over time

00:00

02:00

04:0006:00

08:0010:00

12:0014:00

16:0018:00

20:0022:0000:00

Hom

e R

esid

ence

Offic

e W

ork

Outd

oors

Work

Reta

il W

ork

Oth

er

Work

School E

ducatio

n

Hig

her

Educatio

n

Oth

ers

Roads

Tra

nsport

Hubs

0%

20%

40%

60%

80%

100%

Po

pu

lati

on

Dis

trib

uti

on

(%

) .

Time

(Hour)

Page 7: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

7Photos: Samantha Cockings, David Martin

© Samantha Cockings

© Samantha Cockings

© Copyright Elliott Simpson and licensed for reuse under this Creative Commons Licencehttp://www.geograph.org.uk/photo/919011

© Copyright Nigel Davies and licensed for reuse under this Creative Commons Licencehttp://www.geograph.org.uk/photo/21092

Page 8: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

8

© David Martin

© Samantha Cockings© David Martin

© Samantha Cockings

Page 9: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

Previous Population247 research• ESRC Population24/7 project, 2009-2011

– Spatiotemporal population estimates – by time of day, week, term, season, etc.

– General approach/framework

– Software: SurfaceBuilder247 (.NET)

– Sample outputs

• Various related PhD / University of Southampton projects – population exposure to hazards e.g. flooding,

radiation

Martin, D., Cockings, S., & Leung, S. (2015). Developing a flexible framework for spatiotemporal population modeling. Annals of the Association of American Geographers, 105(4), 754-772

doi: 10.1080/00045608.2015.1022089

Page 10: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

Locations (origins and destinations)

Time profiles Magnitudes

Background

Page 11: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

11

0

500

1000

1500

2000

2500

00 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

Persons

University of Southampton travel survey: respondents on campus, 15 minute intervals

Page 12: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

12

2011 term-time weekday 02:00

Contains National Statistics and Ordnance Survey data © Crown

copyright and database right 2015; Copyright © 2015, Re-used with the

permission of the Health and Social Care Information Centre. All rights

reserved. Contains public sector information licensed under the Open

Government Licence v3;

© OpenStreetMap contributors

Page 13: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

13

2011 term-time weekday 14:00

Contains National Statistics and Ordnance Survey data © Crown

copyright and database right 2015; Copyright © 2015, Re-used with the

permission of the Health and Social Care Information Centre. All rights

reserved. Contains public sector information licensed under the Open

Government Licence v3;

© OpenStreetMap contributors

Page 14: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

Acronyms: QLFS Quarterly Labour Force; DCSF Department for Children, Schools and Families; HESA Higher Education Statistics Agency;

Survey; DCMS Department for Culture, Media and Sport; ALVA Association for Leading Visitor Attractions; DfT Department for

Transport; TfL Transport for London; CAA Civil Aviation Authority

Total

population

+/-

external

visitors

Private dwellings

Non-

residential

Communal ests.

Transport

Employment

Education

Residential

Temp accomm.

Generalised local

Family/social

Retail

Leisure

Tourism

Healthcare

Rail

Metro/subway

Air

Water

Road

Locations Data Sources

- Census, Mid-Year Population Estimates (MYEs)

- Census, Mid-Year Population Estimates (MYEs)

- Census, Annual Business Inquiry, QLFS

- EduBase, DCSF school performance tables, HESA

- VisitBritain, Annual Business Inquiry

- VisitBritain

- Annual Business Inquiry, commercial sources

- ALVA Visitor Statistics, DCMS

- ALVA Visitor Statistics, DCMS

- Hospital Episode Statistics

- National Rail station usage data

- DfT Light Rail Statistics, TfL Tube customer metrics

- CAA UK Airport Statistics

- DfT Sea Passenger Statistics , London River Services

- DfT Road Statistics, Annual Average Daily Flow

-

Page 15: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

Population247 Near Real Time Project (Pop247NRT)

• ESRC New and Emerging Forms of Data Policy Demonstrator Project (Feb 17-Feb 18)– Integration of new, emerging and existing datasets

– Enhanced spatiotemporal population estimates for improved decision-making and policy formulation

– “Nearer to real-time” estimates

• Partners– Public Health England

– Defence, Science and Technology Laboratory

– Health and Safety Executive

Page 16: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

New sources/signals/proxies for more dynamic/less routine activities … e.g.

• Retail – supermarkets, retail centres, high streets

• Leisure – tourist sites, leisure activities, sports events

• Transport – transport hubs e.g. airports, train stations

• One-off/unusual events – festivals, Bank Holidays

Page 17: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

New and emerging forms of data

STATIC DATA

ONS SPD v2.0

OS PoI

GeoLytixSuper

markets

ORR train station usage

Page 18: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

ORR Train Station Usage data

Page 19: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

New and emerging forms of data

STATIC DATA

ONS SPD v2.0

OS PoI

GeoLytixSuper

markets

ORR train station usage

ARCHIVED LIVE DATA

Traffic England

SmartStreetSensor

Page 20: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

Footfall data (SmartStreetSensor project, LDC/CDRC)

© Local Data CompanySource: http://blog.localdatacompany.com/off-to-a-flying-start-the-first-smartstreetsensor-partner-forum

Page 21: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

Traffic England data

Page 22: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

LIVE FEEDS

Google Opening

Hours

Google Popular Times

Traffic England

New and emerging forms of data

STATIC DATA

ONS SPD v2.0

OS PoI

GeoLytixSuper

markets

ORR train station usage

ARCHIVED LIVE DATA

Traffic England

SmartStreetSensor

Page 23: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

Google Places – Opening Hours data

Page 24: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

Google Places – Popular Times data

Page 25: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

ARCHIVED LIVE DATA

Traffic England

SmartStreetSensor

FSA ratings

LIVE FEEDS

FSA ratings

Google Opening

Hours

Google Popular Times

Traffic England

New and emerging forms of data

STATIC DATA

ONS SPD v2.0

OS PoI

GeoLytixSuper

markets

ORR train station usage

“Normal” distributions / NRT estimates

Case studies

Page 26: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

Key opportunities and challenges

• Population247 is an extensible framework for time-specific population modelling

• New and emerging forms of data are providing new insights and opportunities

• A key challenge is whether new data should replace, augment or calibrate existing ones

• Pop247NRT: finalise data processing, implement case studies, stakeholder workshop

26

Page 27: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

Acknowledgements

• Economic and Social Research Council Awards ES/G031304/1, ES/P010768/1

• Glen Hart, William Holmes, Tom Charnock, Nick Gibbins, Samuel Leung (current and past co-investigators)

• Alan Smith, Becky Martin (past PhD researchers)

27

Page 28: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

Contacts

Email: [email protected]

Twitter: @SamCGeog

28

Page 29: Integrating new, emerging and traditional sources of data ...pop247nrt.geodata.soton.ac.uk/downloads/files/... · New and emerging forms of data STATIC DATA ONS SPD v2.0 OS PoI GeoLytix

Population24/7 in a slide…

• Assemble multi-source data library of locations, populations and time profiles

• Transfer total population from origins locations to cells in output grid

• Principal loop is of destinations, identifying population required at specific target time

• Some population remains at origins; some transfers to destinations; some allocated into background (in transit), local dispersion applied

• All processing repeated per population subgroup

Martin, D., Cockings, S., & Leung, S. (2015). Developing a flexible framework for spatiotemporal population modeling. Annals of the Association of American Geographers, 105(4), 754-772

doi: 10.1080/00045608.2015.1022089