Use of innovative technologies such as ... - Statistics...

41
1 Use of innovative technologies such as buildings geo-referencing Dr Janusz Dygaszewicz Director of ICT Systems, Geostatistics and Census Department President of European Forum for Geography and Statistics EFGS Member of Executive Committee of the UN-GGIM: Europe 08.04.2019 Bucharest

Transcript of Use of innovative technologies such as ... - Statistics...

Page 1: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

1

Use of innovative technologiessuch as buildings geo-referencing

Dr Janusz Dygaszewicz

Director of ICT Systems, Geostatistics and Census Department

President of European Forum for Geography and Statistics EFGS

Member of Executive Committee of the UN-GGIM: Europe

08.04.2019 Bucharest

Page 2: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

230 years history of Polish statistics

• 1789 - first countrywide population census in Poland

(based on registers!! )

– The register of nobility and burghers

– The parish register of births and deaths

• 1918 - establishment of Central Statistical Office (CSO)

• 100 years of continued existence of CSO Poland.

2

Page 3: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

Combining Census a combination of data from administrative

sources

(full survey covering basic demographic variables)

with data acquired from

ad-hoc 20% sample survey.

In 2011 - Mixed Model for Population and

Housing Census

3 3

Page 4: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

• Including spatial data reference registersAdministrative Sources

• CAII (CAWI) – Computer Assisted Internet InterviewSelf-enumeration by Internet

• CATI - Computer Assisted Telephone Interview (Call Center)Telephone Interview

• Registered on hand-held terminals with usage GPS and GIS serviceCAPI - Computer Assisted Personal Interview

Face-to-face Interview with respondents executed by the

census enumerators

Data collection channels in 2011 Census

Round

44

Page 5: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

• CAII/CAWI - Computer Assisted Internet Interview,

• CAPI - Computer AssistedPersonal Interview,

• CATI - Computer AssistedTelephone Interviewing.

CAxI

CAxI

CAXI

5 5

Page 6: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

6stat.gov.pl

Census in 2011

Benefits of resigning from paper forms for mobile applications:

better data security,

user-friendly application,

better quality of data in the form,

additional quality control of data from registers.

Page 7: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

7stat.gov.pl

Plan:

• obtainment more responses in CAWI channel – at least 60%,

• usage a clear, easy, short census form (at most about 20questions) and a friendly IT environment,

• popularization of the census based on modern tools andcommunication channels,

Effect:

• implementation of a full survey instead of a representativeone,

• 5-fold reduction in the number of enumerators in relation tothe 2002 census (traditional census),

• reducing the costs of the census in relation to the 2011census.

Concepts of census implementation in 2021

Page 8: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

8stat.gov.pl

0

0,5

1

1,5

2

2,5

3

3,5

4

3,8

3,54

2,69

Co

sts

in U

SD

Cost of the census per capita (USD)

NSP 2002 NSP 2011 NSP 2021

Page 9: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

9stat.gov.pl

Plans after 2021

• Improve and use of registers and update them after

2024 for other statistical purposes

• Participation in the work of international task forces and

working groups on the methodology of future censuses

• Active efforts carried out on the international forum to

increase the scope of information sources to the census,

for example Big Data

Page 10: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

• For that purpose, the reference geodetic data obtained from the State geodetic and cartographic resources, contained:

• Administrative division boundaries,

• Geographical Names,

• Topographic Data Base,

• Cadastral Data,

• Ortophotomap

were used.

The good cooperation between NMA and NSI is crucial !!

10

GIS in Polish official statistics

Page 11: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

Reference materials

• Ortophotomap,

• Cadastral Data,

• Administrativedivision borders,

Primary:

• LPIS (Land Parcel IdentificationSystem),

• Road and street network(commercial),

• Geographical Names.

• Topographic Data Base.

Secondary:

11

Page 12: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

Information technologies

Reference geodeticmaps

Computer visualisation of spatial

databases

Integration statistics and geodetic data

Statistical data

Page 13: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

Innovative production process of statistics

based on Big Data

Page 14: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better
Page 15: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

Address points database

• address points with x,y coordinates

Administrative and Statistical division boundaries

• Statistical regions

• Census areas

Page 16: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

Statistical address points

and building location

address locations for buildings with dwellings

needed for spatial analysis of census data in Poland

• to navigate enumerators

• to visualize census results on maps

16

Page 17: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

The TERYT system as the basis for

geocoding of address register and building

register on x,y coordinates

Page 18: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

Address point identification system

Page 19: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

Address point identification system

Page 20: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

Best practice of geocoding

• Geocode as precisely as it is possible;

• Collect statistical data with reference to an address points (the best!) or smallest enumeration area (EA);

• All address points are referenced to pair of x,y coordinates;

• Official statistics no longer limited to publishing data for administrative o statistical units;

• Remember: x,y geocoding is a fundament for multidimensional spatial analyses.

20

Page 21: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

x,y geocoding

x,y geocoding is crucial in all three stages of the census:

• the preparatory works,

• management of enumerators during the fields works,

• and for multidimensional spatial analysis.

X,Y geocoding eliminate not only the necessity to recalculate

data when administrative boundaries are changing but also

allowing easy aggregation and processing of statistical data in

any chosen area - even for the GRID based dissemination,

Page 22: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

Using Geospatial component in the census:

GIS support for the dispatcher:

• presenting the sampled address points on maps

• displaying the interviewer's on-line position on maps

Page 23: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

Enumerator

tracking

Page 24: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better
Page 25: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better
Page 26: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better
Page 27: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better
Page 28: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better
Page 29: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better
Page 30: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

The GIS application for field operations

- handheld devices

Page 31: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

Enumerator – GIS technology

•Map module - GIS

•Ortophotomap

•Cadastral Data

•Assigned Tasks

•Started Tasks

•Completed Tasks

Page 32: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

Enumerator: main duties

• Visiting all assigned holdings

– Filling electronic questionnaires

• Daily synchronisation

• Contact with the supervisorin terms of task scheduling

• Adding newly identified holdings

Page 33: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

Alarm procedure

• In emergency situations, enumerators have a possibilityof sending an alarm signal to their supervisors

• Alarm notice is sentto the supervisor applicationand via SMS to the supervisor

33

Page 34: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

GEO.STAT.GOV.PLSTART: JULY 2013

Census results: Choropleth maps, Diagram maps

Local Data Bank

Other statistical databases34

Page 35: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

The portal allows statistical data presentation in form of any spatial unit:

35

• 5’ grid

• 1 km2 grid

• administrative division

• urban division

• statistical division

• any other polygon

Geostatistics Portal

Page 36: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

Demographic data in 1 km2 grid

36

(persons)

Page 37: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

Copyright© 1997-2015. The Trustees of Columbia University in the City of New York.

Global pupulation distribution

Page 38: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

„The 10 Level Model”u

niq

ue

iden

tifi

ers

syst

em

38 Personal proposition of Janusz Dygaszewicz CSO Poland

Page 39: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

Geostatistics portals

INSPIRE

Global Statistical Geospatial Framework GSGF

Accessible

& Usable

Interoperable data and

metadata standards

Common geographies

for dissemination of statistics

Geocoded unit record data

in a data management environment

Use of fundamental geospatial infrastructure and geocoding

„The 10 Level Model” for

harmonization of

statistical and

geodesy reference

framework

Page 40: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

Generic Statistical Business Process Model UNECE/Eurostat/OECD

3.1 Build collection

instrument

3.2 Build or enhance

process components

3.3 Build or enhance

dissemination components

3.4 Configure workflows

3.5 Test production

system

3.6 Test statistical

business process

1.1 Identify needs

1.2 Consult &

confirm needs

1.3 Establish output

objectives

1.4 Identify concepts

1.5 Check data availability

1.6 Prepare business

case

2.1 Design outputs

2.2 Design variable

descriptions

2.3 Design collection

2.4 Design frame &

sample

2.5 Design processing

& analysis

2.6 Design production

system & workflow

1

Specify Needs

2

Design

3

Build

4

Collect 5

Process

6

Analyse

8

Evaluate

7

Disseminate

Quality Management/Metadata Management

4.1 Create frame & select sample

4.2 Set up collection

4.3 Run collection

4.4 Finalise collection

5.1 Integrate data

5.2 Classify & code

5.3 Review & validate

5.4 Edit & imput

5.5 Derive new

variables & units

5.6 Calculate weights

5.7 Calculate

aggregates

5.8 Finalise data files

6.1 Prepare draft

outputs

6.2 Validate outputs

6.3 Interpret &

explain outputs

6.4 Apply disclosure

control

6.5 Finalise outputs

7.1 Update output

systems

7.2 Produce

dissemination products

7.3 Manage release of

dissemination products

7.4 Promote

dissemination products

7.5 Manage user

support

8.1 Gather evaluation

inputs

8.2 Conduct evaluation

8.3 Agree an action

plan

3.7 Finalise production

system

4.1 a Geocode frame &

sample

4.3 a Geocode collection

6.2 a Prepare spatial

analyses & maps

2.5a Design geocoding frame, sample & data collection

7.2 a Manage spatial

analyses & maps using GIS

Page 41: Use of innovative technologies such as ... - Statistics Eventscensus.statisticsevents.ro/wp-content/uploads/2019/04/Keynote-speake… · Administrative Sources registers ... better

41stat.gov.pl

Janusz Dygaszewicz

ICT Systems, Geostatistics and Census Department

[email protected]

Thank you for your attention