Estrategy Smart Data

Strategic alignment

Vision 2018

National Development

Plan 2014 – 2018 NES

Smart Data

Strategy

Strategic Plan

Innovation Plan

2015 - 2018

Big data

Objective

STRENGTHEN

PRODUCTION Administrative records

GENERATION

DISSEMINATION

ALTERNATIVE SOURCES / NON

TRADITIONAL METHODS

Priority lines

Sustainable Development Goals

National Census of Population and Housing

Other statistical operations

Source integration

Time

Innovation Plan 2015 - 2018

DEFINE

Actions

Alliances

Budget

Source integration Use of administrative records for population projections. SI-COLE Upgrading of urban levels of the National Geostatistical Framework, incorporating administrative records

Sustainable Development Goals Using satellite images to calculate land use and land cover statistics

National Census of Population and Housing Mobile data usage to optimize the census operation.

Other statistical operations Measuring variations of CPI prices through Webscraping Scanner data to CPI Subjective poverty measurement using Big Data Big Data as input for updating the Statistical Directory, using techniques of extracting data from web pages.

Technologial infrastructure

Phases of execution

Experimental phase ● Pilot projects ● Identify how the different

methods contribute to the statistical process and determine the feasibility and impact on it.

Incorporation phase ● Specify the path and

institutional requirements for the incorporation of smart data in the statistical production process

● Run actions for incorporating non-traditional and alternative sources in the statistical production process

Sustainability phase ● Create the institutional

framework to continue the strategy of Smart data over time.

To contrast To complement To generate new statistics

Viable

Not viable

Innovation, Learning and Knowledge management

Measuring variations of CPI prices through Webscraping

OPEN ACCESS TO DATA / NO CONFIDENTIAL DATA

Six Supermarkets Web pages (part Mercado). 6471 articles downloaded. 37% of items downloaded are in the CPI.

Subjective poverty measurement using Big Data OPEN ACCESS TO DATA

/ NO CONFIDENTIAL DATA

Social network Twitter. Database with 7760 tweets marked.

“I need to be fifteen again so I can save a lot of money for

what I want to do now”

“When I got into that store

everything was so magic until I realized that

I don´t have any money”

“I hope it does not rain

this week cause is my mother´s birthday

and I need to ride my bike this

week so I can save some money”

Using satellite images to calculate land use and land cover statistics

OPEN ACCESS TO DATA / NO CONFIDENTIAL DATA

Landsat 2010 Landsat 2015

Landsat 2005 http://earthexplorer.usgs.gov/

Imágenes satelitalesU. S. Geological Survey -USGS /Barranquilla AM

Access to Data ● Public sector

institutions. There is not free access to the data : micro dato ICFES, Ministerio Educación, DANE. Access is managed under the NES

Confidential Data ● Results at educational

institution and schools, (aggregate statistical information)

SI-COLE

Lessons learned and recommendations

● The methodological design of the reference statistical operation must be

taken into account.

●Document each stage of the project (design, implementation, results, evaluation)

● The participation of an interdisciplinary group that makes contributions

from their different visions, for improving procedures and propose alternatives to the project

● Make research and technology the pillars of the process

●Disclose the results, both at the intermediate steps and the final steps,

receiving feedback about the processes performed.

● Relationship with the public is still complex for access to information.