Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal,...

26
Shedding Light on Philippine Poverty Isabelle Tingzon | February 17, 2019 Mapping Poverty using Machine Learning, Satellite Images, and Open Geospatial Data

Transcript of Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal,...

Page 1: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

Shedding Light on Philippine Poverty

Isabelle Tingzon | February 17, 2019

Mapping Poverty using Machine Learning, Satellite Images, and Open Geospatial Data

Page 2: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

We use data to solve real-worldproblems

PH Department of Science and Technology

P U B L I C S E C TO RABOUT US

Manila | Singapore

Founded 2015

University of the Philippines

Page 3: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

OUR WORK

Example: The Language Landscape of the Philippines in 4 Maps

Geospatial Analysis and Visualization

Page 5: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

Hazard Exposure Map of the PhilippinesOUR WORK

Page 6: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

Our social impact mission is to empower evidence-based policy and action by:

◆ Filling critical data gaps◆ Making data open and useful◆ Innovating with purpose

OUR MISSION

Page 7: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

$ 4.1 M INVESTED | 58 PROJECTS | 38 COUNTRIES

The UNICEF Innovation Fund provides financial and technological support for companies that are using technology in innovative ways to improve children’s lives.

Page 8: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

Sources: Philippine Statistical Authority 2015 Survey, National Economic Development Authority

22M or 21.6% of Filipinos live below the national poverty line.

MOTIVATION

Page 9: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

Child Poverty in the PhilippinesMOTIVATION

3 in every 10 children belong to poor families

Source: Official Poverty Statistics among the Basic Sectors 2015, PSA

Page 10: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

Can cost

millions of dollars

Conducted only

once every 3-5 years

Granularity is on a regional/provincial level

Conducting Household Surveys

MOTIVATION

Page 11: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

Use unconventional, readily-available data sources to predict socioeconomic indicators

SOLUTIONS

Satellite Imagery

Social Media

Data

Other Geospatial

Datasets

Education Level

Electricity Access

Wealth Index

Machine Learning Models

Page 12: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

Machine Learning for Wealth & Poverty Prediction

*Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science 353.6301 (2016): 790-794.

✦ Goal: Faster, cheaper, and more granular reconstruction of poverty measures in the Philippines

✦ Replicated a study by Jean et al.* from the Stanford Sustainability and AI Lab

○ Estimated asset-based wealth for five sub-Saharan African countries

✦ Crowdsourced geospatial information for poverty prediction

SOLUTION Provincial-level Wealth Index(Ground truth)

Page 13: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

Using satellite images to predict wealthAPPROACH

Page 14: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

Problem: Data ScarcityNeed a lot of labeled training data for an end-to-end deep learning approach

Poverty Predictions

Wealth Index, Education, Access to Water, Electricity,

Child Mortality

Model

Data Gap: Not enough labeled training data!

APPROACH

Page 15: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

Nighttime lights can be used as a proxy for economic developmentMetro Manila (Daytime)

SOLUTION

Metro Manila (Nighttime)

Page 16: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

Tagbilaran, Bohol (Daytime) Tagbilaran, Bohol (Nighttime)

SOLUTION

Nighttime lights can be used as a proxy for economic development

Page 17: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

Wealthier places are brighter at nightSOLUTION

Page 18: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

Nighttime Light Intensity

Low, Medium, High based on pixel brightness

Daytime Satellite Images

Convolutional Neural Network

Predict nighttime light intensity as a proxy task

SOLUTION

*Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science 353.6301 (2016): 790-794.

Page 19: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

Nighttime Light IntensityDaytime Satellite

Images

Convolutional Neural Network

Step 1: Predict Nighttime light intensity from Daytime Satellite Images

Step 2: Wealth Prediction using Cluster-level Feature Embeddings

SOLUTION

*Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science 353.6301 (2016): 790-794.

Page 20: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

The model is able to explain 62.5% of the variance

How accurate are our wealth predictions?RESULTS

*Using CNN feature embeddings with regional indicators

Predictions and reported r2 values are from five-fold nested cross-validation.

Page 21: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

Reconstructing Provincial-level MapsRESULTS

Actual Wealth Index

Predictions and reported r2 values are from five-fold nested cross-validation.

Predicted Wealth Index

0 (poor)

Normalized Wealth Index

1 (wealthy)

Page 22: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

RESULTS

Page 23: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

✦ Difficult to distinguish between different levels of extreme poverty for areas with little to no electrification

✦ Difficult to predict other aspects of human development (e.g. access to water, child mortality) using nighttime lights

✦ Poverty estimates are not meant to replace on-the-ground surveys.

LimitationsCAVEATS

Page 24: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

✦ Research Collaboration: Partner with research institutes on exploring alternative methodologies and data sources for poverty prediction:○ Using social media, traffic data, and other geospatial data sources○ Explore unsupervised representation learning methods

✦ Data Sharing: Model additional indicators including○ Socioeconomic resilience to natural disasters○ Child malnutrition rates○ Challenge: Lack of reliable granular ground-truth data

✦ Real-world Impact: Collaborate with the public sector (NGOs, LGUs) for possible applications in humanitarian aid and resource allocation, both in the Philippines and other countries

Moving ForwardNEXT STEPS

Page 25: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

Read more data stories on our blogstories.thinkingmachin.es

Follow Us /thinkdatasci

@thinkdatasci

✦ ✦

Thank [email protected]

Special Thanks

Dohyoung Kim (UNICEF)Vedran Sekara (UNICEF)Priscilla Moraes (Google)Ingmar Weber (QCRI)Masoomali Fatehkia (QCRI)Neal Jean (Stanford Sustainability & AI Lab)Sherrie Wang (Stanford Sustainability & AI Lab)

Page 26: Shedding Light on Philippine Poverty · National Economic Development Authority (NEDA) Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science

✦ Philippine Statistical Authority (PSA) 2015 Survey

✦ National Economic Development Authority (NEDA)

✦ Jean, Neal, et al. "Combining satellite imagery and machine learning to predict poverty." Science 353.6301 (2016): 790-794.

✦ Xie, Michael, et al. "Transfer learning from deep features for remote sensing and poverty mapping." Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence. AAAI Press, 2016.

✦ Head, Andrew, et al. "Can Human Development be Measured with Satellite Imagery?." Proceedings of the Ninth International Conference on Information and Communication Technologies and Development. ACM, 2017.

✦ Perez, Anthony, et al. "Poverty Prediction with Public Landsat 7 Satellite Imagery and Machine Learning." arXiv preprint arXiv:1711.03654 (2017).

References