Rapid Data Gathering

8/4/2019 Rapid Data Gathering

1/20

collection

using mobile phones

Johannes Hoogeveen


2/20

Data collection using surveys

Surveys allow to collect high quality data fromhouseholds or firms

But surveys are:

costly time consuming

inflexible (once a questionnaire is designed itcannot be changed)

As a consequence:

Surveys are typically not able to provide timelydata or data that is needed to address urgentpolicy issues


3/20

Data collection using phones

Mobile phones allow to collect data fromhouseholds and firms without a need to visitthem

This allows mobile surveys to: collect data at low cost and rapidly

collect data from the same respondent over time

change questions every week or month

But

the number of questions that can be asked islimited

respondents may need training (and a phone!)


4/20

A word of caution

Mobile data can be collected in a variety of ways: Calls

SMS

Mobile surveys

USSD

Embedded on SIM card

Avoid the attraction of technology. Simple call centers often do the job. They: work with all phones (also very low end ones)

incur no cost to the respondent

elicit responses from illiterate people

are cheap. Cost of calling within network is low

cost of labor in a call center is typically low

Moreover call centers:

allow enumerators to be well trained

real time supervision and quality control are possible

data collection is flexible: well trained enumerators can explain

difficult questions and can ask follow up questions

in repeat surveys, respondents appreciate personal contact

Low end phones do the


5/20

MOBILE DATACOLLECTION INPRACTICE

A mobile phone call center


6/20

Dar es Salaam mobile phone

survey Phase 1: Baseline survey

Scientific sample (550 households; 150 enumeration areas)

Questionnaire collects basic data about respondents (personaldetails, location, education, basic welfare information)

Use household visit to explain how mobile survey will work

No phones were distributed (they were in Sudan!)

Phase II: Mobile data collection respondents receive a notification by SMS

3 enumerators in call center call respondents

over course of 2-3 days

Weekly (8-20) questions

Questions differ every week

Respondents are remunerated with call credit


7/20

RESULTS AND LESSONS

Respondent answering


8/20

Results: service qualityInconveniencies faced when visiting health

facilities

48%

20%15%

4%

5%

3%

5%

0% 10% 20% 30% 40% 50% 60%

There are no

No medicine

Long queue

Corruption

Services is rude

Not clean

Negligence by health


9/20

Results: opinions

Opinions about constitutionalchanges

5%

59%

24%

12%

0%

10%

20%

30%

40%

50%

60%

70%

President shouldget more powersto make decisions

President shouldget less power tomake decisions

Presidential powerpowers should

remain unchanged

Don't know


10/20

Results: track food crisis

Goods/services for which citizens reportsignificant price changes

32%

4%

13%

5%

7%

39%Food

Water

Electricity

Housing

Beverages

Commuter bus transport


11/20

Results: bed net use

Citizens reporting sleeping under bed net treatedwith Ngao

20%

30%

40%

10%

Does not sleep under bednet

Sleeps under long lastinginsecticide treated bednet

Sleeps under bednet treatedwith Ngao

Sleeps under an untreated

bednet


12/20

Some lessons:

Most attrition happened in the first weeks. Main reasons: Respondents did not fully understand, training is required

Respondents did not have good phone access

Maybe we should have prepared a small contract

Remuneration is appreciated, but the amount does not matter forthe response rate

In some areas, response rates are low because of problems withcell phone reception or electricity

Some training may be required


13/20

Most important:Data is of good quality and non-

response is largely random

dF/dx T-stat

D-wealthiest quintile 0.13 2.124th wealth quintile 0.07 1.09

3rd wealth quintile 0.12 1.91

2nd wealth quintile 0.10 1.65

D-female -0.02 -0.55

Age in years 0.00 0.99

D-Tshs 400 remuneration 0.05 0.99

D-Tshs 500 remuneration 0.05 1.05

Regression on participation in week 14 of survey


14/20

OTHER APPROACHES TO RAPID

DATA GATHERING WITH MOBILE

PHONES


15/20

Water price survey Baseline survey collects price of water and telephone

numbers of clients at 30 water kiosks. Follow up throughtelephone.

Prices at DSM water kiosks

0

50

100

150

200

TipTop

MabiboK

waCassian

Keko

MwangaA

KekoMolemo(behindTanzania

M

abiboRelini

Kigog

oLandaBar

MabibokwaKikanzo

Ubu

ngoMaziwa

Mkunduge

Mtogole

AliMauaA(NearCUFElimika

ManzeseMidizini

Manze

seKiembeni

TandaleUzuri

Tandale

kwaTumbo

Tan

daleYemen

Ma

nzeseUzuri

TandaleMafichoni

MivuleniA

MwembeMkole

MivuleniB

ManzeseKilimani

Manze

seBakhresa

AliMauaB

Pipe Tank

Aug-10 Nov-10 Official price


16/20

Capitation grant monitoring Telephone numbers from an existing data base were

used to call 90 headmasters. They were asked to verifywhether capitation grant had arrived by a certain date


17/20

Price data collection

Local enumerators in 21 rural andurban locations collect price dataon a monthly basis.

Enumerators use a paper bookletand fill a price form on a certaindate of the month.

The next day, they receive a callfrom a call centre to relay their

data.

Data is processed at the centerand made public.


18/20

Business confidence

Telephone numbers of business wereobtained from business incubatorprogram

150 entrepreneurs are called everymonth. Questions about businessconfidence, investments and jobscreated.

Data is processed at the center and

made public.


19/20

Roadblock monitoring

Selected truck drivers (20) on a three main routes beep a callcentre every time they are stopped at a road block.

Call centre operator calls back and asks

specific questions:

Location

Time taken

Amount paid

(identity of driver is known through his number)

This gives weekly data about

number and location of road blocks


20/20

In conclusion

Data collected using call centers and mobile phones provides ampleopportunity to collect

Relevant and Reliable data

In a cost effective and flexible manner

But

contrary to what is often thought, rapid data collection using mobile phonesrequires less ICT skills and more typical survey skills as well as writingskills to implement effectively.

More information on experience with data collection using mobile phones inSouthern Sudan can be found at:http://digitalmedia.worldbank.org/SSP/africa/mobile-phone-data-collection/

Rapid Data Gathering

Documents

Transcript of Rapid Data Gathering