Megan Noel,Yasmin Chandani, Sarah Andersson, Michelle Pahl, Barbara Felling, Amanda Ombeva, Mildred Shieshia, Savitha Subramaniam (JSI-SC4CCM)

Using Mobile Data Capture for M&E in Malawi, Ethiopia,

and Rwanda

Megan NoelGlobal Youth Economic Opportunities SummitOctober 6, 2014

JSI Center for mHealthS M S Me s s a g in g : U S A, G h a n aSu r ve y : Bu r k in a F a s o, E t h i o p i a , G h a n a ,I n d i a , L i be r i a , M a l a w i, M o z a m b iq u e ,N ig e r i a , P h i l i p p i n e s, R w a n d a ,T a n z a n i a , T i m o r- Le s te , Z a m b i a ,Z i m b a b we ,So c i a l Me d i a : A I D S. g o v, S m o k in gCe s s a t i on ,m H e a l t h E v a l u a t i onS M S Re p o r t in g : G h a n a , M a d a g a s c a r,M a l a w i, T a n z a n i a , U S AP a t ie n t a n d C l ie n t M a n a ge me n t :L i be r i a , U S AE d u c a t i o n: U S A, C a m b o d i a

A Sn a p s ho t o f t he U se o f Mo bi l e a t J S I a n d Wo r l dE du c a ti o n

SC4CCM will identify, demonstrate , and institutionalize supply chain management

practices that improve the availability and use of selected essential health products in

community-based programs

WHY MOBILE?

• Save time• Save paper• Cost effective• No programming

skills required• Evidence it works• Donor

encouragement to be innovative

A routine logistics management information system (LMIS) designed by the project and used for M&E in Malawi

Tools

Used by the project to collect M&E data using smart phones

SC4CCM Experience with Mobile

EpiSurveyor/Magpi and cStock used for program monitoring & supervision

2010 2013

Baseline surveys in 3 countries on

smart phones loaded with

EpiSurveyorMidline surveys carried out in 3 countries with

Magpi

HARDWARE for Magpi : Nokia e71 and Nokia e63 smart phonesHARDWARE for cStock : personal mobiles owned by CHWs

2014

cStocklaunched in

Malawi

Endline surveys carried out in 2 countries with

Magpi , cStock used in third

country

2011 2012

Assessment Process

7 day data collector training on Magpi & supply chain1.5 day field test at district, HC and CHW sites

Questionnaires included interviews, observations, records review and stock counting

Data Manager manages incoming forms, coordinated with survey teams and HQ

PRE-SURVEY

SURVEY

SURVEY & POST

Facility-based surveys

Rwanda Midline SurveySystem Level Visited in 10 Districts

Sites Forms per

Level

FormsTotal

District stores 10 1 10

Health Centers 108 4 432

Cell Coordinators 148 4 592

ASCBs (community health workers)

354 4 1,416

# Total forms (30-100 Qs each): 2,450

# Data collectors: 16 + 8 supervisors

# Smart Phones: 24

# Days in the field: ~30

Field work: April 26 –May 26, 2013

Malawi: Variable Ethiopia: PoorRwanda: Good

Connectivity across Countries

Data Flow

FIELD DATABASE

Malawi & Rwanda

Ethiopia

DATA

Paper Mobile

• Data entry is a separate step, can take months to complete

• Data are entered and availableimmediately, practically real time

• Quality or consistency issues in the field may go unnoticed

• Data visibility during field work leads to improved management and quality

• Difficult to manage papers at the interview/observation site

• Phones are compact, electronic records are automatically organized into user-designed database

• Risk of losing data from damaged papers

• Electronic forms are safer ; not as easy to lose or damage (if backed up)

• Need storage space for forms • No physical space needed to store

Advantages To Using Mobile

*Hardware is getting more affordable!

� Assess network capability in the field

� Plan sufficient time (ie. min 1 month) to:� Select appropriate software and hardware� Adapt tools to mobile format� Train on new software & devices� Pilot test and adjust forms … BEFORE

hitting the field

Recommendations for Surveys

� Seek data collectors with experience using similar devices

� Ensure data quality by: � Defining clear protocols for supervision and

ongoing data review during field work� Hiring a strong Data Manager; limiting

editing rights to 1-2 designated individuals

Recommendations for Surveys

1. Plan2. Train data collectors3. Field work 4. Report

The Process

provides real-time, actionable HSA logistics data for managers and stakeholders to coordinate, plan, and identify solutions to better meet customer needs in a timely manner

Secondary source

• cStock’s principle role is to streamline resupply process and improve communication between CHWs and resupply point, (not M&E)

• cStock users report 2 data items every month - stock on hand and receipts of goods

• The system generates more than 10 supply chain performance indicators and displays them in easy to use graphs and charts

cStock Dashboard

• Access to an existing system provides an M&E opportunity

• Align program indicators to data collected by the system; avoid building parallel M&E system or reports

• Data manipulation limited when raw data not fully accessible

• Data available in ‘real time’ still require another step - analysis

cStock Lessons for M&E

� Program Monitoring� Endline Evaluation

Mobile data capture is a viable means of collecting quantitative data for M&E, and has considerable advantages!

Key Lesson

Thank you!sc4ccm.jsi.com