The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... ·...

31
PRESENTER 1 Liana Razafindrazay Geographer, GEMS @HQ PRESENTER 2 Benard Mitto GIS Specialist, GEMS @Nairobi Please… Mute your microphones Turn off your video Send us your questions through the chat box The Rocket, Pocket and Socket Science: Innovative Methods for Project Supervision Geo-Enabling initiative for Monitoring and Supervision (GEMS) Offered by the World Bank’s Fragility, Conflict and Violence Group Supported by the Korea Trust Fund for Economic and Peacebuilding Transitions PRESENTER 3 Annabelle Vinois Social Development Specialist GEMS @HQ

Transcript of The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... ·...

Page 1: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

PRESENTER 1

Liana Razafindrazay

Geographer, GEMS

@HQ

PRESENTER 2

Benard Mitto

GIS Specialist, GEMS

@Nairobi

Please…

Mute your microphones

Turn off your video

Send us your questions through the chat box

The Rocket, Pocket and Socket Science: Innovative Methods for Project Supervision

Geo-Enabling initiative for Monitoring and Supervision (GEMS)

Offered by the World Bank’s Fragility, Conflict and Violence GroupSupported by the Korea Trust Fund for Economic and Peacebuilding Transitions

PRESENTER 3

Annabelle Vinois

Social Development Specialist

GEMS

@HQ

Page 2: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

Overview of the session

• 5mn: Rocket Pocket Socket Trivia - Questionnaire

• 25 min: Introduction to GEMS

• 10 min: Use Cases from the field

• 10 min: Rocket Pocket Socket Trivia - Results

• 10 min: Q&A

Page 3: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

1. Click on the following link posted on the chat box (case sensitive):

https://ee.kobotoolbox.org/x/bLNs40rJ

2. If you are using your phone or tablet, make sure that location services are switched on, on your phone. Then access this link from your phones.

3. Please have fun and complete the questionnaire ☺. We will review the results together at the end of the session.

4. Once you are done, click on “submit” and after submitting,return to the link, click on the small number on the top leftand click “Upload”.

Rocket Pocket Socket Trivia – Please take few minutes to participate ☺

# zero

Page 4: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

Geo-Enabling initiative for Monitoring and Supervision (GEMS)

Building Capacity among Clients and Local Stakeholdersto harness simple ICT Tools for enhanced M&E, Supervision & TPM,

Beneficiary Engagement, Risk Management, & Portfolio Mapping(P167344)

Offered by the World Bank’s Fragility, Conflict and Violence Group in cooperation with GOSTSupported by the Korea Trust Fund for Economic and Peacebuilding Transitions

For further information, just type gems/ in your WBG intranet browser, see here for our intranet site or contact the GEMS team at the FCV Group ([email protected])

Page 5: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

Remote Supervision through Geospatial Tools: Getting Eyes on the Ground

Refugee / IDP camp

Conflict Hotspot

Mafa Water Point Fully Functional

City of Mafa | Mafa LGA | Borno State | 3,560 beneficiaries

Site Inspection Protocol

Inspected: Funke Mgwale | June 6, 2017 | 9:20 am-Sample-

Observations:• The water point has been completed and is intact• Utilization by the local community is high

Northeast Nigeria:Joint UN-WB HDP Stabilization Mission

Example: Fadama III project,

operating in Borno State, Northeast Nigeria

Page 6: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

Combining the “Rocket Science,” “Pocket Science,” and “Socket Science”

Remote SensingThrough SatelliteImagery

The GEMS Method: Systematic Real-Time Field Data Collectionthrough Smartphones

‘Plugging In’Spatial Data From Various Sources

?

Page 7: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

Using the Technology that is Fit-for-Purpose (the toy is too small for this fat cat)

Page 8: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

“Geo-enabling” relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of granular geo-tagged project data that automatically feeds into a central M&E system. This can contribute to effective planning, remote supervision, M&E, TPM and geo-mapping of projects.

The “Pocket Science”: Definition of the GEMS Method

A Geo-enabled Monitoring & Evaluation Platform: Data Integrity along the project cycle!

For further information, just type gems/ in your WBG intranet browser, see here for our intranet site or contact the GEMS team at the FCV Group ([email protected])

Page 9: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

All-in-One Cost-Free Open Source Tool: KoBoToolbox – Developed by HHI

https://www.youtube.com/watch?v=4PNtT51h3CQ

Page 10: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

The GEMS Platform: Multi-use Tool for M&E, Supervision, & Communication

• Remote supervision of implementation

• Enhanced transparencyand accountability

• Structured monitoring of survey data

• Real-time tracking of safeguards compliance

• Coordination across projects and partners

• Communication and citizen engagement

• Automatic integration in centralized M&E system and geo-mapping

➢ Simple & low-cost ICT for improving M&E

➢ Capacity-building for flexible application

Example of successful application – Azerbaijan Rural Investment Project – see map tool: http://azrip.org/maps/index.html

Page 11: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

The GEMS Method: Cheap, Easy to Implement, Scalable & Sustainable

Enter project data

-Sample-

Photo: Impression from geo-enabling training for the South Sudan Local Governance and Service Delivery Project PIU

• Simple and free technology (ODK)

• Customized data collection forms

• No internet/networkconnection needed

• Automatic integration of data in centralized MIS or M&E system

• Automatic mapping of interventions

• Easy to scale across portfolio/partners

• No ICT experts needed

➢ Building Capacity with clients for sustainable use

Page 12: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

The Growing Community behind KoBoToolbox

Page 13: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

Build for Sustainability

https://digitalprinciples.org/principles/

Use Open Standards, Open Data, Open Source, and Open Innovation

Creating a Public Good: Inclusion of Partners for more effective Collaboration

Be Collaborative

Design for Scale

All partners are invited to join!

Page 14: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

Protection of Privacy and Collected Data in KoBoToolbox

Server:• KoBo offers free access to a server (Amazon Web Services) with

unlimited space for every account (up to 10,000 submissions per month by default, more upon request – but always cost free).

• The server hosts the created questionnaires and collected data.• KoBo does not access or forward any data or questionnaires.

Data protection:• KoBo makes frequent backups of its entire database to safeguard

against data losses.• Accounts are protected by usernames and passwords and underlying

data is encrypted according to the latest standards.

Rights and data ownership:• The account users are the sole owners of any data and questionnaires

hosted on KoBo.• The account users are responsible for the collection and administration

of personal data according to national or international data protection legislation (see the EU’s General Data Protection Regulation – GDPR).

• Exclusively information (questionnaires and collected data) that has explicitly been made accessible for the public are available for internet users without the respective passwords. Data made public data may e.g. be included in Google searches, but access can be restricted any time.

You can also connect your own server to KoBoToolbox!

Page 15: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

• GEMS listed as supervision solution for the COVID-19 Strategic Preparedness and Response Program (SPRP)

• No use for monitoring of the disease itself or any surveillance of individuals

• Operational M&E and remote supervision during preparation & implementation:

• Digital monitoring platforms across components, projects, programs and sectors.

• Structured geo-mapping and recording of baseline data on service infrastructure.

• Remote supervision of activities (e.g. infrastructure construction, health trainings).

• Real-time tracking of equipment stocks/delivery (e.g. through barcode recording).

• Monitoring of social protection activities (e.g. LIPW/THIMO, psychosocial support).

• Real-time monitoring of compliance with environmental and social safeguards/ESF.

• Beneficiary or multi-stakeholder engagement (e.g. perception/feedback surveys).

Leveraging GEMS for the COVID-19 Response

• Remote GEMS implementation via:

• Online workshops for staff, clients, and partners on remote supervision, tailored to specific needs of sectors/programs/projects/components.

• Creation of remote supervision platforms, incl. support of design and deployment of digital forms, data architectures, semi-automated analyses and maps.

• Access to existing portfolio mapping platforms (>40,000 sub-projects mapped).

• Support in setting up strategies for digital field data collection & remote analysis.

• Case-by-case support in structured field data analysis, including remote sensing through satellite imagery via partnership with the European Space Agency (ESA).

GEMS Remote Training Calendar | May 2020 (sign up via OLC)

Page 16: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

‘Normal’ in-Country Training: 3 Days Interactive Hands-on Capacity Building

• Creation and administration of data platform

• M&E skills and digital questionnaire design

• ‘Train-the-trainers’ approach for field data collection

• Data mapping and analysis within the application

• Data export, spatial analysis, Excel analysis

➢ Interactive design customized to M&E needs of the projects and implementation environment

➢ System is fully owned and run by client after training and can be used for flexible needs and scaled across operations

For further information, just type gems/ in your WBG intranet browser, see here for our intranet site or contact the GEMS team at the FCV Group ([email protected])

Page 17: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

1) Designate regional/CMU and GP/project-specific Focal Points (FPs)• Ideally 1 or more full-time GP/CMU FP and 1 part-time FP per project, to take ownership of the system• Can be existing staff or new hires (STCs). GP/CMU FPs can be embedded in GEMS team via WPA/charge code• Pre-existing IT/GIS skills not required for FPs, but very useful to take the system further for advanced analysis

2) Identify countries/sectors and projects for GEMS rollout • Ideally based on delivery priority (COVID-19 response), time-sensitivity, geographic footprint• Define what data should be collected, where, how, by whom – and how it feeds into decision-making

3) GEMS team creates a Portfolio Mapping Platform in collaboration with the GP/CMU/region• GEMS provides template, CMU decides what data to collect, GEMS creates platform• GP/CMU FP to take ownership of platform, with data viewing access provided flexibly (CD/CM, TTLs, gov, partners)

4) GEMS team delivers a remote “training-of-trainers” workshop with the FPs and other stakeholders• Training delivered remotely over 8-10 hours, split into 2-3 days with a day in between and “homework” assigned• Training to cover all the technical skills needed for FPs to create & administrate customized digital monitoring systems• All participants need to attend the entire training, as each bit builds upon the previous ones

5) GEMS team supports FPs in finding the best ways of deploying system based on local conditions and sector needs, incl.:• Field access in the client countries and specific options for local access by stakeholders• PIU capacities and ability to conduct remote trainings with PIUs; existing equipment in-country

6) System is deployed with FPs leading the content aspects and take full ownership of the system• GEMS team supports FPs with the technical issues, data architecture and customization of the system, as needed• Supervision/data analysis and follow-up is done by the FPs to make sure it feeds into GP/CMU/project decisions

‘Adjusted’ GEMS Rollout Amidst COVID-19 Restrictions: Specific Steps

Page 18: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

‘Adjusted’ Agenda for Remote Trainings amid Travel Restrictions

Page 19: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

GEMS Example: World Bank Portfolio Mapping at Sub-project Level

GEMS mapped over 50,000 project locations in 12 countries: Burundi, Cameroon, CAR, Chad, Côte d'Ivoire, DRC, Kenya Madagascar, Mali, Mauritania, Niger, and Republic of Congo

Page 20: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

GEMS Support: Overview on ongoing Implementation & Expressions of Interest

Conflict Hotspots Client Countries with Access Limitations

Missions suspended country-wide

Missions suspended outside capital

Subnational regions with limited access

Countries with regional access restrictions

Major conflict incidents in 2016Data sources UCDP & GTD

GEMS trainings & ongoing support

FCV Operational Support

CMU/GP Interest expressed

Mali

Nigeria South Sudan

BDI

Azerbaijan

PakistanLibya Egypt

Caucasus

Yemen

Niger Sudan

DRC

Status quo of GEMS implementation:

• > 2,000 local staff & partners trained• Around 500 WBG projects covered• Implemented in 35+ countries• Various Partner agencies included

(AFD, EU, GIZ, IOM, KFW, UNDP, UNFPA, UNHCR, UNICEF, UN-OCHA, ONOPS, WFP, WHO, WWF)

Uganda

IraqAfghanistan

Peru

Nicaragua

Myanmar

The boundaries, colors, denominations and any other information shown on this map do not imply, on the part of the World Bank Group, any judgement on the legal status of any territory, or any endorsement or acceptance of such boundaries.

Chad

Kenya

Mauritania

Senegal

2018 & 2019 VPU Award Recipient

Indonesia

Tajikistan

AFD GIZ, KfW

ROC

CdI

Kyrgyzstan

CAR

Guinea

BurkinaFaso

West Bank& Gaza

Philippines

Brazil

Djibouti

EAP Islands

Thailand

CameroonGambia

Timor-Leste

Bangladesh

Guinea-Bissau

Cabo Verde

Somalia Maldives

India

Madagascar

Tunisia

Togo

RWA PNG

Mozambique

Liberia

Benin

Ethiopia

Zambia

Haiti

Page 21: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

The GEMS Core Team

For further information, just type gems/ in your WBG intranet browser, see here for our intranet site or contact the GEMS team at the FCV Group ([email protected])

Page 22: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

Examples of GEMS Use in the Field

In Nigeria, Mali, CAR and elsewhere, GEMS provides real-time insights in insecure areas

In Niger, GEMS helps to plan and supervise infrastructure investments

for refugees, internally displaced people and host communities

Project Planning and supervision

In Uganda, a multisectoral nutrition project uses GEMS to monitor

deworming activities that are crucial to prevent stunting in school children

Project Progress Monitoring

In the DRC, detailed data on over 25,000 schools was collected in 3

months, changing the perspective of the Ministry of Education

Portfolio Mapping & Coordination

In South Sudan, remote health facilities have been mapped and

available services and medicine are regularly tracked by GEMS

Real-time Tracking of Service Delivery

Page 23: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

Exit Questionnaire

Weekly Perception and Worksite Questionnaire

DRC Example: GEMS Use for Social Protection Response to the Ebola Crisis

• The project covers over 100,000 beneficiaries in all the affected health zones in 18 months.

• Registration, Entry, Exit, Perception and Worksite questionnaires were developed and conducted with the GEMS tools

• As of Nov 2019, around 30,000 surveys were administered & 550,000 data points mapped.

2,711Surveys

94% Completion

3,071Perception

Surveys

130 Worksite Surveys

458 Pictures

• 99% proud of the work would recommend to others positive opinion from friends and family

• 95% had no problems during the project

• Perceptions on: recruitment process, choice of worksites/location, security, social cohesion, remuneration, issues related to the Ebola crisis, accidents.

• Real-time information from worksites for course correction - female participations, payments, GRM, conflicts, safeguards.

Registration Questionnaire

Entry Questionnaire for Beneficiaries

14,680Surveys

7,265Surveys

95% Completion

• Registration streamlined (5 to 2 days) andquality increased

• Provided baseline for impact evaluation• Database of vulnerable population

• Basic demographic/vulnerability profile• Household composition (indirect

beneficiaries)• Monitor compliance of: - Contracts, code of conduct- Knowledge of health and safety at work,

GRM

Page 24: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

Collected Data are visually verifiable

A monthly progress report is submitted by community facilitators

A progress report per sector can be created (for ex. Health Center, farmer center, school, district, etc.)

Uganda Example: Supervision Platform of a Multisectoral Nutrition Project

Reporting and Monitoring Structure

Page 25: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

Nigeria Example: Supervision Platform of a CDD Project

Le projet obtient régulièrement les informations du terrain via des

évaluateurs intermédiaires qui

vivent dans les zones d’insurgence Boko

Haram.

Page 26: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

▪ Current status of implementation of investment (if applicable)

▪ Project sector / theme▪ Likely number of beneficiaries from this

investment site▪ Security issues at this site▪ Basic understanding of safeguards?

Project & site information

▪ Please select the type of displacement that the investment has or is likely to cause

▪ Type of land hosting the investment▪ How will/has land acquisition take/n place?

Resettlement and land acquisition

2

▪ What types of complaints have been received?▪ Is there a specific person assigned to receive

complaints for this particular investment?▪ What environmental and social safeguards

instrument are/will be required?▪ Is/will the investment cause any public health

and safety concerns?▪ Has/will this investment cause any other

negative environmental and social impacts?

GRM & Safeguards instrument

4

Kenya Example: World Bank Investment Portfolio Tracker

▪ Have there been community consultations on the design and impacts of the investment?

▪ How many women participated in the consultations on the design and impacts of the investment?

Stakeholder consultation & inclusion

3

1

Page 27: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

East Africa Public Health Laboratory • Monitoring the construction and stocking of ultra-modern health laboratory

blocks. • Modern equipment purchase (medical)• Personnel capacity building and• Furniture

Kenya Example: the East Africa Public Health Laboratory Project

Page 28: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

Kenya Example: Transforming Health Systems For Universal Care

Page 29: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

KOSAP• Engaged a consultant to map out all the key areas of

interest such as schools, health centers and ACC offices to be connected to the grid network comprising of 151 mini-grids. In addition to connection to the mini-grids, the consultant identified a list of schools, boreholes, and health facilities for solar panel installation.

• All the mini-grid sites were identified based on population dynamics such as number of households within clusters, existence of social amenities such as schools and health facilities.

• The team is currently using the WB tracker in Manderacounty and plans cascade to other counties. They have developed their own tools to facilitate:

• Tracking of commodities sold by Solar service providers (SSP)

• Capture vital baseline information on characteristics of the beneficiaries for identification, benchmarking, tracking and evaluation purposes.

Kenya Example: Off-grid Solar Access Project for Underserved Counties

Page 30: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

Kenya Example: GEMS Used in Participatory Budgeting

Page 31: The Rocket, Pocket and Socket Science: Innovative Methods ... Rocket... · “Geo-enabling”relates to the use of hand-held ICT tools (smartphones/tablets) for the collection of

For further information about GEMS:

- contact the GEMS team at the FCV Group

[email protected]

- type gems/ in your WBG intranet browser

Get in Touch with the GEMS Team