BEYOND THE STATISTICS ABOUT WATER

WATER SERVICE DELIVERY IN GHANA:

SENSEMAKER® APPROACH

WATER SERVICES THAT LAST …2

BEYOND THE STATISTICS ABOUT WATER SERVICE DELIVERY IN

GHANA: SenseMaker®

APPROACH

2

Presented By: Esinu Abbey (IT Coordinator, CWSA) &

Prosper Dzansi (Monitoring, Evaluation & Learning Expert)

WATER SERVICES THAT LAST …3

Irene Guijt, Learning by DesignDave Snowden, Cognitive Edge

Acknowledgement

WATER SERVICES THAT LAST …4

Outline

Part 1: The SenseMaker Approach

Part 2: Application of SenseMaker

WATER SERVICES THAT LAST …5

SenseMaker….. What is it?

•A software suite developed by Cognitive Edge to help find patterns among stories•A tool for capturing story based data•An Evaluation tool

WATER SERVICES THAT LAST …6

SenseMaker Suite

Attempt to Hear What Really Matters to People

WATER SERVICES THAT LAST …7

Examples of applications

Liverpool Museum of Slavery culture of violence – Latin America grassroots initiatives - East Africa girls’ empowerment – Rwanda, Ethiopia agricultural value chains - cotton, tea, banana water service delivery - Ghana, Uganda youth leadership - global

WATER SERVICES THAT LAST …8

Why use SenseMaker?

Dynamic contexts need adaptive programme Respond to emerging needs Understand diversity of perspectives Focus on values and people’s experiences, with

quantification

Not stand alone approachBuild in other evaluation frameworks

WATER SERVICES THAT LAST …9

What using SenseMaker involvesWhat using SenseMaker involves

An An approach approach to making sense of different fragments of information about to making sense of different fragments of information about a complex change process or about a dynamic contexta complex change process or about a dynamic context Lots of different Lots of different ‘stories’ from many sources ‘stories’ from many sources : water users, water : water users, water

professionals, policy documents, videos, photographsprofessionals, policy documents, videos, photographs Together they build a rich and diverse picture of what is happeningTogether they build a rich and diverse picture of what is happening

Looking at patterns that are emerging can help plan next stepLooking at patterns that are emerging can help plan next steps s (rather than the individual stories……the paterns (rather than the individual stories……the paterns direct us to find out what a cluster of pple are direct us to find out what a cluster of pple are saying …helps in forming themes)saying …helps in forming themes)

SenseMakerSenseMaker® ® is the software is the software to help find patterns among the to help find patterns among the storiesstories But people need to make sense of it and decide on actionBut people need to make sense of it and decide on action

WATER SERVICES THAT LAST …10

Essence

WATER SERVICES THAT LAST …11

From question to action

Prompting question

patterns

Act on signals

Story capture

Self-signification

Visualize patterns (theme, org, time, geo)

Make sense

WATER SERVICES THAT LAST …12

start

Methodology in Practice - GlobalGiving

WATER SERVICES THAT LAST …13

Asking what?

Goals, values, behaviours Non-negotiables

seek surprise & confirm known

WATER SERVICES THAT LAST …14

Tell us about a time when a person or an organization tried to change something in your community.

WATER SERVICES THAT LAST …15

Stage 1 Analysis – Sensemaker (& Excel, SSP, SNA, text analysis)

WATER SERVICES THAT LAST …16

Stage 2 Analysis – People

WATER SERVICES THAT LAST …17

Ghana Group Discussions per ThemeGhana Group Discussions per Theme

Look at the patterns, reflect on your own experiences and read the related stories.

Discuss:1. What messages are emerging from the

patterns?2. Which patterns are odd? And what might

explain those patterns? 3. Which patterns do you recognise?4. What do the patterns suggest might be areas

and issues that require attention? New issues needing investment, some not worthwhile, etc.

WATER SERVICES THAT LAST …18

Library of lived experiencesVisualizing shifting story patternsDissemination to official aid sectorActionable – client, constituent voice

Rolling baselinesUseful for organizations – facilitate decision-making Information challenges existing frameworksCross-organizational thinking

Stories for evidence-based policy changesFraming the impact for/to donorsPeer-to-peer knowledge management

After 18 months

WATER SERVICES THAT LAST …19

Wider Sharing, eg geomapping

WATER SERVICES THAT LAST …20

Last thoughts

See- Attend-ActIt’s not just getting material in front of people

Statistical links (especially self-discovered) create attention– Linked “objectivised anecdotes” provide explanatory power and lead to action

Measure success without pre-defining (no pre defined mined set like logg frames…open mind)

measures of success change over time

allowing learning through tolerated failure (do and learn from mistakes made)

contextual adjustment

Evidence-based policytests of coherence empower ‘people’ to use statistics

potential for whole of population engagement

complexity/narratives alternatives to “Delphi” to allow real time distributed consultation

20

WATER SERVICES THAT LAST …21

Part 2

WATER SERVICES THAT LAST …22

BEYOND THE STATISTICS ABOUT WATER SERVICE

DELIVERY IN GHANA:

SENSE MAKER APPLICATION IN TRIPLE-S

WATER SERVICES THAT LAST …23

PRESENTATION OUTLINE

1.Background of Triple-S

2. Why use SenseMaker in Triple-S 3. Methodology for story collection

4. Analysis

5. Results

6. Next steps

WATER SERVICES THAT LAST …24

BACKGROUND TO TRIPLE-S

Triple-S: a six year research project 2009 – 2014 Managed by IRC in collaboration with partners and funded by

the Bill & Melinda Gates Foundation Seeks to tackle log-term challenges of sustainable water

supply by contributing to shift from “infrastructure perspective” to service delivery approach for rural water sector through:

Action research in Ghana, Uganda (& Burkina Faso) Working with government and sector stakeholders Research, documentation and dissemination International partnerships and advocacy

WATER SERVICES THAT LAST …25

WHY USE SENSE MAKER FOR WHY USE SENSE MAKER FOR TRIPLE S ?TRIPLE S ?

•Respond to emerging needs – flexible funding for Respond to emerging needs – flexible funding for new ideas. new ideas.

• Diversity of perspectives - especially users and Diversity of perspectives - especially users and professionals.professionals.

•Getting beyond statistics about water points and Getting beyond statistics about water points and policy intentions to people’s lived experiences in policy intentions to people’s lived experiences in the water sector.the water sector.

• Monitor water users satisfaction of the services they are receiving..

WATER SERVICES THAT LAST …26

SERVING A LARGER LEARNING PURPOSE

•Triple-S identified Narratives as a means of monitoring and evaluation.•Learning in Triple-S takes place in two areas (Narratives).• Narrative 1: tells the story about sector change towards sustainability (changes in discourse, new ideas emerging, changing practices and policies)• Narrative 2 tells the story of the process to enable this change.• Use of statistical methods and stories in these narratives• Learning is geared towards improving our performance;

WATER SERVICES THAT LAST …27

METHODOLOGY OF STORY COLLECTION

Who tells stories?

1. Two main categories of stakeholders;•Users at water facility level: Akatsi, East Gonja, & Sunyani West District Assemblies• Water Professionals: Government & NGO staff at Central & Decentralized level

2. Actual stories collected: 1, 256, water users 842, water professionals 4143. Pilot stage =300

WATER SERVICES THAT LAST …28

METHODOLOGY OF STORY COLLECTION

Who collects stories? Recruited and trained 22 story collectors•young unemployed graduates or national service personnel, •teachers, •assembly men , •environmental health officers, • community development officers and •Social welfare officers

WATER SERVICES THAT LAST …29

METHODOLOGY OF STORY COLLECTION

Methods for Story Collection• User stories were collected through interviews: • Story collectors where deployed to all area councils in each pilot

District to ensure spread of stories & representativeness.

• Water Professionals stories were collected through:- interviews( in offices of water professionals and sector events- an e-based collector website

 IncentivesLunch and transport allowances were provided to story collectorsFeedback ( sharing and discussion of results to motivate people to

share stories)

WATER SERVICES THAT LAST …30

LESSONS/CONSIDERATIONS

Things that work well• Both water users and professionals were willing to share

stories• The use of the word ‘story’ prompted respondents to share

long narratives and sometimes fairytales or fiction’

Things that did not work well • The use of the collector website did not work well as

practitioners saw no motivation to respond • Practitioners preferred speaking out their experiences

rather than writing them.

WATER SERVICES THAT LAST …31

DATA ENTRY & ANALYSIS

1. Data entry outsourced

2. Two levels of analysis are planned:

• Preliminary analysis on demographics, & key highlights and trends observed by Triple- S

• Sharing the Results with Stakeholders at National Learning Alliance Platform for them to:1. Make sense of the trends observed, 2. Identify messages that emerging from the patterns?3. New issues needing investment, some not worthwhile

WATER SERVICES THAT LAST …32

B. ResultsB. Results

WATER SERVICES THAT LAST …33

What do we need to know? What do we need to know?

Water UsersWater Users• How do people think of their water supply (quality, reliability, quantity etc)? • How do water users perceive water professionals? • How do people know their rights and responsibilities to water use• What are the views of water users/people on who should pay for water?

Water Professionals? Water Professionals? • What are the implementation challenges associated with sustainable provision

of new water facilities? • What success story of non technical /infrastructure can the sector build on? • Where are we seeing stagnation and where are we seeing good• Is there harmonization and alignment being done positive and negative?

WATER SERVICES THAT LAST …34

HOW DO USERS THINK OF THEIR WATER SUPPLY?

WATER SERVICES THAT LAST …35

Water Users How do water users see water professionals

500 stories59.4%

n =842 stories

Their own goalsTheir own goals

People in needPeople in need Their organizationTheir organization

The water providers directly involved in are mainly focused on…

WATER SERVICES THAT LAST …36

Water Users How do people know their rights and

responsibilities to water use

Play no rolePlay no role

Help make decisionsHelp make decisionsKnow who to talk toKnow who to talk to

n =813 stories

287 stories35.3%

WATER SERVICES THAT LAST …37

Water Users How do people know their rights and

responsibilities to water use

Responsibility for water supplyResponsibility for water supply

Rights to water useRights to water use Knowledge about maintaining water supplyKnowledge about maintaining water supply

n =855 stories

334 stories39.1%

My story is about people’s...

WATER SERVICES THAT LAST …38

Water Users What are the views of water users on who should

pay for water

Government or aid organizationGovernment or aid organization

Water userWater userLocal water providerLocal water provider

n =815 stories

267 stories32.8%

In your story, who should pay if the water system breaks?

WATER SERVICES THAT LAST …39

Water Professionals What are the implementation challenges associated with sustainable provision of new water facilities?

ChallengeChallenge

SolutionSolutionProblemProblem

n =414 stories 102 stories24.6%

WATER SERVICES THAT LAST …40

Water Professionals What are the implementation challenges associated with sustainable provision of new water facilities?

PolicyPolicy

ImplementationImplementation FinancingFinancing

n =414 stories

78 stories18.8%

•The story has to do with….

WATER SERVICES THAT LAST …41

Water Professionals What are the implementation challenges associated with sustainable provision of new water facilities?

.

New InfrastructureNew Infrastructure

Post constructionPost construction General sector SupportGeneral sector Support

n =414 stories

70 stories16.9%

Your story is about….

WATER SERVICES THAT LAST …42

Water Professionals

•Context of the story and the emotions associated.

WATER SERVICES THAT LAST …43

Water Professionals What success story of non technical /infrastructure can the sector build on?

.

•How do you feel about your story?

WATER SERVICES THAT LAST …44

WHERE ARE WE SEEING STAGNATION AND WHERE ARE WE SEEING GOOD PROGRESS

.

Story relates to policies and practices about...?

WATER SERVICES THAT LAST …45

WHERE ARE WE SEEING STAGNATION AND WHERE ARE WE SEEING GOOD PROGRESS

.

The same as alwaysThe same as always

The same things but in a better wayThe same things but in a better way Fundamentally different thingsFundamentally different things

118 stories28.5%

n =414 stories

The story is about a situation in which organizations/ people do.?

WATER SERVICES THAT LAST …46

IS THERE HARMONIZATION AND ALIGNMENT BEING DONE POSITIVE AND NEGATIVE

The story is about a situation in which organizations/ people do?

Work independentlyWork independently

Fully align their approachesFully align their approachesCoordinate their activitiesCoordinate their activities

n =414 stories

69 stories16.7%

In your story, organisations...

WATER SERVICES THAT LAST …47

NEXT STEPS

In the Next Steps…

• Sharing and discussing outputs from story analysis in review & coordination platforms at:

- District - Regional- - National level

• Setting up an institutionalized system of data collection • Anchor sense maker activities into M&E system of CWSA and

the sector

WATER SERVICES THAT LAST …48

Thank you

WATER SERVICES THAT LAST …49

Group Discussions per ThemeGroup Discussions per Theme

Look at the patterns, reflect on your own experiences and read the related stories.

Discuss:1. What messages are emerging from the patterns?2. Which patterns are odd? And what might explain those

patterns? 3. Which patterns do you recognise?4. What do the patterns suggest might be areas and issues

that require attention? New issues needing investment, some not worthwhile, etc.