FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels &...

44
HAN RAKELS & BERNADETTE VAN DIJCK

Transcript of FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels &...

Page 1: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

HAN RAKELS & BERNADETTE VAN DIJCK

Page 3: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

Cynefin Framework (Snowden et.al,HBR, 2007)

Page 4: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

How to make sense of

many perspectives?

Page 5: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

Facilitating Multistakeholder DialogueSystemic Change

Large Group Interventions leading to Emerging Practice

Page 6: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

The limits of Face-to-face meetings

Page 7: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

“COULD WE HAVE A MINUTE OF YOUR TIME

?”

“WE ARE INTERESTED IN

YOUR OPINION !”

SURVEYS

Page 8: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

ASSUMPTIVE SURVEYSLimited applicability in complex settings

Page 9: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

Modern technogies

Embracing complexity

Adaptive learning

So what now…?

Page 10: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

Sprockler is...A tool and philosophy for adaptive learning

…from stories

to statistics…To generate quantitative (meta) data,

backed-up by qualitative information

- Explanatory power of stories

- Objectivity of numbers

Page 11: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER
Page 12: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

How does it work?

Page 13: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER
Page 14: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

what’s your

STORY?

Page 15: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

Can you tell me a story about a moment in the past month that you decided – because of transport security - to cancel a (personal or professional) appointment or decided to take a different route?

Incidents in Kabul

Page 16: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

Self-significationMeaning mapping framework

Intuitive and instinctive responses

Fill in the grey areas between multiple choice options

Ownership with respondents

Authentic and more accurate data

Page 17: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

The reason for cancelling or rerouting was:Reported security incident

Fear of insecurity

Bipole

Page 18: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

The situation in my story happens

Bipole

Rarely Daily

Page 19: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

The moment of travel you avoided was: Morning

Afternoon

Evening

Tripole

Tripole

Page 20: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

Which area did you avoid in the event of the story?

Picture Pointer

Page 21: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER
Page 22: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

App & Web CollectorOnline &App collector

Page 23: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

Collector in action

Avicres &Kindermissionswerk

YouthLEADUNICEF

Univ GhentFuture

Women in conflict (oPt)

Page 24: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER
Page 25: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

VisualizationQUANTITATIVE AND QUALITATIVE

Semi-automated analyses and overviews for ownership, swiftness and users friendliness

Advanced statistical analysis possible

Page 26: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

The moment of travel you avoided was:

At night I do not feel safe, and I never go to any invitation, my neighbourhood is too insecure. In the morning I bring my children to school and I'm going to work.

EveningMorning

Afternoon

Page 27: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

EveningMorning

Afternoon

The moment of travel you avoided was:

Page 28: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

Reported security incident

Fear of insecurity

The reason for cancelling or rerouting was:

Page 29: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

Reported security incident

Fear of insecurity

The reason for cancelling or rerouting was:

Page 30: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

Which area did you avoid in the event of the story:

Page 31: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

Which area did you avoid in the event of the story:

Page 32: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

EveningMorning

Afternoon

Reported security incident

Fear of insecurity

Pregnant woman

Others

Page 33: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

SCIENTIFIC

INNOVATIVE

ONERSHIP OF DATA

TECHNICALLY ADVANCED

EASY OF USE

ON AND OFFLINE MULTILINGUALSECURE

ANONYMOUS

FLEXIBLE

Some features

UNDER DEVELOPMENT

CLOSING THE LOOP

Page 34: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

ApplicationsMonitoring and evaluation

Strategic assessments

Lobby and advocacy

Needs assessments

Organisational DiagnosisCohort studies

Customer satisfaction Trend analysis

Impact asessment

Page 35: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

SourcesDavid Cooperrider ‘The Art of Questioning’ on Appreciative Inquiry

Brenda Dervin and Karl Weick on ‘Sensemaking’

Cynthia Kurz and Dave Snowden on ‘Cynefin Framework’ and ‘Sensemaker”

Marvin Weisbord and Sandra Janoff on ‘Future Search’

Robert Keidel on Seeing Organizational Patterns

Charles Osgood on The Measurement of Meaning

Page 36: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

COMPLEXITYWhat is emerging?

Page 37: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

Does it make any

sense?

Page 38: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER
Page 39: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER
Page 40: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

National GovernmentCommunity Radio Station ManagersRadio Program MakersJournalists Civil SocietyForeign Radio Development ExpertsUN Organisations

The “whole system” in the room

Future Search – Community Radio Liberia

Page 41: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

In what part of the house is fuel poverty most felt?

Picture Pointer

Page 42: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

Most of the time you can find me in the streets in the..

TripoleMorning

Afternoon

Evening

Page 43: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

Voice of the peopleOf Groningen

Page 44: FoME Symposium 2015 | Workshop 9: Story-telling and other New Methods of Evaluation | Han Rakels & Bernadette van Dijck: SPROCKLER

MINHA HISTORIA E PRINCIPALMENTE SOBRE...

Um GrupeUm Individuo

“Como minha tarefa de supervisionar, tive receio de não ser bem aceita. Pois ambas as partes não se conheciam. Mas como pessoa observadora que sou fui aos poucos me aproximando e interagindo com”

“Toda sua família com exceção do pai, viveu na casa Esperança, hoje vive ela e uma tia. Seu nascimento foi na casa de abrigo da sede da Avicres, depois foi para a casa Esperança.”

“Conhecer a Avicres e seu trabalho com crianças e adolescente em vuneralida-de social, foi um desafio pais não tinha conhecimento de como via trabalhar com esse pelilico.”