What Customer Wants Approaches to Identify Opportunity for Innovations Hamid Houshmand May 2011.
Innovations for Economic Opportunity Tools for Assessing ... · Innovations for Economic...
Transcript of Innovations for Economic Opportunity Tools for Assessing ... · Innovations for Economic...
![Page 1: Innovations for Economic Opportunity Tools for Assessing ... · Innovations for Economic Opportunity What are systems? •Made of individuals (agents) •Dynamic (agents interact)](https://reader030.fdocuments.net/reader030/viewer/2022041205/5d573d2188c99303278b9951/html5/thumbnails/1.jpg)
Innovations for Economic Opportunity
Tools for Assessing Systemic Change: overview of the
tool trials under USAID/LEO and DFID/BEAM
DCED Global Seminar on Results Measurement
Bangkok – March 15, 2016
![Page 2: Innovations for Economic Opportunity Tools for Assessing ... · Innovations for Economic Opportunity What are systems? •Made of individuals (agents) •Dynamic (agents interact)](https://reader030.fdocuments.net/reader030/viewer/2022041205/5d573d2188c99303278b9951/html5/thumbnails/2.jpg)
Innovations for Economic Opportunity
What are systems?
• Made of individuals (agents)
• Dynamic (agents interact)
• Self-organizing (structures)
• Emergent properties
2
![Page 3: Innovations for Economic Opportunity Tools for Assessing ... · Innovations for Economic Opportunity What are systems? •Made of individuals (agents) •Dynamic (agents interact)](https://reader030.fdocuments.net/reader030/viewer/2022041205/5d573d2188c99303278b9951/html5/thumbnails/3.jpg)
Innovations for Economic Opportunity
• Perceptions – no vantage point; narrative-based
• Relationships – self-organizing, dynamic structures
• Boundaries – you have to draw the line somewhere (the universe is a big place)
How can we understand them?
3
![Page 4: Innovations for Economic Opportunity Tools for Assessing ... · Innovations for Economic Opportunity What are systems? •Made of individuals (agents) •Dynamic (agents interact)](https://reader030.fdocuments.net/reader030/viewer/2022041205/5d573d2188c99303278b9951/html5/thumbnails/4.jpg)
Innovations for Economic Opportunity
What is LEO?
• USAID-funded research initiative
• 8 research spokes
• MSA is leading the research on M&E around systemic change
4
![Page 5: Innovations for Economic Opportunity Tools for Assessing ... · Innovations for Economic Opportunity What are systems? •Made of individuals (agents) •Dynamic (agents interact)](https://reader030.fdocuments.net/reader030/viewer/2022041205/5d573d2188c99303278b9951/html5/thumbnails/5.jpg)
Innovations for Economic Opportunity
Purpose of LEO/BEAM trials
• Purpose: test potential tools to capture systemic change and early signs of change
• Address a key gap:
– Moving beyond imitation
– Capturing things you aren’t looking for
• Developed a short-list of 7 tools
• Narrowed down to 3 to be tested; rest would be assessed through partnerships
5
![Page 6: Innovations for Economic Opportunity Tools for Assessing ... · Innovations for Economic Opportunity What are systems? •Made of individuals (agents) •Dynamic (agents interact)](https://reader030.fdocuments.net/reader030/viewer/2022041205/5d573d2188c99303278b9951/html5/thumbnails/6.jpg)
Innovations for Economic Opportunity
The LEO/BEAM Trials
• Network analysis in Sierra Leone
• SenseMaker in Mozambique
• Outcome Harvesting – TBD
• Plus profiles:
– SenseMaker - VECO, Ag Inputs, PRIME (potentially Katalyst), Yapasa
– Network Analysis – GHG, Ag Inputs, LINC
– AAER + Standard Indicators – PRIME, Samarth
6
![Page 7: Innovations for Economic Opportunity Tools for Assessing ... · Innovations for Economic Opportunity What are systems? •Made of individuals (agents) •Dynamic (agents interact)](https://reader030.fdocuments.net/reader030/viewer/2022041205/5d573d2188c99303278b9951/html5/thumbnails/7.jpg)
Innovations for Economic Opportunity
Network Analysis – DFID/ASI SOBA
• Design: Captures relationships
• Advantages:
– Parses relationships in useful detail
– Window into social norms that influence economic behavior
• Disadvantages:
– Labor and cost intensive
– Complete data is impossible
7
![Page 8: Innovations for Economic Opportunity Tools for Assessing ... · Innovations for Economic Opportunity What are systems? •Made of individuals (agents) •Dynamic (agents interact)](https://reader030.fdocuments.net/reader030/viewer/2022041205/5d573d2188c99303278b9951/html5/thumbnails/8.jpg)
Innovations for Economic Opportunity
Network Analysis – DFID/ASI SOBA
8
Questions: • What are the
relevant network parameters?
• What types of change can one track with NA?
• Is there an NA-lite approach possible?
• Set a baseline of coms and trade data • Identify sentinel individuals
![Page 9: Innovations for Economic Opportunity Tools for Assessing ... · Innovations for Economic Opportunity What are systems? •Made of individuals (agents) •Dynamic (agents interact)](https://reader030.fdocuments.net/reader030/viewer/2022041205/5d573d2188c99303278b9951/html5/thumbnails/9.jpg)
Innovations for Economic Opportunity
• Design: captures perspectives
• Advantages:
– Detects unexpected findings
– Identifies outliers
– Quantitative rigor
• Disadvantages:
– Proprietary
– 100s of micro-narratives
9
SenseMaker – Netherlands/TNS Seed Multiplication
![Page 10: Innovations for Economic Opportunity Tools for Assessing ... · Innovations for Economic Opportunity What are systems? •Made of individuals (agents) •Dynamic (agents interact)](https://reader030.fdocuments.net/reader030/viewer/2022041205/5d573d2188c99303278b9951/html5/thumbnails/10.jpg)
Innovations for Economic Opportunity
SenseMaker – Netherlands/TNS Seed Multiplication
Contextual Questions:
• How do SHFs decide how to farm?
• How do they interact with the SCF change agent supported by the project?
• How do these actors (SHFs and SCFs) interact with other stakeholders differently (each other, banks, policy makers, markets, etc) as the system changes?
Attributive Question:
• To what degree has the project influenced SHFs to change practices through support to SCFs?
– Can Sensemaker answer this question?
– Is the quantitative rigor warranted and useful?
10
![Page 11: Innovations for Economic Opportunity Tools for Assessing ... · Innovations for Economic Opportunity What are systems? •Made of individuals (agents) •Dynamic (agents interact)](https://reader030.fdocuments.net/reader030/viewer/2022041205/5d573d2188c99303278b9951/html5/thumbnails/11.jpg)
Innovations for Economic Opportunity
Outcome Harvesting – TBD
• Design: captures perspectives
• Advantages:
– Detects unexpected outcomes, potentially including the lack of response
– Works in reverse of TBCA (good complement to RCs)
• Disadvantages:
– Nothing inherently systemic about outcomes
11
![Page 12: Innovations for Economic Opportunity Tools for Assessing ... · Innovations for Economic Opportunity What are systems? •Made of individuals (agents) •Dynamic (agents interact)](https://reader030.fdocuments.net/reader030/viewer/2022041205/5d573d2188c99303278b9951/html5/thumbnails/12.jpg)
Innovations for Economic Opportunity
As a field, we’re missing something…
“The ability to collect and pin to a board all the insects that live in the garden does little to lend insight into the ecosystem contained therein.”
– Miller and Page, Complex Adaptive Systems
13
![Page 13: Innovations for Economic Opportunity Tools for Assessing ... · Innovations for Economic Opportunity What are systems? •Made of individuals (agents) •Dynamic (agents interact)](https://reader030.fdocuments.net/reader030/viewer/2022041205/5d573d2188c99303278b9951/html5/thumbnails/13.jpg)
Innovations for Economic Opportunity
The trees: We are great at describing agent behavior
14
Agents performing roles and changing
behaviors
Rules/Norms are not agent-level
![Page 14: Innovations for Economic Opportunity Tools for Assessing ... · Innovations for Economic Opportunity What are systems? •Made of individuals (agents) •Dynamic (agents interact)](https://reader030.fdocuments.net/reader030/viewer/2022041205/5d573d2188c99303278b9951/html5/thumbnails/14.jpg)
Innovations for Economic Opportunity
The forest: system-level behavior
• Systems exhibit emergent behaviors – i.e., the system, itself, does things (it accomplishes tasks)
• Fundamentally, a socio-economy self-organizes to allocate products and services across a population – that’s the principle system-level behavior – How do you describe it?
15
![Page 15: Innovations for Economic Opportunity Tools for Assessing ... · Innovations for Economic Opportunity What are systems? •Made of individuals (agents) •Dynamic (agents interact)](https://reader030.fdocuments.net/reader030/viewer/2022041205/5d573d2188c99303278b9951/html5/thumbnails/15.jpg)
Innovations for Economic Opportunity
How can we analyze and measure the system?
16
Rules/Norms – Institutional
Biases
Generation of Novelty
Flow of Information Network
Structures
Churn
Power Dynamics
Over time!
![Page 16: Innovations for Economic Opportunity Tools for Assessing ... · Innovations for Economic Opportunity What are systems? •Made of individuals (agents) •Dynamic (agents interact)](https://reader030.fdocuments.net/reader030/viewer/2022041205/5d573d2188c99303278b9951/html5/thumbnails/16.jpg)
Innovations for Economic Opportunity
How should a systemic change framework look?
Agent X
Agent Y
Agent behaviors and attributes (e.g., roles, capacities – AAER)
Emergent behaviors and attributes (e.g., Institutional biases, novelty, network features)
Additive features: (e.g., output, diversity, specialization)
MarketShare Associates, forthcoming (2016)
![Page 17: Innovations for Economic Opportunity Tools for Assessing ... · Innovations for Economic Opportunity What are systems? •Made of individuals (agents) •Dynamic (agents interact)](https://reader030.fdocuments.net/reader030/viewer/2022041205/5d573d2188c99303278b9951/html5/thumbnails/17.jpg)
Innovations for Economic Opportunity
Thanks
www.Marketshareassociates.com
18