Developmental Evaluation

Why we do itHow we are using itA way to contribute

Intractable social issues

“In an increasingly complex world,sometimes old questions require new answers”

Developmental Evaluation (DE)

(Patton, 2011)

Innovative, design-oriented initiatives

Strategies, Partnerships,& Outcomes can all beemerging

Unfolding in complex contexts

The Good, the Bad and the Ugly of Evaluation

All evaluation should support learning

Developmental evaluation is different because learning, reflection and ongoing discussion about how to do things is central to the process

Solving social issues can be a tricky, messy place

Provide Education & Training

Workshops

Support the Sharing of Learning &

Knowledge within Hamilton and

across Communities

ASCY – Save the Day for Play Logic Model

Earl

y Le

arni

ng P

rofe

ssio

nals

Early Learning Child Care Centres

OELF Principles Realized in Practice

The early years of Ontario children are catalyst to the development of social, emotional, communication, cognitive and physical skills fundamental to life-long learning and health.

Envi

ronm

ents

Prepared by The O’Halloran Group www.theohallorangroup.ca, October 2011

More Welcoming

Enriched to Spark Curiosity & Exploration

Better Reflect Unique Needs &

Diversity

More Space and Time for Play Based

Learning

Communities

Increased Mentorship

Greater Collaboration

Stronger Networks

More Integrated Child Care System focused on the OELF Principles

Greater Valuing & Sharing Between Early Learning Programs

ASCY

Deeper Knowledge & Understanding of OELF

Greater Skill for & Valuing of Play Based Learning

Increased Resources for Supporting \

Sustainability

Increased Reflection to Inform Planning

Increased Creativity, Experimentation &

Building More of Their Own Solutions

More AmenableView of the Child

More Common Professional

LanguageIncreased Skill for

Observing & Documenting Play

Facilitate Readiness for Curriculum

Change

Provide Mentoring & Coaching

Support Leadership Development

Strategic Planning, Program Logic Models, Policies & Procedures

better reflect OELF/Save the Day for Play

Improved Continuum of Development; Observation & Documentation

Greater engagement of the director as a collaborator in learning

In a developmental evaluation, imposing a logic model can feel something like this…

#BeFearless

Making mistakes

Going back & redesigning your process

When DE Makes Sense

Initiative is emerging in a complex context

Direction and outcomes are unknown

Partners and collaborators may change & grow

There is openness to engagement & reflection

There can be comfort with ambiguity and shifting processes

Role of the evaluator

Ask

Design

Do

Share

Listen

What I would do in a typical evaluation

Ask

Listen

DistillShare

Reflect

What I do in a DE context

Never Stop Questioning

• What, So What, Now What?• What were the critical decisions

that were made?• How has learning informed the

development of activities?• Where are we now? Where do

we want to go next?• To what extent and in what ways

are we working with others?

A good evaluation – developmental or otherwise – reflects the conditions of that

which it is attempting to evaluate

Social Prosperity Wood Buffalo Theory of Change

Complexity

Momentum

Sustainability

Stakeholder Groups

• To examine and characterize the contribution and outcomes of Social Prosperity Wood Buffalo as a systems-level intervention designed to achieve social change

Learning

Knowledge transfer

Stakeholder Engagement

Complementary Research Strategies

Social Prosperity Wood BuffaloEvaluation Plan

Phases

• Laying the Ground Work

• Learning as We Go

• Reflecting on What We Achieved

• Looking Forward

Evaluation Questions

1. What is the contribution to capacity & innovation?

2. How do activities change?

3. What are the lessons learned?

4. What supports innovation?

5. What supports resiliency?

6. What is the impact on relationships and networks?

7. What is the impact on capacity?

8. What are the outcomes of innovation?

Social Prosperity Wood BuffaloEvaluation Plan

Methods & Tools

Activity Tracking

Community Asset Map

Feedback Surveys

Key Informant Interviews

Capacity Assessment

Social Prosperity Wood BuffaloEvaluation Plan

…so far

Innovation

Capacity Building

Capacity Assessment Measure

• To assess capacity for delivering responsive programs and services.

• The development of supports• The development of benchmarks and capacity

indicators

• Available online• As a pdf on the Social Prosperity & Sector

Link websiteshttp://socialprosperity.cahttp://nonprofitsectorlink.com

• Open from now until end of June• Goal is 100 completed

Tanya Darisi, M.A.DirectorThe O’Halloran Group

tanya@theohallorangroup.cawww.theohallorangroup