SETA Chairs Research Programme

M&E in a SETA Environment11 October 2019

Theory of Change Workshop

E.Rosenberg@ru.ac.za www.ru.ac.za/elrc/projects

Agenda

• Presentations– Purpose of the workshop– What has been done thus far– What and why of a ToC workshop– Renay Pillay (DHET Directorate Policy, Research & Evaluation)– Weziwe Sikaka (DHET Skills Branch)

• Group work– Map the high level theory of change– Agree on high level indicators

• Next steps / way forward

PURPOSE OF THE WORKSHOP

1.Map a ToC for SETAs

• Based on various considerations informed by presentations

2.Assign high level indicators

• Impacts; final and intermediate outcomes

3.Decide how to

complete

• Including cap dev

WHAT & WHY OF THEORY OF CHANGE

Society & Economy

PSET System

SETAs

Example of a linear Theory of Change

• Assumptions:• few role players

• no history or context

• simple system (Rogers after Snowden)

Produce an M&E

framework

Train staff how to use it

All problems solved

A Non-linear ToC:

Assumptions:• Multiple role players not

working together optimally• Many historical and dynamic

contextual influences• Complex system (Rogers after

Snowden)

Together draft framework

Together try it out

Together reflect on practicality and outcomes

Together refine or change …

BACKGROUND INFORMING PROCESS

The Research Programme: 8

projects all contribute to the

Overall M&E Framework

Overall SETA M&E Framework: “This is how we want to be evaluated”

CBA Tool; Tracer Study

Protocol; Capacity

Development

Evaluations of Enterprise

skills activity system;

Governance

Performance Indicators + M&E for the MG + M&E for the DG

Reports & presentations are available at www.ru.ac.za/elrc/projects

Proposed Focus Areas for the Overall M&E FW (in addition to the basics)

• Staff capacity

• Organisational capacity

• Partner capacity

• Purposeful evaluations

• Used for learning and action

• Focused use in strategic planning, guided by ToR

• Skills intelligence

• Streamline data gathering, access

• Convene roleplayers –DHETS, DoL, DPME, DPSA, StatsSA, employers

• Platforms & processes

• Theory of Change/Action

• Focused indicators

• Streamline reporting

• Convene role players

• Tools and processes Big Picture

Better data

CapacityStrategic

Use

DHET CONTEXT SHAPING SETA M&E

Presentations

Society & Economy

PSET System

SETAs

Draft NP-PSET:

Draft NP-PSET:

Group Work

1. Map a high level theory of change for SETAs including• expected impact(s)

• final outcomes (in the form of pre-conditions not activities)

• intermediate outcomes

• The connections between them (how will this be achieved)

• Add: other roleplayers and their mandates

2. Report-backs and discussion

3. Refine the ToC and identify impact and outcome indicators

4. Report-back and discussion

5. Reflect on what we achieved and how to complete the task

Eureta Rosenberg, Mike Ward, Khotso Tsotsotso, Glenda Raven, Mike Rogan, Owen Skae, Garry Rosenberg, Carlene Royle, Liso Dlova

Thank You!

E.Rosenberg@ru.ac.za | MikeW@c-s-v.co.za | Khotso-Tsotsotso@wits.ac.za | c.royle@ru.ac.za