Monitoring & Evaluation Terminology

14
Project Monitoring and Evaluation Learning Program May 7 – 18, 2012, Mekong Institute, Khon Kaen, Thailand Monitoring & Evaluation Terminology

description

Monitoring & Evaluation Terminology. Same Same but Difference. Monitoring Evaluation Auditing. Project Design and Monitoring Framework (DMF). Project Results Framework (NZ, AUSAID) Logical Framework or Logframe (UN, USAID, EU, etc.). - PowerPoint PPT Presentation

Transcript of Monitoring & Evaluation Terminology

Page 1: Monitoring & Evaluation Terminology

Pro

ject

Mo

nit

ori

ng

an

d E

valu

atio

n L

earn

ing

Pro

gra

mM

ay 7

– 1

8, 2

012,

Mek

on

g In

stit

ute

, Kh

on

Kae

n, T

hai

lan

d

Monitoring & EvaluationTerminology

Page 2: Monitoring & Evaluation Terminology

Pro

ject

Mo

nit

ori

ng

an

d E

valu

atio

n L

earn

ing

Pro

gra

mM

ay 7

– 1

8, 2

012,

Mek

on

g In

stit

ute

, Kh

on

Kae

n, T

hai

lan

dSame Same but Difference

• Monitoring

• Evaluation

• Auditing

Page 3: Monitoring & Evaluation Terminology

Pro

ject

Mo

nit

ori

ng

an

d E

valu

atio

n L

earn

ing

Pro

gra

mM

ay 7

– 1

8, 2

012,

Mek

on

g In

stit

ute

, Kh

on

Kae

n, T

hai

lan

dProject Design and Monitoring

Framework (DMF)

Project Results Framework (NZ, AUSAID)

Logical Framework or Logframe (UN, USAID, EU, etc.)

An integrated part of design documents, the primary source used during implementation, evaluation, and post - evaluation

Page 4: Monitoring & Evaluation Terminology

Pro

ject

Mo

nit

ori

ng

an

d E

valu

atio

n L

earn

ing

Pro

gra

mM

ay 7

– 1

8, 2

012,

Mek

on

g In

stit

ute

, Kh

on

Kae

n, T

hai

lan

dLogframe

Description Objective Verifiable Indicators (OVI)

Means of Verification (MOV)

Assumption/Risk

Goal (Development Objective)

Purpose (Immediate Objective)

Outputs

Activities Inputs

Page 5: Monitoring & Evaluation Terminology

Pro

ject

Mo

nit

ori

ng

an

d E

valu

atio

n L

earn

ing

Pro

gra

mM

ay 7

– 1

8, 2

012,

Mek

on

g In

stit

ute

, Kh

on

Kae

n, T

hai

lan

dADB’s Design & Monitoring Framework (DMF)

ACTIVITIES

Design Summary

Performance Targets

Data Source Assumptions/ Risks

OUTCOME

IMPACT

OUTPUTS

ACTIVITIES INPUTSINPUTS

Design and Monitoring Framework ReferenceVersion

ACTIVITIES

Design Summary

Performance Targets

Data Source Assumptions/ Risks

OUTCOME

IMPACT

OUTPUTS

ACTIVITIES INPUTSINPUTS

Design and Monitoring Framework ReferenceVersion

Page 6: Monitoring & Evaluation Terminology

Pro

ject

Mo

nit

ori

ng

an

d E

valu

atio

n L

earn

ing

Pro

gra

mM

ay 7

– 1

8, 2

012,

Mek

on

g In

stit

ute

, Kh

on

Kae

n, T

hai

lan

d

Outcome

Impact

Outcome

Design Logic and Monitorability

Page 7: Monitoring & Evaluation Terminology

Pro

ject

Mo

nit

ori

ng

an

d E

valu

atio

n L

earn

ing

Pro

gra

mM

ay 7

– 1

8, 2

012,

Mek

on

g In

stit

ute

, Kh

on

Kae

n, T

hai

lan

dImpact Chain

Page 8: Monitoring & Evaluation Terminology

Pro

ject

Mo

nit

ori

ng

an

d E

valu

atio

n L

earn

ing

Pro

gra

mM

ay 7

– 1

8, 2

012,

Mek

on

g In

stit

ute

, Kh

on

Kae

n, T

hai

lan

dADB Project Performance

Management System

ACTIVITIES

Design Summary

Performance Targets

Data Source Assumptions/ Risks

OUTCOME

IMPACT

OUTPUTS

ACTIVITIES INPUTSINPUTS

Design and Monitoring Framework ReferenceVersion

ACTIVITIES

Design Summary

Performance Targets

Data Source Assumptions/ Risks

OUTCOME

IMPACT

OUTPUTS

ACTIVITIES INPUTSINPUTS

Design and Monitoring Framework ReferenceVersion

Design Management Reporting Evaluation PostEvaluation

ConceptPaperRRP

TA Paper

PAM(Project

Document orInceptionReport)

PPRTPR

PCRTCR

PPERTPER

Page 9: Monitoring & Evaluation Terminology

Pro

ject

Mo

nit

ori

ng

an

d E

valu

atio

n L

earn

ing

Pro

gra

mM

ay 7

– 1

8, 2

012,

Mek

on

g In

stit

ute

, Kh

on

Kae

n, T

hai

lan

dM&E System

• The process of monitoring, evaluating, and comparing planned results with actual results to determine the progress toward Cost Schedule Technical Performance Objectives Strategic fit

Page 10: Monitoring & Evaluation Terminology

Pro

ject

Mo

nit

ori

ng

an

d E

valu

atio

n L

earn

ing

Pro

gra

mM

ay 7

– 1

8, 2

012,

Mek

on

g In

stit

ute

, Kh

on

Kae

n, T

hai

lan

d

RelevancePerformance

SUCCESS

Substantive Focus

Program Quality

Page 11: Monitoring & Evaluation Terminology

Pro

ject

Mo

nit

ori

ng

an

d E

valu

atio

n L

earn

ing

Pro

gra

mM

ay 7

– 1

8, 2

012,

Mek

on

g In

stit

ute

, Kh

on

Kae

n, T

hai

lan

dKey criteria

• relevance – the degree to which the objectives of a programme remain valid and significant;

• performance – progress of a programme towards achieving its objectives, in terms of effectiveness, efficiency and timeliness;

• success – attaining a measurable level of benefits that can be directly attributed to the programme, in terms of impact, sustainability and capacity development.

Page 12: Monitoring & Evaluation Terminology

Pro

ject

Mo

nit

ori

ng

an

d E

valu

atio

n L

earn

ing

Pro

gra

mM

ay 7

– 1

8, 2

012,

Mek

on

g In

stit

ute

, Kh

on

Kae

n, T

hai

lan

dM&E Standard Criteria

• Relevance Development Issues Target Groups Direct Beneficiaries

• Performance Effectiveness Efficiency Timeliness of inputs and results

• Success Impact Sustainability Contribution to Capacity Development

Page 13: Monitoring & Evaluation Terminology

Pro

ject

Mo

nit

ori

ng

an

d E

valu

atio

n L

earn

ing

Pro

gra

mM

ay 7

– 1

8, 2

012,

Mek

on

g In

stit

ute

, Kh

on

Kae

n, T

hai

lan

dMeasurements

• Indicators – What to be measures

• Targets – how much by when

• Baselines – current status

• Milestones – achieving an activity

• With vs Without

• Before vs After

Page 14: Monitoring & Evaluation Terminology

Pro

ject

Mo

nit

ori

ng

an

d E

valu

atio

n L

earn

ing

Pro

gra

mM

ay 7

– 1

8, 2

012,

Mek

on

g In

stit

ute

, Kh

on

Kae

n, T

hai

lan

dSMART Indicators

• Specific

• Measurable

• Achievable

• Relevant

• Time-bound

• A good balance should be achieved between theory and practice, i.e., between what should be and what can be measured

Indicators are "yardsticks" that can be used to demonstrate that changes have (or have not) taken place. They provide meaningful and comparable information on changes.