Sample Evaluation Report Template

8/16/2019 Sample Evaluation Report Template

1/22

[Month Year]

This publication was produced at the request of the United States Agency for InternationalDevelopment. It was prepared independently by


2/22

*I+T$,DU-TI,+ This template is an optional tool to help improveconsistency across #valuation $eports. /hen using this template' ma0e sureall red te&t is deleted' and change all other te&t 1headings' titles' body te&t'etc2 to your content. The most important items to remember regarding graphics and formatting%

3. Apply USAID4s identity and branding according to the USAID 5raphicsStandards6. Use USAID fonts 15ill Sans or 5ill Sans 7T 1bold for headlines' subheadsand highlighted te&t8 regular or light for body te&t8 italic for captions2' or5aramond or Ariel if 5ill Sans not available.9. Use USAID colors%

• :rimary color paletteo USAID Blue 1$5; $ =65 3>;2o USAID Red 1$5; 3?=$ 3@5 >;2o Solid Black 1$5; $ 5 ;2

• Secondary color palette

o Dark Gray 1$5; 36$ 365 36;2o Light Gray 1$5; 663$ 6635 663;2o Light Blue 1$5; 3@$ 3?35 66?;2

B$,+T -,C#$ As with all USAID publications' the front cover has thefollowing elements%

• Use USAID standard graphic identitybrand. Available for downloadfrom http%pdf.usaid.govpdfdocs:+AD;99=.pdf

• :lace the USAID identity in the upper left area in a white Eeld that isone or two hori!ontal bars in height 1the cover should be divided into ?equal hori!ontal bars2.

• If Fointly funded and cobranded 1with a partner or another donor4sbrand2' request lowerleft placement for USAID4s brand' and allbrandsidentities should be of equal si!e and prominence' preferablyalong the bottom of the cover.

#CAGUATI,+ -,C#$S To distinguish #valuations from other type ofpublications also include%

• A Gight ;lue Eeld one or two bars in height behind the evaluation titlewith the word (#valuation) above the title

• A photograph from the proFect being evaluated' and si!ed to cover the

width of the cover' with height ta0ing up = or hori!ontal bars.• Since e&ternal evaluations are not USAID authored' the following

statement must be on the cover% (This publication was produced at therequest of the United States Agency for International Development. Itwas prepared independently by


3/22

I+SID# B$,+T -,C#$ The inside front cover of a publication may be leftblan0 or used for a variety of purposes such as ac0nowledgements' frontcover photo caption' abstracts' etc.H


4/22

*TITG# :A5# $ecommended placement for a title page is the Erst righthandte&t page of a publication8 it may include a repeat of the title and subtitle'communicate an overarching message' etc. It should also include the date'proFect and evaluation identiEcation information' and for evaluations thereshould be a disclaimer per the e&ample below.H

TITLE EASY T!U"DERSTA"D#I"TERESTI"G A"D

S$!RT% I"&LUDE T$E'!RD E(ALUATI!")SUBTITLE M!RE DETAIL# E*G*# S$!RT DES&RI+TI!" !,+R!-E&T BEI"G E(ALUATED .BUT D! "!T USE "AME !,IM+LEME"TI"G +ART"ER !R A&R!"YMS/

*7onth Day' earH

*:roFect +umber 1if one e&ists28 #valuation 7echanism +umber%H

*D#- catalogue number if requested in advance of publicationH

*Any short overarching messageH

DIS-GAI7#$ The author4s views e&pressed in this publication do not necessarily reJect the viewsof the United States Agency for International Development or the United States5overnment.


5/22


6/22

*Section titles and order are illustrative.H

&!"TE"TS

Acronyms....................................................................................................................3

#&ecutive Summary....................................................................................................6

#valuation :urpose and #valuation Kuestions............................................................

:roFect *or :rogramH ;ac0ground...............................................................................@

#valuation 7ethods and Gimitations...........................................................................?

Bindings' -onclusions and $ecommendations..........................................................33

Anne&es...................................................................#rror% $eference source not found

Anne& I% #valuation Statement of /or0...............#rror% $eference source not found3

Anne& II% #valuation 7ethods and Gimitations ........................................................ 9@

Anne& III% Data -ollection Instruments ................................................................... 9@

Anne& IC% Sources of Information............................................................................=

o Gist of :ersons Interviewso ;ibliography of Documents $eviewedo Databaseso *etcH

Anne& C% Disclosure of Any -onJicts of Interest.....................................................

Anne& CI% Statement of DiLerences *only if applicableH.........................................


7/22

A&R!"YMS*#&amples belowH *update based on acronyms used in the reportHADS Automated Directives System

D#- Development #&perience -learinghouseB Biscal earS,/ Statement of /or0USAID U.S. Agency for International Development

3


8/22

E0E&UTI(E SUMMARY The #&ecutive Summary should stand alone as a summary of the 0ey sections of the

report' and should summari!e the content of the full report without adding newinformation. The #&ecutive Summary should ideally be no more than three to fourpages.

E(ALUATI!" +UR+!SE A"D E(ALUATI!" 1UESTI!"S

This should set out the overarching purpose of the evaluation' and how the Endingsare e&pected to be used to inform decisions. This section also describes the#valuation Kuestions 1which should be limited to Fust a few 0ey questions2. It canalso identify 0ey audiences for the evaluation.

+R!-E&T BA&2GR!U"D

#nough information should be provided to give suMcient conte&t. Nowever in the#&ecutive Summary this section can receive less emphasis than it might in theoverall report so that more attention can be given to the evaluation purpose'design' limitations' and Endings. In the main report it should describe the problembeing addressed by the proFect' and the proFect logic for why it will lead to betteroutcomes. This could include a logical framewor0 for the proFect if one e&ists' andthe development hypothesis' or causal logic' of the proFect or program of which theproFect is a part.

E(ALUATI!" 1UESTI!"S# DESIG"# MET$!DS A"D LIMITATI!"S

This section describes the overall design' speciEc data collection and analysismethods lin0ed to the evaluation questions' and limitations of the data' methods' orother issues that aLected the Endings.

,I"DI"GS A"D &!"&LUSI!"S

This section should report those Endings based on evidence generated by theevaluation data collection and analysis methods. Bindings should be factbased andnot rely only on opinion' even of e&perts. -onclusions are drawn directly fromEndings and help summari!e the (so what) of the Endings. Several Endings can leadto one or more conclusions. /henever possible' data should be presented visually ineasy to read charts' tables' graphs' and maps to demonstrate the evidence thatsupports conclusions and recommendations.

6


9/22

9


10/22

E(ALUATI!" +UR+!SE 3

E(ALUATI!" 1UESTI!"SE(ALUATI!" +UR+!SE

The evaluation purpose should be clearly deEned at the beginning of the report. Itshould describe in about one to two pages why the evaluation is being conductednow' how the Endings are e&pected to be used' what speciEc decisions will beinformed by the evaluation' and who the main audiences are for the evaluationreport.

E(ALUATI!" 1UESTI!"S

The evaluation questions are lin0ed to the purpose' and should be listed here. 5oodpractice is to limit the questions in the original statement of wor0 to three to Evethat are clear' focused' and that will directly inform speciEc decisions.


11/22

+R!-E&T BA&2GR!U"DIn one to three pages' this section should clearly outline the proFect 1or program2being evaluated in one to three pages' including the original problem or challenge

the proFect is designed to address and the underlying development hypothesis' orcausal logic' of the proFect or the broader program of which the proFect is a part. If aresults framewor0 1for strategies' obFectives or programs2 or logical framewor0 1forproFects2 is available' this should be included here. Bor proFects designed under theproFect design guidance released in 633' the evaluation team should have accessto the Enal :roFect Appraisal Document and relate anne&es 1which includes a logicalframewor0 and original monitoring and evaluation plans' among other things2. Thisinformation provides important conte&t for understanding the evaluation purpose'questions' methods' Endings and conclusions.

http://www.usaid.gov/our_work/policy_planning_and_learning/documents/PD_Guidance_Final.pdfhttp://www.usaid.gov/our_work/policy_planning_and_learning/documents/PD_Guidance_Final.pdf


12/22

E(ALUATI!" MET$!DS 3

LIMITATI!"S

This section should provide a detailed description within one to three pages of theevaluation methods and why they were chosen. Additional detailed information onthe methods should be provided in an anne&. The reader needs to understand whatthe evaluation team did and why to ma0e an informed Fudgment about thecredibility of the Endings and conclusions and the underlying evaluation designincluding the data collection and analysis methods.

#valuation methods should correspond directly to the questions being as0ed and

should generate the highest quality and most credible evidence possible' ta0ing intoconsideration time' budget and other practical considerations.

:rovide information on all aspects of the evaluation design and methods' includingtrade oLs that led to selection of speciEc data collection and analysis methods' adescription of data availability and quality' and sampling strategies 1purposeful orrandom2' including how interview subFects or site visits were selected. Oust asimportant as describing the evaluation methods is describing any limitations in datacollection and analysis' data quality or access to data sources and that may result inbias. To show the relationship between the evaluation questions and methods' it isuseful to include a chart that lists each evaluation question' the correspondingevaluation method to be used for data collection and analysis' data sources' samplesi!es' and limitations.


13/22

,I"DI"GS# &!"&LUSI!"S 3

RE&!MME"DATI!"S This section is the main body of the report' synthesi!ing what was learned duringthe evaluation and presenting it in an easy to understand and logical fashion./henever possible' data should be presented visually in easy to read charts' tables'graphs' and maps to demonstrate the evidence that supports conclusions andrecommendations.

,I"DI"GS

Bindings are empirical facts based on data collected during the evaluation andshould not rely only on opinion' even of e&perts.

&!"&LUSI!"S

-onclusions synthesi!e and interpret Endings and ma0e Fudgments supported byone or more speciEc Endings.

RE&!MME"DATI!"S

$ecommendations are included if requested in the evaluation statement of wor0.

They are speciEc actions the evaluation team proposes be ta0en by programmanagement that are based on Endings and conclusions. The reader should be ableto discern what evidence supports the conclusions and recommendations.


14/22

A""E0ES*All evaluation reports must include the following as anne&es% 32 the #valuationStatement of /or0' 62 Detailed description of the evaluation design and methods' 92copies of the actual data collection tools such as survey or interview questions' =2 alist of information sources 1including documents reviewed' sites visited' and 0eyinformants' assuming they gave permission to be identiEed2' and' 2 disclosure ofany conJicts of interest by evaluation team members . Additional anne&es such asany Statement of Dierences if applicable' can be included at the discretion of theevaluation team and USAID' and in some cases implementing partners.H


15/22

A""E0 I) E(ALUATI!" STATEME"T !, '!R2

*The Enal #valuation Statement of /or0 that guided the evaluation team should be

included as an anne&.H


16/22

A""E0 II) E(ALUATI!" MET$!DS A"D LIMITATI!"S

$eplace this te&t with the full details of the methods used for data collection andanalysis should be presented here. #&plain why decisions were made to use certain

methods and how those methods were the best available given the evaluationquestions and resources. :rovide details related to how data sources were selected'including sampling methods. If statistical analysis was used' e&plain the powercalculation to determine the sample si!e and conEdence level. If qualitativemethods were used' give details such as whether interviews were structures' howinformants were selected' how sites were selected for direct observation' etc.

If an e&perimental or quasie&perimental impact evaluation' provide detailedinformation on the methods used to randomi!e or to deEne treatment and controlgroups through other means' and how data was collected from both groups atbaseline' midline andor end line.

7a0e sure to include a full and transparent discussion on any limitations to the dataor conclusions from that data that may be due to the methods themselves' dataquality issues' bias' logistical or security constraints' or any other limitations.


17/22

A""E0 III) DATA &!LLE&TI!" I"STRUME"TS

*Include any data collection instruments such as surveys' interview questionnaires'focus group moderator guides' direct observation chec0lists' or any others.H


18/22

A""E0 I() S!UR&ES !, I",!RMATI!"

$eplace this te&t with lists of any documents reviewed' people interviewed' sitesvisited' or any other information sources accessed for the evaluation.

+ote% $emember to get the permission of individuals who are interviewed to usetheir name in the report. If a promise of conEdentiality requires that peopleinterviewed not be identiEed by name' then list the number of interviewees andtheir relationship to the proFect or program being evaluated 1e.g.' 6 clinic patientsthat beneEted from the proFect8 3 doctors that participated in the proFect8 9 localgovernment oMcials8 3 implementing partner employees8 3 local communitymembers who did not participate in the proFect but were eligible to do so8 etc.2.


19/22

A""E0 (I) DIS&L!SURE !, A"Y &!",LI&TS !, I"TEREST

*The #valuation :olicy requires that evaluation reports include a signed statementby each evaluation team member regarding any conJicts of interest. A suggested

format is provided below.H"a4e

Title

!rgani5ation

E6aluation +o7ition8 Team Geader Team memberE6aluation A9ard "u4:er (contract or other instrument)

USAID +ro;ect.7/ E6aluated (Include project name(s),implementer name(s) andaward number(s), if applicable)I ha6e real or intere7t todi7clo7e*

es +o

I> ye7 an79ered a:o6e# Idi7clo7e the >ollo9ing >act7)Real or potential conicts of interest

may include, but are not limited to:! "lose family member who is an

employee of the #S$ID operatin%unit mana%in% the project(s) bein%e&aluated or the implementin%or%ani'ation(s) whose project(s) arebein% e&aluated!

! inancial interest that is direct, or issi%ni*cant thou%h indirect, in theimplementin% or%ani'ation(s) whose

projects are bein% e&aluated or in theoutcome of the e&aluation!

+! "urrent or pre&ious direct orsi%ni*cant thou%h indirecteperience with the project(s) bein%e&aluated, includin% in&ol&ement inthe project desi%n or pre&iousiterations of the project!

-! "urrent or pre&ious wor. eperienceor see.in% employment with the#S$ID operatin% unit mana%in% thee&aluation or the implementin%or%ani'ation(s) whose project(s) arebein% e&aluated!

/! "urrent or pre&ious wor. eperiencewith an or%ani'ation that may be

seen as an industry competitor withthe implementin% or%ani'ation(s)whose project(s) are bein%e&aluated!

0! 1reconcei&ed ideas towardindi&iduals, %roups, or%ani'ations, orobjecti&es of the particular projectsand or%ani'ations bein% e&aluatedthat could bias the e&aluation!

I certify 132 that I have completed this disclosure form fully and to the best of my ability and162 that I will update this disclosure form promptly if relevant circumstances change. If I gain


20/22

access to proprietary information of other companies' then I agree to protect theirinformation from unauthori!ed use or disclosure for as long as it remains proprietary andrefrain from using the information for any purpose other than that for which it was furnished.Signature

Date


21/22

A""E0 (I) [I"SERT TITLE]

*,ther information' such as a Statement of DiLerences' can be provided as ananne& as appropriate' and as determined by the evaluation team' USAID' or' insome cases' the implementing partner.


22/22

*:rovide contact information on the bac0 cover. This can be USAID headquarterinformation' or speciEc to the USAID mission or operating unit that commissionedthe report.H

U.S. Agency for International Development39 :ennsylvania Avenue' +/

/ashington' D- 669

Sample Evaluation Report Template

Documents

Transcript of Sample Evaluation Report Template