Logic Models and Evaluation
Transcript of Logic Models and Evaluation
LogicModelsandEvaluationUNMEvaluationLabSummerInstitute
CharlaHenley,MA,[email protected] /evallab.unm.edu
Summer2019
22July2019 UNMEvaluationLabSummerInstitute- LogicModels 2
LearningobjectivesUnderstandwhatalogicmodelisandwhyit’ssousefulDistinguishbetweenoutputsandoutcomesIdentifyhowregularactivitiesdriveyourmissionTreatthelogicmodelasalivingdocumentDeterminetheassumptions/beliefsthatsupportyourlogicmodel
22July2019 UNMEvaluationLabSummerInstitute- LogicModels 3
WhatisaLogicModel?
Alogicmodelisaone-pagedescriptionofyourprogramthatshowsthelogicalstepsfrominputstoactivitiestooutputsandoutcomes.Thelogicmodelcanbeachart,illustrationortable.
Note:Itisalivingdocument!
22July2019 UNMEvaluationLabSummerInstitute- LogicModels 4
WhyisitsogreattohaveaLogicModel?
• Ifdevelopedorreviewedregularlybystakeholders,itgetseveryoneonthesamepage,andworkingtogether.
• Itprovidesaroadmapfordesigningevaluationactivitiesthatcanhelpyouassessyourprogressandsuccess,andprovideguidanceforbecoming(evenmore)effective.
• Ithelpsyoufigureoutifyourprogrammakessense!
22July2019 UNMEvaluationLabSummerInstitute- LogicModels 5
LogicModelDefinitions
Alogicmodelwillhighlightandlink:• Shortandlongtermoutcomes• Outputs• Activities• Resourcesandinputs
• Assumptions– beliefs• ExternalFactors– barriers
22July2019 UNMEvaluationLabSummerInstitute- LogicModels 6
LogicModelDefinitions,continued
Outcomes=Changesinparticipants’behavior,Knowledge,Skills,Leveloffunctioning,Outlook,Lifetrajectories.Outcomesaretheevidencethatyourprogramishavingthedesiredsuccessinmakingadifference.
22July2019 UNMEvaluationLabSummerInstitute- LogicModels 7
LogicModelDefinitions,continued
Short-termOutcomes:Whatyouwanttoseeforaparticipantonthedayheorshecompletesyourprogram
Long-termOutcomes:Whatyouhopeparticipantstakewiththemintothefuture.
22July2019 UNMEvaluationLabSummerInstitute- LogicModels 8
LogicModelDefinitions,continued
Outputs=theobservablethingsthattheactivitiesproduce:
#ofparticipants#ofeventsmealsservedOutputsaretheevidencethatyouaredoingwhatyouplannedtodo.
22July2019 UNMEvaluationLabSummerInstitute- LogicModels 9
LogicModelDefinitions,continued
Activities=Whatyouaredoingwhenyourprogramishappening:• Classes• Counseling• Homevisits• Events• Etc.
22July2019 UNMEvaluationLabSummerInstitute- LogicModels 10
LogicModelDefinitions,continued
Resources=Thethingsandpeoplethatyouneedtooperateyourprogram:• Space– forstaffmeetings,clientmeetings,storage,groupactivities,etc.
• Grantsanddonations– Fundingsources.• Dedicatedstaff– Administrative,operations,legal• Training– fornewstaff,certifications,licensing• Etc.
22July2019 UNMEvaluationLabSummerInstitute- LogicModels 11
LogicModelDefinitions,continued
• Assumptions– Beliefs• Thesearethebeliefsyouhaveaboutwhatwillworkandwhy
• ExternalFactors– Barriers• Whatmightlimitorbeanobstacletosuccess?
22July2019 UNMEvaluationLabSummerInstitute- LogicModels 12
LogicmodeltemplateInputs Activities Outputs Outcomes
Short Long
Assumptions External Factors22July2019 UNMEvaluationLabSummerInstitute- LogicModels 13
LogicModelExample1Inputs
HumanCapital
PB&JFamiliesLeadershipteamDirectservicestaff
SupportstaffBoardofDirectorsVolunteers&Interns
Professionaldevelopment
FinancialCapitalBraided&leveragedapproachtofinancial
sourcesPrivatedonations
Government&privategrants
SocialCapitalReputationincommunity,
Communitypartners&funders,Evaluation
Accreditation
PhysicalCapital
Physicalsitesembeddedincommunity,Furniture,
Medicalsupplies,Communicationequipment
Transportation,FacilitiesandMaintenance
Interactionswithothersaregenuinelyhopeful,welcoming,respectful,
nonjudgmental,positiveandvalidating
Responsiveness&adaptabilityallowsustomeetpeoplewheretheyare,helpthem
buildontheirstrengthsandsupportthe
capacitytocopeintheirjourneytohealpast
trauma
Heart-CenteredApproach
Program
ParentandchildrelationshipChilddevelopment
assessmentsChilddevelopment
curriculumEarlyinterventionservices
Pre-kindergartenHomevisiting
CasemanagementSocialworkCounseling
Speech,occupational,andphysicaltherapy
NursingTransportation
Meals
Activities
CoalitionbuildingPubliceducation
Politicalaction
Advocacy
IntermediateBenchmarks
Mutualtrust
Programinvestment
Participation Family
INTACTHealthy
attachment
Nurturing&SAFEENVIRONMENT
Hassocialnetwork
Familyresilience
Socialnetwork
Accesstoconcretesupports(food,housingemployment,childcare,
healthcare&education)
ParentPositiveparenting
skills
Socially&emotionallycompetent
Advocatesforself,childandfamily
Understandschilddevelopment
Outcomes
Child
OPTIMALDEVELOPMENT
Healthy,resilient,&socially&emotionallycompetent
Self-advocacyREADYFORSCHOOL
Policy
Statewidechildabusepreventionprogram
Publichealthapproachtoinfantandchildhoodhealth
Adequatesocialsupportforbasicfood,housing,
employment,healthcareandeducationneeds
Transparentandaccessibledata
Assumptions: Regardlessofbackgroundorhistoryeveryfamilyisworthyanddeservessupport,andthepreservationoffamilyserveschildrenandcommunity.Everyfamilyandculturehasstrengths,identifyingthemthroughearlysupportandcollaborativeeffortsmakesallthedifferenceandcreatesthegreatestchangeandimpact.Weallcanchange,everyindividualisworthwhileandeverychilddeservessupportwithoutlabelingorstigma,ourjusticecouldberestorativeandchildabusecanbeprevented.
Assets: Diversity,culture,climate,naturalbeauty,intergenerationalfamilies,creativeandprogressivecommunity,UNM,Medicaid.
External Factors: Poverty,intergenerationalviolence,inadequatefundingforsocialservices,isolation,inadequatetransportation,perceptionsofsingleparentfamilies,nocomprehensivestatewidechildabusepreventionplan,fragmentedhealthmentalhealthsystem,lackofaddictionservices,lackofaffordablehousing,oppressiontowardsmarginalizedgroupsbecauseofsystemicracism.Noaccesstostatedata.
Staffwithfamilies
Parentswithchildren
Allwithcommunity
ReflectiveParallelProcess
Perceptions
Publicawarenessabouttrauma,resilienceand
protectivefactorsandtheimportance
ofprevention
Growth
Awarenessofstrengths
Feelingprotected&supported
Increasedcapacitytocope
Ownershipforactions,accountability
ReducedImpulsivity
Parent&childresilience
Identifyingrealisticgoalsandstepstoreachthem
Connectiontosupports
Creatingowncommunity
SafetyPlanning
Providingprotection&supportforchildren
Fewertriggers,moreoptions
Improvednurturingandsignsofattachment
Action
PB&JLOGICMODEL
StrategyStartearly
MultigenerationalParentingskills&
knowledgeConcretesupportReferraltoservices
Engagesocialsupportnetwork
Children grow to full potential in
nurturing families and a supportive
community
22July2019 UNMEvaluationLabSummerInstitute- LogicModels 14
Benefitstousingtemplate1
• Showsdirect connectionbetweeninput/activityandoutput,outcome• Helpsteamthinkthroughtruepurposeofalleffortsandactivities• Canhelpre-direct energy
22July2019 UNMEvaluationLabSummerInstitute- LogicModels 15
LogicmodeltemplateResources/Inputs Activities Outputs Short-TermOutcomes Long-TermOutcomes
22July2019 UNMEvaluationLabSummerInstitute- LogicModels 16
Assumptions: ExternalFactors:
CentroSávila LogicModel– ClinicalServicesExample2
22July2019 UNMEvaluationLabSummerInstitute- LogicModels 17
Resources Activities Outputs Stepping Stones Outcomes-Circle of Security & Nurture Heart Training
-Staff support
-Reflective Supervision
-Clients’ commitment to grow & build resiliency
-Physical building, rooms
-Grants & other funding
-Art & crafts supplies
-Sensory items/tables
-Community support and engagement
-Volunteers
-Knowledge & experience both
-Events-fall festival
-Groups• Life skills• Jovencit@s• Parenting
Crianza 1 & 2• Women’s support group• Music class • Individual services
(Adults & kids)
-Nurtured Heart Approach
-Individual & family therapy Case management • Legal resources • Child Advocacy • Immigration Services • Educational Services• Housing • Financial Resources
- Number of adults and children attending program
- Number of sessions offered
- Number of participants in attendance
- Number of participants completing program
- Number completing assessments
-Number of stress events reduced
-Increased positive language used in children
-Reports of less violence in home
-Child reports doing better in school, behavior and/or grades
-Broader vocabulary of positive qualities and knowing how it applies to themselves
-Can make eye contact
-Straighter posture• Assertive
communication• More expressions
-Using relaxation techniques
Short
-Better coping skills• Emotionally healthy responses
to child’s stress/ hardship
-Taking care of themselves (parents)
-Self-esteem (children)
-Able to identify one positive thing about themselves (parents & children)
-Recognize responsibility as a parent
-Children know they are not at all at fault for difficult situations.
-Time-out for parents• How parents react with children • Increase self-awareness
(reason why they are doing certain things like raising their voices)
-Children can recognize tools & people to enhance their safety
Long
-Improved parent-child relationship
-Parent is emotionally supportive
-More attentive
-Able to handle difficult emotions better (parents and children)
-Able to recognize child’s emotional state easier
-Improved emotional quality of life• More positive feelings• Connection with
parent & child • Feeling of safety/
security
EnlaceComunitarioLogicModelExample3
22July2019 UNMEvaluationLabSummerInstitute- LogicModels 18
Benefitstousingtemplate2
• Faster andsimpler thantemplate1• Greatstarting point• Getsteamonthesamepagewithprogramdirection
22July2019 UNMEvaluationLabSummerInstitute- LogicModels 19
YourTurn
- Logicmodel- Startalogicmodel:focusonoutcomes- Reviewalogicmodel:areyourshort-termandlong-termoutcomesreasonable(areyouwillingtobeheldaccountableforthem)?
22July2019 UNMEvaluationLabSummerInstitute- LogicModels 20