Interactive Focus Groups Workshop New · What is an Interactive Focus Group? •Engages...
Transcript of Interactive Focus Groups Workshop New · What is an Interactive Focus Group? •Engages...
InteractiveFocusGroups3rd AnnualEvaluationLabWorkshopCharlaHenley,UNMEvaluationLabTeamLead
[email protected],2018
Draw:
Howdidyoufeelaboutevaluationbefore thisworkshopandhowdoyoufeelaboutitnow?
4/27/18 UNMEvaluationLab:InteractiveFocusGroups 2
SpeedDating:
Whatnew evaluationideasortechniquesdidyoulearntoday?
4/27/18 UNMEvaluationLab:InteractiveFocusGroups 3
GroupLists:
Practicalstepsforimplementingideasandtechniquesyoulearnedtoday.
4/27/18 UNMEvaluationLab:InteractiveFocusGroups 4
Individual:
Whodidyouconnect with?
Whatdidyoulearn fromthem(ifanything)?
4/27/18 UNMEvaluationLab:InteractiveFocusGroups 5
Individual:
Whatdidyouthinkoftheoverallworkshop?Whatdidyouenjoy?Whatwouldyouchange?Whatwouldyouliketosee nextyear?
4/27/18 UNMEvaluationLab:InteractiveFocusGroups 6
InteractiveFocusGroups– 4W1H
• What,When,Why,Who&How?
4/27/18 UNMEvaluationLab:InteractiveFocusGroups 7
WhatisanInteractiveFocusGroup?• Engagesparticipatesinpre-planned activitiestogetanswerstoquestions• Typicallyinvolveswriting,drawing,talkingwithoneotherperson,talkingwiththewholegroup
4/27/18 UNMEvaluationLab:InteractiveFocusGroups 8
WhencanyouuseanInteractiveFocusGroup?• Anytimeyouthinkyoumightbenefitfromavarietyofdatacollectionmethods• Whenyouwanttoknowhowyourparticipantsexperiencedyourprogramandif/howitchangedthem
4/27/18 UNMEvaluationLab:InteractiveFocusGroups 9
WhyuseanInteractiveFocusGroup?• Engagesthetalkers andthelisteners• Allowsmultiplemeansofcommunicatingresponses(verbal,written,drawn)
• Speedsuptranscriptiontime• Theyarefun foryou&participants!• Endupwithcooldrawingstouseinfinalreports.
4/27/18 UNMEvaluationLab:InteractiveFocusGroups 10
EnlaceComunitario YouthLeadersEvaluation
• EvaluationGoal:ImpactoftheprogramonYouthLeadersthemselvesasaresultoftheirtrainingandparticipationintheYouthLeadersprogram.• Activity:AddcharacteristicstothegingerbreadpersontomakehimorhertheperfectYouthLeader
4/27/18 UNMEvaluationLab:InteractiveFocusGroups 11
EnlaceComunitario RelacionesSaludables EvaluationEvaluatingachievementofthegoaltohavelastingimpactongraduates.• Activity:ListonenewthingyoulearnedfromeachthemeintheHealthyRelatingCourse.
4/27/18 UNMEvaluationLab:InteractiveFocusGroups 12
EvaluationoftheEvaluationLab(Eval^2)
Evaluatingachievementofsupportingstudentsindevelopingtheknowledge,skills,andtoolstheyneedtodesignandimplementprogramevaluationsthatreflectorganizations’valuesandmissions.• Activity:Drawthetoolsyounowhaveinyourevaluationtoolbox!
4/27/18 UNMEvaluationLab:InteractiveFocusGroups 13
EvaluationoftheEvaluationLab(Eval^2)Evaluatingachievementofsupportingstudentsindevelopingtheknowledge,skills,andtoolstheyneedtodesignandimplementprogramevaluationsthatreflectorganizations’valuesandmissions.
• Oneofthequestions:Whatdidthecoursefeellikeforstudents?
• Activity:Drawwhatyoufeltlikeonthisgingerbreadperson.
4/27/18 UNMEvaluationLab:InteractiveFocusGroups 14
WhocandotheInteractiveFocusGroup?• Externalevaluator• You!
4/27/18 UNMEvaluationLab:InteractiveFocusGroups 15
How?Buildingtheprotocol (script)
BuildingtheProtocol
1. Articulatetheevaluationgoals2. Assignactivities toeachgoal3. Listmaterials neededtocompleteeachactivity4. Assigntimeframe toeachactivity
4/27/18 UNMEvaluationLab:InteractiveFocusGroups 17
Step1:OurEvaluationGoalsAftertheWorkshop,participantswill:1. feelpositivelyabouttakingonevaluationsthatare
possibleandmeaningful;2. learnsomethingaboutevaluationthatappliestothem;3. learnfromeachotherandabouteachotherin
conversation(network);4. recognizegrindthinking(survivalmode)vs.mission
thinkingandbemotivatedintomissionthinking;and5. learndifferentoptionsforevaluationthatarewithin
reach.
4/27/18 UNMEvaluationLab:InteractiveFocusGroups 18
Step2:PossibleActivitiesGingerbreadPerson– individual◦ Expresssentimentsaboutsomething(feeling)SpeedDating– pairs◦ Shortquestions◦ Answerwithapartner(moreprivate)GroupLists– groupsofnomorethan5◦ Lessprivate,butgivesopportunitytobrainstormIndividualAnswers– individual◦ Entirelyprivate◦ Opportunitytosharefreely◦ Canbedrawn,listed,paragraph,etc.PlusandDelta– biggroup,individual◦ Givesparticipantsachancetovoicethoughtsaboutprograminquestion
4/27/18 UNMEvaluationLab:InteractiveFocusGroups 19
Step2(con’t):AssigningActivitiesAftertheWorkshop,participantswill:1. feel positivelyabouttakingonevaluationsthatarepossibleand
meaningful- Activity:GingerbreadPerson2. learnsomethingaboutevaluationthatappliestothem- Activity:
SpeedDatingand GroupLists3. learnfrom eachotherandabout eachotherinconversation
(network)- Activity:IndividualAnswers4. recognizegrindthinking(survivalmode)vs.missionthinkingand
bemotivatedintomissionthinking- Activity:GroupLists5. learndifferentoptionsforevaluationthatarewithinreach-
Activity:GroupLists
4/27/18 UNMEvaluationLab:InteractiveFocusGroups 20
Step3:Materials!
• GingerbreadPerson– eitherflipchartwithgingerbreadpersondrawnor printoutsofgingerbreadperson,markers,pens• SpeedDating– flashcards,tape,markers,questionsprintedorwrittenontheboard• IndividualAnswers– flashcards,pens• GroupLists– flipchartorflashcards,tape,markers,printedoutvisualoftheactivity• Plusanddelta– flipchart,markers,alsopens,paperforthosewhomaynotwanttoshareoutloud
4/27/18 UNMEvaluationLab:InteractiveFocusGroups 21
Step4:Timeframe
• Stronglybasedinhowlongyouhaveforthegroup• Actualtimeineachactivityshouldallowformovement,explanation,questions• Activitytimesintheprotocol willbeshorterthanhowlongtheoverallactivityactuallytakes
• Today– 40minutes• GingerbreadPerson– Participantsget5minutes– totalactivitytime10minutes
• SpeedDating– Participantsget4minutes– totalactivitytime10minutes• GroupLists– Participantsget5minutes– totalactivitytime10minutes• IndividualAnswers(includingPlusandDelta)– Participantsget5minutes– totalactivitytime10minutes
4/27/18 UNMEvaluationLab:InteractiveFocusGroups 22
OurProtocol
• Seehandout– emailmeforacopy([email protected])• Wewillpostonworkshopwebsite
4/27/18 UNMEvaluationLab:InteractiveFocusGroups 23
ClosingandNextSteps• InteractiveFocusGroups:
• Engagethetalkersandthelisteners• Speeduptranscriptiontime• Arefunforyouandtheparticipants!
• AfteryourInteractiveFocusGroup:• Takepicturesofeverythingpostedonthewallsoroneaselssoyoucantypeintoexcelorword.• Debrief:Askyourself,howdiditgo?Whatcouldhavebeenbetter?• Reviewdata:trytohighlight thediversityofideasandthecommonthemes
4/27/18 UNMEvaluationLab:InteractiveFocusGroups 24
Questions,thoughts,ideas?
• Wewillsendallparticipantsawrite-upoftheworkshopevaluation!
4/27/18 UNMEvaluationLab:InteractiveFocusGroups 25