Measuring the Impact of Dementia-Friendly Education and ... · Web view, peer-reviewed literature...
Transcript of Measuring the Impact of Dementia-Friendly Education and ... · Web view, peer-reviewed literature...
Measuring the Impact of Dementia-Friendly Education and Training Sessions: A Toolkit
September 2019
Prepared for
Erin Long, MSWAdministration on Aging
Administration for Community Living330 C Street, SW
Washington, DC 20201
Prepared by
Heather L. Menne, PhDRTI International
3040 Cornwallis Rd.Research Triangle Park, NC 27709
Lourdes R. Guerrero, EdD, MSWDavid Geffen School of Medicine at UCLA
10833 Le Conte Ave, 17-348 CHS Los Angeles, CA 90095
Contract # HHSP233201600021IAdministration for Community Living
U.S. Department of Health and Human Services
Table of ContentsAcknowledgements.....................................................................................................................................1
Background..................................................................................................................................................2
Process for Developing the Recommended Tools.......................................................................................3
Recommended Tools...................................................................................................................................4
Brief Tool for Dementia-Friendly Education and Training Sessions: Individual Trainings............................5
Pre-Workshop Questions.........................................................................................................................5
Post-Workshop Questions.......................................................................................................................6
Brief Tool for Dementia-Friendly Education and Training Sessions: Organizational or Sector Trainings.....7
Pre-Workshop Questions.........................................................................................................................7
Post-Workshop Questions.......................................................................................................................8
Brief Tools for Dementia-Friendly Education and Training Sessions: Instructions.....................................10
Instructions............................................................................................................................................10
Scoring...................................................................................................................................................10
Reporting...............................................................................................................................................16
Brief Tool for Dementia-Friendly Education and Training Sessions: Annotated........................................21
Pre-and Post-Workshop Questions for Individual and Organizational/Sector Tool...............................21
Post-Workshop Question for Individual Tool.........................................................................................21
Pre-Workshop Question for Organizational/Sector Tool.......................................................................22
Post-Workshop Question for Organizational/Sector Tool.....................................................................22
Notes.....................................................................................................................................................22
1
Acknowledgements
The National Alzheimer’s and Dementia Resource Center gratefully acknowledges
the Dementia-Friendly Evaluation Workgroup.
Co-Chairs
• Heather Menne (National Alzheimer’s and Dementia Resource Center)
• Lourdes Guerrero (University of California, Los Angeles)
Workgroup Members
• Jennifer Carson (University of Nevada, Reno)
• Jennifer Heston (Miami University)
• Suzanne Kunkel (Miami University)
• Christine McKibbin (University of Wyoming)
• Christy Nishita (University of Hawaii)
• Peter Reed (University of Nevada, Reno)
The National Alzheimer’s and Dementia Resource Center also is grateful for the
leadership and review of Erin Long of the Administration on Aging/Administration for
Community Living. This paper was produced under contract with RTI International
through Contract Number HHSP233201600021I with the Administration for Community
Living/U.S. Department of Health and Human Services.
This paper is the work of the National Alzheimer’s and Dementia Resource Center
and does not necessarily express the opinions of the Administration on Aging/
Administration for Community Living, the U.S. Department of Health and Human Services,
or RTI International.
2
BackgroundIn 2019, the Administration for Community Living (ACL), the National Alzheimer’s
and Dementia Resource Center (NADRC), and a group of evaluators for ACL grants that
involved dementia-friendly activities collaborated to create brief tools to measure the
impact of dementia-friendly training and education efforts. This work is part of the
evolution of dementia-capable states and communities. Encouraging the development of
dementia-friendly communities is one element of a model dementia-capable system.1
The Dementia-Friendly Evaluation Workgroup (hereafter referred to as the
Workgroup) was convened to create the brief tools. The Workgroup included ACL staff
from the Administration on Aging, NADRC staff, and evaluation representatives from five
ACL Alzheimer’s Disease program grantees. It was understood that the resulting tools
would be used for future dementia-friendly activities to address individual- and
organizational/sector-level dementia-friendly training and education. It was acknowledged
that local communities may opt to also collect data specific to their program and that the
brief tools created by the Workgroup would be common measures collected across all
programs. The aim of the Workgroup was to:
Identify a core, limited set of items to measure impact of dementia-friendly training.
The Workgroup used a participatory and consensus approach where all members
were able to contribute, advocate, and discuss the ideas presented. The Workgroup
engaged in rich and robust discussion on varying approaches to states and communities
becoming dementia-friendly, the benefits and challenges of process and outcome
evaluations, data collection tools for measuring impact, and the key outcomes of dementia-
friendly education and training. Early in the discussions, the range of outcomes to consider
included knowledge, attitudes, empathy, awareness, readiness, inclusion, accessibility, and
behavior/practice change. Based on consensus achieved among the group, the final
outcomes to be measured in the brief tools are:
• Knowledge
• Attitudes
• Behavior/Practice Change
1 Gould, E., Menne, H., McCallion, P., Hughes, S. & Shuman, S. (2019, September). Dementia-capable states and communities: Lessons learned from Administration on Aging grantees. Prepared for the U.S. Administration on Aging/Administration for Community Living. Available at https://nadrc.acl.gov/node/93
3
We expect that there will be an increase in knowledge and attitudes about dementia
after attending a structured dementia-friendly education and training session, and we
expect that session attendees will report intent to make behavior or practice change
related to the dementia-friendly education and training session. The resulting tools are a
result of full consensus on some items and majority approval on other items.
The method for identifying the core items included conference calls and interim
work on the part of the Workgroup. The next section outlines the steps taken to develop
the recommended tools for measuring the impact of dementia-friendly training.
Process for Developing the Recommended Tools
Seven evaluators were active participants for the 4 months of the Workgroup’s
duration, and one of these evaluators served as the lead facilitator for the Workgroup. The
Workgroup convened from April through July 2019, with five conference calls (typically
lasting 90 minutes) and activities to complete between calls. The Workgroup began with a
description of each grantee’s dementia-friendly effort and a sharing of evaluation plans and
related resources.
The Workgroup developed a matrix for key domains, which included questions or
topics within those domains and whether the questions were most relevant at the
individual or organizational/sector level. Over the course of two calls and work between
calls, the Workgroup focused on three outcomes (i.e., knowledge, attitudes, and behavior/
practice change) and identified and reviewed specific questions for each outcome from
existing instruments. As documented in the Brief Tool: Annotated, peer-reviewed literature
of validated measures and evaluations of local dementia-friendly efforts served as
resources in the development of the recommended brief tools. During the last two calls, the
Workgroup discussed and refined the proposed questions for each outcome, including the
response options and nuances of word choice. Between and after these last calls, the
Workgroup shared written comments on the tools. Program staff from grants conducting
dementia-friendly activities provided feedback on the content, understandability, and
burden of a draft tool. Feedback from program staff was critical for the final adjustments
made to these tools.
As outlined above, the brief tools were derived from existing validated measures
and evaluations of local dementia-friendly efforts. We have not conducted interviews with
individuals who are likely to complete these tools in order to know if the questions are
4
understood as intended or if the terms used are the most accessible, nor have these new
brief tools undergone a validation study. We expect that the use of these tools by local
dementia-friendly programs will inform how feasible they are to use in a range of
dementia-friendly education and training sessions and whether the tools serve as valid
measures of change associated with the education and training sessions.
Recommended Tools
Two brief tools; a set of instructions for the use, scoring, and reporting of the brief
tools; and an annotated version of the tools (documenting the sources of the questions)
were developed based on the input and guidance of the Workgroup. The resulting
documents are included in this toolkit:
• Brief Tool for Dementia-Friendly Education and Training Sessions: Individual
Trainings
• Brief Tool for Dementia-Friendly Education and Training Sessions: Organizational
or Sector Trainings
• Brief Tool for Dementia-Friendly Education and Training Sessions: Instructions
• Brief Tool for Dementia-Friendly Education and Training Sessions: Annotated
5
Brief Tool for Dementia-Friendly Education and Training Sessions
Individual Trainings
Pre-Workshop Questions
Knowledge QuestionsAfter reading the statements below, please circle the correct answer.
1. Dementia is part of normal aging. True False2. Dementia is not just about having memory problems. It can affect
thinking, communication and everyday tasks.True False
3. People with dementia may express themselves or communicate through actions instead of words.
True False
Attitude QuestionsOn a scale from 1 to 5, circle the number you feel reflects your feelings about each statement.
1. I am confident interacting with people with dementia.
Strongly disagree
1
Disagree2
Neutral 3
Agree4
Strongly agree
52. People with dementia need to
feel respected, just like anyone else.
Strongly disagree
1
Disagree2
Neutral 3
Agree4
Strongly agree
5
3. I can respond to people with dementia with understanding.
Strongly disagree
1
Disagree2
Neutral 3
Agree4
Strongly agree
5
4. I am motivated to get to know people with dementia better.
Strongly disagree
1
Disagree2
Neutral 3
Agree4
Strongly agree
5
6
Post-Workshop Questions
Knowledge QuestionsAfter reading the statements below, please circle the correct answer.
1. Dementia is part of normal aging. True False2. Dementia is not just about having memory problems. It can affect
thinking, communication and everyday tasks. True False
3. People with dementia may express themselves or communicate through actions instead of words.
True False
4. Did you learn about accessing community resources related to dementia as part of this workshop/training/session?
Yes No
Attitude QuestionsOn a scale from 1 to 5, circle the number you feel reflects your feelings about each statement.
1. I am confident interacting with people with dementia.
Strongly disagree
1
Disagree 2
Neutral 3
Agree4
Strongly agree
5
2. People with dementia need to feel respected, just like anyone else.
Strongly disagree
1
Disagree 2
Neutral 3
Agree4
Strongly agree
5
3. I can respond to people with dementia with understanding.
Strongly disagree
1
Disagree 2
Neutral 3
Agree4
Strongly agree
5
4. I am motivated to get to know people with dementia better.
Strongly disagree
1
Disagree 2
Neutral 3
Agree4
Strongly agree
5
Behavior Question1. Which of the following actions will you take to create a more dementia friendly and
inclusive community?
Put a check next to each action you will take. Select as many as you like. ✔ Offer support to people with dementia Offer support to caregivers of people with dementia Volunteer for an organization that helps people with dementia or their caregivers Make my home more dementia friendly Make my workplace more dementia friendly Make my community more dementia friendly Encourage my friends to become dementia friendly Be more patient with people with dementia when out in the community Are there any other actions you will take? Please list them below:
7
Brief Tool for Dementia-Friendly Education and Training Sessions
Organizational or Sector TrainingsPre-Workshop QuestionsWhich category best describes the organization you represent at this training? (Please mark ONLY ONE)
□ Legal Services □ Banks / Financial Services
□ Neighbors / Community Member
□
Government Agencies
□ Emergency Planning / First Responder
□ Libraries □ Communities of Faith
□ Business / Retail
□ Transportation Services
□ Hospitals / Acute Care Settings
□ Residential Care □ Food service/ Restaurant
□ Other, please specify:
Knowledge QuestionsAfter reading the statements below, please circle the correct answer.
1. Dementia is part of normal aging. True False2. Dementia is not just about having memory problems. It can affect
thinking, communication and everyday tasks.True False
3. People with dementia may express themselves or communicate through actions instead of words.
True False
Attitude QuestionsOn a scale from 1 to 5, circle the number you feel reflects your feelings about each statement.
1. I am confident interacting with people with dementia.
Strongly disagree
1
Disagree2
Neutral 3
Agree4
Strongly agree
5
2. People with dementia need to feel respected, just like anyone else.
Strongly disagree
1
Disagree2
Neutral 3
Agree4
Strongly agree
5
3. I can respond to people with dementia with understanding.
Strongly disagree
1
Disagree2
Neutral 3
Agree4
Strongly agree
5
4. I am motivated to get to know people with dementia better.
Strongly disagree
1
Disagree2
Neutral 3
Agree4
Strongly agree
5
8
9
Post-Workshop QuestionsKnowledge QuestionsAfter reading the statements below, please circle the correct answer.
1. Dementia is part of normal aging. True False2. Dementia is not just about having memory problems. It can affect
thinking, communication and everyday tasks. True False
3. People with dementia may express themselves or communicate through actions instead of words.
True False
4. Did you learn about accessing community resources related to dementia as part of this workshop/training/session?
Yes No
Attitude QuestionsOn a scale from 1 to 5, circle the number you feel reflects your feelings about each statement.
1. I am confident interacting with people with dementia.
Strongly disagree
1
Disagree2
Neutral 3
Agree4
Strongly agree
52. People with dementia need to
feel respected, just like anyone else.
Strongly disagree
1
Disagree2
Neutral 3
Agree4
Strongly agree
5
3. I can respond to people with dementia with understanding.
Strongly disagree
1
Disagree2
Neutral 3
Agree4
Strongly agree
5
4. I am motivated to get to know people with dementia better.
Strongly disagree
1
Disagree2
Neutral 3
Agree4
Strongly agree
5
Behavior/Practice Change Question1. Which of the following actions will you take to create a more dementia friendly and
inclusive community?
Put a check next to each action you will take. Select as many as you like. ✔ Offer support to people with dementia Offer support to caregivers of people with dementia Volunteer for an organization that helps people with dementia or their caregivers Make my home more dementia friendly Encourage my friends to become dementia friendly Be more patient with people with dementia when out in the community Make sure staff/co-workers are educated about effective communication strategies when interacting with people with dementia
Adapt current services or put new services in place for people with dementia Adapt current services or put new services in place for dementia caregivers Adopt employee benefits practices that are supportive of family caregivers of persons with dementia
10
Put a check next to each action you will take. Select as many as you like. ✔ Make environmental changes in my organization or public space (e.g., establish places to rest or quiet rooms and spaces; maps/signage; lighting; contrasting surfaces)
Are there any other actions you will take? Please list them below:
11
Brief Tools for Dementia-Friendly Education and Training Sessions
Instructions
Instructions
These brief tools are designed to measure the impact of dementia-friendly
education and training sessions. Structured dementia-friendly education and training
sessions may be part of programs that aim to build a dementia-friendly community (e.g.,
Dementia Friendly USA, Dementia Friends).
When should these brief tools be used?These brief tools should be used before (items labeled “Pre-Workshop”) and after
(items labeled “Post-Workshop”) structured dementia-friendly education and training
sessions.
When should these brief tools not be used?These brief tools should not be used for dementia-friendly recruitment and
marketing/outreach activities.
How should these brief tools be used?The questions from the brief tools can be printed double-sided and distributed for
completion before (Pre-workshop) and then after (Post-workshop) education and training
sessions.
Alternatively, programs may want to add the questions in these brief tools to other
questions that are important to their specific program. In this case, these items can be
copied and pasted into the format most suitable for the program to collect pre- and post-
workshop data.
Scoring
Programs using the brief tools can understand the impact of their dementia-friendly
education and training sessions by using the scoring process described here. Using these
steps, programs can calculate descriptive information from the pre-workshop and post-
workshop data and calculate the change from pre-workshop to post-workshop for items
12
asked at both times. The next sections are broken down by one organization item and the
following outcomes: knowledge, attitudes, behavior/practice change.
Organization DescriptionTable 1 contains wording of the organization question in the Organizational/Sector
tool, the coding or values that correspond to the responses, and a description of how to
calculate descriptive scores.
Table 1. Organization Description Questions, Coding, and Scoring CalculationsQuestion* Coding / Values for Responses To calculate descriptive
information Which category best describes the organization you represent at this training?
Legal Services = 1Banks/Financial Services = 2Neighbors/ Community Member = 3Government Agencies = 4Emergency Planning/First Responder = 5Libraries = 6Communities of Faith = 7Business/Retail = 8Transportation Services = 9Hospitals/Acute Care Settings = 10Residential Care = 11Food Service/ Restaurant = 12Other = 13
Count of attendees by categoryFormula: # of all attendees marking a category (repeat for each category)
% of attendees by categoryFormula:% = 100*(# of all attendees marking a category/ # of total attendees)(repeat for each category)
* This question only appears in the Organizational/Sector Tool.
Organization Description ExampleUsing the formulas outlined above, Table 2 contains sample responses to the pre-
workshop organization Description question and the resulting descriptive scores. For
example, one person had a value of 5 (Emergency Planning/First Responder), one person
had an 8 (Business/Retail), one person had a 10 (Hospitals/Acute Care Settings), two
people had 11 (Residential Care), and one person had a 12 (Food Service/Restaurant).
Therefore 16.7% were in Emergency Planning/First Responder (100*[1/6]), 16.7%
Business/ Retail (100*[1/6]), 16.7% Hospitals/Acute Care Settings (100*[1/6]), 33.3%
Residential Care (100*[2/6]), and 16.7% were Food Service/Restaurant.
Table 2. Organization Description Question: Calculation ExampleAttendee Response
1 52 83 124 115 106 11
Note: All numbers are for demonstration purposes only.
13
KnowledgeTable 3 contains the wording of the knowledge questions, the coding or values that
correspond to the responses, and descriptions of how to calculate descriptive scores and
change scores (when appropriate).
Table 3. Knowledge Questions, Coding, and Scoring CalculationsQuestion Coding /
Values for Responses
To calculate descriptive information for Pre-workshop data (or Post-workshop data)
To calculate change from pre-workshop to post-workshop
Dementia is part of normal aging.
True = 0False = 1 (correct answer)
% of attendees who report “False” Pre-workshop (or Post-workshop)Formula:% = 100*(# of attendees who report “False” Pre-workshop (or Post-workshop)/ # of total attendees)
% change of attendees who report “False” Pre-workshop to attendees who report “False” Post-workshopFormula: % = 100*([# of Post-workshop attendees who report “False” - # of Pre-workshop attendees who report “False”] / # of total attendees)
Dementia is not just about having memory problems. It can affect thinking, communication and everyday tasks.
True = 1 (correct answer)False = 0
% of attendees who report “True” Pre-workshop (or Post-workshop)Formula:% = 100*(# of attendees who report “True” Pre-workshop (or Post-workshop)/ # of total attendees)
% change of attendees who report “True” Pre-workshop to attendees who report “True” Post-workshopFormula: % = 100*([# of Post-workshop attendees who report “True” - # of Pre-workshop attendees who report “True”] / # of total attendees)
People with dementia may express themselves or communicate through actions instead of words.
True = 1 (correct answer)False = 0
% of attendees who report “True” Pre-workshop (or Post-workshop)Formula:% = 100*(# of attendees who report “True” Pre-workshop (or Post-workshop)/ # of total attendees)
% change of attendees who report “True” Pre-workshop to attendees who report “True” Post-workshopFormula: % = 100*([# of Post-workshop attendees who report “True” - # of Pre-workshop attendees who report “True”] / # of total attendees)
Did you learn about accessing community resources related to dementia as part of this workshop/ training/session?
Yes = 1No = 0
% of attendees who report “Yes” Post-workshopFormula:% = 100*(# of attendees who report “Yes” Post-workshop/ # of total attendees)
N/A
Knowledge ExampleUsing the formulas outlined above, Table 4 contains sample responses to the pre-
workshop and post-workshop Knowledge questions and the resulting descriptive and
14
change calculation scores. For example, for Question 2 (Dementia is not just about having
memory problems. It can affect thinking, communication and everyday tasks.), two people
responded “True” Pre-workshop; therefore, Question 2’s pre-workshop descriptive score
would be 33.3% (100*[2/6]). The change score for Question 2 would be an improvement of
16.7% (100*{[3-2]/6}).
Table 4. Knowledge Questions: Calculation Example
AttendeeKnowledge Questions
Q1 Pre Q1 Post Q2 Pre Q2 Post Q3 Pre Q3 Post Q4 Post*1 1 1 0 1 1 1 12 1 1 0 0 0 1 03 1 1 1 1 1 1 14 1 1 0 1 0 0 05 0 1 0 0 1 1 16 1 1 1 0 0 1 1
Descriptive Score 83.3% 100% 33.3% 50% 50% 83.3% 66.7%Change Score 16.7% 16.7% 33.3% N/A
Note: All numbers are for demonstration purposes only.*Q4 is not asked pre-workshop.
Attitudes Table 5 contains the attitude questions, the coding or values that correspond to the
responses, and descriptions of how to calculate descriptive scores and change scores
(when appropriate).
Table 5. Attitude Questions, Coding, and Scoring CalculationsQuestion Coding / Values for
ResponsesTo calculate descriptive information for Pre-workshop data (or Post-workshop data)
To calculate change from pre-workshop to post-workshop
I am confident interacting with people with dementia.
Strongly disagree = 1Disagree = 2Neutral = 3Agree = 4Strongly agree = 5
Average responseFormula:Add together the reported values (1-5) for each attendee Pre-workshop (or Post-workshop)/ # of total attendees
Change in average responsePre-workshop average:Add together the reported values (1-5) for each attendee Pre-workshop/ # of total attendees Post-workshop average:Add together the reported values (1-5) for each attendee Post-workshop/ # of total attendees
Change:Difference = Post-workshop average – Pre-workshop average
15
Question Coding / Values for Responses
To calculate descriptive information for Pre-workshop data (or Post-workshop data)
To calculate change from pre-workshop to post-workshop
People with dementia need to feel respected, just like anyone else.
Strongly disagree = 1Disagree = 2Neutral = 3Agree = 4Strongly agree = 5
Same as above Same as above
I can respond to people with dementia with understanding.
Strongly disagree = 1Disagree = 2Neutral = 3Agree = 4Strongly agree = 5
Same as above Same as above
I am motivated to get to know people with dementia better.
Strongly disagree = 1Disagree = 2Neutral = 3Agree = 4Strongly agree = 5
Same as above Same as above
Attitudes ExampleUsing the formulas outlined above, Table 6 contains sample responses to the pre-
workshop and post-workshop Attitudes questions and the resulting descriptive and change
calculation scores. For example, for Pre-workshop Question 3 (I can respond to people with
dementia with understanding.), one person had value of 1, two people had value of 2, two
people had a value of 3, and one person had a value of 4; therefore, Question 3’s pre-
workshop descriptive score would be 2.50 ({[1*1] + [2*2] + [2*3] + [1*4]}/6]). The change
score for Question 2 would be a change of 1.2 points (3.70-2.50).
Table 6. Attitude Questions: Calculation Example
AttendeeAttitude Questions
Q1 Pre Q1 Post Q2 Pre Q2 Post Q3 Pre Q3 Post Q4 Pre Q4 Post1 3 3 3 5 2 3 1 22 4 4 3 4 3 4 2 43 2 4 4 4 1 3 3 34 1 3 4 4 4 5 2 35 1 2 3 3 3 4 4 46 3 3 2 4 2 3 2 3
Descriptive Score 2.33 3.17 3.17 4.00 2.50 3.70 2.33 3.17Change Score 0.84 0.83 1.20 0.84
Note: All numbers are for demonstration purposes only.
Behavior/Practice ChangeTable 7 contains the wording of the behavior/practice change questions, the coding
or values that correspond to the responses, and descriptions of how to calculate descriptive
scores and change scores (when appropriate). Some items are asked in both tools, whereas
16
some items are unique to the Individual Tool and some are unique to the
Organizational/Sector Tool (* indicate differences).
Table 7. Behavior/Practice Change Questions, Coding, and Scoring CalculationsQuestion Coding /
Values for Responses
To calculate descriptive information for or Post-workshop data
Action: Offer support to people with dementia
✔ = 1 % of attendees who report ✔ Formula:% = 100*(# of attendees who report ✔/ # of total attendees)
Action: Offer support to caregivers of people with dementia
✔ = 1 Same as above
Action: Volunteer for an organization that helps people with dementia or their caregivers
✔ = 1 Same as above
Action: Make my home more dementia friendly
✔ = 1 Same as above
Action: Make my workplace more dementia friendly*
✔ = 1 Same as above
Action: Make my community more dementia friendly*
✔ = 1 Same as above
Action: Encourage my friends to become dementia friendly
✔ = 1 Same as above
Action: Be more patient with people with dementia when out in the community
✔ = 1 Same as above
Action: Make sure staff/co-workers are educated about effective communication strategies when interacting with people with dementia**
✔ = 1 Same as above
Action: Adapt current services or put new services in place for people with dementia**
✔ = 1 Same as above
Action: Adapt current services or put new services in place for dementia caregivers**
✔ = 1 Same as above
Action: Adopt employee benefits practices that are supportive of family caregivers of persons with dementia**
✔ = 1 Same as above
Action: Make environmental changes in my organization or public space (e.g., establish places to rest or quiet rooms and spaces; maps/signage; lighting; contrasting surfaces)**
✔ = 1 Same as above
Action: Other specify ✔ = 1 Same as above
17
Question Coding / Values for Responses
To calculate descriptive information for or Post-workshop data
Action: all Total Count of ActionsFormula: # of all actions with ✔ by attendee (e.g., offer support, volunteer, be more patient)
Average number of ActionsFormula:# of all actions with ✔ by attendee (e.g., offer support, volunteer, be more patient)/ # of total attendees
Note: Removed the Change Calculation column as it is not applicable for Behavior/Practice Change items.*These items only appear in the Individual Tool. ** These items only appear in the Organizational/Sector Tool.
Behavior/Practice Change ExampleUsing the formulas outlined above, Table 8 contains sample responses to the post-
workshop Behavior/Practice Change questions and the resulting descriptive scores. For
example, for Post-workshop Behavior/Practice Change Question 2, two people had value of
1; therefore, Question 2’s post-workshop descriptive score would be 33.3% (100*[2/6]).
The count of All Actions totaled 16 (2+6+3+2+2+2), and the average of all actions reported
by attendees would be 2.67 (16/6).
Table 8. Behavior/Practice Change Questions: Calculation Example
AttendeeBehavior/Practice Change Questions
Count of All ActionsQ1 Post Q2 Post Q3 Post Q4 Post Q5 Post
1 1 1 22 1 1 1 1 1 53 1 1 1 34 1 1 25 1 1 26 1 1 2
Descriptive Score (%)
50.0% 33.3% 100.0% 16.7% 66.7% Total 16
Note: All numbers are for demonstration purposes only. Only a few Behavior/Practice Change Questions are shown for ease.
Descriptive Score
(average)
2.67
Reporting2
ACL grants that include the delivery of dementia-friendly education and training can
use these brief tools to measure the impact of dementia-friendly education and training
sessions, or another similar tool approved by ACL.
2 Reporting is only applicable to ACL Alzheimer’s disease grantees delivering dementia-friendly education and training.
18
Using the formulas outlined earlier in this document, ACL grantees can report on the
impact of their dementia-friendly education and training. ACL grantees should report
cumulative data, and results should be included in a Final Report. For example, if a grantee
has 17 attendees during one performance period and 72 in the second performance period,
the grantee should report the data on all 89 attendees (17+72), regardless of the number of
training sessions, when it submits its reporting to ACL. Organizations collecting data as a
result of ACL grant program funded activities will submit their raw (attendee-reported)
data in an Excel file as part of their final report.
The tables below show how the cumulative data can be reported. These tables are
organized by the question or outcomes outlined earlier: organization description,
knowledge, attitudes, and behavior/practice change. These include the descriptive scores
and change scores (as applicable) but not the unique responses of each attendee. The
blank tables below (Tables R1, R3, R5, and R7) can be used to present cumulative data. The
example tables (Tables R2, R4, R6, and R8) are presented to show the example data used in
the Scoring section.
Table R1. Reporting Organization Description
Total Attendees
Organization Description
Lega
l Ser
vice
s
Ban
ks/
Fin
anci
al
Serv
ices
Nei
ghb
ors/
Co
mm
un
ity
Mem
ber
Gov
t A
gen
cies
Emer
gen
cy
Pla
nn
ing/
Fir
st
Res
pon
der
Lib
rari
es
Com
mu
nit
ies
of
Fait
h
Bu
sin
ess/
Ret
ail
Tra
nsp
orta
tion
Se
rvic
es
Hos
pit
als/
Acu
te
Care
Set
tin
gs
Res
iden
tial
Car
e
Food
Ser
vice
/ R
esta
ura
nt
Oth
er
Descriptive Score (Count) Descriptive Score (%)
19
Table R2. Reporting Organization Description: Example
Total Attendees: 6
Organization Description
Lega
l Ser
vice
s
Ban
ks/
Fin
anci
al
Serv
ices
Nei
ghb
ors/
Co
mm
un
ity
Mem
ber
Gov
t A
gen
cies
Emer
gen
cy
Pla
nn
ing/
Firs
t R
esp
ond
er
Lib
rari
es
Com
mu
nit
ies
of
Fait
h
Bu
sin
ess/
Ret
ail
Tra
nsp
orta
tion
Se
rvic
es
Hos
pit
als/
Acu
te
Care
Set
tin
gs
Res
iden
tial
Car
e
Food
Ser
vice
/ R
esta
ura
nt
Oth
er
Descriptive Score (Count)
1 1 1 2 1
Descriptive Score (%) 16.7 16.7 16.7 33.3 16.7
Table R3. Reporting Knowledge Questions
Total Attendees: Knowledge Questions
Q1 Pre Q1 Post Q2 Pre Q2 Post Q3 Pre Q3 Post Q4 PostDescriptive Score (%) Change Score (%) N/A
Table R4. Reporting Knowledge Questions: Example
Total Attendees: 6Knowledge Questions
Q1 Pre Q1 Post Q2 Pre Q2 Post Q3 Pre Q3 Post Q4 PostDescriptive Score (%) 83.3 100.0 33.3 50.0 50.0 83.3 66.7Change Score (%) 16.7 16.7 33.3 N/A
Table R5. Reporting Attitude Questions
Total Attendees:Attitude Questions
Q1 Pre Q1 Post Q2 Pre Q2 Post Q3 Pre Q3 Post Q4 Pre Q4 PostDescriptive Score Change Score
Table R6. Reporting Attitude Questions: Example
Total Attendees: 6Attitude Questions
Q1 Pre Q1 Post Q2 Pre Q2 Post Q3 Pre Q3 Post Q4 Pre Q4 PostDescriptive Score 2.33 3.17 3.17 4.00 2.50 3.70 2.33 3.17Change Score 0.84 0.83 1.20 0.84
20
Table R7. Reporting Behavior/Practice Change Questions
Total Attendees:
Behavior/Practice Change Questions
Off
er s
up
por
t to
peo
ple
wit
h d
emen
tia
Off
er s
up
por
t to
care
give
rs o
f peo
ple
wit
h d
emen
tia
Vol
un
teer
for
an o
rgan
izat
ion
th
at h
elp
s p
eop
le w
ith
d
emen
tia
or t
hei
r ca
regi
vers
Mak
e m
y h
ome
mor
e d
emen
tia
frie
nd
ly
Mak
e m
y w
ork
pla
ce m
ore
dem
enti
a fr
ien
dly
Mak
e m
y co
mm
un
ity
mor
e d
emen
tia
frie
nd
ly
Enco
ura
ge m
y fr
ien
ds
to b
ecom
e d
emen
tia
frie
nd
ly
Be
mor
e p
atie
nt w
ith
peo
ple
wit
h d
emen
tia
wh
en o
ut
in th
e co
mm
un
ity
Mak
e su
re s
taff
/co-
wor
ker
s ar
e ed
uca
ted
ab
out
effe
ctiv
e co
mm
un
icat
ion
str
ateg
ies
wh
en in
tera
ctin
g w
ith
peo
ple
wit
h d
emen
tia
Ad
apt c
urr
ent s
ervi
ces
or p
ut n
ew s
ervi
ces
in p
lace
fo
r p
eop
le w
ith
dem
enti
a
Ad
apt c
urr
ent s
ervi
ces
or p
ut n
ew s
ervi
ces
in p
lace
fo
r d
emen
tia
care
give
rs
Ad
opt
emp
loye
e b
enef
its
pra
ctic
es th
at a
re
sup
por
tive
of f
amil
y ca
regi
vers
of p
erso
ns
wit
h
dem
enti
a
Mak
e en
viro
nm
enta
l ch
ange
s in
my
orga
niz
atio
n o
r p
ub
lic
spac
e (e
.g.,
esta
bli
sh p
lace
s to
res
t or
qu
iet
room
s an
d s
pac
es; m
aps/
sign
age;
ligh
tin
g;
con
tras
tin
g su
rfac
es)
Oth
er s
pec
ify
Act
ion
: all
Descriptive Score
(count)
Descriptive Score
(average)N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A
Descriptive Score (%)
N/A
21
Table R8. Reporting Behavior/Practice Change Questions: Example.
Total Attendees: 6
Behavior/Practice Change Questions
Off
er s
up
por
t to
peo
ple
wit
h d
emen
tia
Off
er s
up
por
t to
care
give
rs o
f peo
ple
wit
h d
emen
tia
Vol
un
teer
for
an o
rgan
izat
ion
th
at h
elp
s p
eop
le w
ith
d
emen
tia
or t
hei
r ca
regi
vers
Mak
e m
y h
ome
mor
e d
emen
tia
frie
nd
ly
Mak
e m
y w
ork
pla
ce m
ore
dem
enti
a fr
ien
dly
Mak
e m
y co
mm
un
ity
mor
e d
emen
tia
frie
nd
ly
Enco
ura
ge m
y fr
ien
ds
to b
ecom
e d
emen
tia
frie
nd
ly
Be
mor
e p
atie
nt w
ith
peo
ple
wit
h d
emen
tia
wh
en o
ut
in th
e co
mm
un
ity
Mak
e su
re s
taff
/co-
wor
ker
s ar
e ed
uca
ted
ab
out
effe
ctiv
e co
mm
un
icat
ion
str
ateg
ies
wh
en in
tera
ctin
g w
ith
peo
ple
wit
h d
emen
tia
Ad
apt c
urr
ent s
ervi
ces
or p
ut n
ew s
ervi
ces
in p
lace
for
peo
ple
wit
h d
emen
tia
Ad
apt c
urr
ent s
ervi
ces
or p
ut n
ew s
ervi
ces
in p
lace
for
dem
enti
a ca
regi
vers
Ad
opt
emp
loye
e b
enef
its
pra
ctic
es th
at a
re s
up
por
tive
of
fam
ily
care
give
rs o
f per
son
s w
ith
dem
enti
a
Mak
e en
viro
nm
enta
l ch
ange
s in
my
orga
niz
atio
n o
r p
ub
lic
spac
e (e
.g.,
esta
bli
sh p
lace
s to
res
t or
qu
iet
room
s an
d s
pac
es; m
aps/
sign
age;
ligh
tin
g; c
ontr
asti
ng
surf
aces
)
Oth
er s
pec
ify
Act
ion
: all
Descriptive Score
(count)3 2 6 1 4 0 0 0 0 0 0 0 0 0 16
Descriptive Score
(average)N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A 2.67
Descriptive Score (%)
50.0 33.3 100.0 16.7 66.7 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 N/A
22
Brief Tool for Dementia-Friendly Education and Training Sessions
Annotated
Pre-and Post-Workshop Questions for Individual and Organizational/Sector Tool
Knowledge Questions
1. Dementia is part of normal aging.1 True False2. Dementia is not just about having memory problems. It can affect
thinking, communication and everyday tasks.2 True False
3. People with dementia may express themselves or communicate through actions instead of words.3 True False
Attitude Questions
1. I am confident interacting with people with dementia.3
Strongly disagree
1
Disagree 2
Neutral 3
Agree 4
Strongly agree 5
2. People with dementia need to feel respected, just like anyone else.4
Strongly disagree
1
Disagree 2
Neutral 3
Agree 4
Strongly agree5
3. I can respond to people with dementia with understanding.4
Strongly disagree
1
Disagree 2
Neutral 3
Agree 4
Strongly agree5
4. I am motivated to get to know people with dementia better.5
Strongly disagree
1
Disagree 2
Neutral 3
Agree 4
Strongly agree5
Post-Workshop Question for Individual Tool
Behavior Question1. Which of the following personal actions will you take to create a more dementia-
friendly and inclusive community?Put a check next to each action you will take. Select as many as you like. ✔ Offer support to people with dementia6 Offer support to caregivers of people with dementia6 Volunteer for an organization that helps people with dementia or their caregivers6
Make my home more dementia friendly6 Make my workplace more dementia friendly6 Make my community more dementia friendly6 Encourage my friends to become dementia friendly6 Be more patient with people with dementia when out in the community6 Are there any other actions you will take? Please list them below:
23
Pre-Workshop Question for Organizational/Sector Tool
Which category best describes the organization you represent at this training? (Please mark ONLY ONE)8
□ Legal Services □ Banks/Financial Services
□ Neighbors / Community Member
□ Government Agencies
□ Emergency Planning / First Responder
□ Libraries □ Communities of Faith
□ Business / Retail
□ Transportation Services □ Hospitals/Acute Care Settings
□ Residential Care □ Food service/ Restaurant
□ Other, please specify:
Post-Workshop Question for Organizational/Sector Tool
Behavior/Practice Change Question1. Which of the following actions will you take to create a more dementia-friendly and
inclusive community?Put a check next to each action you will take. Select as many as you like. ✔ Offer support to people with dementia6 Offer support to caregivers of people with dementia6 Volunteer for an organization that helps people with dementia or their caregivers6 Make my home more dementia friendly6 Encourage my friends to become dementia friendly6 Be more patient with people with dementia when out in the community6 Make sure staff/co-workers are educated about effective communication strategies when interacting with people with dementia7
Adapt current services or put new services in place for people with dementia7 Adapt current services or put new services in place for dementia caregivers7 Adopt employee benefits practices that are supportive of family caregivers of persons with dementia8
Make environmental changes in my organization or public space (e.g., establish places to rest or quiet rooms and spaces; maps/signage; lighting; contrasting surfaces)7
Are there any other actions you will take? Please list them below:
Notes1 Adapted question from Alzheimer’s LA “Broken Sentences” worksheet for Dementia Friendly workshops. 2 Adapted question from Alzheimer’s Disease Knowledge Scale: Carpenter, B. D., Balsis, S., Otilingam, P. G., Hanson, P. K., & Gatz, M. (2009). The Alzheimer's Disease Knowledge Scale: Development and psychometric properties. The Gerontologist, 49(2), 236–247.3 Adapted question from Dementia Attitudes Scale: O’Connor, M. L., & McFadden, S. H. (2010). Development and psychometric validation of the Dementia Attitudes Scale. International Journal of Alzheimer’s Disease. 2010. doi:10.4061/2010/4542184 Adapted question from Lintern, T., & Woods, B. (1996). Approaches to dementia questionnaire. University of Wales, Bangor, UK.5 Adapted question from Pittinsky, T. L., Rosenthal, S. A., & Montoya, R. M. (2011). Measuring positive attitudes toward outgroups: Development and validation of the Allophilia Scale. In L. R. Tropp & R. K. Mallett (Eds.), Moving beyond
24prejudice reduction: Pathways to positive intergroup relations (pp. 41-60). Washington, DC, US: American Psychological Association. http://dx.doi.org/10.1037/12319-002 6 Adapted from Dementia Friends USA “personal action steps.” 7 Adapted from the Dementia Friendly Wyoming Communities Evaluation and Impact Survey.8 Adapted from Dementia Friendly America – Dementia Friendly Community Metrics.