Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators...

43
Brant E. Fries Please do not cite without permission 1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University of Michigan May 7, 2002

Transcript of Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators...

Page 1: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

Brant E. Fries Please do not cite without permission 1

Development of Home Care Quality Indicators Based on

the MDS-HC

Brant E. Fries, Ph.D.University of Michigan

May 7, 2002

Page 2: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

2Brant E. Fries Please do not cite without permission

Agenda

RAI-HC as the basis for Quality Indicators Home Care Quality Indicators (HCQIs)

• Development• Summarizing HCQIs

Use of HCQIs in evaluating the MI Choice Programs

Page 3: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

3Brant E. Fries Please do not cite without permission

Agenda

RAI-HC as the basis for Quality Indicators Home Care Quality Indicators (HCQIs)

• Development• Summarizing HCQIs

Use of HCQIs in evaluating the MI Choice Programs

Page 4: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

4Brant E. Fries Please do not cite without permission

RAI-Home Care Assessment System

Developed by interRAI, a multi-nation group of clinicians, researchers and policymakers

Community analogue to the RAI, mandated in U.S. nursing homes

Page 5: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

5Brant E. Fries Please do not cite without permission

Improvements in the RAI

Primary purpose:• Improve care plans through improved

assessment

Page 6: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

6Brant E. Fries Please do not cite without permission

Improvements in the RAI

Three parts of the RAI-HCMinimum Data Set (MDS-HC) TriggersClient Assessment Protocols (CAPs)

(Care planning guidelines)

Page 7: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

7Brant E. Fries Please do not cite without permission

Improving Assessment Process

Items clearly defined, including: • full definitions• examples and exclusions• time delimiters

Cover all relevant domains• individuals’ strengths and weaknesses• tradeoff of breadth/depth and length

Page 8: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

8Brant E. Fries Please do not cite without permission

Improving Assessment Process

Use all possible sources of information• individual, formal/informal caregivers, MD,

medical record, etc. • self-reporting may be inaccurate• assessor decides when sources are

inconsistent

Page 9: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

9Brant E. Fries Please do not cite without permission

Improving Assessment Process

Careful testing of psychometric properties

Training manual Ongoing refinement - RAI-HC Version 2

Page 10: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

10Brant E. Fries Please do not cite without permission

Applications of MDS-HC Data

ASSESSMENT

Care Plan (CAP)

Eligibility Systems(MI Choice)

Quality Measures (HCQI)

Case-Mix Algorithm (RUG-III/HC)

Page 11: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

11Brant E. Fries Please do not cite without permission

RAI Family of Instruments

Chronic care/nursing homes RAI 2.0 Home Care RAI-HC 2.0 Mental Health RAI-MH Acute Care RAI-AC Post-Acute Care-Rehabilitation RAI-PAC Assisted Living RAI-AL Palliative Care RAI-PC

Page 12: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.
Page 13: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

13Brant E. Fries Please do not cite without permission

Common Basis

All interRAI instruments have common basis of care planning

Major items in common Possible to link across time and setting Start of a “language” to describe long-

term care users

Page 14: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

14Brant E. Fries Please do not cite without permission

Implementation of RAI-HC

InterRAI grants royalty-free license to governments

Adopted by 10 states, Department of Veterans Affairs

International adoptions Used in fee-for-service and managed

care programs

Page 15: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

15Brant E. Fries Please do not cite without permission

Agenda

RAI-HC as the basis for Quality Indicators Home Care Quality Indicators (HCQIs)

• Development• Summarizing HCQIs

Use of HCQIs in evaluating the MI Choice Programs

Page 16: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

16Brant E. Fries Please do not cite without permission

Uses of MDS-HC Data for Quality Measurement

User Profiles • Whom are we serving?

Performance Benchmarks• Are we serving the “right” people?

Outcome Measures• What happens to the people we serve?

Quality Indicators• How do care strategies affect the people we

serve? 

Page 17: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

17Brant E. Fries Please do not cite without permission

Why HCQIs Are Important

HCQI= Home Care Quality Indicators Citizens, legislators, administrators want

“proof” that programs work

Page 18: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

18Brant E. Fries Please do not cite without permission

Uses of HCQIs

Regulation• Who is doing a substandard job?

Management• How well am I doing? Compared with last year?

Consumers• Where should I get care?

Best practices• Who is doing an outstanding job?

Benchmarking• How do I compare with others?

Page 19: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

19Brant E. Fries Please do not cite without permission

HCQI Authors

John P. Hirdes Ph.D.

Brant E. Fries Ph.D.

John N. Morris Ph.D.

David Zimmerman Ph.D.

Naoki Ikegami M.D., Ph.D.

Dawn Dalby M.Sc.

Suzanne Hammer M.Sc.

Pablo Aliaga M.Sc.

Rich Jones, Ph.D.

Page 20: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

20Brant E. Fries Please do not cite without permission

Considerations in Developing HCQIs

Reliability and validity of data items Points of comparison

• Prevalence, incidence Validity of indicators Application – when agency is responsible

• Prevalence: follow-up data only• Incidence: intake to follow-up

Page 21: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

21Brant E. Fries Please do not cite without permission

HCQI Research in a Nutshell

Two year effort in Canada, USA, Japan Involved many stakeholders Started with QIs from other sectors Workgroups in Canada and Michigan Identification of exclusions Analysis with data from Canada, US, Italy HCQIs with reasonable prevalence Adjustments

Page 22: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

22Brant E. Fries Please do not cite without permission

Prevalence HC Quality Indicators

 Nutrition• Inadequate Meals• Weight Loss• Dehydration

Pain• Disruptive/Intense Pain• Unmanaged Pain

Physical function• No Assistive Device for Clients

with Difficulty in Locomotion• ADL/Rehabilitation Potential

and No Therapies

Psychosocial function• Social Isolation with Distress• Delirium• Negative mood

Medication• No medication review

Safety/Environment• Falls• Any injuries• Neglect/Abuse

Other• No Influenza Vaccination• Hospitalization

Page 23: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

23Brant E. Fries Please do not cite without permission

Incidence HC Quality Indicators

Psychosocial function• Failure to improve/ incidence

of cognitive decline• Failure to improve/ incidence

of difficulty in communication

Other• Increased health instability

Incontinence• Failure to improve/

incidence of bladder continence

Ulcers• Failure to improve/

incidence of skin ulcers Physical function

• Failure to improve/ incidence of decline in ADL

• Failure to improve/ incidence of impaired locomotion in the home

Page 24: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

24Brant E. Fries Please do not cite without permission

Adjusting HCQIs

Risk adjustment• Should we adjust?• Team identified candidate risk adjusters• Analyze Ontario, Michigan and Italian data:

–Adjustment in same direction/ magnitude in 2 out of 3 countries

Page 25: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

25Brant E. Fries Please do not cite without permission

Example: Two Nutrition HCQIs

TITLE

DESCRIPTION RISK ADJUSTERS

W7. Prevalence of inadequate meals

Numerator: Clients who ate 1 or fewer meals in 2 of the last 3 days Denominator: All clients

-Aged 65 years or older -End-stage disease

W24. Prevalence of weight loss

Numerator: Clients with unintended weight loss Denominator: All clients, excluding clients with end-stage disease on initial assessment

-ADL impairment (ADL hierarchy score) -Diagnosis of cancer

Page 26: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

26Brant E. Fries Please do not cite without permission

Adjusting HCQIs

Selection/Ascertainment adjustment• Should we adjust?• Use intake rates to derive agency-level

measure of bias• Analysis of Ontario and Michigan data

Page 27: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

27Brant E. Fries Please do not cite without permission

Risk/Ascertainment Adjustments for Mood, 8 Michigan Agencies

0%

10%

20%

30%

40%

50%

60%

Unadjusted Adjusted: Risk Adjusted: Risk+Ascert.

Page 28: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

28Brant E. Fries Please do not cite without permission

Two HCQIs, by Agency

0%

20%

40%

60%

Michigan Ontario Michigan Ontario

Disruptive/intense daily pain Delirium

Page 29: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

29Brant E. Fries Please do not cite without permission

All HCQI – Agency “A”

0

1

2

a_wmeala_wlossa_deh

a_phya_wdecb

a_wisul

a_wloco

a_wther

a_wmeal

a_wloss

a_deh

a_phya_wdecb

a_wisula_wlocoa_wther

a_wdfnda_lochpa_fallhp

a_wisol

a_wcogd

a_delir

a_dep

a_com

a_pain

a_paina

a_painhpa_wabus

a_inja_whosp

Page 30: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

30Brant E. Fries Please do not cite without permission

All HCQI – Agency “B”

0

1

2

a_wmeala_wlossa_deh

a_phya_wdecb

a_wisul

a_wloco

a_wther

a_wmeal

a_wloss

a_deh

a_phya_wdecb

a_wisula_wlocoa_wther

a_wdfnda_lochpa_fallhp

a_wisol

a_wcogd

a_delir

a_dep

a_com

a_pain

a_paina

a_painhpa_wabus

a_inja_whosp

Page 31: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

31Brant E. Fries Please do not cite without permission

People want simple quality measures

Good Housekeeping Seal Consumer Report Circles Olympic Medals Michelin Stars

Page 32: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

32Brant E. Fries Please do not cite without permission

Average Relative QIHC, by Michigan Agency

0

0.2

0.4

0.6

0.8

1

1.2

1.4

Page 33: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

33Brant E. Fries Please do not cite without permission

Single Measure of Home Care Quality

People want simple, but…• We lose critical information• May not be feasible

When we present multiple measures…• Difficult to interpret• Still seeking good “views”

Page 34: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

34Brant E. Fries Please do not cite without permission

Agenda

RAI-HC as the basis for Quality Indicators Home Care Quality Indicators (HCQIs)

• Development• Summarizing HCQIs

Use of HCQIs in evaluating the MI Choice Programs

Page 35: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

Are you just pissing and moaning, or can you verify what you’re saying with data?

Page 36: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

36Brant E. Fries Please do not cite without permission

Methods

Used adjusted HCQIs 23 agencies Over 8 quarters, from Jan 99 to Dec 01

• Training and computerization in 2nd quarter

Page 37: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

Change in Agency Average HCQI Score, by Period

40%

60%

80%

100%

120%

140%

160%

1 2 3 4 5 6 7 8Quarter

Rat

io t

o P

erio

d 1

HC

QI

Meal

Wtloss

Dehyd

MedsRev

Contin

SkinUlc

AssistDev

Therapy

ADLdecl

Locomot

Falls

SocIsol

CogDecl

Delirium

Mood

Communic

Pain

DisruptPain

IntensePain

Abuse

Injuries

Hospitaliz

Worse

Page 38: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

38Brant E. Fries Please do not cite without permission

Results

Over 8 periods (2 years) – (p<.005) 16 HCQIs improved (e.g., mood, falls,

hospitalizations, weight loss, social isolation, decubiti)

4 HCQIs remained the same (e.g., pain, disruptive pain, injuries, no assistive dev.)

2 HCQIs worsened (intense pain, rehab potential without therapies)

Page 39: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

39Brant E. Fries Please do not cite without permission

GOOD POOR

Defining Good /Poor Quality

Page 40: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

Average “Good”/ “Bad” HCQIs, by Quarter

0

1

2

3

4

5

1 2 3 4 5 6 7 8

Quarter

Num

ber

of H

CQ

Is

Bad

Good

RAITraining

Page 41: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

41Brant E. Fries Please do not cite without permission

GOOD BAD

Distribution of a HCQI

Page 42: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

42Brant E. Fries Please do not cite without permission

Next Steps

Further validation of HCQIs Develop archives for benchmarking Applicability to subpopulations Quality of Life?

Page 43: Brant E. Fries Please do not cite without permission1 Development of Home Care Quality Indicators Based on the MDS-HC Brant E. Fries, Ph.D. University.

43Brant E. Fries Please do not cite without permission

Conclusions

RAI-HC has potential to improve care directly, through improved care planning

MDS-HC has multiple uses, including measuring quality of care

HCQIs can be used to monitor care• Directly computed from MDS-HC• Useful for comparisons, benchmarking