Implementing a modified WHO surgical safety checklist in ... · PDF fileImplementing a...

1
Papadakos N, Shelmerdine S, Goh GS , Belli AM Interventional Radiology Department, St George's Healthcare NHS Trust, London, UK Implementing the action plan Following the initial study period we instigated a series of changes to address the cultural and practical barriers faced during implementation: 1. Local champions The authors acted as local champions to promote and monitor checklist use. Also acted as a source of information and gathered feedback. 2. Training and education We undertook a series of educational sessions after the 1st and 2nd audit cycles: Questionnaires to assess current staff knowledge. Oral presentations at departmental meetings. Small group session teaching to also allow the IR staff to discuss concerns. Electronic presentations (designed to clarify all aspect of the checklist and its appropriate application). Presenting the clinical evidence and the benefit of checklists (e.g. large multicentre studies and significant improvement to safety). 3. Teamwork and leadership Following the 1st audit it was agreed the nurses would lead the checklist for each case (similar practice to surgical theatres and in line with NPSA recommendations). All IR team members involved in the case should be present to complete the checklist. These changes empowered the nurses and resulted in a greater sense of team work and collective responsibility. 4. Regular feedback and repeat audit Repeat audit cycles and monitoring the uptake of the checklist highlighted issues relating to poor compliance. Regular feedback sessions with the IR team, helped highlight a number of issues (e.g. IR team did not understand some of the specific terms used in the checks). Allowed further guidance and additional training to be implemented. 0.0 10.0 20.0 30.0 40.0 50.0 60.0 70.0 80.0 90.0 100.0 Checklist conducted All checks fully completed Appropriately completed procedural site marking check 44.2 2.2 76.1 84.8 44.3 83.0 90.7 95.5 98.7 Pecentage Study period A Study period B Study period C NHS St. George’s Healthcare NHS Trust Implementing a modified WHO surgical safety checklist in Interventional Radiology Background to audit Results of repeat audits The World Health Organisation (WHO) introduced the surgical checklist in 2008 (and revised in 2009) to reduce errors, morbidity and mortality involved in surgical procedures. 1 The RCR and National Patient Safety Agency (NPSA) introduced a pilot checklist based on the WHO template in 2009 for interventional radiology (IR). The final modified checklist was introduced in 2010 (Fig. 1.a.). 2 There is growing interest in the use of checklists within IR internationally. CIRSE introduced its checklist (Fig. 1.b.) for Europe in 2011 and the SIR recommended the use of checklists in their recent ‘Quality Improvement in Interventional Radiology’ publication (2012). 3,4 What is the evidence for safety checklists? Safety checklists have been standard practice for decades in many other industries and professions (e.g. aviation and the military). Uptake in healthcare has been much slower. The are numerous publications and studies discussing the benefits of checklists and team briefings in the surgical theatre and clinical hospital environments. 5,6 Large multicentre studies have shown significant reductions in surgical mortality and morbidity when the WHO surgical checklist has been used. 7,8 Koetser et al. were able to demonstrated an improvement in the completion of standard peri-procedural checks and reduction in IR procedure postponements. 9 Kearns et al. reported improvement in inter-professional staff communication and a positive response from patients aware of the WHO surgical checklist (conducted during elective caesarean section, hence applicable to IR as most patients are conscious). 10 IR can result in significant morbidity and complications. The setup is comparable to that of the surgical operating theatre, with similar safety requirements, procedural and team work based practice. The aim of this audit was to assess the uptake of the NPSA IR checklist within our unit, the barriers faced during its introduction and implement changes to achieve 100% compliance (we used the published NPSA checklist without local modifications). Retrospective data collection of 476 procedures during 3 separate audit periods from PACS: Period A (06/06/2010 to 06/07/2010), Period B (15/12/2010 to 04/02/2011) and Period C (01/04/2011 to 30/06/2011). Data collected for each individual IR case included: whether a checklist had been undertaken and if so whether this was fully completed. In addition the correct procedural site marking check was assessed for satisfactory completion. Total consecutive cases audited during first study period 104. Checklist conducted for audited cases - 46 (44.2%). All checks fully completed - 1 (2.2%). Appropriately completed procedural site marking check - 35 (76.1%). Barriers to implementing the IR safety checklist A number of barriers were felt to have limited initial successful implementation. These included: 1.Lack of awareness, understanding, learning materials and training - Many of members of the IR team were unaware of the checklist’s introduction and when or how to use it. 2. Attitudes towards the checklist and team work - Some members of the IR team felt it was irrelevant and an unnecessary introduction of further bureaucracy. 3. Lack of leadership - Initially there was no nominated IR team member responsible for leading or documenting the checks. Aims and standards Methodology Checklists have been shown to reduce morbidity and mortality in surgical and hospital practice. It is reasonable to assume that these benefits would translate to IR. Whilst IR safety checklists are a relatively new concept, the recently introduced CIRSE checklist in Europe and recommendations by the SIR, mean they will play a greater role in improving the safety of IR patients. 3,4 We have demonstrated a strategy and series of changes to practice which can lead to successful implementation and sustained use of such safety checklists within IR departments. We will continue to work towards 100% checklist completion. Conclusion There was a statistically significant (P<0.005) improvement in both the number of safety checklists conducted and the number of cases for which all checks were fully completed. In addition there was also a numerical, although not statistically significant (P=0.3338), improvement in the appropriate completion of the procedural site marking check. Period A Period B Period C P value Total Cases 104 125 247 n/a Checklist conducted 46 (44.2%) 106 (84.8%) 224 (90.7%) 0.0003 All checks fully completed 1 (2.2%) 47 (44.3%) 214 (95.5%) 0.0001 Appropriately completed procedural site marking check 35 (76.1%) 88 (83.0%) 221 (98.7%) 0.3338 Results of first round Action plan Figure 1.b. Figure 1.a. Table 1. Figure 2. References: 1. WHO | Safe Surgery Saves Lives [Internet]. WHO. [cited 2012 Apr 12];Available from: http://www.who.int/patientsafety/safesurgery/en/index.html 2. NPSA. Patient safety resources [Internet]. [cited 2012 May 1];Available from: http://www.nrls.npsa.nhs.uk/resources/?EntryId45=59860 3. Lee MJ, Fanelli F, Haage P, et al (2012) Patient safety in interventional radiology: a CIRSE IR checklist. Cardiovasc Intervent Radiol 35(2):2446 4. Steele JR, Sidhu MK, Swensen SJ, et al (2012) Quality Improvement in Interventional Radiology: An Opportunity to Demonstrate Value and Improve Patient-centered Care. J Vasc Interv Radiol 23(4):43541 5. Pronovost P, Needham D, Berenholtz S, et al (2006) An intervention to decrease catheter-related bloodstream infections in the ICU. N Engl J Med 355(26):272532 6. Makary MA, Sexton JB, Freischlag JA, et al (2006) Operating room teamwork among physicians and nurses: teamwork in the eye of the beholder. J Am Coll Surg 202(5):74652 7. Haynes AB, Weiser TG, Berry WR, et al (2009) A surgical safety checklist to reduce morbidity and mortality in a global population. N Engl J Med 360(5):4919 8. de Vries EN, Prins HA, Crolla RMPH, et al (2010) Effect of a comprehensive surgical safety system on patient outcomes. N Engl J Med 363(20):192837 9. Koetser ICJ, de Vries EN, van Delden OM, et al (2012) A Checklist to Improve Patient Safety in Interventional Radiology. Cardiovascular and Interventional Radiology [cited 2012 May 15];Available from: http://www.ncbi.nlm.nih.gov/pubmed/22562482 10. Kearns RJ, Uppal V, Bonner J, et al (2011) The introduction of a surgical safety checklist in a tertiary referral obstetric centre. BMJ Qual Saf 20(9):81822

Transcript of Implementing a modified WHO surgical safety checklist in ... · PDF fileImplementing a...

Page 1: Implementing a modified WHO surgical safety checklist in ... · PDF fileImplementing a modified WHO surgical safety checklist in Interventional Radiology Background to audit Results

Papadakos N, Shelmerdine S, Goh GS , Belli AM Interventional Radiology Department, St George's Healthcare NHS Trust, London, UK

Implementing the action plan

Following the initial study period we instigated a series of changes to address the cultural and practical barriers faced during implementation:

1. Local champions

• The authors acted as local champions to promote and monitor checklist use.

• Also acted as a source of information and gathered feedback.

2. Training and education

We undertook a series of educational sessions after the 1st and 2nd audit cycles:

• Questionnaires to assess current staff knowledge.

• Oral presentations at departmental meetings.

• Small group session teaching to also allow the IR staff to discuss concerns.

• Electronic presentations (designed to clarify all aspect of the checklist and its appropriate application).

• Presenting the clinical evidence and the benefit of checklists (e.g. large multicentre studies and significant improvement to safety).

3. Teamwork and leadership

• Following the 1st audit it was agreed the nurses would lead the checklist for each case (similar practice to surgical theatres and in line with NPSA recommendations).

• All IR team members involved in the case should be present to complete the checklist.

• These changes empowered the nurses and resulted in a greater sense of team work and collective responsibility.

4. Regular feedback and repeat audit

• Repeat audit cycles and monitoring the uptake of the checklist highlighted issues relating to poor compliance.

• Regular feedback sessions with the IR team, helped highlight a number of issues (e.g. IR team did not understand some of the specific terms used in the checks).

• Allowed further guidance and additional training to be implemented.

0.0

10.0

20.0

30.0

40.0

50.0

60.0

70.0

80.0

90.0

100.0

Checklist conducted

All checks fully completed

Appropriately completed procedural site marking

check

44.2

2.2

76.1

84.8

44.3

83.0

90.7 95.5 98.7

Pe

cen

tage

Study period A

Study period B

Study period C

NHS

St. George’s Healthcare

NHS Trust

Implementing a modified WHO surgical safety checklist in Interventional Radiology

Background to audit

Results of repeat audits

• The World Health Organisation (WHO) introduced the surgical checklist in 2008 (and revised in 2009) to reduce errors, morbidity and mortality involved in surgical procedures.1

• The RCR and National Patient Safety Agency (NPSA) introduced a pilot checklist based on the WHO template in 2009 for interventional radiology (IR). The final modified checklist was introduced in 2010 (Fig. 1.a.). 2

• There is growing interest in the use of checklists within IR internationally. CIRSE introduced its checklist (Fig. 1.b.) for Europe in 2011 and the SIR recommended the use of checklists in their recent ‘Quality Improvement in Interventional Radiology’ publication (2012). 3,4

What is the evidence for safety checklists?

• Safety checklists have been standard practice for decades in many other industries and professions (e.g. aviation and the military). Uptake in healthcare has been much slower.

• The are numerous publications and studies discussing the benefits of checklists and team briefings in the surgical theatre and clinical hospital environments. 5,6

• Large multicentre studies have shown significant reductions in surgical mortality and morbidity when the WHO surgical checklist has been used. 7,8

• Koetser et al. were able to demonstrated an improvement in the completion of standard peri-procedural checks and reduction in IR procedure postponements. 9

• Kearns et al. reported improvement in inter-professional staff communication and a positive response from patients aware of the WHO surgical checklist (conducted during elective caesarean section, hence applicable to IR as most patients are conscious). 10

• IR can result in significant morbidity and complications. The setup is comparable to that of the surgical operating theatre, with similar safety requirements, procedural and team work based practice.

• The aim of this audit was to assess the uptake of the NPSA IR checklist within our unit, the barriers faced during its introduction and implement changes to achieve 100% compliance (we used the published NPSA checklist without local modifications).

• Retrospective data collection of 476 procedures during 3 separate audit periods from PACS: Period A (06/06/2010 to 06/07/2010), Period B (15/12/2010 to 04/02/2011) and Period C (01/04/2011 to 30/06/2011).

• Data collected for each individual IR case included: whether a checklist had been undertaken and if so whether this was fully completed.

• In addition the correct procedural site marking check was assessed for satisfactory completion.

• Total consecutive cases audited during first study period – 104. • Checklist conducted for audited cases - 46 (44.2%). • All checks fully completed - 1 (2.2%). • Appropriately completed procedural site marking check - 35 (76.1%).

Barriers to implementing the IR safety checklist

• A number of barriers were felt to have limited initial successful implementation. These included:

1.Lack of awareness, understanding, learning materials and training - Many of members of the IR team were unaware of the checklist’s introduction and when or how to use it.

2. Attitudes towards the checklist and team work - Some members of the IR team felt it was irrelevant and an unnecessary introduction of further bureaucracy.

3. Lack of leadership - Initially there was no nominated IR team member responsible for leading or documenting the checks.

Aims and standards

Methodology

• Checklists have been shown to reduce morbidity and mortality in surgical and hospital practice. It is reasonable to assume that these benefits would translate to IR.

• Whilst IR safety checklists are a relatively new concept, the recently introduced CIRSE checklist in Europe and recommendations by the SIR, mean they will play a greater role in improving the safety of IR patients. 3,4

• We have demonstrated a strategy and series of changes to practice which can lead to successful implementation and sustained use of such safety checklists within IR departments. We will continue to work towards 100% checklist completion.

Conclusion

• There was a statistically significant (P<0.005) improvement in both the number of safety checklists conducted and the number of cases for which all checks were fully completed.

• In addition there was also a numerical, although not statistically significant (P=0.3338), improvement in the appropriate completion of the procedural site marking check.

Period A Period B Period C P value

Total Cases

104

125

247

n/a

Checklist

conducted

46 (44.2%)

106 (84.8%)

224 (90.7%)

0.0003

All checks fully

completed

1 (2.2%)

47 (44.3%)

214 (95.5%)

0.0001

Appropriately

completed

procedural site

marking check

35 (76.1%) 88 (83.0%) 221 (98.7%) 0.3338

Results of first round

Action plan

Figure 1.b.

Figure 1.a.

Table 1.

Figure 2.

References: 1. WHO | Safe Surgery Saves Lives [Internet]. WHO. [cited 2012 Apr 12];Available from: http://www.who.int/patientsafety/safesurgery/en/index.html 2. NPSA. Patient safety resources [Internet]. [cited 2012 May 1];Available from: http://www.nrls.npsa.nhs.uk/resources/?EntryId45=59860 3. Lee MJ, Fanelli F, Haage P, et al (2012) Patient safety in interventional radiology: a CIRSE IR checklist. Cardiovasc Intervent Radiol 35(2):244–6 4. Steele JR, Sidhu MK, Swensen SJ, et al (2012) Quality Improvement in Interventional Radiology: An Opportunity to Demonstrate Value and Improve Patient-centered Care. J Vasc Interv

Radiol 23(4):435–41 5. Pronovost P, Needham D, Berenholtz S, et al (2006) An intervention to decrease catheter-related bloodstream infections in the ICU. N Engl J Med 355(26):2725–32

6. Makary MA, Sexton JB, Freischlag JA, et al (2006) Operating room teamwork among physicians and nurses: teamwork in the eye of the beholder. J Am Coll Surg 202(5):746–52 7. Haynes AB, Weiser TG, Berry WR, et al (2009) A surgical safety checklist to reduce morbidity and mortality in a global population. N Engl J Med 360(5):491–9 8. de Vries EN, Prins HA, Crolla RMPH, et al (2010) Effect of a comprehensive surgical safety system on patient outcomes. N Engl J Med 363(20):1928–37 9. Koetser ICJ, de Vries EN, van Delden OM, et al (2012) A Checklist to Improve Patient Safety in Interventional Radiology. Cardiovascular and Interventional Radiology [cited 2012 May

15];Available from: http://www.ncbi.nlm.nih.gov/pubmed/22562482 10. Kearns RJ, Uppal V, Bonner J, et al (2011) The introduction of a surgical safety checklist in a tertiary referral obstetric centre. BMJ Qual Saf 20(9):818–22