W Midlands Rural Development Programme March 2008 Stakeholders event.
West Midlands Clinical Senate Assembly Event 27th November …€¦ · Question 3: What have you...
Transcript of West Midlands Clinical Senate Assembly Event 27th November …€¦ · Question 3: What have you...
Page 1 of 24
West Midlands Clinical Senate Assembly Event
27th November 2019 Coventry University
Post-Event Evaluation
NHS England and NHS Improvement
Page 2 of 24
Contents
1. Introduction ………………………………………………………………………...... 3
2. Aims and Objectives ………………………………………………………………... 3
3. Event Planning, Promotion and Communications …………………………….… 4
4. Attendance ……………………………………………………………………………4
5. Mentimeter Presentation – Real Time Feedback ……………………………...…4
6. Lessons Learned and Recommendations …………………………………..…….5
7. Post-Event Survey (Evaluation) ……………………………………………….…...7
8. Appendix …………………………………………………………………………..…13
8.1 Appendix 1: Agenda ……………………………………………………..….13 8.2 Appendix 2: Save the Date ……………………………………………….. 15 8.3 Appendix 3: Online Registration ……………………………………….… 16 8.4 Appendix 4: Mentimeter Results ………………………………………..…17 8.5 Appendix 5: Survey (Evaluation) ………………………………………..…19 8.6 Appendix 6: Survey Comments ………………………………………..…. 21
Page 3 of 24
1. Introduction
The West Midlands Clinical Senate (WMCS) Assembly Event, 27th November 2019, focused on digital transformation within the NHS (Appendix 1) and was approved by the Federation of the Royal Colleges of Physicians of the United Kingdom for 3 category 1 (external) CPD credits.
The target group for the event included representatives from local Clinical Commissioning Groups (CCGs), WMCS Assembly and Council Members, clinical leaders, patient & public leaders, and other stakeholders interested in current digital development within the NHS. The event was also seen as a method of generating interest for WMCS Assembly membership from clinicians, professionals from public health & social care, academic health and science networks, and leaders with responsibility for the delivery of Sustainably Transformation Programmes (STP) and Integrated Care Services (ICS).
2. Aim and Objectives
The aim of the event was to bring together a diverse range of clinicians (from both the
WMCS Assembly and the regional health economy), and patient representatives to
learn about the future vision of the NHS. This was in regard to how innovation and
advancement in digital technology is supporting NHS professionals specifically in:
▪ contributing to improved quality to deliver safer care
▪ addressing health inequalities
▪ improving life expectancy
▪ delivering improved patient outcomes.
Event Objectives 1. Support and help raise the profile of the WMCS amongst stakeholders, increasing
stakeholders’ understanding of the work of the Senate and encourage engagement with the Senate’s work programme.
2. Contribute in developing productive relationships with key stakeholders (internal and external).
3. Promote the benefits of joining the WMCS and actively recruit to the Assembly.
Page 4 of 24
3. Event Planning, Promotion and Communication
A project plan was produced and supplemented with clearly defined roles and a communication plan, to ensure milestones were achieved and deliverables met. The event promotion was conducted with the support of the NHS England and Improvement (NHSE&I) Communications Team (Appendix 2) who circulated the event details to their counterparts across the West Midlands. Event details were also circulated to the following entities across the West Midlands footprint: NHS Trusts (including mental health), CCGs, STPs, ICSs, Local Authorities, other public sector services, Academic Health Science Network, Public Health England, Health Education England, WMCS Council and Assembly Members, Clinical Networks, Patient and Public Involvement Groups, NHSE&I Midlands Newsletter, and our nearest Clinical Senates (East Midlands, and East of England). Delegate Registration Delegates benefitted from online registration (Wufoo), allowing for quick and easy registration and tracking (Appendix 3).
4. Attendance
The event was attended by a range of professionals from different disciplines including managers, IT and digital leads, clinicians, and patient & public representatives from across the West Midlands. 122 delegates registered to attend the event, the day’s total attendance was 81 (30% Clinicians, 70% Non-Clinicians).
5. Mentimeter Presentation – Real Time Feedback
This year’s agenda included pre and post-event presentations allowing for real-time feedback. Mentimeter allowed the WMCS to engage with and assess the audience’s self-defined knowledge base. Delegates submitted their answers via their smart devices / laptops which instantaneously displayed the results on screen via bar charts or a word cloud. Delegates were asked three questions, one question pre-event and two questions post-event: Question 1: How would you rate your current knowledge of digitalisation within the
NHS? (pre-event question. 66 delegates responded). Question 2: How would you rate your current knowledge of digitalisation within the
NHS? (post-event question 49 delegates responded).
Page 5 of 24
Question 3: What have you learnt? (post-event question. word cloud allowed delegates to submit multiple comments).
Questions 1 and 2 provided a useful metric, with the results demonstrating a post-event increase in delegates’ self-reported knowledge of digitalisation (Appendix 4).
6. Lessons Learned and Recommendations
The following lessons learned, and recommendations, have been informed from experiential learning whilst project managing the event, and the post-event feedback forms. Agenda/Speaker Management
• A General Election was announced in late October 2019, the Keynote Speaker for this event withdrew due to purdah guidance relating to events, which asked employees to: ‘Avoid attending events where you may be asked to respond to questions about policy or on matters of public controversy. This may mean withdrawing from previously agreed engagements.’ The cancellation of the Keynote Speaker was handled smoothly, and a member of the WMCS Council was able to step in.
• Delays in circulating the agenda had an impact in achieving one of the objectives of the event (encouraging the attendance and recruitment of clinicians to the WMCS Assembly) as most clinicians require at least six weeks’ notice to attend learning events.
• During the event, some of the presentations ran over their allocated time which resulted in shortening the break period. Post-event, delegates requested that more time should be allocated for networking.
Recommendations:
• Ensure back-up speaker(s) are secured to provide cover for any cancellations.
• Dedicate time on the agenda to promote WMCS Assembly membership and the benefits of being a member.
• Improved management of confirmed speakers to ensure presentations and topic titles are delivered to time.
• Allow more time for delegates to network, extend Q&A sessions, and consider holding an all-day event.
Page 6 of 24
Delegates/Marketing/Communications
• 122 delegates registered to attend the event, the total attendance on the day was 81 (inclusive of WMCS staff and presenters). Approximately 30% of the delegates were clinicians, indicating the WMCS should improve its methods in increasing attendance from clinicians at future Assembly events.
• The WMCS catered for a figure under the actual number of delegates to help mitigate food wastage. Despite this, food wastage was still experienced after the lunch service.
Recommendations:
• Schedule reminder emails ahead of the event emphasising the importance of cancelling if a delegate is unable to attend. This should result in fewer non-attendances and less food wastage.
• Enlist support from presenters, WMCS Council and Assembly Members to disseminate and promote event information, particularly to clinicians.
• Twitter is a useful platform for engagement with clinicians, using the correct hashtags can generate discussions in a Twitter chat which can include topics to be presented at the event, or use influential names of confirmed event speakers to attract delegates. This could be facilitated by the West Midlands NHSE&I Communications Team.
• Promote on LinkedIn - this can be useful when attempting to attract a professional audience. The West Midlands NHSE&I Communications Team can publish on the NHSE&I LinkedIn page.
• NHSE&I Communications Team to promote and announce speakers as they are confirmed to generate interest.
Audio Visual Equipment
• Some delegates reported poor sound quality and requested better use of microphones.
Recommendation:
• The Chair could encourage delegates and presenters to use microphones during presentations and Q&A sessions.
Page 7 of 24
7. Post-Event Survey (Evaluation) Evaluation Methods Delegates were asked to complete a short survey, with reminders provided during and at the end of the event. The surveys were available in two formats:
1. Online (hosted on Microsoft Forms, accessed via smartphones/electronic devices)
2. Paper version (Appendix 5). The survey contained 12 questions, consisting of 8 rating scales and 4 open ended questions. Delegates were also encouraged to provide comments for each presentation. This mixture provided a useful balance of quantitative and qualitative data. The following rating scale was utilised: A follow-up email, and a link to the online survey, was circulated a few days after the event to capture those who did not have a chance to complete and return their evaluations on the day.
• 12 paper forms were completed and returned (11 on the day, 1 from the follow-up email)
• 18 forms were completed online.
• 30 out of 81 surveys completed = 37% response rate
Survey Analysis: Quantitative Data Table 1 shows the following information:
▪ The individual tallied scores for each presentation ▪ The combined score for each presentation (a graph can be found on page 12)
1 2 3 4 5
Not directly relevant in
current post but of interest
Not useful Fairly useful Useful Extremely useful
Page 8 of 24
Table 1: Combined Scores for Each Presentation
The following can be denoted from Table 1:
Presentations Combined
Score Total
Responses
Presentation 1: What Does Digital Mean to Me and My Patients – General Practice Perspective 118
30
Blank 1 2 3 4 5
0 0 1 8 13 8
Presentation 2: National Data Analysis to Support Improvement of Health and Care 110
30
Blank 1 2 3 4 5
0 1 0 11 14 4
Presentation 3: Digital Opportunities for The Midlands
111
Blank 1 2 3 4 5 30
0 0 2 9 15 4
Presentation 4: How to Implement Technology in The Workplace – Example from Staffordshire STP 115
30
Blank 1 2 3 4 5
0 0 2 9 11 8
Presentation 5: Mental Health Global Digital Exemplar Mental Health Data Sharing. The Merit Programme 124
30
Blank 1 2 3 4 5
0 0 0 7 12 11
Presentation 6: Ambulance Global Digital Exemplar. What Does This Mean for Staff and Patients? GED Programme – What Does This Mean for Other Organisations? 113
30
Blank 1 2 3 4 5
0 0 2 7 17 4
Presentation 7: Digital Services UHB Patient Perspective of Digital.
124
29 Blank 1 2 3 4 5
1 0 1 5 8 15
Page 9 of 24
• Presentations 5 and 7 were the highest scoring presentations, both scoring 124.
• Presentation 7 received the most ‘5’ ratings.
• All presentations (bar one) received scores from all 30 responders. This gap is denoted in the ‘blank’ column.
Delegates were also asked to rate the overall event, the results for which can be found below in Table 2: Table 2: Combined Score for Overall event
Overall Event Combined
Score Total
Responses
How useful did you find this event (overall)?
108
26
Blank 1 2 3 4 5
4 0 0 5 12 9
Page 10 of 24
118
110111
115
124
113
124
100
105
110
115
120
125
130
Presentation 1 Presentation 2 Presentation 3 Presentation 4 Presentation 5 Presentation 6 Presentation 7
Table 1: Combined Scores for Each Presentation
Page 11 of 24
Survey Analysis: Qualitative Data
• The survey provided an opportunity for qualitative feedback for each presentation (Appendix 6).
• Comments pertaining to the event overall were positive, with multiple comments provided for each section:
What were the
best and/or worst aspects of
this event?
What impact will this event have on your
future practice?
To what extent did the presenters provide a balance (evidence based where possible) view of the topics?
Any comments regarding the event overall?
Number of
comments 37 26 26 26
• Presentation 7 received the most positive comments, which demonstrated for this event that patient and public involvement added real value and a different perspective to the event.
• All comments were generally positive, particularly those which related to the event in general, with delegates stating they would review how digital can better aid their respective departments. Below shows themed analysis with examples of comments from the survey.
Range of topics covered All respondents commented positively. ▪ “Very interesting background which brought me up-to-date on the wider agenda” ▪ “Lots of practical examples to help my local NHS community take this huge
agenda in manageable chunks” ▪ “Excellent, varied and comprehensive” ▪ “I thought they provided a well-balanced view"
Organisation of the event All respondents responded positively.
▪ “High quality” ▪ “Very good” ▪ “Very enjoyable” ▪ “Well organised” ▪ “Excellent”
Page 12 of 24
Improvements for future events 1. Improving the sound quality and encouragement to use microphones for
speakers and Q&A sessions.
2. More time for networking.
3. More time for Q&A sessions. Summary There was a real appetite at the event to understand digital enablement in the NHS and Social Care Services. The event provided a platform for debate and discussion where key messages for NHSE&I were noted, these will be conveyed in the form of a short report to the regional team for further consideration. The qualitative and quantitative data from the event survey demonstrate that the delegates valued the presentations, particularly the patient perspective, and the ensuing question and answer sessions.
Page 13 of 24
8. Appendix
8.1 Appendix 1 – Agenda
Clinical Senate Assembly Event
What Does Digital Really Mean?
Wednesday 27th November 2019 09.00 to 13.00 hours
Venue – Coventry University, Technology Park, Puma Way
Coventry, CV1 2TT
Agenda
'West Midlands Clinical Senate Assembly Event' has been approved by the Federation of the
Royal Colleges of Physicians of the United Kingdom for 3 category 1 (external) CPD credit(s).
Timings Item(s)
Presented by
09:00
Arrival and Refreshments
09:30
Welcome, Introduction
Professor Adrian Williams Professor of Neurology Chair Neurosciences NNAG/CRG & West Midlands Clinical Senate
09:35
What Does Digital Mean to Me and My Patients - General Practice Perspective
Dr Masood Nazir GP and Managing Partner at Hall Green Health Associate CCIO for Primary Care Chief Clinical Information Officer| NHS Birmingham and Solihull Clinical Commissioning Groups
10.00
National Data Analysis to Support Improvement of Health & Care
Daniel Ray Director of Data (DSP, Analytics, Insights, Statistics, and Research Enablement) Professor of Health Informatics (hon) NHS Digital
10.15 Digital Opportunities for The Midlands Eddie Olla Director for Digital Transformation Midlands NHS England and NHS Improvement
Page 14 of 24
10:30
How to Implement Technology in The Workplace; Example from Staffordshire STP
Dr Ruth Chambers OBE Staffordshire STP’s Clinical Lead for Technology Enabled Care Services Programme, Digital Workstream and Honorary Professor Keele University, Visiting Professor Staffordshire University
10:45
Panel Q&A
11:05
Break & Networking
11:30
Mental Health Global Digital Exemplar Mental Health Data Sharing The Merit Programme
Dr James Reed Consultant Psychiatrist Chief Clinical Information Officer Birmingham and Solihull Mental Health NHS Foundation Trust
11:50
Ambulance Global Digital Exemplar What Does This Mean for The Staff and Patients? GDE Programme – What Does This Mean for Other Organisations?
Phil Collins Head of IM&T West Midlands Ambulance Service
12:10
Digital Services UHB Patient Perspective of Digital
Dr Tanya Pankhurst Consultant Nephrologist Director of Digital Healthcare University Hospital Birmingham Gary Taylor Patient Leader MyHealth Access Board of Trustees, PSC Support University Hospital Birmingham
12:30
Panel Q&A
12:50
Summary & Close
Professor Adrian Williams Dr Masood Nazir
13:00 LUNCH & Networking
All
Electronic copies of the presentations will be circulated after the event.
Page 15 of 24
8.2 Appendix 2 – Save the Date
Page 16 of 24
8.3 Appendix 3 – Online Registration
Page 17 of 24
8.4 Appendix 4 – Mentimeter Results
Page 18 of 24
Page 19 of 24
8.5 Appendix 5 – Survey (Evaluation) Form
Page 20 of 24
Online registration https://forms.office.com/Pages/ResponsePage.aspx?id=kp4VA8ZyI0umSq9Q55CtvxDmUNdF5fhClMuJVTd8jZlURjBVUVdDMlRPUUtZWEU2NDRYSE1WVVBXWC4u
Page 21 of 24
8.6 Appendix 6 – Survey Comments
How useful did you find this event (overall)?
The rooms acoustics weren’t very good, and the microphones didn’t really help including the roaming mikes among the audience, the questions were difficult to hear.
Presentation 1
Whether it was the rooms acoustics or just speaking very quickly, the presenter was rather difficult to understand.
Presentation 2
Very interesting background which brought me up to date on the wider agenda.
Presentation 3
No comments .
Presentation 4
Good examples
Lots of practical examples to help my local NHS community tackle this huge agenda in manageable ‘chunks’.
Presentation 5
Real explanation of practical application in the mental health trust.
Very clear.
Interesting in sharing the ‘works and all’ of a nine year programme
Presentation 6
Very understandable and interesting.
Pitched well for a mixed audience
Presentation 7
Hearing the patient rep presenter was the best.
The second part especially the patient rep
The patient rep presenter particularly good.
Great to hear patient view.
Brilliant.
Patient rep presenter - brilliant.
I particularly appreciated the patient rep presenter’s input as to what can be achieved for patients, recognising the huge gap in competence currently.
What aspects of the event did you enjoy? What could be improved upon?
All
The patient experiences. The West Midlands ambulance experience.
Usefulness to patients.
Patient perspective.
Everything was excellent.
Patient perspective.
Would have been positive to have non-medical CCIOs representing a diverse clinical leadership stance promoting wider professional representation in the Senate.
Patient perspective.
Some good content, some of it was repetitive and been seen at other events.
Very good speakers. Acoustics in venue challenging. More networking opportunity.
Page 22 of 24
More space for networking around coffee area. Time very limited, so presenters rushing through content. Audio quality could be better. More encouragement to use microphones.
I was impressed with the way the patient experience and outcomes were considered as part of most of the presentations. There is a need for more technical people of explain their work more clearly and stop using acronyms.
Mental Health Talk.
Mental health examples.
Presenter 5
Understanding of how digital can be implemented and facts.
Questions
Brisk presentations, very focused.
Good overview
Insight and networking.
Enjoyed update on patient care.
Good networking
Overall picture of current situation.
Variety of talks, networking
Wide range of presentations offered interesting perspective.
Good mixture of national overview and regional initiatives. Really pleased to see patient perspective.
What impact will this event have on your future practice?
Better understanding of digital
I have taken away ideas for change management and benefits
Look into digital innovations which help my patients
Will reflect on digital options
Not sure already bought in for the change but implementation is multi stake holder job but optimistic for future.
Useful to connect with partners about their experiences.
As a commissioner I will continue to pursue the digital agenda particularly by engaging clinicians.
Increase focus on sharing of information and lessons required regionally and nationwide.
Generally helpful and some useful takeaways
Encourage sharing of experience and benefits between GP practices and NHS trusts
I am going to develop a digital enabler to prescribing end of life drugs
At Healthwatch Warwickshire we are undertaking a project on Digital and has provided a clear insight into thoughts and benefits from a clinical point of view. It will allow us to communicate some of these elements to the public where there is a thirst for communication to work better vs concerns over security and affordability of connection or lack of knowledge on how to use new systems. Taking people on the journey is essential as is changing cultures and trust.
Aware
Helps learning to develop digital priorities for mental health.
More enthusiasm for pushing our hospital to develop more technology
Some good ideas to take into IAPT
Looking to use data for improvement
Significantly
Page 23 of 24
More confidence in embracing/supporting digital.
Review how IT can aid my own/department’s practice.
More aware of local programmes.
Positive change.
Will share with West Midlands Healthwatch network.
More focused on small digital wins.
Keep enthusiastic.
To what extent did the presenters provide a balance (evidence based where possible) view of the topics?
At times.
Good examples of what worked and didn’t.
Variable.
Good.
Excellent, varied and comprehensive.
Not sure but personal experience from people does support the idea.
As far as they could - more examples of co-production would be useful to share.
Very well.
Fair.
I thought they provided a very balanced view.
Difficult to answer.
Yes.
Very well.
Could be more practical.
Yes, very well.
Very balanced.
Good.
Good question and answer session.
Evidence base involved.
Very good.
Minimal evidence-based view. Little on real impact on outcomes.
Overall yes, some danger of elevating expectations, without addressing culture and legacy.
Mostly.
Very good.
Very good.
Not strong but time limited. Poorly addressed.
Any comments regarding the event overall?
Really useful event
Good event
Excellent
Location slightly difficult to access for traveling by road
Would appreciated a focus on more inclusive engagement with colleagues and patients. Behaviour change, and modelling is key to invest in workforce
Good event maybe more needed on solutions and more time for questions?
Good.
Great collection of expertise in one place. Would be good to expand access to these people in collaborative groups.
Very good.
Excellent- learned a lot. Well done.
Page 24 of 24
Helpful and informative.
Excellent event - need more time for networking.
Good.
All good.
Many thanks.
High Quality.
Very good, poor time management.
Good.
Good venue.
Some of the ‘the’ language was (for me) difficult to follow, but a copy of the presentation will help me.
Very enjoyable – feel enthused
A lot about development of apps, requiring the patient to initiate the interaction but no real discussion on ‘remote’ links between clinicians to allow direct access to expert opinions. I like the final question - what would panel members want from digital enablement of their healthcare.