Christiana Noestlinger & Bea Vuylsteke, Institute of Tropical Medicine, Belgium This work is part of...
12
EVALUATION FRAMEWORK OF QUALITY ACTION Mixed method approach: QUANTITATIVE AND QUALITATIVE INSTRUMENTS Christiana Noestlinger & Bea Vuylsteke, Institute of Tropical Medicine, Belgium This work is part of the Joint Action on Improving Quality in HIV Prevention (Quality Action), which has received funding from the European Union within the framework of the Health Programme.
-
Upload
leslie-craig -
Category
Documents
-
view
212 -
download
0
Transcript of Christiana Noestlinger & Bea Vuylsteke, Institute of Tropical Medicine, Belgium This work is part of...
EVALUATION FRAMEWORK OF QUALITY ACTION
Mixed method approach: QUANTITATIVE AND QUALITATIVE
INSTRUMENTS
Christiana Noestlinger & Bea Vuylsteke, Institute of Tropical Medicine, Belgium
This work is part of the Joint Action on Improving Quality in HIV Prevention (Quality Action), which has received funding from the European Union within the framework of the Health Programme.
www.qualityaction.eu
Evaluation of Quality Action
• Evaluation team (WP 3):
– Institute of Tropical Medicine, Antwerp, Belgium– University of Applied Sciences and Arts Northwestern
Switzerland, School of Social Work (FHNW)
• Input from other WPs• Data output to other WPs
www.qualityaction.eu
WP5: Capacity Building
WP6: Practical Application
WP7: Principles and Criteria
WP8: Policy Development
WP4: Tools
www.qualityaction.eu
WP5: Capacity Building
WP6: Practical Application
WP7: Principles and Criteria
WP8: Policy Development
WP4: Tools
www.qualityaction.eu
Specific objectives of the project and the evaluation
Coordination and dissemination
Starting environment
Final evaluation
SO 1:Develop a training package
Evaluation of new tools
SO2: Ensure level of knowledge and skills
of trainers/facilitators
Evaluation of knowledge and skills of
trainees
SO3: Support 80 tool applications
Satisfaction with
facilitators
Level of success of
the applications
Perceived level of quality
improvement
SO4: Develop a charter for quality in
HIV prevention
Endorsement and signing
of the charter
SO5: Produce policy statement and
strategic actions
Level of QA/QI
included in national HIV
strategies
www.qualityaction.eu
Evaluation objectives and data collection instruments
Starting environment
questionnaire (QAN)Topic guide for kick-of interviews (QAL)
Starting environment
Final evaluation
Evaluation of new tools
Training questionnaire (QAN)
Topic guide for interviews/FGD during training
workshops part 2 (QAL)
Evaluation of knowledge and skills of
trainees
Practical application questionnaire (process and
outcome) (QAN)
Satisfaction with
facilitators
Level of success of
the applications
Perceived level of quality
improvement
Endorsement and signing
of the charter
Final questionnaire (QAN)
Topic guide for final interviews (QAL)
Level of QA/QI
included in national HIV
strategies
www.qualityaction.eu
Instrument Participants Timing Method
Starting environment questionnaire
Stakeholders of the project
2 weeks before Kick-off workshop
On-line, semi-anonymous
Training questionnaire
Participants of European level training workshops
Pre- and post-training, part 1 and part 2 workshops
On-line, anonymous
Practical application questionnaire
Partners applying a tool
Process: max 6 weeks after applicationOutcome: 6 months after application
On-line, anonymous
Final questionnaire Stakeholders of the project
2 weeks before concluding conference
On-line, anonymous
Data collection instruments: quantitative
www.qualityaction.eu
Instrument Participants Timing Method
Topic guide for interviews (open-ended)
Stakeholders of the project
During the Kick-off workshop
Face-to-face interviews; audio-taped; inductive analysis
Topic guide for focus group discussions (open-ended)
Participants of European level training workshops
During part 2 European level training workshops
Focus Group discussions with trainees; transcription; inductive analysis
Topic guide for interviews (open-ended)
7 trainers of the European level training workshops
During part 2 European level training workshops
Face-to-face interviews; audio-taped; inductive analysis
Final interviews (open-ended)
Stakeholders of the project
During the concluding conference
Face-to-face interviews; audio-taped; inductive analysis
Data collection instruments: qualitative
www.qualityaction.eu
Timeline evaluation instrumentsOct-Nov 2015
Sept-Oct
2014
June 2014
April 2014
May – June 2013
Starting environment questionnaire Training questionnaire (part 1)
Training questionnaire (part 2) Application questionnaire (process)
Application questionnaire (outcome) Final questionnaire
Starting environment interview Focus group trainees
Interviews trainers Final interview
www.qualityaction.eu
Other data collection for monitoring and evaluation
• Process and output indicators: routine data monitoring systems – meeting minutes– internet pages– reports, tracking forms, etc.
• Process evaluation of selected activities: feedback forms– Kick-off workshop– Concluding conference
www.qualityaction.eu
Guiding principles
• Participatory• Not invasive• Existing forms (other WPs)• User friendly on-line questionnaires• Confidentiality• Anonymity
www.qualityaction.eu
Summary
• Evaluation is a cornerstone of the Quality Action• Not a simple before-after activity• Combination of methods• Input of partners crucial• Findings serve as a basis to (partially) develop quality
principles and criteria for the charter
