Training Future Evaluators: Developing skills and social ... · Training Future Evaluators:...
Transcript of Training Future Evaluators: Developing skills and social ... · Training Future Evaluators:...
Training Future Evaluators: Developing Skills and Social
Awareness
Dr. Christine FrankWith former student Alyshia Landry
Research Analyst ProgramGeorgian College
Georgian CollegeBarrie, Ontario, Canada
www.georgianc.on.ca/info/rap
Program prepares
• Research professionals– Government– Health– Education– Non-profits– Market research
How the program works
• One year postgraduate• Students from any discipline• 8 months classes and projects• 3 months internship• Excellent placement rate
What do we want in future evaluators?
• Of course:– Research skills and knowledge – Evaluation theory and practice
• But also– Sensitivity to social problems– Big picture thinking– Empathy for program clients– Strong commitment to improving the human
condition
Typical Class Projects Program Evaluation
• AES/CES conference last October• Local social programs• Local events such as the Annual Art Tour
• Focus here is on two recent projects:– Making Ends Meet: Poverty in Barrie– View from the Inside: Adult Diabetes Care in
Barrie
Making Ends Meet Study
Conducted for the Child, Youth & Family Services Coalition of Simcoe County Took place over two months in fall 2004Coalition advisory group involvedExplored impacts, attitudes and perceptions of poverty
MethodsResearchers visited the Salvation Army and David Busby Street CentrePurpose: to familiarize themselves with the operations of the centers and to get a sense of how assistance is accessed
Worker Focus Group at the College
Purpose: To get a better understanding of issues in Barrie from workers’ point of view
Community Dinner at David Busby Center
Purpose: To explore issues in Barrie from clients’ point of view
In-depth Interviews with Clients, Committee Members, Volunteers and General PublicPurpose: To investigate poverty experiences and attitudes about living in need
Helping out at the community dinner!
Slide from students’ Results Presentation
Children and PovertyChildren raised in poverty become “outsiders” at a very early age. Never knowing the security of where they will live, when they will eat and who they can turn to for help almost guarantees that their entire lives will be lived on the margins.
Diabetes Study• Conducted for Royal Victoria Hospital • Took place over two months fall 2005• Diabetes Management Centre) staff
involved• Explored patient experience with Centre
and in Barrie area over all.
MethodsResearchers visited the Diabetic Management CentrePurpose: to familiarize themselves with the operations of the centre
Worker Focus Group at the College Purpose: To get a better understanding of diabetes care issues in Barrie from health workers’ point of view
In-depth Interviews with ClientsPurpose: To explore diabetes care issues in Barrie from clients’ point of view
• People with diabetes often feel depressed, angry, frustrated, discouraged, guilty, and afraid
• Patients can feel controlled by their diabetes and the strict medication and meal regimens
Slide from students’ Results Presentation
Emotional & Psychological Effects
Student Comments: Skills• The opportunity to interview an individual on such a
personal and sensitive topic was essential to improve my listening skills. Initially, I found myself not speaking but thinking about my next question and that is not conducive to a good interview. Nearing the end of the interview I was able to clear my head and just follow the interview.
• I learned the importance of good research planning. • The interview with a participant built up my confidence in
my interviewing skills, and made me want to pursue qualitative research in more depth. The study also introduced me to analysis using NVivo.
Student Comments: Sensitivity to social problems
• I was much more aware of the financial burdens people are finding themselves in… I was shocked at how expensive the drugs and sugar strips are – I really thought everything was always covered - -that was very much a sad reality check.
• I learned that there seems to be a shortage of doctors. The person I interviewed had to travel to a different city because he was unable to find an available doctor in the Barrie, Ontario area.
Student Comments: Sensitivity to social problems
• It was upsetting to learn that many general practitioners are not up to date about diabetes and diabetes care.
• You know that I am not a qualitative research fan; however, I learned how that kind of service works. I understand now how hard is the struggle of the professionals and the staff in providing an excellent service.
Student Comments: Empathy for program clients
• I had no idea about the extent of complications that diabetes can cause. I also learned how difficult it is to completely change one's lifestyle in order to combat diabetes. I had sort of thought that the most that diabetes involved was a shot a few times a day and carefully watching what you eat, but it is far more complicated than that, including frequent testing of blood sugar levels which requires expensive equipment.
Student Comments: Empathy for program clients
• In my ignorance, I had always believed that if a person remained fit and healthy, the side effects of diabetes would be minimal. I now understand that diabetes is a progressive disease, and associated health problems are inevitable no matter how fit a person is. I have also come to understand the psychological toll that diabetes can take on people who suffer from it. The guilt and self blame that some diabetics experience is quite traumatic.
Student Comments: Big picture thinking
• This experience provided me with greater awareness of the complexities of our medical system. It is continually strained financially, and needs to be designed very effectively to achieve the goal of maintaining citizens’ health.
Student Comments: Commitment to improving the human condition
• I was lucky enough to be part of the presentation to the RVH management and others who work with Barrie area residents with diabetes. It was wonderful to put all the work together and ensure that the important findings were received by the right people. The feedback was so positive and knowing that your research will help make a difference was very rewarding for the class to hear.
Program Information
• http://www.georgianc.on.ca/academics/programs/program_info.php?major=RAPP