Training Future Evaluators: Developing skills and social ... · Training Future Evaluators:...

21
Training Future Evaluators: Developing Skills and Social Awareness Dr. Christine Frank With former student Alyshia Landry Research Analyst Program Georgian College [email protected]

Transcript of Training Future Evaluators: Developing skills and social ... · Training Future Evaluators:...

Page 1: Training Future Evaluators: Developing skills and social ... · Training Future Evaluators: Developing Skills and Social Awareness Dr. Christine Frank With former student Alyshia

Training Future Evaluators: Developing Skills and Social

Awareness

Dr. Christine FrankWith former student Alyshia Landry

Research Analyst ProgramGeorgian College

[email protected]

Page 2: Training Future Evaluators: Developing skills and social ... · Training Future Evaluators: Developing Skills and Social Awareness Dr. Christine Frank With former student Alyshia

Georgian CollegeBarrie, Ontario, Canada

www.georgianc.on.ca/info/rap

Page 3: Training Future Evaluators: Developing skills and social ... · Training Future Evaluators: Developing Skills and Social Awareness Dr. Christine Frank With former student Alyshia

Program prepares

• Research professionals– Government– Health– Education– Non-profits– Market research

Page 4: Training Future Evaluators: Developing skills and social ... · Training Future Evaluators: Developing Skills and Social Awareness Dr. Christine Frank With former student Alyshia

How the program works

• One year postgraduate• Students from any discipline• 8 months classes and projects• 3 months internship• Excellent placement rate

Page 5: Training Future Evaluators: Developing skills and social ... · Training Future Evaluators: Developing Skills and Social Awareness Dr. Christine Frank With former student Alyshia

What do we want in future evaluators?

• Of course:– Research skills and knowledge – Evaluation theory and practice

• But also– Sensitivity to social problems– Big picture thinking– Empathy for program clients– Strong commitment to improving the human

condition

Page 6: Training Future Evaluators: Developing skills and social ... · Training Future Evaluators: Developing Skills and Social Awareness Dr. Christine Frank With former student Alyshia

Typical Class Projects Program Evaluation

• AES/CES conference last October• Local social programs• Local events such as the Annual Art Tour

• Focus here is on two recent projects:– Making Ends Meet: Poverty in Barrie– View from the Inside: Adult Diabetes Care in

Barrie

Page 7: Training Future Evaluators: Developing skills and social ... · Training Future Evaluators: Developing Skills and Social Awareness Dr. Christine Frank With former student Alyshia

Making Ends Meet Study

Conducted for the Child, Youth & Family Services Coalition of Simcoe County Took place over two months in fall 2004Coalition advisory group involvedExplored impacts, attitudes and perceptions of poverty

Page 8: Training Future Evaluators: Developing skills and social ... · Training Future Evaluators: Developing Skills and Social Awareness Dr. Christine Frank With former student Alyshia

MethodsResearchers visited the Salvation Army and David Busby Street CentrePurpose: to familiarize themselves with the operations of the centers and to get a sense of how assistance is accessed

Worker Focus Group at the College

Purpose: To get a better understanding of issues in Barrie from workers’ point of view

Community Dinner at David Busby Center

Purpose: To explore issues in Barrie from clients’ point of view

In-depth Interviews with Clients, Committee Members, Volunteers and General PublicPurpose: To investigate poverty experiences and attitudes about living in need

Page 9: Training Future Evaluators: Developing skills and social ... · Training Future Evaluators: Developing Skills and Social Awareness Dr. Christine Frank With former student Alyshia

Helping out at the community dinner!

Page 10: Training Future Evaluators: Developing skills and social ... · Training Future Evaluators: Developing Skills and Social Awareness Dr. Christine Frank With former student Alyshia

Slide from students’ Results Presentation

Children and PovertyChildren raised in poverty become “outsiders” at a very early age. Never knowing the security of where they will live, when they will eat and who they can turn to for help almost guarantees that their entire lives will be lived on the margins.

Page 11: Training Future Evaluators: Developing skills and social ... · Training Future Evaluators: Developing Skills and Social Awareness Dr. Christine Frank With former student Alyshia

Diabetes Study• Conducted for Royal Victoria Hospital • Took place over two months fall 2005• Diabetes Management Centre) staff

involved• Explored patient experience with Centre

and in Barrie area over all.

Page 12: Training Future Evaluators: Developing skills and social ... · Training Future Evaluators: Developing Skills and Social Awareness Dr. Christine Frank With former student Alyshia

MethodsResearchers visited the Diabetic Management CentrePurpose: to familiarize themselves with the operations of the centre

Worker Focus Group at the College Purpose: To get a better understanding of diabetes care issues in Barrie from health workers’ point of view

In-depth Interviews with ClientsPurpose: To explore diabetes care issues in Barrie from clients’ point of view

Page 13: Training Future Evaluators: Developing skills and social ... · Training Future Evaluators: Developing Skills and Social Awareness Dr. Christine Frank With former student Alyshia

• People with diabetes often feel depressed, angry, frustrated, discouraged, guilty, and afraid

• Patients can feel controlled by their diabetes and the strict medication and meal regimens

Slide from students’ Results Presentation

Emotional & Psychological Effects

Page 14: Training Future Evaluators: Developing skills and social ... · Training Future Evaluators: Developing Skills and Social Awareness Dr. Christine Frank With former student Alyshia

Student Comments: Skills• The opportunity to interview an individual on such a

personal and sensitive topic was essential to improve my listening skills. Initially, I found myself not speaking but thinking about my next question and that is not conducive to a good interview. Nearing the end of the interview I was able to clear my head and just follow the interview.

• I learned the importance of good research planning. • The interview with a participant built up my confidence in

my interviewing skills, and made me want to pursue qualitative research in more depth. The study also introduced me to analysis using NVivo.

Page 15: Training Future Evaluators: Developing skills and social ... · Training Future Evaluators: Developing Skills and Social Awareness Dr. Christine Frank With former student Alyshia

Student Comments: Sensitivity to social problems

• I was much more aware of the financial burdens people are finding themselves in… I was shocked at how expensive the drugs and sugar strips are – I really thought everything was always covered - -that was very much a sad reality check.

• I learned that there seems to be a shortage of doctors. The person I interviewed had to travel to a different city because he was unable to find an available doctor in the Barrie, Ontario area.

Page 16: Training Future Evaluators: Developing skills and social ... · Training Future Evaluators: Developing Skills and Social Awareness Dr. Christine Frank With former student Alyshia

Student Comments: Sensitivity to social problems

• It was upsetting to learn that many general practitioners are not up to date about diabetes and diabetes care.

• You know that I am not a qualitative research fan; however, I learned how that kind of service works. I understand now how hard is the struggle of the professionals and the staff in providing an excellent service.

Page 17: Training Future Evaluators: Developing skills and social ... · Training Future Evaluators: Developing Skills and Social Awareness Dr. Christine Frank With former student Alyshia

Student Comments: Empathy for program clients

• I had no idea about the extent of complications that diabetes can cause. I also learned how difficult it is to completely change one's lifestyle in order to combat diabetes. I had sort of thought that the most that diabetes involved was a shot a few times a day and carefully watching what you eat, but it is far more complicated than that, including frequent testing of blood sugar levels which requires expensive equipment.

Page 18: Training Future Evaluators: Developing skills and social ... · Training Future Evaluators: Developing Skills and Social Awareness Dr. Christine Frank With former student Alyshia

Student Comments: Empathy for program clients

• In my ignorance, I had always believed that if a person remained fit and healthy, the side effects of diabetes would be minimal. I now understand that diabetes is a progressive disease, and associated health problems are inevitable no matter how fit a person is. I have also come to understand the psychological toll that diabetes can take on people who suffer from it. The guilt and self blame that some diabetics experience is quite traumatic.

Page 19: Training Future Evaluators: Developing skills and social ... · Training Future Evaluators: Developing Skills and Social Awareness Dr. Christine Frank With former student Alyshia

Student Comments: Big picture thinking

• This experience provided me with greater awareness of the complexities of our medical system. It is continually strained financially, and needs to be designed very effectively to achieve the goal of maintaining citizens’ health.

Page 20: Training Future Evaluators: Developing skills and social ... · Training Future Evaluators: Developing Skills and Social Awareness Dr. Christine Frank With former student Alyshia

Student Comments: Commitment to improving the human condition

• I was lucky enough to be part of the presentation to the RVH management and others who work with Barrie area residents with diabetes. It was wonderful to put all the work together and ensure that the important findings were received by the right people. The feedback was so positive and knowing that your research will help make a difference was very rewarding for the class to hear.