copyThe Association for Dementia Studies

Methodological challenge in arts and dementia evaluation A critical perspective on the literature

Karen Gray University of Worcester

TAnDem Doctoral Training Centre

copyThe Association for Dementia Studies

Introduction bull The methodological challenges of

conducting a literature review aboutmethodological challengebull Categories of challengebull Context and complexity

copyThe Association for Dementia Studies

Definition methodology ldquohellipthe study ndash the description the explanation and the justification ndash of methodshelliprdquo

ldquoI believe that the most important contribution methodology can make to science is [hellip] to help unblock the roads of inquiryrdquo

Kaplan A (1964) The conduct of inquiry methodology for behavioural science San Francisco Chandler p18 p24

copyThe Association for Dementia Studies

Definition critical ldquoCritical social research [hellip] aims at an analysis of socialprocesses delving beneath ostensive and dominantconceptual frames in order to reveal the underlyingpractices their historical specificity and structuralmanifestationsrdquo

Harvey L (1990) Critical social research London Unwin Hyman p3

ldquohellipscientific knowledge and technologies do not evolve ina vacuum Rather they participate in the social worldbeing shaped by it and simultaneously shaping itrdquo

Law J (2004) After method Mess in social science research Oxford Routledge p12

copyThe Association for Dementia Studies

What kind of literature review bull Little published work specifically on the topic of

methodological challengebull A sense that information was to be found in the

lsquogapsrsquobull Potentially important grey literature including

unpublished practice-based evaluations andreflective practice of artist practitioners

bull Wide area of focusbull Arts or health paradigm

copyThe Association for Dementia Studies

Categories of challenge Method and measure Communication bull Design delivery amp implementation bull Cognitive (in)capacity

of evaluation studies bull Perceptions and stigmabull Theorisation bull Interpretation and meaning ofbull Measuring key concepts aesthetic experience

Ethics Values bull Formal ethics processes bull Evaluation choices value-laden andbull Accounting for lsquoriskinessrsquo of art perspectivalbull Rights and voices of people with bull Cultural value and arts engagement

dementia bull Economic valuation

Context bull Capturing and accounting for complexitybull Understanding mechanisms

copyThe Association for Dementia Studies

What do I mean by context ldquoContext includes anything external to the intervention that may act as a barrier or facilitator to its implementation or its effectrdquo (Moore et al 2015) For example bull Setting in which arts activity is experienced - physical space

routines and associated practicesbull Timebull Cultural social and relational networks of participantsbull Personal and clinical histories cultural demographies or

aesthetic preferences of participantsbull Policies practices and discourse surrounding dementia

hellipthese interact with the artistic technical and relational practice of the individual arts practitioner

copyThe Association for Dementia Studies

Context and complexity bull Effects are frequently measured or observed but

mechanisms (why something has an effect) less wellexplored or understood

bull Simple cause and effect view unlikely to help usunderstand whether the same effect will be seenanother time or in another context

bull Is it the arts activity or intervention that is complex orthe context (Hawe et al 2009)

copyThe Association for Dementia Studies

How might we better capture and understand complexity

Olafur Eliasson The wave moving on the sea between Greenland and Iceland 1999 Source httpolafureliassonnet

copyThe Association for Dementia Studies

Introduction bull The methodological challenges of

conducting a literature review aboutmethodological challengebull Categories of challengebull Context and complexity

copyThe Association for Dementia Studies

Definition methodology ldquohellipthe study ndash the description the explanation and the justification ndash of methodshelliprdquo

ldquoI believe that the most important contribution methodology can make to science is [hellip] to help unblock the roads of inquiryrdquo

Kaplan A (1964) The conduct of inquiry methodology for behavioural science San Francisco Chandler p18 p24

copyThe Association for Dementia Studies

Definition critical ldquoCritical social research [hellip] aims at an analysis of socialprocesses delving beneath ostensive and dominantconceptual frames in order to reveal the underlyingpractices their historical specificity and structuralmanifestationsrdquo

Harvey L (1990) Critical social research London Unwin Hyman p3

ldquohellipscientific knowledge and technologies do not evolve ina vacuum Rather they participate in the social worldbeing shaped by it and simultaneously shaping itrdquo

Law J (2004) After method Mess in social science research Oxford Routledge p12

copyThe Association for Dementia Studies

What kind of literature review bull Little published work specifically on the topic of

methodological challengebull A sense that information was to be found in the

lsquogapsrsquobull Potentially important grey literature including

unpublished practice-based evaluations andreflective practice of artist practitioners

bull Wide area of focusbull Arts or health paradigm

copyThe Association for Dementia Studies

Categories of challenge Method and measure Communication bull Design delivery amp implementation bull Cognitive (in)capacity

of evaluation studies bull Perceptions and stigmabull Theorisation bull Interpretation and meaning ofbull Measuring key concepts aesthetic experience

Ethics Values bull Formal ethics processes bull Evaluation choices value-laden andbull Accounting for lsquoriskinessrsquo of art perspectivalbull Rights and voices of people with bull Cultural value and arts engagement

dementia bull Economic valuation

Context bull Capturing and accounting for complexitybull Understanding mechanisms

copyThe Association for Dementia Studies

What do I mean by context ldquoContext includes anything external to the intervention that may act as a barrier or facilitator to its implementation or its effectrdquo (Moore et al 2015) For example bull Setting in which arts activity is experienced - physical space

routines and associated practicesbull Timebull Cultural social and relational networks of participantsbull Personal and clinical histories cultural demographies or

aesthetic preferences of participantsbull Policies practices and discourse surrounding dementia

hellipthese interact with the artistic technical and relational practice of the individual arts practitioner

copyThe Association for Dementia Studies

Context and complexity bull Effects are frequently measured or observed but

mechanisms (why something has an effect) less wellexplored or understood

bull Simple cause and effect view unlikely to help usunderstand whether the same effect will be seenanother time or in another context

bull Is it the arts activity or intervention that is complex orthe context (Hawe et al 2009)

copyThe Association for Dementia Studies

How might we better capture and understand complexity

Olafur Eliasson The wave moving on the sea between Greenland and Iceland 1999 Source httpolafureliassonnet

copyThe Association for Dementia Studies

Definition methodology ldquohellipthe study ndash the description the explanation and the justification ndash of methodshelliprdquo

ldquoI believe that the most important contribution methodology can make to science is [hellip] to help unblock the roads of inquiryrdquo

Kaplan A (1964) The conduct of inquiry methodology for behavioural science San Francisco Chandler p18 p24

copyThe Association for Dementia Studies

Definition critical ldquoCritical social research [hellip] aims at an analysis of socialprocesses delving beneath ostensive and dominantconceptual frames in order to reveal the underlyingpractices their historical specificity and structuralmanifestationsrdquo

Harvey L (1990) Critical social research London Unwin Hyman p3

ldquohellipscientific knowledge and technologies do not evolve ina vacuum Rather they participate in the social worldbeing shaped by it and simultaneously shaping itrdquo

Law J (2004) After method Mess in social science research Oxford Routledge p12

copyThe Association for Dementia Studies

What kind of literature review bull Little published work specifically on the topic of

methodological challengebull A sense that information was to be found in the

lsquogapsrsquobull Potentially important grey literature including

unpublished practice-based evaluations andreflective practice of artist practitioners

bull Wide area of focusbull Arts or health paradigm

copyThe Association for Dementia Studies

Categories of challenge Method and measure Communication bull Design delivery amp implementation bull Cognitive (in)capacity

of evaluation studies bull Perceptions and stigmabull Theorisation bull Interpretation and meaning ofbull Measuring key concepts aesthetic experience

Ethics Values bull Formal ethics processes bull Evaluation choices value-laden andbull Accounting for lsquoriskinessrsquo of art perspectivalbull Rights and voices of people with bull Cultural value and arts engagement

dementia bull Economic valuation

Context bull Capturing and accounting for complexitybull Understanding mechanisms

copyThe Association for Dementia Studies

What do I mean by context ldquoContext includes anything external to the intervention that may act as a barrier or facilitator to its implementation or its effectrdquo (Moore et al 2015) For example bull Setting in which arts activity is experienced - physical space

routines and associated practicesbull Timebull Cultural social and relational networks of participantsbull Personal and clinical histories cultural demographies or

aesthetic preferences of participantsbull Policies practices and discourse surrounding dementia

hellipthese interact with the artistic technical and relational practice of the individual arts practitioner

copyThe Association for Dementia Studies

Context and complexity bull Effects are frequently measured or observed but

mechanisms (why something has an effect) less wellexplored or understood

bull Simple cause and effect view unlikely to help usunderstand whether the same effect will be seenanother time or in another context

bull Is it the arts activity or intervention that is complex orthe context (Hawe et al 2009)

copyThe Association for Dementia Studies

How might we better capture and understand complexity

Olafur Eliasson The wave moving on the sea between Greenland and Iceland 1999 Source httpolafureliassonnet

copyThe Association for Dementia Studies

Definition critical ldquoCritical social research [hellip] aims at an analysis of socialprocesses delving beneath ostensive and dominantconceptual frames in order to reveal the underlyingpractices their historical specificity and structuralmanifestationsrdquo

Harvey L (1990) Critical social research London Unwin Hyman p3

ldquohellipscientific knowledge and technologies do not evolve ina vacuum Rather they participate in the social worldbeing shaped by it and simultaneously shaping itrdquo

Law J (2004) After method Mess in social science research Oxford Routledge p12

copyThe Association for Dementia Studies

What kind of literature review bull Little published work specifically on the topic of

methodological challengebull A sense that information was to be found in the

lsquogapsrsquobull Potentially important grey literature including

unpublished practice-based evaluations andreflective practice of artist practitioners

bull Wide area of focusbull Arts or health paradigm

copyThe Association for Dementia Studies

Categories of challenge Method and measure Communication bull Design delivery amp implementation bull Cognitive (in)capacity

of evaluation studies bull Perceptions and stigmabull Theorisation bull Interpretation and meaning ofbull Measuring key concepts aesthetic experience

Ethics Values bull Formal ethics processes bull Evaluation choices value-laden andbull Accounting for lsquoriskinessrsquo of art perspectivalbull Rights and voices of people with bull Cultural value and arts engagement

dementia bull Economic valuation

Context bull Capturing and accounting for complexitybull Understanding mechanisms

copyThe Association for Dementia Studies

What do I mean by context ldquoContext includes anything external to the intervention that may act as a barrier or facilitator to its implementation or its effectrdquo (Moore et al 2015) For example bull Setting in which arts activity is experienced - physical space

routines and associated practicesbull Timebull Cultural social and relational networks of participantsbull Personal and clinical histories cultural demographies or

aesthetic preferences of participantsbull Policies practices and discourse surrounding dementia

hellipthese interact with the artistic technical and relational practice of the individual arts practitioner

copyThe Association for Dementia Studies

Context and complexity bull Effects are frequently measured or observed but

mechanisms (why something has an effect) less wellexplored or understood

bull Simple cause and effect view unlikely to help usunderstand whether the same effect will be seenanother time or in another context

bull Is it the arts activity or intervention that is complex orthe context (Hawe et al 2009)

copyThe Association for Dementia Studies

How might we better capture and understand complexity

Olafur Eliasson The wave moving on the sea between Greenland and Iceland 1999 Source httpolafureliassonnet

copyThe Association for Dementia Studies

What kind of literature review bull Little published work specifically on the topic of

methodological challengebull A sense that information was to be found in the

lsquogapsrsquobull Potentially important grey literature including

unpublished practice-based evaluations andreflective practice of artist practitioners

bull Wide area of focusbull Arts or health paradigm

copyThe Association for Dementia Studies

Categories of challenge Method and measure Communication bull Design delivery amp implementation bull Cognitive (in)capacity

of evaluation studies bull Perceptions and stigmabull Theorisation bull Interpretation and meaning ofbull Measuring key concepts aesthetic experience

Ethics Values bull Formal ethics processes bull Evaluation choices value-laden andbull Accounting for lsquoriskinessrsquo of art perspectivalbull Rights and voices of people with bull Cultural value and arts engagement

dementia bull Economic valuation

Context bull Capturing and accounting for complexitybull Understanding mechanisms

copyThe Association for Dementia Studies

What do I mean by context ldquoContext includes anything external to the intervention that may act as a barrier or facilitator to its implementation or its effectrdquo (Moore et al 2015) For example bull Setting in which arts activity is experienced - physical space

routines and associated practicesbull Timebull Cultural social and relational networks of participantsbull Personal and clinical histories cultural demographies or

aesthetic preferences of participantsbull Policies practices and discourse surrounding dementia

hellipthese interact with the artistic technical and relational practice of the individual arts practitioner

copyThe Association for Dementia Studies

Context and complexity bull Effects are frequently measured or observed but

mechanisms (why something has an effect) less wellexplored or understood

bull Simple cause and effect view unlikely to help usunderstand whether the same effect will be seenanother time or in another context

bull Is it the arts activity or intervention that is complex orthe context (Hawe et al 2009)

copyThe Association for Dementia Studies

How might we better capture and understand complexity

Olafur Eliasson The wave moving on the sea between Greenland and Iceland 1999 Source httpolafureliassonnet

copyThe Association for Dementia Studies

Categories of challenge Method and measure Communication bull Design delivery amp implementation bull Cognitive (in)capacity

of evaluation studies bull Perceptions and stigmabull Theorisation bull Interpretation and meaning ofbull Measuring key concepts aesthetic experience

Ethics Values bull Formal ethics processes bull Evaluation choices value-laden andbull Accounting for lsquoriskinessrsquo of art perspectivalbull Rights and voices of people with bull Cultural value and arts engagement

dementia bull Economic valuation

Context bull Capturing and accounting for complexitybull Understanding mechanisms

copyThe Association for Dementia Studies

What do I mean by context ldquoContext includes anything external to the intervention that may act as a barrier or facilitator to its implementation or its effectrdquo (Moore et al 2015) For example bull Setting in which arts activity is experienced - physical space

routines and associated practicesbull Timebull Cultural social and relational networks of participantsbull Personal and clinical histories cultural demographies or

aesthetic preferences of participantsbull Policies practices and discourse surrounding dementia

hellipthese interact with the artistic technical and relational practice of the individual arts practitioner

copyThe Association for Dementia Studies

Context and complexity bull Effects are frequently measured or observed but

mechanisms (why something has an effect) less wellexplored or understood

bull Simple cause and effect view unlikely to help usunderstand whether the same effect will be seenanother time or in another context

bull Is it the arts activity or intervention that is complex orthe context (Hawe et al 2009)

copyThe Association for Dementia Studies

How might we better capture and understand complexity

Olafur Eliasson The wave moving on the sea between Greenland and Iceland 1999 Source httpolafureliassonnet

copyThe Association for Dementia Studies

What do I mean by context ldquoContext includes anything external to the intervention that may act as a barrier or facilitator to its implementation or its effectrdquo (Moore et al 2015) For example bull Setting in which arts activity is experienced - physical space

routines and associated practicesbull Timebull Cultural social and relational networks of participantsbull Personal and clinical histories cultural demographies or

aesthetic preferences of participantsbull Policies practices and discourse surrounding dementia

hellipthese interact with the artistic technical and relational practice of the individual arts practitioner

copyThe Association for Dementia Studies

Context and complexity bull Effects are frequently measured or observed but

mechanisms (why something has an effect) less wellexplored or understood

bull Simple cause and effect view unlikely to help usunderstand whether the same effect will be seenanother time or in another context

bull Is it the arts activity or intervention that is complex orthe context (Hawe et al 2009)

copyThe Association for Dementia Studies

How might we better capture and understand complexity

Olafur Eliasson The wave moving on the sea between Greenland and Iceland 1999 Source httpolafureliassonnet

copyThe Association for Dementia Studies

Context and complexity bull Effects are frequently measured or observed but

mechanisms (why something has an effect) less wellexplored or understood

bull Simple cause and effect view unlikely to help usunderstand whether the same effect will be seenanother time or in another context

bull Is it the arts activity or intervention that is complex orthe context (Hawe et al 2009)

copyThe Association for Dementia Studies

How might we better capture and understand complexity

Olafur Eliasson The wave moving on the sea between Greenland and Iceland 1999 Source httpolafureliassonnet

copyThe Association for Dementia Studies

How might we better capture and understand complexity

Olafur Eliasson The wave moving on the sea between Greenland and Iceland 1999 Source httpolafureliassonnet

copyThe Association for Dementia Studies

Context

karengrayworcacuk

Supervisory team Simon Evans (Worcester) Amanda Griffiths and Justine Schneider (Nottingham)