Download - Chapter 15 Evaluation Recognizing Success. Social Work Evaluation and Research Historically –Paramount to the work of early social work pioneers Currently.

Chapter 15

Evaluation

Recognizing Success

Social Work Evaluation and Research

• Historically – Paramount to the work of early social work

pioneers

• Currently– Renewed emphasis on research with

emphasis on evidence-based practice

© 2013 Pearson Education, Inc. All rights reserved.

Evidence-Based Decision Making

• Develop answerable question

• Track down evidence

• Critically appraise evidence

• Apply the evidence

• Evaluate effectiveness


Implications for Practice

• Benefits– Enhances scientific foundation– Legitimizes practice strategies– Supports standards of accountability

• Cautions– Privileged information; May promote a focus

on individuals than on environmental contexts


Ethics in Research

• Informed consent

• Confidentiality

• Anonymity

• Voluntary participation

• Objectivity

• Careful research design

• Accurate reporting of findings


The Research Process

• Specify research problem

• Review the literature

• Relate research problem to theory

• Formulate hypothesis

• Select research design


The Research Process

• Gather data

• Analyze data

• Interpret results

• Identify implications

• Prepare report


Research Terminology

• Variables– Independent/Dependent/Intervening variables

• Hypothesis

• Measurement

• Reliable and validity

• Qualitative and quantitative analysis


Practice Evaluation

• Measure the effectiveness of strategies

• Types– Progress evaluation– Client outcome assessment– Program evaluation


General Evaluative Criteria

• Key Questions– Was the desired outcome attained?– Was the outcome reached in the most direct

way?– Were the client’s rights protected and the

rights of others ensured?


Progress Evaluation

• Continual monitoring and evaluating of action plan– Detect positive movements– Steer activities toward desired outcomes– Evaluate the viability of the plan

• Collaborative process


Client Outcome Assessment

• Measures – Degree of achievement of client systems'

expressed goals – Effectiveness of the strategies implemented

• Example: Goal Attainment Scaling – Uses clients’ goal statements as

measurement criteria


Types of Single-System Designs

• AB design

• B design

• ABC design

• ABAB design

• BAB design

• Multiple baseline– Multiple clients, settings, & target problems


AB Design

• Includes – one baseline period (A) – one intervention period (B)

• Introduce single independent variable or intervention at end of baseline phase


B Design

• Steps– Apply intervention– Measure any changes that occur

• Drawback: Lack of baseline for comparing before and after measures


ABC Design

• Successive intervention phases following the baseline period

• Drawback: – Introduce several interventions – Uncertain which intervention has the most

effect


ABAB Design

• String of AB designs – Same client system and the same intervention

• Reversal or withdrawal design - more evidence of the causal effects

• Ethical issue: planned withdrawal of interventions


BAB Design

• Reversal design– No initial baseline pattern– Immediate introduction of an intervention– Observe and measure changes in data

patterns during phases

• Ethical issue: planned withdrawal of intervention


Multiple Baselines

• Multiple clients: Generalize findings

• Multiple settings– Generalize outcomes of intervention in

various settings in client's life.

• Multiple target problems – Simultaneously evaluate the change in

multiple situations of a single client


Limitations of Single-System Designs

• Not all social workers use behavioral or task-centered treatment models

• Questions– How to accommodate the research role

without violating the service role– How to ensure empowerment-oriented

participation by clients


Program Evaluation

• Is the program accomplishing what it set out to do?

• Consumer satisfaction surveys – Assess clients' perceptions or attitudes about

an agency's delivery of services

• Use to– Make administrative decisions; Set priorities
