Michigan’s Prekindergarten: Michigan School Readiness Program MSRP
Evaluation readiness, program quality and outcomes in men...
Transcript of Evaluation readiness, program quality and outcomes in men...
![Page 1: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/1.jpg)
Evaluation readiness, program quality and outcomes in men's behaviour change programs
Practice and policy implications of an ANROWS Perpetrator Interventions Research project
October 2018
![Page 2: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/2.jpg)
Research collaboratorsAndrew Day, James Cook University
Rodney VlaisDonna Chung, Curtin University
Damian Green, Curtin University
![Page 3: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/3.jpg)
Why this research?
![Page 4: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/4.jpg)
Components of the research
![Page 5: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/5.jpg)
Evolution
![Page 6: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/6.jpg)
Evolution
![Page 7: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/7.jpg)
s
Evolution
![Page 8: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/8.jpg)
Evolution
![Page 9: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/9.jpg)
State of knowledge on the effectiveness of MBCPs
![Page 10: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/10.jpg)
Minimum standardsApproaches taken by other jurisdictions
![Page 11: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/11.jpg)
Minimum standards
Where's the evidence?
![Page 12: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/12.jpg)
Minimum standards
Principles and intent, or prescriptions?
![Page 13: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/13.jpg)
Compliance with minimum standards
![Page 14: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/14.jpg)
Beyond MBCPs
![Page 15: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/15.jpg)
![Page 16: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/16.jpg)
Minimum standards
![Page 17: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/17.jpg)
Minimum standards
Practice guidance
![Page 18: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/18.jpg)
Minimum standards
• Support for program providers to comply with standards
![Page 19: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/19.jpg)
Minimum standards
• Funding to enable compliance
![Page 20: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/20.jpg)
Minimum standards
![Page 21: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/21.jpg)
Let’s innovate!
![Page 22: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/22.jpg)
Accreditation systems
![Page 23: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/23.jpg)
Key principles• Be clear and transparent
• Support providers to become accreditation‐ready
• Have sufficient accreditation‐related tools, templates and resources to scaffold accreditation‐readiness
• Not be too time consuming
• Utilise accreditors with some independence from the accrediting body
• Have a review and appeals process
• Have some flexibility for program providers to demonstrate compliance in ways that make sense in local contexts
• Enable opportunities for program providers who do not meet particular standards to improve their practice to do so
• Be based on a positive rather than punitive spirit
![Page 24: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/24.jpg)
Accreditation systems
![Page 25: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/25.jpg)
Accreditation systems
![Page 26: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/26.jpg)
Accreditation systems
Program or organisational level?
![Page 27: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/27.jpg)
Components of comprehensive accreditation systems
• Three‐yearly program audits‐ live observations of practice‐ client files‐ staff files‐ policies & procedures documentation
• Informal, more regular check‐ins• Peer‐review of practice• Innovation support• Complaints mechanism
![Page 28: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/28.jpg)
Accreditation systems
![Page 29: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/29.jpg)
A supportive accreditation approach
![Page 30: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/30.jpg)
Beyond MBCPsStandards and accreditation systems that encompass an expanding diversity of perpetrator intervention programs
![Page 31: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/31.jpg)
Specialist qualifications & training
![Page 32: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/32.jpg)
Facilitating communities of practice
![Page 33: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/33.jpg)
Female partners’ experiences of MBCPs• 6 women, aged 30 – 42, two separated with VROs• 5 were relieved he was in a MBCP – an outsider / professional having ‘eyes’ on him
• Partner contact seen as important• Experiences of partner contact were very mixed however … not sufficiently timely … not sufficiently assertive … not focused on children … wasn’t clear what it would involve
• Varied responses to whether the MBCP was making a difference … some reported a positive difference … major fear that changes will be short‐lived once he completes the program
![Page 34: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/34.jpg)
“…because everything I know about the program is from him. Like, what’s going on, what’s the steps, one‐to‐one, or he told me about something they’re moving on to, like, a group or maybe you need one‐to‐one, or you need bookings, and if he doesn’t tell me I would not know”.
![Page 35: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/35.jpg)
“Because, I was just like, look, you know, you have these services available, and I’m asking you for them, but yet I don’t get them. You know, you don’t follow up, you don’t call me back, you don’t…you know, you said that, you’d try and do this, and I don’t hear from you. I get that he’s the one with the problem, you know I understand that, he’s the one that needs fixing, but he’s left a trail of destruction in his wake, and the kids need help, you know, let alone me. My kids need help, I can deal with myself, but when you have got a child who is trying to stab himself and he’s cutting himself with glass, what more is it going to take, for you to listen and help?”
![Page 36: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/36.jpg)
Program evaluation
• Evaluation in a systems context
![Page 37: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/37.jpg)
Program evaluation
![Page 38: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/38.jpg)
Incidents of violence or patterns of coercive control and social entrapment?
![Page 39: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/39.jpg)
Program evaluation
![Page 40: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/40.jpg)
Program evaluation
![Page 41: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/41.jpg)
Program evaluation
Making each other's work easier
![Page 42: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/42.jpg)
Outcome measures: Proximal measures of change
![Page 43: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/43.jpg)
Outcome measures: Tools and scales
• Project Mirabal scales• Actuarial risk assessment scales• Violent & controlling behaviour checklists• Project IMPACT
![Page 44: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/44.jpg)
Program logicBoring bureaucratic process ...
or genuine driver of program quality?
![Page 45: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/45.jpg)
3 levels of program logic models
1. Systems level2. Program level3. Individual change level
![Page 46: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/46.jpg)
Monitoring & evaluation frameworks
Without conceptual clarity about objectives and change mechanisms, you can't evaluate
![Page 47: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/47.jpg)
Program integrity
![Page 48: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/48.jpg)
Monitoring program integrity
![Page 49: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/49.jpg)
Tailoring interventions
![Page 50: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/50.jpg)
RNR
![Page 51: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/51.jpg)
Differential responses?
![Page 52: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/52.jpg)
Tailoring interventions in practice• More time for initial and ongoing assessment
• Strengthening program readiness and capacity to participate
• Case planning• Case reviews ... including joint reviews with the referrer• Case management ... and service coordination
• Supplementary individual sessions
• Optional intervention components or modules
• Safety & accountability planning
![Page 53: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/53.jpg)
Tailoring interventions
Barriers to tailoring
![Page 54: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/54.jpg)
Practitioner focus groups
• Managing low levels of readiness to change• Assessment tools often not fit for purpose• Quality of the program materials affects program integrity
• Little consistency about the signposts for change• Very little window into outcomes• Some attempts towards individualised safety planning
• Relationships with referrers …
![Page 55: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/55.jpg)
Tailoring interventions
• Providing a program or responding to risk?
![Page 56: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/56.jpg)
Safety & accountability planning
![Page 57: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/57.jpg)
Safety & accountability planning
More than an exit plan
![Page 58: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/58.jpg)
Safety & accountability planningBuilding it in throughoutthe program
Process as important as the product
Initial assessment phase
Safety & accountabilityreview processes – harnessinginvolvement of the group
Use of individual sessions
Strengthening plans afterhigh impact sessions
Extended exit process
Follow‐up on whether he is using it!
![Page 59: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/59.jpg)
Safety & accountability planning
![Page 60: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/60.jpg)
Safety & accountability planning
More than a piece of paper
Not a practitioner case formulationor case plan
Creativity required!
Active involvement of the man –it’s his plan to be accountable tothose his violence impacts upon
… though scaffolding his work ondeveloping the plan is required
… some men will need morescaffolding than others
Attuned to his preferred learningand information processing styles
Uses media / formats that he will most readily access, and thathave impact
![Page 61: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/61.jpg)
Recommendations1. Program providers should be supported to give more attention to their program’s theory of change, including the development of program logic models.
2. Program logic models should consider systems‐level, individual‐level and (if appropriate) community‐level impacts and outcomes.
3. Program providers should be supported to implement processes that monitor and improve program integrity and fidelity – but not in a way that leads to rigid, over‐manualised approaches.
4. The development of minimum standards, at the current time, should be based on (sufficiently detailed, articulated and nuanced) practice principles rather than practice prescriptions.
5. Minimum standards should focus as much on an organisation’s capacity to safely and sustainably provide a range of specialist perpetrator interventions as on the specifics of any particular program run.
6. Accreditation systems based on monitoring program provider compliance with minimum standards need to be multi‐component rather than singular 'tick and flick’ registration processes, and include observations of live practice.
![Page 62: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/62.jpg)
7. Accreditation systems should be constructed and enacted in ways that support program providers to reflect upon and improve the quality of their practice in line with agency‐level vision and ethos – not only as a means to monitor adherence to standards.
8. Safety and accountability planning should be prioritised in sector and practice development efforts as a potentially high impact way to improve the quality and effectiveness of MBCP provision.
9. If calls are to continue for community‐based MBCP providers to adopt RNR and other principles to tailor their programs to individual perpetrator and family circumstances, they need to be funded and equipped to do so.
10. A national, MBCP outcomes framework should be developed to engender some consistency in evaluation frameworks and evaluation activity, and to help build the evidence base.
11. Program providers should be supported to extend their program logic models into evaluation and performance monitoring plans, even if not all aspects of the plan can immediately be implemented.
12. Australian jurisdictions should consider shared work to develop the equivalent of the European Project Impact outcome evaluation tools and researcher‐practitioner partnerships.
![Page 63: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/63.jpg)
13. A suite of outcome evaluation tools should include victim‐centred measures that focus on exposure to coercive control.
14. Evaluation plans should include measures of impacts on adult and child victims that do not rely on changes in the perpetrator’s behaviour.
15. Proximal measures of the impact of MBCPs offer considerable promise to guide clinical and program evaluation efforts, but work in this area needs to be embedded within a research and evaluation stream that is adequately resourced.
16. Research to identify quality practice in partner support and safety work is urgently needed.
17. Partner support and safety work needs to be properly funded and prioritised, rather than remaining secondary relative to resources allocated to engaging perpetrators. Please consider removing this list for consistency with the executive summary and repetition with the below tables of recommendations.
![Page 64: Evaluation readiness, program quality and outcomes in men ...sfv.org.au/wp-content/uploads/2018/10/WA-ANROWS... · 1. Program providers should be supported to give more attention](https://reader034.fdocuments.net/reader034/viewer/2022050304/5f6ca8a3f7409b22903bd3fd/html5/thumbnails/64.jpg)
Evaluation readiness, program quality and outcomes in men's behaviour change programs
Practice and policy implications of an ANROWS Perpetrator Interventions Research project
October 2018