Social Marketing Implementation: A Way of · Youth Involvement Items GA.2. To what extent do youth...

20

Transcript of Social Marketing Implementation: A Way of · Youth Involvement Items GA.2. To what extent do youth...

Page 1: Social Marketing Implementation: A Way of · Youth Involvement Items GA.2. To what extent do youth organizations and/or representatives actively participate in planning, implementation,
Page 2: Social Marketing Implementation: A Way of · Youth Involvement Items GA.2. To what extent do youth organizations and/or representatives actively participate in planning, implementation,

Funded by the Substance Abuse and Mental Health Services Administration (SAMHSA) through

the Child, Adolescent and Family Branch, Center for Mental Health Services

Kirstin Painter, PhD, SAMHSA Contracting Officer Representative

Emily Lichvar, PhD SAMHSA Alternate Contracting Officer Representative

Social Marketing Implementation: A Way of

Getting Youth Involved in Systems of Care

Monique Thornton, MPH; Nataly Johanson Tello; Sushama Rajapaksa, MA; Joselin Bravo;

Amanda Vithidkul, MPH; Chandria Jones, PhD, MPH

Page 3: Social Marketing Implementation: A Way of · Youth Involvement Items GA.2. To what extent do youth organizations and/or representatives actively participate in planning, implementation,

Disclaimer

The views, opinions, and content expressed in this presentation do not necessarily reflect the views, opinions, or policies of the Center for Mental Health Services (CMHS), the Substance Abuse and Mental Health Services Administration (SAMHSA), or the U.S. Department of Health and Human Services (HHS).

Page 4: Social Marketing Implementation: A Way of · Youth Involvement Items GA.2. To what extent do youth organizations and/or representatives actively participate in planning, implementation,

Focus of this Presentation

• Describe the extent to which social marketing-related mechanisms and strategies are being implemented by grantees

• Describe the effectiveness of these social marketing-related mechanisms and strategies

• Describe how a grantee’s level of implementation of social marketing-related mechanisms and strategies relates to youth involvement in that grant

Page 5: Social Marketing Implementation: A Way of · Youth Involvement Items GA.2. To what extent do youth organizations and/or representatives actively participate in planning, implementation,

Data Source

• The Self-Assessment of Implementation Survey (SAIS) is a data collection component of the CMHI SOC Expansion National Evaluation conducted by Westat

– Quantitative self-report measure of grantee implementation completed by respondents at programmatic and administrative levels from 34 FY2013 and FY2014 SOC expansion grantees

– Administered online in the second year of grant funding

Page 6: Social Marketing Implementation: A Way of · Youth Involvement Items GA.2. To what extent do youth organizations and/or representatives actively participate in planning, implementation,

SAIS Content Areas

• The SAIS covers the following content areas:– Barriers and facilitators to implementation – Governance– Management– Support of local service delivery– Geographic area covered by SOC– SOC principles: family-driven, youth-guided, individualized,

evidence-supported, culturally and linguistically competent, interagency/collaborative, coordination, accessible, community based, least restrictive

Page 7: Social Marketing Implementation: A Way of · Youth Involvement Items GA.2. To what extent do youth organizations and/or representatives actively participate in planning, implementation,

Social Marketing Items

Not planned

1

Planned but

not started

2

Somewhat

implemented

3

Significantly

implemented

4

Extensively

implemented

5

Don’t know

99

M.5.a. SOC sites use several strategies at the jurisdiction level to ensure access to

services: Social marketing of system of care

S.4.a. SOC sites use several jurisdiction-level strategies to support local service

systems in their efforts to reach underserved populations: Support of local social

marketing efforts

GA.5.a. Which of the following strategies are used to share information on SOC

implementation and expansion efforts with partner agencies and organizations across

the jurisdiction?: Social marketing efforts

Please select the response that best describes how each is being used in [your system of care].

Page 8: Social Marketing Implementation: A Way of · Youth Involvement Items GA.2. To what extent do youth organizations and/or representatives actively participate in planning, implementation,

Youth Involvement Items

GA.2. To what extent do youth organizations and/or representatives actively participate in planning,

implementation, and expansion activities across the jurisdiction (for example, are there areas with

little or no active youth representation)?

G.3.b. Overall, how involved have youth representatives been in the SOC governance at the

jurisdictional level in the past 6 months?

M.2.b. Overall, how involved have youth representatives been in SOC management at the

jurisdictional level in the past 6 months?

Please select the response that best describes how each is being used in [your system of care].

Not at all involved A little involved Moderately involved Extensively involved Don’t know

1 2 3 4 99

Not

active

Active in a small area

of the jurisdiction

Active in about half of

the jurisdiction

Active in many areas/most of

the jurisdiction

Active throughout the

jurisdiction

Don’t

know

1 2 3 4 5 6

Page 9: Social Marketing Implementation: A Way of · Youth Involvement Items GA.2. To what extent do youth organizations and/or representatives actively participate in planning, implementation,

Methods

• Data analyzed in SAS Statistical Software

• Data was cleaned; recoded as needed

• Missing data was excluded from analyses

• Analyses included:

– Descriptive statistics

– Pearson correlations

– Frequencies

– Odds ratios

Page 10: Social Marketing Implementation: A Way of · Youth Involvement Items GA.2. To what extent do youth organizations and/or representatives actively participate in planning, implementation,

SAIS Respondents

Family Reps, 10%Other Agency Reps, 9%

CMHI Project Directors

Family Reps

Youth Reps

MH Agency Reps

CW Agency Reps

JJ/Education Agency Reps

Other Agency Reps

Quality Care Monitors

Page 11: Social Marketing Implementation: A Way of · Youth Involvement Items GA.2. To what extent do youth organizations and/or representatives actively participate in planning, implementation,

Preliminary Results: Descriptives

Table 1. Social Marketing Implementation and Youth Involvement in FY2013 and FY2014 CMHI SOC Expansion Grantees: Descriptive Statistics (N = 182)

Variable Mean SD Range n (%)

Social marketing strategies used to share information with partner agencies and organizations

4.36 1.33 1-6 120 (66%)

Social marketing strategies used to ensure access to services 4.19 1.42 1-6 145 (79%)

Social marketing strategies used to support local service systems in their efforts to reach underserved populations

4.01 1.41 1-6 120 (66%)

Extent to which youth organizations and/or representatives actively participate in activities

3.16 1.23 1-5 147 (80%)

How involved youth representatives have been in the SOC governance at the jurisdictional level in the past 6 months

2.84 .99 1-4 138 (75%)

How involved youth representatives have been in SOC management at the jurisdictional level in the past 6 months

2.69 1.00 1-4 143 (78%)

Page 12: Social Marketing Implementation: A Way of · Youth Involvement Items GA.2. To what extent do youth organizations and/or representatives actively participate in planning, implementation,

Preliminary Results: Correlations

Table 2. Pearson Correlation Coefficients for Social Marketing Implementation and Youth Involvement in FY2013 and FY2014 CMHI SOC Expansion Grantees

Youth org/rep active participation in activities

Youth repinvolvement in SOC governance

Youth repinvolvement in SOC management

Social marketing strategies to ensure access to services

0.47979*n = 131

0.26018n = 116

0.30311n = 126

Social marketing strategies to support local service systems in their efforts to reach underserved populations

0.47474*n = 114

0.46725*n = 99

0.39408*n = 109

Social marketing strategies to share information with partner agencies and organizations

0.43346*n = 112

0.32330n = 99

0.37241*n = 110

n = the number of observations

*p<.0001

Page 13: Social Marketing Implementation: A Way of · Youth Involvement Items GA.2. To what extent do youth organizations and/or representatives actively participate in planning, implementation,

Preliminary Results: Odds Ratios

Table 3. Frequencies for Social Marketing Implementation and Youth Involvement in FY2013 and FY2014 CMHI SOC Expansion Grantees

Youth Involvement

Social Marketing Implementation

High Low Total

High68(44%)

36(23%)

104(67%)

Low21(13%)

31(20%)

52(33%)

Total89(57%)

67(43%)

156(100%)

Grantees that reported having high social marketing implementation were 1.79 times more likely to report high youth involvement when compared to grantees who reported low social marketing implementation.

Page 14: Social Marketing Implementation: A Way of · Youth Involvement Items GA.2. To what extent do youth organizations and/or representatives actively participate in planning, implementation,

Discussion

• The preliminary findings from these analyses align with findings from qualitative data analysis of stakeholder interviews with project directors and youth and family representatives from FY2013 and FY2014 System of Care (SOC) Expansion and Sustainability Implementation grantees.

Source: Thornton, M., Vithidkul, A., Jones, C., Jones, G., and Rosenblatt, A. (2017. March). Developing a

Conceptual Framework for Social Marketing within Children’s Mental Health Systems of Care (poster

presenter). Annual Children’s Mental Health Research & Policy Conference on Child, Adolescent, and

Young Adult Behavioral Health, Tampa, FL.

Page 15: Social Marketing Implementation: A Way of · Youth Involvement Items GA.2. To what extent do youth organizations and/or representatives actively participate in planning, implementation,

Discussion

A keyword search query was conducted in NVivo 11 on the stakeholder interviews. Thirty grantees (13 FY2013 and 17 FY2014) were identified, and 53 interviews were pulled into the query results.

Interviews were reviewed to create this descriptive model.

The highlighted components of the model represent key ways in which grantees were involving youth in their social marketing activities.

Page 16: Social Marketing Implementation: A Way of · Youth Involvement Items GA.2. To what extent do youth organizations and/or representatives actively participate in planning, implementation,

Limitations

• Limited data

• Missing data

• Possible confounding variables

• Self-report bias

Page 17: Social Marketing Implementation: A Way of · Youth Involvement Items GA.2. To what extent do youth organizations and/or representatives actively participate in planning, implementation,

Conclusions

• There is some relationship between the level of implementation of social marketing strategies and youth involvement in grants.

• There are several ways to involve youth in social marketing planning and implementation, which could act as a gateway to greater participation in grant management, governance, and expansion activities.

Page 18: Social Marketing Implementation: A Way of · Youth Involvement Items GA.2. To what extent do youth organizations and/or representatives actively participate in planning, implementation,

Next Steps

• Use network analysis to understand youth engagement in grantee implementation efforts in social marketing

• Examine the practice steps involved in implementing social marketing strategies

Page 19: Social Marketing Implementation: A Way of · Youth Involvement Items GA.2. To what extent do youth organizations and/or representatives actively participate in planning, implementation,

Contact Information

Monique Thornton, MPH

National Evaluation Team

[email protected]

Page 20: Social Marketing Implementation: A Way of · Youth Involvement Items GA.2. To what extent do youth organizations and/or representatives actively participate in planning, implementation,

More on Youth Involvement

Symposium: Elevation, Engagement & Empowerment: Advancing Youth Voice in Evaluation

Symposium Chair: Abram Rosenblatt, PhD, Westat, Rockville, Maryland

Discussant: Dorothy Webman, DSW, Webman Associates, LLC, New York, New York

Tuesday, March 6, 2018

1:30 pm - 2:30 pm

Bayshore 5

Measure What You

Treasure: Engaging

Youth in Data

Collection

Glynis Jones, MSM; Chandria Jones, PhD,

Westat, Rockville, MD

Innovative Approaches

for Engaging Youth in

Systems of Care

Benedicta Osafo-Darko, MA; Chandria Jones,

PhD; Viola Samson, MD; Affoue A. Sara

Ayemonche, BS; Abram Rosenblatt, PhD,

Westat, Rockville, MD

Moving Forward: The

Next Phase of Youth

Voice in Evaluation

Brianne Masselli, Youth MOVE National,

Portland, ME