Appendix A:CS-CASH Logic Model

We conductRESEARCH and OUTREACH….

__________Outreach CorePerformance Indicators1

•Education programs•Outreach activities

Research CorePerformance Indicators1

•External Grants•Funded CS-CASH Pilots•NIOSH-funded projects

That leads toPRODUCTS.

___________Outreach & Research Cores’Performance Indicators1

•Reports•Presentations•Databases •Instruments•Conferences •Trainings•Media and Technology•Publications•New grants

And we

move them to…

ACTIVITIES OUTPUTS OURSTAKEHOLDERS 2

____________Outreach & Administrative Cores’Networks• Healthcare providers• Technology

producers• Policy makers• Labor, trade,

professional organizations

• Extension Agencies • Educators• Government

agencies (e.g.,USDA)• Rural leadersResearch Core Networks• Other Researchers• Funding Agencies

Who TAKE ACTION to

develop or revise practices/policies

____________Outreach & Administrative Cores• Best Practices • Guidelines• New Technology• Trade & media

releases• New Websites• New CurriculaResearch Core• Enhanced

Research Capacity• Large national

grant funding• Pilot projects

sustained

Which influences our END USERS

through improved knowledge and attitudes about

health & safety3…_______________Outreach, Research & Administrative Core End Users•Ag Workers•Ag Employers•Ag Operators•Scientists4

INTERMEDIATE OUTCOMES

END OUTCOMES

SOCIAL BENEFITS METRICS 3,5-7

Population Safety • Self-reported PPE use• Self-reported risk reductions

Population Health • Self-reported hearing status• Self-reported respiratory• Self-reported injury

Quality of Life• BRFS Item

ECONOMIC BENEFITS METRICS5

Health Care Utilization5

• Self-reported office visits Self-reported ED use

• Self-reported hospitalization days

• Self-reported lost work days• Self-reported out of pocket

expenses for injuryCost Benefits

• Program costs relative toeconomic impacts

CENTER SUSTAINABLITY METRICS 8

Effective Governance

And that leads

to long-range impact

4/25/16

1. Performance Measure Source: NIOSH Logic Model. Data collected for CS CASH through Online Database.2. Performance Measure Source: NIOSH Goals and Logic Model. Data collected for CS CASH through Social Network Analysis3. Performance Measure Source: Blumenthal , D., McGinnis, M. (2015). Measuring Vital Signs. JAMA. 2015;313(19):1901-1902. doi:10.1001/jama.2015.4862; Pincus, H., Zainab, A., Blank, A., & Mazmanian, P. (2013). Evaluation and the NIH Clinical Translational Science Awards: A Top Ten List. Evaluation & the

Health Profession, 36,411-431. Data collected for CS CASH through POPULATION-BASED OUTCOMES AND END OUTCOMES EVALUATION SURVEY and CS CASH INJURY SURVEILLANCE SURVEY (NASD)4. Zhang, Y., Wang, L., Diao, T. The Quantitative Evaluation of the Clinical and Translational Science Awards Program Based on Science Mapping and Scientometric Analysis. CTS Journal 6 (6). 452 – 457.5. Performance Measure Source: Institute of Medicine (2015). Vital Signs: Measuring Health and Health Care: Core Metrics for Health and Healthcare Progress. National Academies of Health Accessed at: http://iom.nationalacademies.org/Reports/2015/Vital-Signs-Core-Metrics.aspx; Blumenthal , D.,

McGinnis, M. (2015). Measuring Vital Signs. JAMA. 2015;313(19):1901-1902. doi:10.1001/jama.2015.4862. Data Collected for CS CASH through POPULATION-BASED OUTCOMES AND END OUTCOMES EVALUATION SURVEY and CS CASH INJURY SURVEILLANCE SURVEY (NASD) 6. Data collected through CS CASH INJURY SURVEILLANCE SURVEY (NASS)7. Pincus, H., Zainab, A., Blank, A., & Mazmanian, P. (2013). Evaluation and the NIH Clinical Translational Science Awards: A Top Ten List. Evaluation & the Health Profession, 36,411-431. Data collected from ICE Instrument and Field Visits8. Cramer, M., Atwood, J., Stoner, J. (2006). Measuring the Organizational Effectiveness of Coalitions. Public Health Nursing Journal. 23(1), 74-87.

2017 3/7/2017

Appendix B:Internal Coalition Effectiveness©

The ICE© measures the organizational effectiveness and governance of a coalition, such as the Central States Center for

Agricultural Safety and Health (CS-CASH). There are two sections - please complete both.

Section 1 evaluates how effectively the CS-CASH members work together for common goals and objectives.

Section 2 evaluates how effectively the CS-CASH leaders facilitate achievement of common goals and objectives.

(Note-Leaders include R. Rautiainen, T. Wyatt, E. Duysen, E. Rogan, D. Romberger, J. Poole, C. Kelling, A. Yoder, A. Ramos, M.

Cramer, and J. Pomicter)

SECTION 1. CS-CASH MEMBERS….

Strongly Disagree

Somewhat Disagree

Slightly Disagree

Unsure Slightly Agree

Somewhat Agree

Strongly Agree

1. Have a shared social vision for the CS-CASH goals

2. Agree with the CS-CASH mission and purpose

3. Work together to make CS-CASH financial resources go substantially further

4. Work together to coordinate CS-CASH activities to avoid duplication of efforts and maximize collaboration

5. Work together to strengthen each other’s’ advocacy/dissemination efforts on behalf of the CS-CASH

6. Work together to expand each other’s knowledge and potential for addressing CS-CASH issues that arise

7. Enrich each other’s competencies on topics related to clinical and translational research

8. Work together to establish positive relations with those whom the CS-CASH wants to engage and mobilize

9. Encourage each other’s active participation in CS-CASH decision-making processes

10. Encourage each other to identify and analyze problems, develop solutions, and evaluate outcomes

11. Have a sense of inclusivity that engages a variety of individuals from the community and partnering institutions in the work of the CS-CASH

12. Successfully implement the vast majority of the CS-CASH milestones and metrics on a timely basis .

13. Take the necessary corrective actions when problems arise regarding lack of activity implementation by other CS-CASH members

a. Believe the CS-CASH clinical and translational research resources are shared equitably across the coalition of institutional partners

b. Believe the CS-CASH clinical and translational research resources are responsive to and reflect the needs and interests of faculty and community members

M. Cramer, J. Atwood, J. Stoner, 2007. Reproduction without the authors’ express written consent is not permitted. Permission to sue this scale may be obtained from Mary E. Cramer, University of Nebraska Medical Center, 985330 Nebraska Medical Center, Omaha, NE 68198-5330, or mecramer@unmc.edu.

2017 3/7/2017

SECTION 2. CS-CASH LEADERS….

Strongly Disagree

Somewhat Disagree

Slightly Disagree

Unsure Slightly Agree

Somewhat Agree

Strongly Agree

14. Facilitate a shared social vision among CS-CASH members

15. Facilitate member consensus about the CS-CASH mission and purpose

16. Promote involvement by a broad base of members in the work of the CS-CASH

17. Reposition CS-CASH assets, competencies, and resources to meet changing needs and priorities

18. Develop other clinical and translational research leaders within the CS-CASH

19. Provide opportunities for CS-CASH members to be involved in on-going quality improvement processes

20. Provide resources to keep CS-CASH members updated and informed on clinical and translational research topics, methodologies, and best practices

21. Provide resources to support clinical and translational leadership skills across the CS-CASH

22. Establish positive relations with community members (e.g., Community Advisory Board) in order to engage and mobilize them for involvement in clinical and translational research activities

23. Facilitate positive, trusting relations with partnering institutions

24. Build and support respectful relationships with CS-CASH members

25. Encourage CS-CASH members in decision-making processes

26. Facilitate open and transparent communications between CS-CASH members and the CS-CASH Administration Core

27. Facilitate inclusivity by encouraging diverse perspectives from faculty and community members involved in the work of the CS-CASH

28. Work to engage a representative cross section of the CS-CASH regional community to participate in clinical and translational research activities

29. Engage members in using formative evaluation data for quality improvement and goal achievement

30. Take corrective actions when problems arise regarding lack of milestone or metric implementation by CS-CASH members

c. Ensure CS-CASH clinical and translational research resources are shared equitably across the coalition of institutional partners

d. Ensure the CS-CASH clinical and translational research resources are responsive to and reflect the needs and interests of faculty and community members

2017 3/7/2017

M. Cramer, J. Atwood, J. Stoner, 2007. Reproduction without the author's express written consent is not permitted. Permission to use this scale may be obtained from Mary E. Cramer, University of Nebraska Medical Center, 985330 Nebraska Medical Center, Omaha, NE 68198-5330, or mecramer@unmc.edu.

SURVEY CODE FOR DATA ENTRY: 1 = SD, 2 = SWD, 3= SLD, 4 = U, 5 = SLA, 6 = SWA, 7 = SA

Please provide comments here:

Page 1 of 2

Appendix C: Field Interview Guide: Cycle 2, Year 1 (May/June 2017)

Seven new Pilot Projects

The Evaluation component of CS-CASH looks at how everyone who is part of the Center (the entire

organization and the leadership) works together to accomplish the Center’s goals. The purpose of the

interview is twofold; one is to learn more about your project and to hear how you view your

collaboration with the Center. In addition, a brief orientation is conducted to familiarize investigators

with the CS-CASH database, website and organizational chart.

1. Knowledge: How familiar are you with the Center’s organizational structure in terms of

leadership and governance?

2. Relationships: Can you tell us how well CS-CASH is achieving its mission of improving the

health and safety of members within the agricultural community?

a. Are respectful relationships built between CS-CASH and the community to engage and

mobilize?

b. Is facilitation open to communication with community members

c. Is engagement a broad cross section of the communities to participate in CS-CASH work?

3. Activities: We know something about your project from the grant proposal or member meeting

updates, but can you also give us a brief description of your project and where you are at now?

a. Are you preparing to publish or submit a new grant-funding request?

Sustainability plans. New collaborations? New funding sources?

4. Activities: Tell us about your timeline for the project … do you feel you are on schedule?

a. If not, how could the Center help?

Administrative Focus

5. So far, has your experience with the CS-CASH Center been positive such that you would consider

doing this again?

a. What has worked well/been problematic?

6. How well does the Center manage their part of the contract with you?

7. Do you receive the communication and/or support you need from the Center and in a timely

manner to ensure, your work plan is completed?

a. Is there any way that the Center might improve?

8. Overall, do you see the Center as being a good partner for your project and its goals?

a. In what ways has the Center been/not been a good partner?

9. Do you foresee any future collaboration with the Center or other new research partners because of

your association with CS-CASH?

A. If yes, in what capacity?

10. What barriers have you encountered in working with the Center?

11. What could the Center do better to help you meet your professional goals?

12. Do you currently, or have you in the past, worked with other Ag Centers?

If yes,

a. How would you say that CS-CASH fares in comparison?

b. Are there positives in the other Ag Centers that CS-CASH should consider as a

way to improve?

13. How would you describe your level of understanding and commitment to the CS-CASH goals and

mission?

Page 2 of 2

a. Has your understanding of Ag Health been strengthened from your participation with CS-

CASH?

b. Has leadership provided or facilitated training opportunities?

Pilot Projects (New Investigators) Additional Questions (Poole, Kelling, Donham, Sheridan)

14. How is the Center as a scientific collaborator? What does the Center bring to your work?

15. Are you getting what you need from the CS-CASH research coordinator?

a. If so, what services/resources in particular do you find most helpful.

b. If not, what services/resources would you like to have made available?

16. Will you be able to use this pilot study for submission of your next level of external funding?

17. At this point in your project, do you foresee collaborating with the CS-CASH Center and/or UNMC

researchers for your future scientific collaborations?

a. If so, what resources/benefits does CS-CASH offer that will be important to your future

work?

b. If not, please share with us what resources/services you need that the Center does not

currently provide.

18. In your opinion, has the effort invested in this pilot been worth the amount of funding that you

received from CS-CASH?

Activities Reporting / CS-CASH Website

19. Have you entered activities into the form yet?

If yes,

a. Were you able to access the form and enter information easily?

b. Are you able to enter information on a regular basis?

c. Have you utilized the “View Activities” tab yet to see a list of activities that you have

entered?

If no,

a. Have you gone onto the website to review the form?

20. Is there anything that you would like to see added to the CS-CASH Website?

http://www.unmc.edu/publichealth/cscash/ click on “About Us” tab then to the left click on “Evaluation

Team” and to the upper right, click on CS-CASH Product Activity Reporting shaded in red; enter user

name and password.

21. Do you have any additional comments or thoughts regarding the CS-CASH Center? Any

suggestions on how the Center leadership can improve?

Just a reminder to all of you who will be presenting and publishing results from work that was sponsored

by CS-CASH. Please remember to acknowledge this funding. This is one more way that we can

demonstrate our Outputs/Outcomes to NIOSH. Here is the grant information:

Funding from the Central States Center for Agricultural Safety and Health

NIOSH Contract grant number: U54 OH010162

Handouts: CS-CASH Org Chart & Logic Model

Web Links: CS-CASH website: http://www.unmc.edu/publichealth/cscash/

CS-CASH fb page: https://www.facebook.com/unmccscash/?fref=ts

CS-CASH Members Project

Activity Reporting