Tobacco Free Tobacco Free Nebraska’s TRAIN:Nebraska’s TRAIN:

Using an online Using an online reporting system for reporting system for program evaluation.program evaluation.

Poster AbstractPoster Abstract

Problem/ObjectiveProblem/Objective: Tobacco control evaluation can be very challenging : Tobacco control evaluation can be very challenging given the wide range of activities that exist in most statewide programs. given the wide range of activities that exist in most statewide programs. Identifying and monitoring the activities that take place in multiple Identifying and monitoring the activities that take place in multiple communities can be very burdensome unless that information is housed in a communities can be very burdensome unless that information is housed in a centralized reporting system which provides easy ways to access and centralized reporting system which provides easy ways to access and analyze the data. analyze the data.

MethodsMethods: Tobacco Free Nebraska implemented the Tobacco Reporting and : Tobacco Free Nebraska implemented the Tobacco Reporting and Information Network (TRAIN) to facilitate information delivery among the Information Network (TRAIN) to facilitate information delivery among the state’s 22 local tobacco control coalitions, and between the local coalitions state’s 22 local tobacco control coalitions, and between the local coalitions and the state. In addition to being a communications resource for the and the state. In addition to being a communications resource for the program, the TRAIN system is an excellent evaluation tool because it program, the TRAIN system is an excellent evaluation tool because it provides a centralized database that details local tobacco control initiatives. provides a centralized database that details local tobacco control initiatives.

ResultsResults: The evaluation team worked closely with state staff and local : The evaluation team worked closely with state staff and local coalitions to work out the technical issues involved in implementing TRAIN coalitions to work out the technical issues involved in implementing TRAIN and in identifying the key indicators to be measured using the system. and in identifying the key indicators to be measured using the system. Results suggest that the TRAIN system provides excellent data for Results suggest that the TRAIN system provides excellent data for evaluators, local coalitions, and state staff. evaluators, local coalitions, and state staff.

ConclusionsConclusions: Tobacco Free Nebraska’s local tobacco control initiatives are : Tobacco Free Nebraska’s local tobacco control initiatives are now documented in and reported through the TRAIN system. This interactive now documented in and reported through the TRAIN system. This interactive online reporting and information system has facilitated the evaluation and online reporting and information system has facilitated the evaluation and surveillance efforts of the statewide program, and has enhanced surveillance efforts of the statewide program, and has enhanced communication among Nebraska’s 22 local coalitions.communication among Nebraska’s 22 local coalitions.

What is the TRAIN?What is the TRAIN?

TTobacco obacco RReporting eporting AAnd nd IInformation nformation NNetworketwork. . TRAIN is a TRAIN is a web-based information management web-based information management

and reporting systemand reporting system that provides local tobacco that provides local tobacco control coordinators with the ability to create and control coordinators with the ability to create and update the strategies and action steps needed update the strategies and action steps needed to accomplish the goals of their program. to accomplish the goals of their program.

TRAIN tells TFN and program evaluators what TRAIN tells TFN and program evaluators what activities have taken place in local tobacco activities have taken place in local tobacco control coalitions. control coalitions.

TRAIN and EvaluationTRAIN and Evaluation

Tobacco control evaluation can be challenging Tobacco control evaluation can be challenging given the wide range of activities that exist in given the wide range of activities that exist in most statewide programs. most statewide programs.

Identifying and monitoring the activities of Identifying and monitoring the activities of multiple community-based coalitions can be multiple community-based coalitions can be particularly difficult unless information about particularly difficult unless information about coalition activities is coalition activities is gathered in a systematic gathered in a systematic wayway and and housed in a centralized systemhoused in a centralized system that that provides easy ways to access and analyze data. provides easy ways to access and analyze data.

Prior to TRAINPrior to TRAIN

Qualitative data from personal interviews was Qualitative data from personal interviews was used to monitor the activities of TFN-sponsored used to monitor the activities of TFN-sponsored coalitions.coalitions.

This provided rich data and fostered a strong This provided rich data and fostered a strong relationship between the evaluation coordinator relationship between the evaluation coordinator and local coalitions.and local coalitions.

However, the process was time consuming and However, the process was time consuming and did not provide standardized measures for the did not provide standardized measures for the program’s long-term evaluation needs.program’s long-term evaluation needs.

Three Functions of TRAINThree Functions of TRAIN

1)1) ReportingReporting: TFN-funded coalitions report on : TFN-funded coalitions report on work plan objectives and strategies during work plan objectives and strategies during biannual reporting periods.biannual reporting periods.

2)2) EvaluationEvaluation: TRAIN reports provide the : TRAIN reports provide the primary source of process measures for primary source of process measures for Nebraska’s community-based tobacco Nebraska’s community-based tobacco coalition activities.coalition activities.

3)3) InformationInformation: TRAIN allows information : TRAIN allows information sharing among Nebraska’s tobacco coalitions, sharing among Nebraska’s tobacco coalitions, and between the statewide program and local and between the statewide program and local coalitions.coalitions.

Homepage - http://train.esp.fsu.edu Homepage - http://train.esp.fsu.edu

Coalition HomepageCoalition Homepage

Objective Details PageObjective Details Page

Strategy Report PageStrategy Report Page

Overview of Coalition StrategiesOverview of Coalition Strategies

Sample Core Process Measures Sample Core Process Measures ReportReport

TRAIN HighlightsTRAIN Highlights

Coalition work plans improvedCoalition work plans improved. Objectives . Objectives and strategies became more specific and and strategies became more specific and measurable because of system measurable because of system requirements and interaction with the requirements and interaction with the evaluation technical assistant. evaluation technical assistant.

The system The system provides the core process provides the core process measuresmeasures for Nebraska’s community- for Nebraska’s community-based tobacco control initiatives.based tobacco control initiatives.

TRAIN ChallengesTRAIN Challenges

System rolled out before all the System rolled out before all the elements were in place. elements were in place.

Early on, users were frustrated by occasional Early on, users were frustrated by occasional system changes, down times and “bugs”.system changes, down times and “bugs”.

Quality check measures were not in place until Quality check measures were not in place until midway through the first 2003 reporting period.midway through the first 2003 reporting period.

Data from 2002 was gathered by the system but Data from 2002 was gathered by the system but deemed too unreliable for evaluation.deemed too unreliable for evaluation.