Evaluating & Tracking Your Outreach...

25
Evaluating & Tracking Your Outreach Efforts

Transcript of Evaluating & Tracking Your Outreach...

Page 1: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater

Evaluating & Tracking Your

Outreach Efforts

Page 2: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater

What we do …

• Print materials (brochures, newsletters, fact sheets …)

• Field demonstrations• Tours• Radio• Meetings/workshops

Page 3: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater

How can we tell ….

• If those brochures, tours and ads had any impact?

• Which methods work best at raising awareness?

• Which work best at changing behavior?• Are we making progress in raising

awareness?• Are we making progress in changing

behavior?

Page 4: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater
Page 5: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater

Communication survey methods

• Focus Groups• Mail surveys• Internet• Telephone• Intercepts

Page 6: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater

Why bother tracking/surveying?

• Increase effectiveness.• Tweak programs during

implementation.• Better use of limited resources.• Can show funding organization

success.• People participating feel good when

they know they are making a difference.

Page 7: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater

What is an Intercept Survey?

• Intercept respondent at high traffic area.

• Location frequented by most or all of the people in the community.

• Only require a day or two of data gathering (200 respondents).

• Short – takes only a few minutes/respondent.

Page 8: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater

MDEP Intercept Surveywas designed to:

• survey basic understanding of NPS/stormwater issues (awareness).

• survey local outreach efforts.

• survey likely or existing behaviors (BMP use or planned use).

Page 9: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater

The Maine Intercept survey will:

• Track changes in awareness of both your message and your organization.

• Track changes in willingness to do behaviors.

• Track changes in behavior.• Indicate if advertisement is being

noticed.• Track if your outreach effort having

the desired results?

Page 10: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater

Who might use this survey?

• 319 funded projects.• Lake association outreach projects.• Regulated stormwater community

outreach projects.• Projects funded by grants (can show

funding agency outcome).

Page 11: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater

An Example - BASWG

• Track impact of their outreach program to raise awareness and change behavior.

• Show progress for Maine’s General Stormwater Permit.

• Make educated decisions and use funding wisely.

• Documentation for grants.

Page 12: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater

Methodology

• Hired Market Decisions.• Surveyed on 2 Saturdays (July 2008)

201 people.• Only had 20% refusal, which is

relatively low (normally about 50%)• Conducted at 3 different super

markets and 4 shopping areas in the greater Bangor area

Page 13: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater

The Questions

• Basic demographic information• Awareness of pollution issues &

events happening• Behavior

Page 14: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater

How concerned are you about water quality of Maine

waterways?

• 87% very to somewhat concerned.

• 12% Not very concerned

Page 15: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater

Recall seeing ad with rubber ducks?

• 77% said yes• 23% said no

Page 16: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater

Recall seeing ad regarding lawn care safe for kids & pets?

• 34% yes• 66% no

Page 17: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater

Interest in personally taking action to stop stormwater

pollution

• 23 % very interested• 53% somewhat interested• 15% somewhat uninterested• 8% very uninterested

Page 18: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater

Heard of any local efforts to reduce stormwater pollution?

• 15% yes• 84% no

Page 19: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater

How likely are you to take action to reduce lawn fertilizers, pesticides &

herbicides?

• 33% already do or done• 40% very likely• 9% not at all likely*

* Does not include respondents who said ‘does not apply’ or don’t know/refuse (73 said does not apply or don’t know/refuse)

Page 20: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater

If you were looking for info on taking action, where would

you go?

• 66% internet• 15% hardware store• 5% family & friends• 2% all of the above• 7% other• 4% don’t know/refuse

Page 21: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater

Other BMP related questionsVerbatim Questions

Demographics

Page 22: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater

What we learned:

• We have a concerned audience.• The audience believes stormwater

has an impact on water quality.• They recall seeing the duck ad

(recognition).• Willingness to take action to protect

water.

Page 23: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater

• Haven’t heard of local organizations trying to protect water.

• Audience is willing to pick up after pets.

• 40% of the audience is willing to reduce the amount of lawn chemicals; they are primed for our message.

• When people are looking for information, they turn to the internet.

Page 24: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater

This information was used* to:

• Design a plan to raise awareness that stormwater is polluting Maine waters.

• Design a plan to change people’s use of lawn care products.

• Track the impact of these plans as they are implemented.

• Meet the communities’ stormwater permit.

* Along with other information.

Page 25: Evaluating & Tracking Your Outreach Effortsneiwpcc.org/npsconferenceold/09-presentations/Hoppe... · the people in the community. • Only require a day or two of data ... NPS/stormwater

MDEP’s Intercept Survey(The following are available)

• The Survey• Guide to administering survey• Excel Spread sheet to analyze data

To get a copy:

Email [email protected]

or call 207-760-3134