Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel:...

42
Project Outcome User Panel: Survey Lessons Learned June 9, 2016

Transcript of Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel:...

Page 1: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Project Outcome User Panel:

Survey Lessons Learned

June 9, 2016

Page 2: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

About Project Outcome

Page 3: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Why Measure Outcomes?

• Respond to questions from stakeholders

• Report program successes to funders

• Show that programs are making a difference

• Patrons gained confidence

• Patrons learned something new

• Patrons changed behavior

Page 4: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

What does Project Outcome Measure?

As a result of library programs & services, did

library patrons:

• Learn something new?

• Gain confidence?

• Change their behavior?

• Gain awareness of the library?

Page 5: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Surveys for 7 Service Areas

Page 6: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Today’s Speakers

Crystal Schimpf Facilitator

Samantha Lopez Public Library Association

Emily Plagman Public Library Association

Justin Wasterlain Santa Clara City Library (CA)

Maria Redburn Bedford Public Library (TX)

Dan Caufield Buffalo & Erie County

Public Library (NY)

Page 7: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Agenda

• Panelist Introductions

• Lessons Learned

Planning

Survey Distribution

Data Collection & Entry

• Challenges Faced

• Questions & Discussion

• Announcements

Page 8: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Panelist Introductions

Page 9: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

• Santa Clara, California

• Population of 120,000

• 3 branch library system

• 370 adult programs last year

• Using Project Outcome since

September 2015

Page 10: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Technology Education Reevaluation

• About 4-8 computer related programs a month.

• Tech classes were poorly attended but no real feedback

available

• Needed consistent evaluation model to determine

effectiveness of programs

• Use Project Outcome for new or under performing programs

Page 11: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Results:

• Response rate for these surveys has been very high and positive.

• Gives concrete data to show administration and other stakeholders about program

effectiveness

• Comments were often most valuable part from a development standpoint.

Page 12: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Buffalo & Erie County Public Library System

• Erie County, N.Y

• Population: 919,000

• 37 library locations

• New to Project Outcome

(2 months in)

Page 13: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Workforce Development & Computer Training

Workforce & Business Development

• Offsite programs for entrepreneurs and job seekers

• Between 17-35 participants in classroom settings at

local schools, colleges, and partnering organizations

• Paper surveys offered at the end of program with the

option to use cell phone with a survey link.

• Project Outcome was emphasized as the evaluation

method for an approved 2016-2019 adult literacy

grant.

“Workforce Development at New York Libraries

through Public Library Systems”

Page 14: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Survey Results

Questions asked, scores and comparisons

Page 15: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Bedford Public Library

• Bedford, TX

• Population: 48,592

• 1 library location

Page 16: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

To Survey or Not to Survey

• Outcome rich

• Pilot program

• Identify new programs

• Improve existing programs

• Evaluate resource intense programs

Page 17: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Survey Results

Results: 24 ESL Surveys

Page 18: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Lessons Learned

Page 19: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

What did your library learn during the

planning process?

Planning for Project Outcome

Audience: Please share in chat

Page 20: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Planning for Project Outcome

What did your library learn during the

planning process?

Audience: Please share in chat

Dan Caufield Buffalo & Erie County

Public Library (NY)

Page 21: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Planning for Project Outcome

What did your library learn during the

planning process?

Audience: Please share in chat

Maria Redburn Bedford Public Library (TX)

Page 22: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Justin Wasterlain Santa Clara City Library (CA)

Planning for Project Outcome

What did your library learn during the

planning process?

Audience: Please share in chat

Page 23: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Survey Distribution

What did your library learn about

distributing surveys to patrons?

Audience: Please share in chat

Page 24: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Survey Distribution

What did your library learn about

distributing surveys to patrons?

Audience: Please share in chat

Maria Redburn Bedford Public Library (TX)

Page 25: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Dan Caufield Buffalo & Erie County

Public Library (NY)

Survey Distribution

What did your library learn about

distributing surveys to patrons?

Audience: Please share in chat

Page 26: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Entering Survey data

What did your library learn about

collecting & entering survey data?

Audience: Please share in chat

Page 27: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Entering Survey data

What did your library learn about

collecting & entering survey data?

Audience: Please share in chat

Justin Wasterlain Santa Clara City Library (CA)

Page 28: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Entering Survey data

What did your library learn about

collecting & entering survey data?

Audience: Please share in chat

Dan Caufield Buffalo & Erie County

Public Library (NY)

Page 29: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Maria Redburn Bedford Public Library (TX)

Entering Survey data

What did your library learn about

collecting & entering survey data?

Audience: Please share in chat

Page 30: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Type your questions in the chat.

Audience Questions & Comments

Justin Wasterlain Santa Clara City Library (CA)

Maria Redburn Bedford Public Library (TX)

Dan Caufield Buffalo & Erie County

Public Library (NY)

Page 31: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Challenges

Page 32: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Challenges

What is one challenge your library

has faced in implementing Project

Outcome?

How have you addressed it?

Audience: Please share in chat

Page 33: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Challenges

What is one challenge your library has faced

while implementing Project Outcome?

How have you addressed it?

Audience: Please share in chat

Maria Redburn Bedford Public Library (TX)

Page 34: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Challenges

What is one challenge your library has faced

while implementing Project Outcome?

How have you addressed it?

Audience: Please share in chat

Justin Wasterlain Santa Clara City Library (CA)

Page 35: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Type your questions in the chat.

Audience Questions & Comments

Justin Wasterlain Santa Clara City Library (CA)

Maria Redburn Bedford Public Library (TX)

Dan Caufield Buffalo & Erie County

Public Library (NY)

Page 36: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Plans for the Future

Page 37: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Justin Wasterlain Santa Clara City Library (CA)

Maria Redburn Bedford Public Library (TX)

What are your plans for the future with

Project Outcome?

Audience: Please share in chat

Dan Caufield Buffalo & Erie County

Public Library (NY)

Page 38: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Announcements

Page 39: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

ALA Annual Conference: June 24-28, 2016

Friday, June 24, 9:00AM-4:00PM

Preconference

Project Outcome Enrollment Workshop : Simple Tools to

Measure Our True Impact

DEADLINE TO REGISTER IS JUNE 10

Saturday, June 25, 3:00-4:00PM

The Power of Performance: Project Outcome

Page 40: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Next Webinar – Save the Date

July 14, 2016, Thursday @ 1:00PM Central

Project Outcome Regional Training: Virtual Information Session

Page 41: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

If you haven’t already…

• Sign up on the Project Outcome website

• View training resources

• Schedule a survey in the Survey Portal

• View Data Dashboards

• Join the Facebook group

• Follow Project Outcome on Twitter

Page 42: Project Outcome User Panel: Survey Lessons Learned...Jun 09, 2016  · Project Outcome User Panel: Survey Lessons Learned June 9, 2016 . About Project Outcome . ... • Tech classes

Thank you!