Long term evaluation of IL programme slides

Technische Universität MünchenUniversitätsbibliothek

Long term evaluation of Information Literacy programme

Tina Hohmann

University Library of Technische Universität München

35th IATUL Conference

Espoo, Finland, 2 – 5 June 2014

23-25 April 2014


Background


Quality Management and TUM

University Library


Immediate feedbackversuslong-term impact


• Find out if the workshops make a difference and long term effectiveness

• Significant differences between short term and long term evaluation?

• Suggestions (and inspirations) for improvements

Aims and Objectives


The workshops


Get Ready for Your Studies - Introductory Library CourseBeing prepared is half the battle: Getting started with studies will be easier for you if you know how you find important literature…

Get Ready for Your Degree - Advanced Library CourseIt’s getting serious now: You need to find, acquire and edit the current specialised literature for your topic…

Reference Management with Citavi - Introductory CourseKeep track of your references! In the Citavi - Introductory Course, you will learn all the basic features…


In total 96 events.

Students and staff


The survey


Abbildung fragebogen?


Results


Return

Average return rate 23%

Equal across workshops and time

In total 144 respondents for evaluation


• Do the workshops make a difference for participants?

• Significant differences between short term and long term evaluation?

• Significant or surprising outcomes

• Any conclusions or further action required?


Do the workshops make a difference?


Great presentation

and helpful instructor!

This event has

supported me in writing

a great dissertation

This was by far the best training at TUM and I have received the top grade for my dissertation! The instructor, Ms (…)

was very good! (…) TOP!This workshop was part of my Masters‘ degree studies. However, the skills I have acquired in this workshop would have been very helpful for my Bachelor…


Differences short-term and long-term feedback


Search


Search

Participants rated the topic Internet search as…

in 2012 in 2014


Search

Percentage of participants saying that since they have participated in the workshop, they find relevant information on the Internet more quickly…≙ ?

Internet search is…


Referencing


Search

Participants rated the topic Referencing as…

in 2012 in 2014


More about correct referencing, please

(esp. in connection with the recent

plagiarism scandals) – whereas

collaboration with faculties is needed

in order to develop a standard

referencing style across the university

or at least the faculties.

Currently each chair seems

to have its own referencing style…


Significant or surprising Results


Reference management software Citavi


Citavi is great –

unfortunately, where I did

my Bachelor’s placement,

everybody was using

EndNote. Inevitably I had

to do the same… At present not regularly using Citavi as I had to switch to Endnote at the request of my current supervisor


Awareness of the IL programme across university


(…) I had no idea

and none of the

lecturers has

mentioned them

A lot of students,

even in their last year,

are not aware of

the range of resources

on offer. Everybody

should attend this

workshop.Maybe you should do more to advertise the fact that you offer workshops regularly and that they are not time-consuming. I know quite a few other

students, who would have benefitted from the workshop, but were not aware of it…

…Both of your workshops were very helpful.

All students from semester 5 should attend these


Implications for our IL programme


Awareness of the IL programme across university


Search


… is important


Referencing


Lessons learnedfor next time


Conclusion


Long-term evaluation of our IL programme

helps to understand students’ attitudes and

perceptions

→ Complements the range of efforts to

measure customer satisfaction for TUM

library


Long-term effect of our trainings and

suggestions for improvement

→ Improving our programme


Results show that our workshops do make a

difference for the students

→ Strengthen our position within the

university


Image Attribution

6 „Drama barrier series10“ CC by Pulpolux!!! on flickr

8+9+40 „Resume Workshop with Bain & Company” CC by City Year on flickr

11+39 „Studierende im Hörsaal“ (students in theater) © Uli Benz, TU München

16 „Blue Impact“ CC by Vladimir Jovanovic on flickr

18 „Bananas“ CC by Ian Ransley on flickr

19+33 „Internet“ CC by Trans Cam on flickr

22+35 „USGS Reference Mark“ CC by Mark Christian on flickr

28+31 „ BWL Studentenfeature“ (students on bridge) © Andreas Heddergott, TU München

37 „Steps15“ CC by Aschevogel on flickr

41 „TUM Fahnen in der Arcisstrasse“ (TUM flags Arcisstrasse) © Albert Scharger, TU

München

43 „Historischer Uhrturm“ (historic clock tower) © Thorsten Naeser, TU München

References Porst, R. (2009): Fragebogen. Ein Arbeitsbuch (2nd ed.). Wiesbaden, Germany: VS Verlag für Sozialwissenschaften.

Schilling, K. & Applegate, R. (2012) Best methods for evaluating educational impact: A comparison of the efficacy of commonly used measures of library instruction. Journal of the Medical Library Association, 100 (4), 264


Contact

[email protected]

Questions…?

Long term evaluation of IL programme slides

Education

Transcript of Long term evaluation of IL programme slides