CILIP ARLG '12: Measuring impact and quality
58
Measuring impact and quality Workshop: Measuring the use of online resources Tom Edmonds OpenAthens Product Manager
-
Upload
eduserv -
Category
Technology
-
view
1.327 -
download
2
Transcript of CILIP ARLG '12: Measuring impact and quality
Measuring impact and quality
Workshop: Measuring the use of online resources Tom Edmonds
OpenAthens Product Manager
Maximising the ROI for library budgets
• Lightening demo!
• Where does your library budget go?
• What challenges do you face?
• Some solutions
• YOU
• Case studies
www.eduserv.org.uk
Eduserv - OpenAthens
1994 2000 2008 2009 2010 2011 Today…
• Athens developed & first web service launched
• Athens adopted by NHS England in the UK
• Athens became OpenAthens
• 33% of the Australian healthcare market adopts OpenAthens - SAH - DoH Victoria
• US Department of Veteran Affairs adopts OpenAthens
• US Navy Medicine Information Systems Support Agency adopts OpenAthens
• > 4,000 customers use OpenAthens
• > 4 million users worldwide
[Lightning demo]
Identity & Access Management - markets
Academic
Healthcare
Publishing
Public
Sector
Commercial
[Lightning demo]
www.eduserv.org.uk
Some library stats.
www.eduserv.org.uk
Library developments
Print and online
Online
100%
2007
2009
1999
Source: Ebsco
www.eduserv.org.uk
Where does your library budget go?
Resources
Personnel
Buildings
Other
www.eduserv.org.uk
Where does your library budget go?
39% 25%
13%
23%
Resources
Personnel
Buildings
Other
Source: commercial research company
www.eduserv.org.uk
Where does your resources budget go?
68%
15%
10% 3%
2%
2%
e-Journals
Online databases
Magazines & newspapers
Books
e-Books
Source: commercial research company
www.eduserv.org.uk
Where does your e-resources budget go?
Source: Bath Spa University (2010)
www.eduserv.org.uk
JISC Activity data programme
Looking for the link between library usage and student
attainment
“There is a statistically significant correlation across a number of
universities between library activity data and student attainment”
- thank you to the JISC & Huddersfield University
www.eduserv.org.uk
www.eduserv.org.uk
www.eduserv.org.uk
50.3
56.8
53.1
56.4
59.3
49.5
53.1
49.8 50.9
48.5
39.2
36.1 36.4 37.2
34.3
26.1
22.8 23.0 22.3 21.1
10.0
20.0
30.0
40.0
50.0
60.0
70.0
2005/06 2006/07 2007/08 2008/09 2009/10
1 2:1 2:2 3
www.eduserv.org.uk
www.eduserv.org.uk
What are the challenges?
…for optimizing your library spend
www.eduserv.org.uk
Challenges…
• Budgets
www.eduserv.org.uk
Challenges…
• Budgets
• Suppliers
• Increasing subscription costs
• Lack of flexibility.
www.eduserv.org.uk
Challenges…
• Budgets
• Suppliers
• Technologies • IP address management
• Authentication steps for both the library and publisher
• User ID setups
• A to Z list management
• OpenURL management
• Licence compliance policy management
• Support: troubleshooting, downtime, usage monitoring, training etc.
www.eduserv.org.uk
The challenges…
• Budgets
• Suppliers
• Technologies
• politics
Source: stus.com
www.eduserv.org.uk
The challenges…
• Budgets
• Suppliers
• Technologies
• politics
• Usability
www.eduserv.org.uk
www.eduserv.org.uk
23
www.eduserv.org.uk
24
www.eduserv.org.uk
25
www.eduserv.org.uk
26
www.eduserv.org.uk
27
www.eduserv.org.uk
The challenges…
• Budgets
• Suppliers
• Technologies
• politics
• Usability
• Users.
www.eduserv.org.uk
The “Path of least resistance”
“...an information [seeker] will
tend to use the most convenient
search method, in the least
exacting mode available.
Information seeking behaviour
stops as soon as minimally
acceptable results are found.”
Source: http://en.wikipedia.org/wiki/
www.eduserv.org.uk
“...numerous studies have shown users
are often willing to sacrifice information
quality for accessibility. This fast food
approach to information consumption
drives librarians crazy. ‘Our information
is healthier and tastes better too’ they
shout.”
- Peter Morville (“Ambient Findability”, 2005)
Principle of Least Effort
30
www.eduserv.org.uk
31
www.eduserv.org.uk
Marketing your library
www.eduserv.org.uk
Social media
“I found out all my students were looking
at material in the VLE but going straight
to Facebook to use the discussion tools
and discuss the material and the
lectures. I thought I might as well join
them and ask them questions in their
preferred space.”
- What is Web 2.0? Ideas, technologies and implications
for education. Paul Anderson. A JISC report
www.eduserv.org.uk
Mobilise your library…
www.eduserv.org.uk
Market your resources
Source: Gungahlin Library, Australia
flickr.com/photos/silversprite/5120507383
www.eduserv.org.uk
Library portal
www.eduserv.org.uk
Over to you...
What have you done/are doing to get more from your library budget?
www.eduserv.org.uk
Case Study 1:
www.eduserv.org.uk
Small UK HE institution
to implement Shibboleth
reduce burden of administering access
increase use of electronic resources
no IT resource
implement a local authentication
solution.
Objectives:
Constraints:
Solution:
www.eduserv.org.uk
Project: duration – 9 months…
www.eduserv.org.uk
Small UK HE institution –
• No access queries
• Handful of Athens queries!
• Integration with Google Docs
• Gmail access for post-graduates
• Increased resource usage
• 20,000 more sessions in 2010/11.
one year on…
www.eduserv.org.uk
Small UK HE institution – number of logins
Year/
Month January
No. %
2009 16,460
2010 18,198 11
2011 22,930 39
February
No. %
8,247
11,345 37
27,359 232
March
No. %
13,860
21,276 54
27,446 98
www.eduserv.org.uk
Case Study 2:
www.eduserv.org.uk
Commercial research library
to simplify working in a fluid environment
manage changing need for information
fixed (if not falling) budget
re-negotiate licences
integrate library services.
Objectives:
Constraints:
Solution:
www.eduserv.org.uk
User behaviour:
Copied in the library
Borrowed
Downloaded
www.eduserv.org.uk
What are the consequences?
-
10,000
20,000
30,000
40,000
50,000
60,000
2007 2008 2009 -
1,000
2,000
3,000
4,000
5,000
6,000
2007 2008 2009
Subscription cost Number of downloads
www.eduserv.org.uk
What are the consequences?
0.00
2.00
4.00
6.00
8.00
10.00
12.00
14.00
16.00
18.00
20.00
2007 2008 2009
Cost per download
www.eduserv.org.uk
Three steps to improve ROI
• Re-negotiated subscriptions
• Implemented a local identity and access management
solution (OpenAthens)
• Implemented OpenURL and A to Z list management
using TDNet.
www.eduserv.org.uk
Re-negotiated subscriptions
Publisher 1
• No movement on price or licencing terms
• No alternative arrangements available
• From 2010, the complete collection was replaced by a
collection of the most used titles.
www.eduserv.org.uk
-
1,000
2,000
3,000
4,000
5,000
6,000
2007 2008 2009 2010
-
10,000
20,000
30,000
40,000
50,000
60,000
2007 2008 2009 2010
What were the consequences?
Subscription cost Number of downloads
www.eduserv.org.uk
0.00
2.00
4.00
6.00
8.00
10.00
12.00
14.00
16.00
18.00
20.00
2007 2008 2009 2010
What were the consequences?
Cost per download
www.eduserv.org.uk
The impact: publisher 1
• End users have less access
• Library service is curtailed
• Publisher loses income.
www.eduserv.org.uk
Re-negotiated subscriptions
Publisher 2:
• 2007 ~35 journals, not much used
• 2008 cancelled most of them
• 2010 new arrangement with publisher
o download everything at a fixed price
o subscriptions commence when it is profitable.
www.eduserv.org.uk
What were the consequences?
Cost of subscriptions Number of downloads
-
10,000
20,000
30,000
40,000
50,000
60,000
70,000
80,000
2007 2008 2009 2010
-
1,000
2,000
3,000
4,000
5,000
6,000
2007 2008 2009 2010
www.eduserv.org.uk
What were the consequences?
Cost per download
0.00
5.00
10.00
15.00
20.00
25.00
30.00
35.00
40.00
2007 2008 2009 2010
www.eduserv.org.uk
The impact: publisher 2
• End users have more access than they did 3 years ago
• The library service improves
• Publisher regains income.
www.eduserv.org.uk
Conclusions…
• Negotiate
• Technology solutions
• Environment
• Social media
• Traditional tools
www.eduserv.org.uk
Thank you for listening
Twitter: @edm0nds
Skype: tomedmonds.eduserv
Email: [email protected]
