Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on...
-
Upload
michael-levine-clark -
Category
Education
-
view
666 -
download
3
description
Transcript of Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on...
![Page 1: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/1.jpg)
Discovery or Displacement? A Large-Scale Longitudinal Study of the Effect of Discovery Systems on Online
Journal Usage
UKSGHarrogate
April 16, 2014
Michael Levine-Clark, University of DenverJohn McDonald, University of Southern California
Jason Price, SCELC Consortium
http://tinyurl.com/pg686r4
![Page 2: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/2.jpg)
Does implementation of a discovery service impact usage of publisher-
hosted journal content?
![Page 3: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/3.jpg)
Publisher-hosted journals are only part of the picture
eBooks, pBooks, aggregator journal content, etc.
publisher journal content
The six publishers in this study
![Page 4: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/4.jpg)
What did we measure?
• Whether there is an effect
• NOT why that effect exists (that’s a future study!)
![Page 5: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/5.jpg)
![Page 6: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/6.jpg)
![Page 7: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/7.jpg)
Data collection• List of libraries with discovery services
>Searched on lib-web-cats
• Surveyed Libraries>Discovery service Implemented>Implementation Date (month/year)>Search box location>Marketing effort
• 149 Libraries Gave Approval>33 libraries selected for this phase>6 for each of the 4 major discovery services and a
group of 9 libraries with no service
![Page 8: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/8.jpg)
Dataset• 33 Libraries
– 28 US, 2 CA, 1 each from UK, AUS, NZ
–WorldCat book holdings>Average: 1,114,193 ; Range: ~300k to ~2.6mil
• Implementation dates (Discovery Libraries): >2010 (3), 2011 (19), 2012 (2)
• 6 Publishers
• 9,206 Journals
• 163,545 Usable Observations
![Page 9: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/9.jpg)
Methodology
Compared COUNTER JR1 total full text article views for the
12 months before vs 12 months after implementation date
June
201
0St
art
Impl
emen
tatio
nM
ay 2
011
May
201
2En
d
Year 1 Year 2
Included implementation month in Year 1 to ensure that both periods included an entire academic year
![Page 10: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/10.jpg)
Observations by Publisher
![Page 11: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/11.jpg)
Journals by Library & Service
5327
3262
5328
6294
4384
![Page 12: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/12.jpg)
![Page 13: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/13.jpg)
Average Usage Change By Discovery & Publisher
Per Journal & Per 10,000 FTE
![Page 14: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/14.jpg)
![Page 15: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/15.jpg)
Examine Data for Outliers
![Page 16: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/16.jpg)
Full Model
Including Discovery Service, Publisher, and Library
Including Discovery Service, Publisher, and Library
![Page 17: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/17.jpg)
Testable Effects
• Discovery Tool– Implemented by multiple libraries– Used to find content from all publishers
• Publisher– Accessible in all discovery tools– Accessible across multiple libraries
• Library– Uses content from multiple publishers– Uses only one discovery tool (so only within DT)
![Page 18: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/18.jpg)
Nested ANOVA Model
[all three factors – preliminary results]
![Page 19: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/19.jpg)
Does usage change vary across libraries?
Institution (sorted by Mean Change)
![Page 20: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/20.jpg)
Does usage change vary across libraries using the same service?
Library 10-15 Library 16-21 Library 22-27 Library 28-33Library 1-9
![Page 21: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/21.jpg)
Does usage change vary across publishers?
Publisher (sorted by Mean Change)
B
AAA A A
![Page 22: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/22.jpg)
Does usage change vary across discovery services?
A
BB
C
D
![Page 23: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/23.jpg)
Publisher
Does the effect of discovery service differ across publishers?
![Page 24: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/24.jpg)
ResultsCan we detect differences between Discovery Services, Publishers, and/or Libraries and/or their interactions? • Library – Yes• Publisher – No• Discovery Service – Yes
• Differential discovery service effect by publisher – Yes
![Page 25: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/25.jpg)
Next Steps• Design & test for effects of:
–Aggregator full text availability–Publisher Size–Journal Subject–Overall usage trends–Configuration options in Discovery services
• Expand pool of libraries• Perhaps explore WHY
![Page 26: Discovery or Displacement: A Large Scale Longitudinal Study of the Effects of Discovery Platforms on Online Journal Usage](https://reader034.fdocuments.net/reader034/viewer/2022042814/5558aca1d8b42a7e298b45e7/html5/thumbnails/26.jpg)
Past Presentations• Ithaka Sustainable Scholarship Conference (October 2013)• Charleston Conference (November 2013)• ER&L/Library Journal Webinar (December 2013)• Shangai Jiao Tong Univ / Beijing Univ (Jan 2014)• SCELC Colloquium (March 2014)• ER&L (March 2014)• Presentations posted on slideshare :
–http://visualcv.com/lpq4t1s –http://tinyurl.com/pg686r4