Personalized Recommender Systems in e-Commerce and m-Commerce: A Comparative Study
Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized...
Transcript of Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized...
![Page 1: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/1.jpg)
Next-generation Metrics for Scholarly Performance
William Gunn, Ph.D. Head of Academic Outreach
Mendeley
@mrgunn
https://orcid.org/0000-0002-3555-2054
![Page 2: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/2.jpg)
Open Access Policies
![Page 3: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/3.jpg)
Open Access Has Benefits
• The perception that there were tradeoffs when choosing open access slowed adoption
• Only Open Access can fully provide the benefits of the web – interoperability, accessibility, discovery
• An expanded definition of impact brings new kinds of content and new metrics
![Page 4: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/4.jpg)
King, Christopher (2012) Thomson Reuters Annual Report
http://ar.thomsonreuters.com/_files/pdf/MultiauthorPapers_ChrisKing.pdf
![Page 5: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/5.jpg)
Adams, Jonathan. "Collaborations: the fourth age of research."
Nature 497.7451 (2013): 557-560.
![Page 6: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/6.jpg)
Amgen: 47 of 53 “landmark” oncology publications could not be reproduced
Bayer: 43 of 67 oncology & cardiovascular projects were based on contradictory results
Dr. John Ioannidis: 432 publications purporting sex differences in hypertension, multiple sclerosis, or lung cancer. Only one data set was reproducible
There is no gold standard
![Page 7: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/7.jpg)
Pochoda, Phil. "The big one: The epistemic system break in scholarly monograph
publishing." new media & society 15.3 (2013): 359-378.
Authors Publishers
Printers
Shippers
Booksellers
Readers
![Page 8: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/8.jpg)
Pochoda, Phil. "The big one: The epistemic system break in scholarly monograph
publishing." new media & society 15.3 (2013): 359-378.
Authors Publishers
Printers
Shippers
Booksellers
Readers
1770
![Page 9: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/9.jpg)
Authors Readers Internet
Research is changing
Publishers
Repositories
Professional
Websites
![Page 10: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/10.jpg)
Challenges for Repositories
• The world is leaning green
• Repositories thus have an essential role
• Repositories aren’t in the workflow of a researcher, neither in search for new ideas nor in presentation of their work
![Page 11: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/11.jpg)
The Ouroboros problem
• repositories need content deposited to get usage, and they need usage to get deposits
• Discovery tools can address usage and usage will promote content
– scholarly outputs are papers, datasets, code, and more.
![Page 12: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/12.jpg)
New forms of discovery
• personalized recommendations based on reading history
• related articles
• recommender frameworks
–implement recommendations as a service
• third-party recommender services
–serve niche audiences
![Page 13: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/13.jpg)
research impacts more than authors
http://altmetrics.org/manifesto/
![Page 14: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/14.jpg)
...and aggregates research data in the cloud
Mendeley extracts research data…
Install Mendeley Desktop
Collecting rich signals from domain experts.
![Page 15: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/15.jpg)
Home Work Mobile
Cloud Library
![Page 16: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/16.jpg)
Shared Folder
![Page 17: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/17.jpg)
Mendeley Research Catalog
![Page 18: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/18.jpg)
Mendeley Research Catalog
![Page 19: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/19.jpg)
Read papers + keep track of notes
470M documents
![Page 20: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/20.jpg)
Taking some misery out of writing
![Page 21: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/21.jpg)
Information Extraction
![Page 22: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/22.jpg)
We are publishing this data to the LOD cloud
http://code-research.eu/
![Page 23: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/23.jpg)
Defining readership
• Each document addition is a “read”
• stamped with metadata describing the context of the read event
• a read is like a citation, but faster and captures more
![Page 24: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/24.jpg)
research impacts more than authors
http://altmetrics.org/manifesto/
![Page 25: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/25.jpg)
![Page 26: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/26.jpg)
![Page 27: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/27.jpg)
Readership vs. citations
• it comes with a payload of metadata
• it accrues faster
• it illuminates previously hidden impact
![Page 28: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/28.jpg)
http
://arx
iv.org
/htm
l/1203.4
745v1
altmetrics show broader impact
![Page 29: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/29.jpg)
htt
p://d
x.d
oi.org
/10.3
789/isqv25no2.2
01
3.0
4
![Page 30: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/30.jpg)
http://www.asis.org/Bulletin/Apr-13/AprMay13_Lin_Fenner.html
altmetrics show broader impact
![Page 31: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/31.jpg)
Issues To Be Addressed
• Identity
• Privacy
• Attribution
• Gaming
• Filtration
standards/ best practice
![Page 32: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/32.jpg)
Amgen: 47 of 53 “landmark” oncology publications could not be reproduced
Bayer: 43 of 67 oncology & cardiovascular projects were based on contradictory results
Dr. John Ioannidis: 432 publications purporting sex differences in hypertension, multiple sclerosis, or lung cancer. Only one data set was reproducible
There is no gold standard
![Page 33: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/33.jpg)
Cultural skew is important
South America is weak on N.A. social media, strong on Mendeley
![Page 34: Next-generation Metrics for Scholarly Performance · 2019. 8. 6. · •personalized recommendations based on reading history •related articles •recommender frameworks –implement](https://reader034.fdocuments.net/reader034/viewer/2022051919/600bf617958e150fce79f6e9/html5/thumbnails/34.jpg)
What would people build if they could get the data?
• Impact Story – get credit for all your work
• PLOS ALM – article-level metrics for papers
• Plum Analytics – bespoke analytics for libraries (EBSCO)
• Altmetric.com – altmetrics for publishers. (Digital Science)