Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield
description
Transcript of Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield
![Page 1: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/1.jpg)
Academic Publishing is Evolving…
Article Level MetricsLooking Backwards / Looking
Forwards
Pete Binfield Co-Founder and Publisher PeerJ
The PLOS ALM Workshop 10/10/2013
@ThePeerJhttps://peerj.com
![Page 2: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/2.jpg)
Academic Publishing is Evolving…
Q2 13
Q1 13
Q4 12
Q3 12
Q2 12
Q1 12
Q4 11
Q3 11
Q2 11
Q1 11
Q4 10
Q3 10
Q2 10
Q1 10
Q4 09
Q3 09
Q2 09
Q1 09
Q4 08
Q3 08
Q2 08
Q1 08
Q4 07
Q3 07
Q2 07
Q1 07
Q4 06
0
1000
2000
3000
4000
5000
6000
7000
8000
Year Pubs Notes2007
1,200 Larger than ~ 95% of all journals
2008
2,800 Largest OA journal in world
2009
4,400 3rd largest journal in world
2010
6,750 Largest journal in world
2011
13,800 ~1.4% of PubMed output in that year
2012
23,500 ~2.4% of PubMed output in that year
2013
~31,000
>3% of the literature
PLOS ONE Quarterly Published Output
![Page 3: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/3.jpg)
http://figshare.com/articles/Scale_of_OA_Publishing/650794
Stacked area graph of the contribution ofmajor ‘APC’ OA publishers (articles per year)
![Page 4: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/4.jpg)
Academic Publishing is Evolving…Screenshot from ~ Nov 2009 but Way Back Machine has examples from April 2008
PLOS Didn’t Invent Article Level Metrics
![Page 5: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/5.jpg)
Academic Publishing is Evolving…
Launched in May 2007 http://journalofvision.org/7/7/i/http://www.slideshare.net/PLoS/niso-article-level-metrics-presentation-for-online-2
![Page 6: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/6.jpg)
Academic Publishing is Evolving…June 2007
![Page 7: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/7.jpg)
Academic Publishing is Evolving…~ May 2009 (NISO presentation)http://www.slideshare.net/PLoS/niso-article-level-metrics-presentation-for-online-2
![Page 8: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/8.jpg)
Academic Publishing is Evolving…
So How Did We Get Here:
![Page 9: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/9.jpg)
Academic Publishing is Evolving…
![Page 10: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/10.jpg)
Academic Publishing is Evolving…
Bill Hooker, Sep 30th 2008. In Comments on http://thewobblingmind.wordpress.com/2008/08/31/feasibility-of-plos-ones-peer-review-model/
![Page 11: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/11.jpg)
Academic Publishing is Evolving… Internal to PLOS Mid-2008(thanks to J Lin for providing)
![Page 12: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/12.jpg)
Academic Publishing is Evolving…
Internal to PLOS Mid-2008(thanks to J Lin for providing)
![Page 13: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/13.jpg)
Academic Publishing is Evolving…
• A test ALM Email was sent to Authors, in ~ August 2008• at which point PLOS ONE had published ~3,100 articles
• The mailing was merged to all corresponding authors whose articles exceeded certain thresholds for having ALMs to report on
• We provided info which was scraped / obtained from• Google Scholar• Google Analytics• PLOS Commenting functionality• CiteULike• Google News
• Response was 100% positive – giving us reassurance about messaging
Testing the Concept
August 2008
![Page 14: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/14.jpg)
Academic Publishing is Evolving…
![Page 15: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/15.jpg)
Academic Publishing is Evolving…
Presentation at Raleigh, November 2008
![Page 16: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/16.jpg)
Academic Publishing is Evolving…http://blogs.plos.org/plos/2009/03/article-redesign-on-plos-journals/Mar 31st 2009. It wasn’t called ALMs in this ‘official’ post…
![Page 17: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/17.jpg)
Academic Publishing is Evolving…
http://www.myplick.com/user/PLoS
http://blogs.plos.org/everyone/2009/03/31/newly-launched-features-on-our-online-platform/1st use of the phrase by us?
http://everyone.plos.org/2009/03/31/newly-launched-features-on-our-online-platform/ Possible first public use of the phrase ‘article level metrics’ by PLOS
![Page 18: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/18.jpg)
Academic Publishing is Evolving…
![Page 19: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/19.jpg)
Academic Publishing is Evolving…
http://www.slideshare.net/PLoS/niso-article-level-metrics-presentation-for-online-2?from_search=27
May 2009 to NISO
![Page 20: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/20.jpg)
Academic Publishing is Evolving…http://blogs.plos.org/plos/2009/09/article-level-metrics-at-plos-addition-of-usage-data/and http://blogs.plos.org/plos/2009/03/plos-journals-upgrade-to-topaz-092/ by Rich CaveSept 16th 2009. Note: it was now called ALMs…
![Page 21: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/21.jpg)
Academic Publishing is Evolving…
Any Effects?
![Page 22: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/22.jpg)
Academic Publishing is Evolving… Internal to PLOS Mid-2008(thanks to J Lin for providing)
![Page 23: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/23.jpg)
Academic Publishing is Evolving…
Michael Habib, Elsevier, Oct 2009
![Page 24: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/24.jpg)
Academic Publishing is Evolving… Internal to PLOS Mid-2008(thanks to J Lin for providing)
![Page 25: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/25.jpg)
Academic Publishing is Evolving…
“This paper is featured in a commentary in the Journal of XXX and has been evaluated as “must read” by XXX for the Faculty of 1000 Biology.”
“Top downloaded paper in XXX in 2011”
“PLoS ONE metrics show that this article had 6,358 online views and 1,318 downloads within 3 months of publication. These compare with annual average life-time views of papers ranging from 400 to 2,800 in all PLoS journals, and 600 in PLoS ONE. In early December 2011, its usage was 10,400 versus an average of 900/paper for the journal. It is the 3rd most highly cited paper amongst the XXX papers in the journal.“
Quotes from 3 Resumes (in the Last Few Days)
Note: No one ever mentions tweets, likes, bookmarks etc…
![Page 26: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/26.jpg)
Academic Publishing is Evolving…
http://www.nature.com/naturejobs/science/articles/10.1038/nj7463-491a
![Page 27: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/27.jpg)
Academic Publishing is Evolving…
![Page 28: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/28.jpg)
Academic Publishing is Evolving… Internal to PLOS Mid-2008(thanks to J Lin for providing)
![Page 29: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/29.jpg)
Academic Publishing is Evolving…
http://scholarlykitchen.sspnet.org/2013/09/03/what-does-a-scientist-want/#comment-109084
![Page 30: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/30.jpg)
Academic Publishing is Evolving…
Looking Forwards
![Page 31: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/31.jpg)
Academic Publishing is Evolving…
Have they fulfilled their original aims?
![Page 32: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/32.jpg)
Academic Publishing is Evolving… Internal to PLOS Mid-2008(thanks to J Lin for providing)
![Page 33: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/33.jpg)
Academic Publishing is Evolving…
Is Anyone Using them Fully?
![Page 34: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/34.jpg)
Academic Publishing is Evolving…
To What Extent AreWe Talking To Ourselves?
![Page 35: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/35.jpg)
Academic Publishing is Evolving…
Is this the best usage display we can do?
c.f. Frontiers in 2008…
![Page 36: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/36.jpg)
Academic Publishing is Evolving…
Why has no publisher equaled / surpassed this?
![Page 37: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/37.jpg)
Academic Publishing is Evolving…
Access to the Data?
![Page 38: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/38.jpg)
Academic Publishing is Evolving…
Internal to PLOS Mid-2008(thanks to J Lin for providing)
Science Online Jan 2010
What Is STILL Missing?
![Page 39: Article Level Metrics Looking Backwards / Looking Forwards Pete Binfield](https://reader035.fdocuments.net/reader035/viewer/2022062501/5681642e550346895dd5f4c1/html5/thumbnails/39.jpg)
Academic Publishing is Evolving…
Thank You
Pete BinfieldCo-Founder and Publisher
@[email protected] @ThePeerJ