13 0212 toccon - carpenter altmetrics 2

Alternative Metrics

How the future of assessment can improve discovery and delivery of

content

Todd Carpenter, Executive Director, NISOTools of Change Conference, New York, NY

February 12, 2013

Tuesday, February 12, 13

@TAC_NISO Twitter Highlights• So excited to present on #altmetrics today during #tocfbf at #fbf12

• Again, I’m pre-tweeting my presentation. Slides to come! #tocfbf #fbf12

• #NISO = 1/3 Publishers, 1/3 Libraries, 1/3 automation suppliers. Communities converge to develop standards #tocfbf #fbf12

• Standards are everywhere in book publishing, we just don’t notice them anymore. #tocfbf #fbf12

• In 1955 Eugene Garfield published “Citation Indexes for Science” in Science http://bit.ly/xfylwh #tocfbf #fbf12

• Quote: “If I have seen further it is by standing on ye shoulders of Giants." Sir Isaac Newton #tocfbf #fbf12

• Sounds like beginning of a joke: 2 guys at Stanford, they wrote this paper, then started a company in a garage ... #tocfbf #fbf12

• Citations are awesome, aren’t they? A perfect solution to all the world’s problems, no? #tocfbf #fbf12

• Citations aren’t always a measure of quality. They are also a very lagging indicator of impact #tocfbf #fbf12

• #altmetrics a suite of assessment criteria & measures being developed to assess importance of a particular scholarly output #tocfbf #fbf12

• #altmetrics examples: usage analysis, metrics of non-traditional content, observational or behavioral analysis, social media #tocfbf #fbf12

• How 1 can apply #altmetrics Sell related content, spot trends in near-real-time, ID new fields or new services, marketing #tocfbf #fbf12

• Real world #altmetrics examples: http://bit.ly/OzGnGt www.tynt.com http://bit.ly/TcNIh0 http://bit.ly/PknZb4 #tocfbf #fbf12

• Issues needing consensus regarding #altmetrics - Authorship, provenance, definitions of components, privacy, openness #tocfbf #fbf12


http://bit.ly/xfylwh

http://bit.ly/xfylwh

http://bit.ly/OzGnGt

http://bit.ly/OzGnGt

http://www.tynt.com

http://www.tynt.com

http://bit.ly/TcNIh0

http://bit.ly/TcNIh0

http://bit.ly/PknZb4




• Non-profit industry trade association accredited by ANSI with 150+ members

• Mission of developing and maintaining technical standards related to information, documentation, discovery and distribution of published materials and media

• Volunteer driven organization: 400+ spread out across the world

• Responsible for standards like ISSN, DOI, Dublin Core metadata, DAISY digital talking books, OpenURL, MARC records, and ISBN (indirectly)

About


Image: DanTaylor Image: : Joel Washing

Standards are familiar, even if you don’t notice


http://www.flickr.com/photos/dantaylor/1145628275/

http://www.flickr.com/photos/dantaylor/1145628275/

http://www.flickr.com/photos/joelwashing/2481227847/

http://www.flickr.com/photos/joelwashing/2481227847/

Who is reading published content?


We stand on the shoulders of giants...


The Mighty Citation


Impact factor


Thomson-Reuters IMPACT FACTOR


Two Stanford Students


They wrote a paper


They started a company in someone’s garage

Photo: APTuesday, February 12, 13

Citations are awesome, aren’t they?

A perfect solution to all the world’s problems, no?

A simple conclusion can be drawn


“What Des-Cartes did was a good step. You have added much several ways, & especially in taking ye colours of thin plates into philosophical consideration. If I have seen further it is by standing on ye shoulders of Giants."

Back to Sir Isaac Newton


Citations aren’t always what we think they are

Caveat emptor


http://en.wikipedia.org/wiki/Caveat_emptor

http://en.wikipedia.org/wiki/Caveat_emptor

Another problem with citations


So where to from here?Tuesday, February 12, 13

Define Altmetrics, Please


Usage Based Metrics


Image: Domenico, Caron, Davis, et al.

Citation of non-traditional content

Citations to new forms of communciation aren’t as simple as one might think.

Define a use of this?


Clickstream Analysis


Social Media Metrics

Image: Danny Brown, The State of Social Media Marketing 2012


http://dannybrown.me/2012/09/11/the-state-of-social-media-marketing-2012/

http://dannybrown.me/2012/09/11/the-state-of-social-media-marketing-2012/

Behavioral Metrics


Multivariate analysis


OK, it’s important, but what does it mean for

MY BUSINESS


Have you bought something from

Amazon?


Did you buy something that

“other people bought”?


$$$$ One Million Dollars $$$$


$$$$ One Million Dollars $$$$

Not

Implemented


Everything is a Recommendation

Netflix Recommendations: Beyond the 5 stars


http://techblog.netflix.com/2012/04/netflix-recommendations-beyond-5-stars.html

http://techblog.netflix.com/2012/04/netflix-recommendations-beyond-5-stars.html

What can Netflix glean from:

Several billion item ratingsItem popularity - along many axis

Stream plays each - along many axisMillions of “queue” additions daily

Rich item metadataUser interface interactions

Social dataExternal data

“All I see now is blonde, brunette, redhead”


Presenting movies is not the only game to play with these data


Innovation often takes place at the

intersection of different fields


Image: http://www.crispian.net/CrispiansScienceMap.html


http://www.crispian.net/CrispiansScienceMap.html

http://www.crispian.net/CrispiansScienceMap.html

Clickstream data yields high-resolution maps of science

Johan Bollen, Herbert Van de Sompel, et al. PLoS One, February 2009

Mapping the World of Science


So what else can I do?


Realtime Trend Spotting


Improve products and customer services


Editorial applications


Author services

(“How is my book doing?”)


Marketing applications


Is anyone really doing any of this?

(Beyond Amazon, Google & Netflix?)


70%


Issues we face with alternative metrics


Image: Flickr user karindalziel


http://www.flickr.com/photos/nirak/512878595/

http://www.flickr.com/photos/nirak/512878595/

Authorship-----

Disambiguation

Contributor Roles


Basic Definitions Needed

(So we are all talking about the same thing)


More open exchange of component data


Large Amounts of DataGood Analysts

Implementation StrategyCreativityStandards

(we can only do so much)

All you need is....


One Very Last Thing…

Image from Will Lion: http://www.flickr.com/photos/will-lion/2646213692/


Thank you!

Todd Carpenter, Executive [email protected]

National Information Standards Organization (NISO)3600 Clipper Mill Road, Suite 302

Baltimore, MD 21211 USA+1 (301) 654-2512

www.niso.org


mailto:[email protected]

mailto:[email protected]

http://www.niso.org

http://www.niso.org

13 0212 toccon - carpenter altmetrics 2

Business

Transcript of 13 0212 toccon - carpenter altmetrics 2