A Library-Based Metrics & Impact Core

Kristi Holmes, PhD@kristiholmes

NISO Virtual Conference: Justifying the Library Using Assessment to Justify Library InvestmentsApril 20, 2016

Galter Library’s Metrics and Impact Core

• The Metrics and Impact Core (MIC), housed in Galter Library, has expertise in bibliometrics, data visualization, continuous improvement, information systems and alternative metrics. The core provides extensive advisory services for researchers, groups or departments on topics such as:

• developing successful publishing strategies• managing or tracking publications• maintaining an impactful online identity• measuring or assessing research impact by discipline• communicating research impact to audiences

Metrics and Impact Core websitehttp://galter.northwestern.edu/Request-Services-and-Materials/metrics-and-impact-core-mic

Northwestern University Clinical and Translational Sciences (NUCATS) Institute

Mission: Speeding transformative research discoveries to patients

and the community

http://nucats.northwestern.edu/

Evaluation Services for the campus

Studios – lead to training grants, foundation awards, cores, etc.

Northwestern University Clinical and Translational Sciences (NUCATS) Institute Evaluation and Continuous Improvement Program

Mission: Speeding transformative research discoveries to patients and the community

http://nucats.northwestern.edu/

Some sample metrics…

OUTPUT Metrics

Time to Publication or other output

Number of technology transfer products

ROI of pilot awards

ROI of TL1, T32, KL2 scholars

Time from publication to research synthesis

IMPACT Metrics

Influence of a research output

Researcher and institutional collaborations

Career development and path/trajectory

PROCESS Metrics

Time from IRB submission to approval

Time from grant award to start of study

Volume of investigators who use services, take training, and other activities

Writing About Your Impact on the New NIH Biosketchhttp://galter.northwestern.edu/news/wr iting-about-your-impact-in-the-new-nih-biosketch

Matchmaker, Make Me a Match: Choosing a Journalhttp://galter.northwestern.edu/news/matchmaker-make-me-a-match-choosing-a-journal

Sharing, Publishing, and Archiving Your Workhttp://galter.northwestern.edu/news/shar ing-publishing-and-archiving-your-work

Visualizing Science at Feinberg School of Medicinehttp://galter.northwestern.edu/news/visualizing-science-at-feinberg-school-of-medicine

Recent News Items

Communication

Frameworks and Resources

Becker Model for Assessing Research Impact (C Sarli)-https://becker.wustl.edu/impact-assessment/how-to-use

Academic Careers Understood through Measurement and Norms (ACUMEN)-http://research-acumen.eu/portfolio

Research Excellence Framework (REF) Impact Case Studies-http://impact.ref.ac.uk/CaseStudies/

Canadian Academy of Health Sciences (CAHS) Framework-http://www.cahs-acss.ca/wp-content/uploads/2011/09/ROI_FullReport.pdf

And more…

Tools and data sources

Bibliographic databases: Scopus (Elsevier)NU Scholars (Elsevier)PubMed (NLM)Web of Science (Thomson Reuters)Google Scholar

Other databases:Scholarly DatabaseNIH RePORTEREssential Science Indicators (Thomson Reuters)

Tools: Sci2TableauTagxedoExcelIllustrator

Service Examples

Recognition of Faculty and Alumni

Visualizations for recognition

Department of Preventive Medicine, NU FSMDevelopment and Alumni Relations, NU FSM

Global Influence of Jeremiah Stamler, MD

Network of top 50 co-author relationships with Jeremiah Stamler, MD

Data from Elsevier’s Scopus. Data span from 1949-2014.

Visualization created using Sci2 tool (cns.iu.edu).

Top 20 Journal Titles for Jeremiah Stamler, MD

Titles of publications for Jeremiah Stamler, MD

Data from Elsevier’s Scopus.Data span from 1949-2014.

Visualization created using Tagxedo.

Publication Summaries

• Productivity: how much research was produced and who produced it- # of researchers in group- # of articles published by members- Average articles per year- # of unique source (journal) titles

• Collaboration: who worked together to make the research happen- # of country affiliations of co-authors- # of top institutional affiliations of co-authors- Listing of funding organizations from 2014 to present

• Research Topics: what the research was about- Document types for published articles- Top key words used in articles- Top subject areas of source (journal) titles

Departmental Publication Summaries continued…

Citation Impact for the Group: the impact it had on subsequent scientific research

- Total citations- Average citations per year- Average citations per publication- Citations by year of publication- Citations cumulative- Citations by year of publication per publication- Most highly cited publication- # of country affiliations of citing authors- # of languages of citing articles- # of unique source (journal titles) from citing articles- # of unique country affiliations of citing authors- # of unique institutional affiliations of citing authors- h- index of departmental documents- # of documents with no citations- Hot or Highly Cited publications

Citation Impact for Individuals: the impact he/she had on subsequent scientific research

­ Total published articles (career span and report timespan)­ Total citations (career span and report timespan)­ h-index­ m-index­ # of co-authors

High Impact Research

http://www.feinberg.northwestern.edu/research/about/high-impact/index.html

Office of the Dean, NU FSM

Other services…

https://galter.northwestern.edu/news/writing-about-your-impact-in-the-new-nih-biosketch

We offer: u Galter classu Individual consultationsu Online guide

It’s a team effort!u Pamela Shawu Karen Gutzman

NIH biosketch review

Other services…

Assistance with grant proposal and submission

u Award nominationsu Visa applicationsu Progress reports

Custom reports

The library offers expertise in bibliometrics, data visualization, continuous improvement, information systems and alternative metrics through the Metrics and Impact Core. 18

Research Impact and Metrics Services and Support

VisualizationsPublication Summaries

Indicator and Measurement OverviewProductivity: how much research was produced and who produced it

# of researchers in department# of artic les published by facultyAverage artic les per year# of unique source (journal) titles

Collaboration: who worked together to make the research happen

# of country affiliations of co-authors# of top institutional affiliations of co-authorsListing of funding organizations from 2014 to present

Research Topics: what the research was aboutDocument types for published artic lesTop key words used in artic lesTop subject areas of source (journal) titles

Citation Impact for Department: the impact it had on subsequent scientific research

Total c itationsAverage citations per yearAverage citations per publicationCitations by year of publicationCitations cumulativeCitations by year of publication per publicationMost highly c ited publication# of country affiliations of c iting authors# of languages of c iting artic les# of unique source (journal titles) from citing artic les# of unique country affiliations of c iting authors# of unique institutional affiliations of c iting authorsh- index of departmental documents# of documents with no citationsHot or Highly Cited publications

Citation Impact for Individuals: the impact he/she had on subsequent scientific research

Total published artic les (career span and report timespan)Total c itations (career span and report timespan)h-indexm-index# of co-authors

Custom Reports

Karen Gutzman is our Impact and Evaluation Librarian. Contact her directly or through your liaison librarian. Visit the Metrics and Impact Core online.

A few future directions

Galter Classes:-Enhancing the Impact of Your Research-Bibliometrics for Researchers

Galter Guides-Enhancing the Impact of Your Research-Methods and Processes for Individual/Group Publication

Summaries-Evaluation Resources at Northwestern

Building out the Service Core

Acknowledgements

Teams:• Karen Gutzman & Pamela Shaw• The amazing team at Galter Library

• NUCATS

Questions/Follow-up:• kristi.holmes@northwestern.edu• Twitter: @kristiholmes

Thank you!Kristi Holmes@kristiholmeskristi.holmes@northwestern.eduorcid.org/0000-0001-8420-5254

Image credits

• http://k12education.gatesfoundation.org/wp-content/uploads/2015/10/tools_cropped.jpg

• http://www.clipartpanda.com/categories/stack-of-paper-png