Journal Ranking MetricsJournal Ranking MetricsSNIP & SJR – A new perspective in Journal Performance Management Journal Performance Management

“Using the Impact Factor alone to judge a journal is like using weight alone to judge a person’s health.”

Source: The Joint Committee on Quantitative Assessment of Research: “Citation Statistics”, a report from the International Mathematical Union

“There is no single ‘best’ indicator that could accommodate all facets of the new reality of Journal Metrics.”

- Wolfgang Glänzel, Centre for R&D Monitoring, ECOOMLeuven, Belgium, g

Bibliometrics – A discipline that uses statistical methods to analyze content and measure research performance.

Users demand alternative to Impact Factor

Assign value to Scopus-unique content, especially

- “How do impact factors of journals in Scopus, especially those not covered by Web of Science, compare to those di

tor

q , p yregional content

y , pindexed in WoS?” Lopez-Illescas et al, J Informetrics, 2008, p304-316

- “Basically, I measure good research by papers. The better th th b tt h S th I t F t

Journal quality is a key aspect f f l ti

EdSc

ient

ist the papers, the better my research. So the Impact Factor. Quite simple.” Group Leader, Netherlands- “Impact Factor is considered one of the crucial citation indicators widely used in research assessment and science

of performance evaluation

Facilitates Scopus adoption if - “It is a no-brainer – the only thing missing from Scopus to anS indicators widely used in research assessment and science

administration.” Pislyakov, 2008, Scientometrics p1-10

p pfaced with switch from WoS

y g g preally take over from ISI is legitimate journal metrics.” Inn Beng Lee, Head of Customer Marketing, Asia Pacific

Libr

ari

Increases willingness of other publishers to cooperate

-“This will have a very positive effect on our relationship with other publishers and spur collaboration to ensure full coverage.” Ove Kähler, Senior Product Manager for Scopus Content, N th l dub

lishe

r

NetherlandsPu

How would you know that all of these journals are the best?

Journal Impact Factor 2008*Lancet Infectious Diseases 13.165S i l St di f S i 1 343Social Studies of Science 1.343

Dyes & Pigments 2.507Expert Systems with Applications 2 596Expert Systems with Applications 2.596

Progress in Nuclear Magnetic Resonance Spectroscopy 6.162

*Journal Citation Reports 2009

Communications on Pure & Applied Mathematics 3.806Citation behaviour is different per field• Frequency of publication• Number of authors

L h f f li• Length of reference list

How do you compare with confidence?

Our approachNot one-dimensional, but multi-dimensional approachMake metrics freely availabley

Don’t invent metrics ourselves – ask the external experts Survey what’s out thereMeet experts to understand how metrics meet user needsCalculate test data for metric shortlistCalculate test data for metric shortlist

Decide with advice from the internal experts, Academic RelationsResult – endorse SJR and SNIPNeither are ‘leading’ – both are given equal importance

Secure support from publishing divisionsSecure support from publishing divisions

3-year citation window = fairest compromise

To which years are citations made in 2007 directed?

8

9

10

Immunology and Microbiology (67,9%)Biochemistry, Genetics and Molecular Biology (65,3%)Pharmacology, Toxicology and Pharmaceutics (63,6%)General (58,3%)M di i (60 8%)

6

7

8 Medicine (60,8%)Neuroscience (64,8%)Chemistry (55,4%)Health Professions (56,4%)Nursing (53,5%)Chemical Engineering (51,6%)Materials Science (52,6%)

4

5

Dentistry  (55,9%)Energy (42,1%)Physics and Astronomy (47,3%)Veterinary (47,9%)Agricultural and Biological Sciences (45,0%)Environmental Science (43,5%)Engineering (38,7%)

1

2

3 Psychology (44,8%)Earth and Planetary Sciences (41,3%)Computer Science (33,7%)Mathematics (32,5%)Decision Sciences (32,4%)Economics, Econometrics and Finance (29,0%)Business, Management  and Accounting (27,7%)

0

2007 2006 2005 2004 2003 2002 2001 2000 1999 1998 1997 1996

, g g ( , )Social Sciences (20,1%)Arts and Humanities  (10,1%)

Source: Felix de Moya

SJR and SNIP snippets…

SCImago Journal Rank – SJR• Developed by SCImago Felix de Moya SCImago research group• Developed by SCImago – Felix de Moya, SCImago research group

Consejo Superior de InvestigacionesCientíficas (CSIC), University of Granada,

• Main feature: prestige metric – similar to Google PageRank• Citations are weighted depending on the status of the source they come from

• Secondary feature : different citation behaviour addressed

So rce Normali ed Impact per Paper SNIPSource-Normalized Impact per Paper – SNIP• Developed by Henk Moed, CWTS, University of Leiden

• Main feature: contextual citation impact • Main feature: contextual citation impact • Part 1 – evens out differences in likelihood of citation (i.e. different behaviours)• Part 2 – evens out differences in database coverage in subject fields

SCImago Journal Rank - SJR

SJR is a prestige metric citations weighted depending on where they come fromSJR is a prestige metric – citations weighted depending on where they come from- A journal transfers its prestige by citing- Prestige transferred = journal’s SJR

e g Lancet SJR 2007 = 1 541 high prestigee.g. Lancet SJR 2007 = 1.541 – high prestigee.g. Scandinavian Journal of Medicine and Science in Sports SJR 2007 = 0.153 – lower prestige

A journal’s prestige is shared equally between its citations

Life Sciences journal Arts & Humanities journal

Hi h i t l t f it ti

Normalize for differences in

it ti b h i • High impact, lots of citations• One citation = low value

• Low impact, few of citations• One citation = high value

citation behaviour between subject fields

Source Normalized Impact per Paper - SNIP

Calculate ‘Citation Potential’ for 2009

1. Collect papers citing 1-3 year old papers in target journal in 2009

2. Collect reference lists of citing papers

Etc.

3. Count number of references in citing papers to any (in any journal) 1-3 year old papers

Etc.

4. Citation Potential = average number of references to any 1-3 year old papers

Etc.

SNIP = 2009 Impact / 2009 Citation Potential• Life Sciences – high impact high Citation Potential

Normalize for differences in

it ti b h i Life Sciences high impact, high Citation Potential• Arts & Humanities – low impact, low Citation Potential

citation behaviour between subject fields

Metrics to Support User Needs

N d SJR SNIPNeed SJR SNIP

Manipulation-proofAll journals have a metric

Fair to database coverage

M iMetrics are currentDatabase transparency

R k j l ith t I t F tRank journals without Impact FactorsMetric transparency

F i t ll bj t fi ldFair to all subject fields

Flexible ranking

First Scopus, and then…

SJR and SNIP will be launched in Scopus on 23 January 2010All 18,000 journals, proceedings and book series receive SJR and SNIP valuesSJR and SNIP for 2009 go back to 1999Refreshed twice per year: April and Septemberp y p pNew titles will have SJR and SNIP in their second year of coverageFreely available via the Scopus Info site

First Scopus, and then…

www.journalmetrics.com

Available for Non-users of Scopus

14

We are asking users to change their mindsetLaunch 23 January 2010 All journals, book series, proceedings

All years, 1999-2009y ,Note – 2009 Impact Factor will be published June 2010

Metrics refresh 2010 SeptemberMetrics refresh 2010 September2011 and ongoing April, September

Refresh what? All years recalculated to reflect retrospective changes in Refresh what? All years recalculated to reflect retrospective changes in dynamic databaseHistorical values archived on Info site

New titles rule: if data are available, metric will be calculatedIf title covered from 2010, first metrics published in April 2011

Note – first Impact Factor for new launch would be 2011 published June 2012Note – first Impact Factor for new launch would be 2011, published June 2012,Note – first Impact Factor for newly indexed but established title would be 2012, published June 2013

Information availableAccess all SNIP & SJR values @

www journalmetrics comwww.journalmetrics.com

Additional Resources:• Research Trends Special Issue on Journal

performance Indicators [www.researchtrends.com] (print and online at ) (p t a d o e at )

• Press Release • Scopus.com • Info Site Scopus [ http://info.scopus.com ]