42510011 0010 1010 1101 0001 0100 1011

Applying Usage Data to Collection Management

in Libraries & Consortia

Jason S. Price, Ph.D.Science & Electronic Resources LibrarianClaremont Colleges’ Libraries; SCELCBetter Data, Better Business: Applying Usage Data in Scholarly publishing

June 6, 2007 Society for Scholarly Publishing Annual Meeting. San Francisco, CA

4251

0011 0010 1010 1101 0001 0100 1011

Major questions• Which titles should we keep or

cut?– Highest use/value vs. Lowest

use/value

• Which titles should we add?– Most requested (Traditional & Web)

• Which package provides highest or lowest value?

4251

0011 0010 1010 1101 0001 0100 1011

Use and Value

1. Determining cost per use2. Comparison with ILL cost3. ‘By-title’ data4. Comparison across

Publishers1. html? pdf? combined (FTAR)?

5. Need for context

4251

0011 0010 1010 1101 0001 0100 1011Overall cost per use=1 year’s cost / 1 year’s requests

e.g. $58,600 publisher E-access fee 35,700 article views

$1.64 Cost per use* $420,000 mandatory cost of subs (to

agent) for a subset of these same titles

$420K + $ 58.6K = $478,600 / 35,700 = $13.40

Determining Cost Per Use

?

4251

0011 0010 1010 1101 0001 0100 1011

Overall cost per view by Subs Type

Cost per view by access type

$30.51

$0.81

$13.41

$0

$5

$10

$15

$20

$25

$30

$35

All Titles Subscribed Titles[n=192]

Unsubscribed(Leased) Titles

[n=345]

Access Type

Co

st p

er v

iew

[n=537]

4251

0011 0010 1010 1101 0001 0100 1011

Comparison with ILL cost

Package CPV = $13.40

What does this tell us?

• Is it High? Low?

• Better than ILL?

4251

0011 0010 1010 1101 0001 0100 1011

Which titles to keep/cut: By-title data

Combined 3yr use

4251

0011 0010 1010 1101 0001 0100 1011

Challenge: Usage report granularity

Title-level use statistics• Currently reported per title• Can’t separate frontfile use from

backfile use– Backfile may be previously purchased or freely

available

• Ultimately cost per use should be based on what customers are paying for– Issue of repository / free backfile use

4251

0011 0010 1010 1101 0001 0100 1011

Which titles should be added?

• Still largely determined by faculty request

• Journal Report 2 (turnaways) is under-utilized by libraries and publishers

• (see example for Consortia near the end)

4251

0011 0010 1010 1101 0001 0100 1011

Cross-package comparison

So Pkg 1 is a better value than Pkg 3?

pkgIDTotal Use SubsCost UnSubsCost Overall PPV1 140048 $1,652,000 $182,000 $13.102 20341 $333,000 $10,000 $16.863 13572 $282,000 $21,000 $22.33

CPV

It might not be…

4251

0011 0010 1010 1101 0001 0100 1011

Variation in use by format

Davis and Price, 2006 JASIST

4251

0011 0010 1010 1101 0001 0100 1011

html to pdf Ratios vary widely for these packages

352 5684066

13004

32688

48047

0

10000

20000

30000

40000

50000

1 2 3Package

# o

f vi

ews

html viewspdf downloads

1:1.3 1:23

1:12

How many pdfs in Pkg 1 are duplicates of html views?

4251

0011 0010 1010 1101 0001 0100 1011

Live Link

4251

0011 0010 1010 1101 0001 0100 1011

S3. Package value revisited

pdf requests only tell a different story!

pkgID Est. pdf Use SubsCost UnSubsCost Overall PPP1 83469 $1,652,000 $182,000 $21.972 18734 $333,000 $10,000 $18.313 13287 $282,000 $21,000 $22.80

CPP

pkgIDTotal Use SubsCost UnSubsCost Overall PPV1 140048 $1,652,000 $182,000 $13.102 20341 $333,000 $10,000 $16.863 13572 $282,000 $21,000 $22.33

CPU

vs.

4251

0011 0010 1010 1101 0001 0100 1011

Implications

• Publisher interface/content types can have major influence on cost per view

• Linking tools can have significant disruptive effects on CPV calculations

• It is unclear whether pdfs vs FTARs are ‘better’ for cost comparisons

THUS: Within publisher comparisons are more valid than between publisher comparisons

4251

0011 0010 1010 1101 0001 0100 1011SCELC Package 'W' Overall Price per Use

$0.00

$10.00

$20.00

$30.00

$40.00

$50.00

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

Member (Sorted by decreasing spend)

Pri

ce p

er f

ull

text

art

icle

vie

w

Use

dat

a n

ot

aval

iab

le

Consortium

Benchmarks for context

4251

0011 0010 1010 1101 0001 0100 1011SCELC Package 'W' Overall Price per Use

$0.00

$10.00

$20.00

$30.00

$40.00

$50.00

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

Member (Sorted by decreasing spend)

Pri

ce p

er f

ull

text

art

icle

vie

w

Use

dat

a n

ot

aval

iab

le

Consortium

16: Low value?

4251

0011 0010 1010 1101 0001 0100 1011SCELC Package 'W' Overall Price per Use

$0.00

$10.00

$20.00

$30.00

$40.00

$50.00

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

Member (Sorted by decreasing spend)

Pri

ce p

er f

ull

text

art

icle

vie

w

Use

dat

a n

ot

aval

iab

le

Consortium

16: High value?

4251

0011 0010 1010 1101 0001 0100 1011SCELC Package 'W' Overall Price per Use

$0.00

$10.00

$20.00

$30.00

$40.00

$50.00

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

Member (Sorted by decreasing spend)

Pri

ce p

er f

ull

text

art

icle

vie

w

Use

dat

a n

ot

aval

iab

le

Consortium

16: The value of context

4251

0011 0010 1010 1101 0001 0100 1011

Questions for Consortia

• Is cost/value fairly distributed among members/participants?

• How can value/attractiveness be maintained or increased for current and future participants?

• License renewals– do pricing terms need to be renegotiated?

4251

0011 0010 1010 1101 0001 0100 1011SCELC Package 'W' Overall Price per Use

$0.00

$10.00

$20.00

$30.00

$40.00

$50.00

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

Member (Sorted by decreasing spend)

Pri

ce p

er f

ull

text

art

icle

vie

w

Use

dat

a n

ot

aval

iab

le

Consortium

Equitable distribution of value?

4251

0011 0010 1010 1101 0001 0100 1011

Year to year comparisonSCELC Package 'E' Price per Use

$8.54

$4.06

$0.00

$2.00

$4.00

$6.00

$8.00

$10.00

$12.00

Year

Pri

ce p

er f

ull

text

art

icle

req

ues

t

2005 2006

Two-Tailed Paired T(df = 15) = 2.13p = 0.0244

4251

0011 0010 1010 1101 0001 0100 1011

Year/Year by institution

SCELC Package 'E' Price per Use by Member

$0.00

$5.00

$10.00

$15.00

$20.00

$25.00

$30.00

$35.00

$40.00

$45.00

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16

Member

Pri

ce p

er f

ull

tex

t ar

ticl

e re

qu

est

20052006

4251

0011 0010 1010 1101 0001 0100 1011

JR2 Turnaways by Journal: Collaborative Collection Management

2004 2005 2006

ChemInform ChemInform ChemInform

Journal of Molecular Recognition

Journal of Molecular Recognition

Journal of Molecular Recognition

Journal of Peptide Science Journal of Peptide Science Journal of Peptide Science

Ment Retard and Dev Disab Ment Retard and Dev Disab Ment Retard and Dev Disab

Electroanalysis Electroanalysis ChemMedChem

Reviews in Medical VirologyChemical Engineering & Technology - CET

Reviews in Medical Virology

Int J Robust and Nonlinear Control Prenatal Diagnosis Prenatal Diagnosis

The Chemical RecordHuman Psychopharmacology

International Journal of Cancer

ChiralityPolymer Engineering and Science

Journal of Cellular Biochemistry

Single MoleculesProgress in Photovoltaics: Research and Applications

Ultrasound in Obstetrics and Gynecology

4251

0011 0010 1010 1101 0001 0100 1011

Conclusions1. Price is an integral part of use evaluation

– Recognize that libraries need to base expenditures on actual return on cost

2. Meaningful cross-publisher comparisons are difficult (but will still be sought)

3. Context is crucial for within-publisher comparison

– Consortial statistics provide valuable benchmarks– Cross-year comparisons can indicate increasing

value– Use consortial context to identify ideal institutions

for additional sales (added titles, backfiles, etc)