Usage Statistics in Context: related standards and tools Oliver Pesch Chief Strategist, E-Resources...

Usage Statistics in Context: related standards and tools

Oliver PeschChief Strategist, E-ResourcesEBSCO Information Services

Usage Statistics and Publishers: Implementation and New Insights

September 20, 2010

http://www.pspcentral.org/index.cfm

Overview

• The librarian’s view of the landscape• Tools and standards• Importance of getting it right• Looking ahead

Library

PublisherSite 1

PublisherSite 1

PublisherSite 2

PublisherSite 2

AggregatorSite 1

AggregatorSite 1

Library Collection

Much of the library collectionno longer resides in the library

Much of the library collectionno longer resides in the library

Library

PublisherSite 1

PublisherSite 1

PublisherSite 2

PublisherSite 2

AggregatorSite 1

AggregatorSite 1

Library Collection

Users are often not in the library.

Usage data is captured by the content

provider (not the library)

Users are often not in the library.



User are often not in the library.



User are often not in the library.



Library

PublisherSite 1

PublisherSite 1

PublisherSite 2

PublisherSite 2

AggregatorSite 1

AggregatorSite 1

Library Collection

Usage?

A librarian wanting to collect usage data has to download reports

from content providers.

A librarian wanting to collect usage data has to download reports

from content providers.

Library

PublisherSite 1

PublisherSite 1

PublisherSite 2

PublisherSite 2

AggregatorSite 1

AggregatorSite 1

Library Collection

Usage?

Usage

Usage consolidation tool

These reports are then loaded into some kind of tool to consolidate the usage, so a single

report can be prepared.

These reports are then loaded into some kind of tool to consolidate the usage, so a single

report can be prepared.

Library

PublisherSite 1

PublisherSite 1

PublisherSite 2

PublisherSite 2

AggregatorSite 1

AggregatorSite 1

Library Collection

Usage?

Usage


Different formats

Different terminology

Different counting rules

Initially there were a number of challenges with this approach.

COUNTER was created to address these.

Initially there were a number of challenges with this approach.

COUNTER was created to address these.

Library

PublisherSite 1

PublisherSite 1

PublisherSite 2

PublisherSite 2

AggregatorSite 1

AggregatorSite 1

Library Collection

Usage?

Usage


Retrieving stats can be time consuming

Retrieving reports is a lot of work. The role of SUSHI is to

automate this process.

Retrieving reports is a lot of work. The role of SUSHI is to

automate this process.

Library

PublisherSite 1

PublisherSite 1

PublisherSite 2

PublisherSite 2

AggregatorSite 1

AggregatorSite 1

Library Collection

Usage?

Usage


SUSHI uses a client/server approach in which software at the library talks to

software at the publisher site to

retrieve the reports










Library

PublisherSite 1

PublisherSite 1

PublisherSite 2

PublisherSite 2

AggregatorSite 1

AggregatorSite 1

Library Collection

Cost/Use?


Librarians also measure value by

computing cost-per-use. Cost data must

be obtained and loaded into the system.

Librarians also measure value by

computing cost-per-use. Cost data must

be obtained and loaded into the system.

AgentAgent

AcquisitionsSystem

AcquisitionsSystem

ConsortiumConsortium

OtherOther

Acquire

Cost/Use?

Cost/Use

Library

PublisherSite 1

PublisherSite 1

PublisherSite 2

PublisherSite 2

AggregatorSite 1

AggregatorSite 1

Library Collection


Acquire

AgentAgent

AcquisitionsSystem

AcquisitionsSystem


OtherOther

Cost information is combined with usage

numbers to create the measures.

Cost information is combined with usage

numbers to create the measures.

Cost/Use

Library

PublisherSite 1

PublisherSite 1

PublisherSite 2

PublisherSite 2

AggregatorSite 1

AggregatorSite 1

ERMERM

Library Collection


Acquire

AgentAgent

AcquisitionsSystem

AcquisitionsSystem


OtherOther

If the library is using an ERM system,

it will have a knowledge base.

If the library is using an ERM system,

it will have a knowledge base.

Knowledgebase

Cost/Use

Library

PublisherSite 1

PublisherSite 1

PublisherSite 2

PublisherSite 2

AggregatorSite 1

AggregatorSite 1

ERMERM

Library Collection


Acquire

AgentAgent

AcquisitionsSystem

AcquisitionsSystem


OtherOther

The title lists for the knowledge base usually come from content providers

The title lists for the knowledge base usually come from content providers

Knowledgebase

Cost/Use

Library

PublisherSite 1

PublisherSite 1

PublisherSite 2

PublisherSite 2

AggregatorSite 1

AggregatorSite 1

ERMERM

Library Collection


Acquire

AgentAgent

AcquisitionsSystem

AcquisitionsSystem


OtherOther

Inconsistent reports, inaccurate lists, lack of information cause

problems

Inconsistent reports, inaccurate lists, lack of information cause

problems

Knowledgebase

Cost/Use

Library

PublisherSite 1

PublisherSite 1

PublisherSite 2

PublisherSite 2

AggregatorSite 1

AggregatorSite 1

ERMERM

Library Collection


Acquire

AgentAgent

AcquisitionsSystem

AcquisitionsSystem


OtherOther

KBART is a recommended practice to improve the knowledge base

quality

KBART is a recommended practice to improve the knowledge base

quality

Knowledgebase

More on standards, tools and available assistance…

The technology behind SUSHI

SUSHI is a simple standard that:• Allows software on one computer to request a

COUNTER report from another.• Describes a web service based on the SOAP

standard, which is:– a client/server protocol;– using a “request”/”response” approach.

• The client sends a “request” identifying the account, the desired report and the date range

• The server prepares the report then sends back a “response” containing the COUNTER report.

Usage Reporting

System

Usage Reporting

System

Library

PublisherSite 2

PublisherSite 2

Usage Consolidation

tool

SUSHI is an enabling technology (not a

product)

SUSHI is an enabling technology (not a

product)

Knowledgebase

SUSHIClient

SUSHIClient

SUSHIServerSUSHIServer

SUSHI Clients

The library needs “client” software. Options are:• Use a free client (or create their own) to harvest

reports and store them on the local system.• SUSHI client that comes with commercial (or other)

usage consolidation system – often part of an E-Resource Management system.

• Part of an outsourcing service for collection of statistics.

SUSHI Servers

The content provider creates the “server” software.: • Integrates with administration/usage reporting

module.• Provided by content hosting service.• Feature of an outsourcing service for handling

usage.

Getting help with SUSHI

NISO’s SUSHI Site…

http://www.niso.org/workrooms/sushi

http://www.niso.org/workrooms/sushi

FAQs for librarians, content providers and

about COUNTER

FAQs for librarians, content providers and

about COUNTER

Getting started guides for client and server

development.

Getting started guides for client and server

development.

Links to free client software, a developer kit for a .NET

server, a tool to help consortia harvest usage,

and more…

Links to free client software, a developer kit for a .NET

server, a tool to help consortia harvest usage,

and more…

Schemas both as text and graphical representations.

Schemas both as text and graphical representations.

A discussion list for developers. Get answers to questions, collaborate with others to test your

services.

A discussion list for developers. Get answers to questions, collaborate with others to test your

services.

Getting help with SUSHI

The SUSHI Server Registry

http://sites.google.com/site/sushiserverregistry/





Little things make a big difference…

Library

PublisherSite 1

PublisherSite 1

PublisherSite 2

PublisherSite 2

AggregatorSite 1

AggregatorSite 1

ERMERM

Library Collection

Cost/Use?


Acquire

AgentAgent

AcquisitionsSystem

AcquisitionsSystem


OtherOther

Cost/Use

Common problems… “The Journal of XYZ”

Common problems… “The Journal of XYZ”

Knowledgebase

Journal of XYZJournal of XYZThe Journal of XYZThe Journal of XYZ

XYZ JournalXYZ Journal

Journal of XYZ, TheJournal of XYZ, The

Cost doesn’t get applied correctly

Cost doesn’t get applied correctly

Under counting because usage not combined

Under counting because usage not combined

Usage may be rejected as “not in

collection”

Usage may be rejected as “not in

collection”

Guidelines for titles and ISSNs

• Ensure titles are consistent between various systems.

• Make sure the right ISSN is being used for the right title.

• Include both the print and online ISSN where possible.

• If the title has changed names, keep the history.

Things to watch out for with COUNTER reports

• Use the proper form of the title and the correct ISSN

• If using comma-separated output format, be careful of titles with embedded commas and quotes

• Avoid duplicate rows, where possible.

Hint: When things don’t match usage may not be counted.

Things to watch out for with SUSHI

• XML that is not valid.• Identifier types, categories and metric types that

are not valid or the wrong case.• A service that needs custom client development to

work.

Hint: Test your service with the MISO client to ensure it is valid.

In the works…

SUSHI

• SUSHI Registry could become machine readable– Allow auto-configuration of SUSHI clients – Content providers can “advertise”, URL to

SUSHI server, authentication methods used, reports supported, day-of-the-month usage is available, etc.

COUNTER

• Search Clicks – a new optional report– Measure value of databases by tracking the

activity from the result list…• View full text• Click for more detail• Link to link resolver• View images or tables• Etc.

COUNTER – related to SUSHI

• Guidance will be added to the CoP about SUSHI authentication

• SUSHI compliance will become part of the audit

Cost/Use

Library

PublisherSite 1

PublisherSite 1

PublisherSite 2

PublisherSite 2

AggregatorSite 1

AggregatorSite 1

ERMERM

Library Collection


Acquire

AgentAgent

AcquisitionsSystem

AcquisitionsSystem


OtherOther

The “usage reporting” landscape

The “usage reporting” landscape

Knowledgebase

Thank You

Oliver [email protected]

Usage Statistics in Context: related standards and tools Oliver Pesch Chief Strategist, E-Resources...

Documents

Transcript of Usage Statistics in Context: related standards and tools Oliver Pesch Chief Strategist, E-Resources...