COUNTER usage statistics: Measuring the benefits of the big deals Angela Conyers Evidence Base, Research & Evaluation Birmingham City University.

COUNTER usage statistics: Measuring the benefits of the big

deals

Angela ConyersEvidence Base, Research & Evaluation

Birmingham City University

Working with usage statistics

2004-5

NESLi2 analysis of usage statistics (JISC)

2006-9

Analysing Publisher Deals (Evidence Base)

2008

Assessing the value of the NESLi2 deals (JISC)

2008-9

Usage Statistics Portal Scoping Study (JISC)

2010 -

JUSP - Journal Usage Statistics Portal (JISC)

What do libraries want from usage data?

• Be sure it is right • Ready access for reporting• How well titles in a deal are being used:

– High use, nil and low use• Usage by subject area• Analyse trends over time• Evidence of value for money

• Single point of access to usage data from multiple publishers

• No need to visit separate publisher sites to download usage statistics

• Usage comparison across publishers and years

• Establishing value for money

JUSP Purpose and benefits

http://www.flickr.com/photos/wallyg/418328695/

A collaborative project

Libraries in JUSP

138 UK higher education and research council libraries are in JUSP

http://www.flickr.com/photos/ellf/3910635234/

18 publishersAmerican Association for the Advancement of ScienceAmerican Institute of Physics Annual ReviewsBioOneBritish Medical Journal Publishing GroupEdinburgh University Press ElsevierEmeraldFuture MedicineInstitute of Physics

Nature Publishing GroupOxford University PressProject MUSERoyal Society of ChemistrySAGESpringerTaylor & FrancisWiley-Blackwell

3 intermediariesEbsco EJSPublishing Technology (ingentaconnect)Swets

Publishers and intermediaries in JUSP

What data are we collecting?

COUNTER usage reportsJR1 • Journal Report 1:

Number of Successful Full-Text Article Requests by Month and Journal

JR1a• Journal Report 1a:

Number of Successful Full-Text Article Requests from an Archive by Month and Journal

http://www.flickr.com/photos/bionicteaching/2920562020/

How do we collect data?

• Standardized Usage Statistics Harvesting Initiative (SUSHI)

• M2M way of gathering statistics

• Replaces the user-mediated collection of usage reports

• 12 JUSP SUSHI clients available

• SUSHI server to gather data from JUSP

http://www.flickr.com/photos/ragingwire/3395161474/

• Data is quality checked• Full usage reports are given:

– JR1 and JR1a usage reports from publishers– Addition of usage from intermediaries/gateways– Separation of JR1A archive use from use of

current deal

• -

Making sure it is right

Adding value to the JR1

• Titles with the highest use from one publisher or all publishers in JUSP

• Titles in various usage ranges, from nil and low to very high

• Search facility – title or ISSN or keyword• Trends over time (2009- )• Comparing usage of different publishers• Assisting with the SCONUL return

Adding value to JUSP

JUSP enhancements:

• Adding subscribed or core titles

• What titles are in the deal?

Helping to judge the value of a deal

Adding subscribed or core titles

• How much are the subscribed titles being used?

• How much are other titles in the deal being used?

• Does usage show that the deal offers better value than individual subscribed titles?

Adding subscribed or core titles

What titles are in the deal?

Accounting for nil usage• Does the JR1 report contain titles that are not

available in the collection the library subscribes to?

• Does the JR1 report contain titles that are no longer part of the current deal e.g. name changes, publisher changes?

What titles are in the deal?

How many titles are in the deal?

Project Muse JR1 for 2011 for a library with the Basic Research Collection–

59% of titles in the JR1 are not in the library’s deal and will show nil use.

Titles in the Premium Collection in the JR1 498

Titles in the Basic Research Collection 206

Titles in the JR1 not available to the Library 292

How many titles are in the deal?

JUSP enhancements

• Usage patterns of subscribed or core titles

• Identification of titles in the deal or collection within the JR1 report

• Adding more publishers

Measuring costs

Cost per download• All titles• Subscribed titles• Non-subscribed titles

Cost per title• All titles in the JR1• All titles in the deal/collection taken• Subscribed titles• Non-subscribed titles

[email protected]

www.jusp.mimas.ac.uk