http:// www.minesforlibraries.o rg http:// www.arl.org/stats MINES for Libraries™ Presented by Martha Kyrillidou Director of the ARL Statistics and Service Quality Programs Association of Research Libraries at Rutgers University Library June 1 2007 New Brunswick, NJ www.arl.org/stats/
47
Embed
Http:// MINES for Libraries™ Presented by Martha Kyrillidou Director of the ARL Statistics and Service.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Libraries Remain a Credible Resource in Libraries Remain a Credible Resource in 2121stst Century Century
98% agree with statement98% agree with statement, “My … library , “My … library contains information from credible and contains information from credible and known sources.”known sources.”
Note. Digital Library Federation and Council on Library and InformationResources. (2002). Dimensions and Use of the Scholarly Information Environment.
Only Only 15.7% agreed with the statement15.7% agreed with the statement “The “The Internet has not changed the way I use the Internet has not changed the way I use the library.”library.”
Note. Digital Library Federation and Council on Library and InformationResources. (2002). Dimensions and Use of the Scholarly Information Environment.
• MINES is a transaction-based research methodology consisting of a web-based survey form and a random moments sampling plan
• MINES typically measures who is using electronic resources, where users are located at the time of use, and their purpose of use in the least obtrusive way
• MINES was adopted by the Association of Research Libraries (ARL) as part of the “New Measures” toolkit in May, 2003.
• MINES is different from other electronic resource usage measures that quantify total usage (e.g., Project COUNTER, E-Metrics) or measure how well a library makes electronic resources accessible (LibQUAL+™).
Questions Addressed By MINES for Libraries™ for the OCUL Scholars Portal
• How extensively do sponsored researchers use OCUL’s Scholars Portal? How much usage is for non-funded research, instruction/education, student research papers, and course work?
• Are researchers more likely to use the Scholars Portal from inside or outside the library? What about other classifications of users?
• Are there differences in Scholars Portal based on the user’s location (e.g., in the library; on-campus, but not in the library; or off-campus)?
• Could MINES, combined with usage counts, provide an infrastructure to make Scholars Portal usage studies routine, robust, and easily integrated into OCUL’s administrative decision-making process for assessing networked electronic resources?
MINES strategy• A representative sampling plan, including sample size, is
determined at the outset. Typically, there are 48 hours of surveying over 12 months at a medical library and 24 hours a year at a main library.
• Random moment/web-based surveys are employed at each site.
• Participation is usually mandatory, negating non-respondent bias, and is based on actual use in real-time.– IRB waiver or approval
• Libraries with database-to-web gateways or proxy re-writers offer a comprehensive networking solution for surveying all networked services users during survey periods.
• Web survey design guidelines that MINES followed: – Presentation
• Simple text for different browsers – no graphics– Different browsers render web pages differently
• Few questions per screen or simply few questions• Easy to navigate• Short and plain• No scrolling• Clear and encouraging error or warning messages• Every question answered in a similar way - consistent
– Radio buttons, drop downs• ADA compliant• Introduction page or paragraph• Easy to read
– Must see definitions of sponsored research. • Can present questions in response to answers – for example if
sponsored research was chosen, could present another survey
Quality Checks• Target population is the population frame – surveyed the patrons
who were supposed to be surveyed - except in libraries with outstanding open digital collections.
• Check usage against IP. In this case, big numbers may not be good. May be seeing the survey too often.
• Alter order of questions and answers, particularly sponsored and instruction.
• Spot check IP against self-identified location• Spot check undergraduates choosing sponsored research –
measurement error• Check self-identified grant information against actual grants • Content validity – discussed with librarians and pre-tested. • Turn-aways – number who elected not to fill out the survey• Library information architecture -- Gateway v. HTML pages – there
“It is useless to tell the acquisitions librarian that half the monographs ordered will never be used,unless we can specify which 50% to avoid buying.” (Galvin and Kent, 1977)
The most popular current method of measuring usage of electronic resources by libraries is not through web-based usage surveys, but through vendor supplied data of library patron usage or transaction usage.
Web-based usage surveys are increasingly relevant in the collection of usage data to make collection development and service decisions, to document evidence of usage by certain patron populations, and to collect and analyze performance outputs.
Brinley Franklin and Terry Plum, “Successful Web Survey Methodologies for Measuring the Impact of Networked Electronic Services (MINES for LibrariesTM)” IFLA Journal 32 (1) March, 2006
A web-based transactional survey that collects data on users’ demographics and their purpose of use. It is administered in real time over the course of at least a year using a random moments sampling plan.
MINES for LibrariesTM has been administered at 40 North American universities in the last four years. More than 100,000 North American networked services users have been surveyed using a standard protocol.
Off CampusNon-UConn131.128.89.54EducationInstruction/Education/Departmental (Non-Funded) Researchhttp://www.euromonitor.com/womdas/12:57:4412/3/2004
Off CampusNon-UConn134.241.135.70Non-UConnInstruction/Education/Departmental (Non-Funded) Researchhttp://homerweb.lib.uconn.edu/cgi-bin/Pwebrecon.cgi?DB=local&PAGE=First13:28:5212/3/2004
Off CampusNon-UConn134.74.42.82Business AdministrationOther Activitieshttp://homerweb.lib.uconn.edu/cgi-bin/Pwebrecon.cgi?DB=local&PAGE=First12:56:4612/3/2004In the LibraryUConn Faculty137.99.1.122
Liberal Arts & SciencesOther Activitieshttp://www.siam.org/journals/simax/simax.htm12:52:1712/3/2004On Campus - StorrsUConn Graduate Student137.99.1.122