DISCOVERY AND LIBRARY MANAGEMENT SYSTEMS Marshall Breeding Independent Consult, Author, Founder and Publisher, Library Technology Guides http://www.librarytechnology.org/ http://twitter.com/mbreeding 19 June 2013 HKU Library Leadership Institute
DISCOVERY AND LIBRARY MANAGEMENT SYSTEMS
Marshall BreedingIndependent Consult, Author, Founder and Publisher, Library Technology Guideshttp://www.librarytechnology.org/http://twitter.com/mbreeding
19 June 2013 HKU Library Leadership Institute
Challenge: More integrated approach to information and service delivery
Library Web sites offer a menu of unconnected silos: Books: Library OPAC (ILS online catalog module) Search the Web site Articles: Aggregated content products, e-journal collections OpenURL linking services E-journal finding aids (Often managed by link resolver) Subject guides (e.g. Springshare LibGuides) Local digital collections
ETDs, photos, rich media collections Metasearch engines Discovery Services – often just another choice among
many All searched separately
Online Catalog
Books, Journals, and Media at the Title Level
Not in scope: Articles Book Chapters Digital objects Web site content Etc.
Scope of SearchSearch:
Search Results
ILS Data
Next-gen Catalogs or Discovery Interface (2002-2009)
Single search box Query tools
Did you mean Type-ahead
Relevance ranked results (for some content sources)
Faceted navigation Enhanced visual displays
Cover art Summaries, reviews,
Recommendation services
Discovery Interface search model
Search: Digital
Collections
ProQuest
EBSCOhost
…MLA
Bibliography
ABC-CLIO
Search Results
Real-time query and responses
ILS Data
Local Index
Meta
search
En
gin
e
Discovery Products
http://www.librarytechnology.org/discovery.pl
Differentiation in Discovery
Products increasingly specialized between public and academic libraries Public libraries: emphasis on engagement
with physical collection + e-books Academic libraries: concern for discovery of
heterogeneous material types, especially books + articles + digital objects
Discovery from Local to Web-scale Initial products focused on technology
AquaBrowser, Endeca, Primo, Encore, VuFind, LIBERO Uno, Civica Sorcer, Axiell Arena Mostly locally-installed software
Current phase is focused on pre-populated indexes that aim to deliver Web-scale discovery Primo Central (Ex Libris) Summon (Serials Solutions) WorldCat Local (OCLC) EBSCO Discovery Service (EBSCO) Encore Synergy (no index, though)
Public Library Information Portal
Search:
Digital Collections
Web Site ContentCommunit
yInformatio
n
…Customer-providedcontent
Reference Sources
Search Results
Pre-built harvesting and indexing
Conso
lidate
d In
dex
ILS Data
Aggregated Content packages
Archives
Usage-generate
dData
Customer
Profile
Web-scale Index-based Discovery
Search:
Digital Collections
Web Site Content
Institutional
Repositories
…E-Journals
Reference Sources
Search Results
Pre-built harvesting and indexing
Conso
lidate
d In
dex
ILS Data
Aggregated Content packages
(2009- present)
Usage-generate
dData
Customer
Profile
Open Access
Web-scale Search Problem
Search:
Search Results
Pre-built harvesting and indexing
Con
solid
ate
d
Index
???
Non Participating
Content Sources
Problem in how to deal with resources not provided to ingest into consolidated index
Digital Collections
Web Site ContentInstitution
al Repositori
es
…E-Journals
ILS Data
Aggregated Content packages
Discovery Service Installations
Discovery Product
2007 2008
2009
2010 2011 2012 Installed
Primo 12 37 53 506 111 101 1151
AquaBrowser 55 339 64 69 74 58 254
Encore 72 72 109 56 72 365
LS2 PAC 46 77 58 88 73 305
Summon 50 164 214 158 504
Enterprise 16 75 100 102 328
Civica Sorcer 7 12 22 3 42
Axiell Arena 61 57 33 76
Chamo 10 34 7 23 86
Web-scale Search Problem
Search:
Search Results
Pre-built harvesting and indexing
Con
solid
ate
d
Index
???
Non Participating
Content SourcesProblem in how to deal with
resources not provided to ingest into consolidated index
Digital Collections
Web Site ContentInstitution
al Repositori
es
…E-Journals
ILS Data
Aggregated Content packages
Challenge for Relevancy
Technically feasible to index hundreds of millions or billions of records through Lucene or SOLR
Difficult to order records in ways that make sense
Many fairly equivalent candidates returned for any given query
Must rely on use-based and social factors to improve relevancy rankings
Evaluating Index-based Discovery Services
Intense competition: how well the index covers the body of scholarly content stands as a key differentiator
Difficult to evaluate based on numbers of items indexed alone.
Important to ascertain now your library’s content packages are represented by the discovery service.
Important to know what items are indexed by citation and which are full text
Important to know whether the discovery service favors the content of any given publisher
Open Discovery Initiative
NISO Work Group to Develop Standards and Recommended Practices for Library Discovery Services Based on Indexed Search
Informal meeting called at ALA Annual 2011
Co-Chaired by Marshall Breeding and Jenny Walker
Term: Dec 2011 – May 2013
Balance of Constituents
Libraries
Publishers
Service Providers
17
Marshall Breeding, Vanderbilt UniversityJamene Brooks-Kieffer, Kansas State University Laura Morse, Harvard UniversityKen Varnum, University of Michigan
Sara Brownmiller, University of OregonLucy Harrison, College Center for Library Automation (D2D liaison/observer)Michele Newberry
Lettie Conrad, SAGE PublicationsBeth LaPensee, ITHAKA/JSTOR/PorticoJeff Lang, Thomson Reuters
Linda Beebe, American Psychological Assoc
Aaron Wood, Alexander Street Press
Jenny Walker, Ex Libris GroupJohn Law, Serials SolutionsMichael Gorrell, EBSCO Information Services
David Lindahl, University of Rochester (XC)Jeff Penka, OCLC (D2D liaison/observer)
Integrating e-Books into Library Automation Infrastructure
Current approach involves mostly outsourced arrangements
Collections licensed wholesale from single provider
Hand-off to DRM and delivery systems of providers
Loading of MARC records into local catalog with linking mechanisms
No ability to see availability status of e-books from the library’s online catalog or discovery interface
2013: The current state of discovery
Online Catalogs of ILS modules in decline Increasing numbers of academic libraries offer
discovery services Index-based search emerges
Summon, Primo/Primo Central, EBSCO Discovery Service, WorldCat Local
Indexes growing in comprehensiveness and depth. Relevancy algorithms gaining sophistication Increasing numbers of publishers and providers
cooperate with library discovery services Open Discovery Initiative launched October 2011
New-generation Library Management
Fragmented Library Management LMS for management of (mostly) print Duplicative financial systems between library and local
government or other parent organization E-book lending platform (multiple?) Interlibrary loan (borrowing and lending) Self-service and AMH infrastructure Electronic Resource Management PC Scheduling and print management Event scheduling Digital Collections Management platforms (CONTENTdm,
DigiTool, etc.) Discovery-layer services for broader access to library collections No effective integration services / interoperability among
disconnected systems, non-aligned metadata schemes
Is the status quo sustainable? ILS for management of (mostly) print Duplicative financial systems between library and campus Electronic Resource Management (non-integrated with
ILS) OpenURL Link Resolver w/ knowledge base for access to
full-text electronic articles Digital Collections Management platforms (CONTENTdm,
DigiTool, etc.) Institutional Repositories (DSpace, Fedora, etc.) Discovery-layer services for broader access to library
collections No effective integration services / interoperability among
disconnected systems, non-aligned metadata schemes
Integrated (for print) Library System
Circulation
BIB
Staff Interfaces:
Holding / Items
CircTransact
User Vendor Policies$$$
Funds
Cataloging Acquisitions Serials OnlineCatalog
Public Interfaces:
Interfaces
BusinessLogic
DataStores
LMS / ERM: Fragmented Model
Circulation
BIB
Staff Interfaces:
Holding / Items
CircTransact
User Vendor Policies$$$
Funds
CatalogingAcquisitionsSerials OnlineCatalog
Public Interfaces:
Application Programming Interfaces
`
LicenseManagement
LicenseTerms
E-resourceProcurement
VendorsE-Journal
Titles
Protocols: CORE
Common approach for ERM
Circulation
BIB
Staff Interfaces:
Holding / Items
CircTransact
User Vendor Policies$$$
Funds
CatalogingAcquisitionsSerials OnlineCatalog
Public Interfaces:
Application Programming Interfaces
Budget License Terms
Titles / Holdings
Vendors
Access Details
Gaps in Automation
Almost no systematic automation support for references and research services Customer Relationship Management?
Resource sharing / Interlibrary loan management
Collection development support
Comprehensive Resource Management
No longer sensible to use different software platforms for managing different types of library materials
ILS + ERM + OpenURL Resolver + Digital Asset management, etc. very inefficient model
Flexible platform capable of managing multiple type of library materials, multiple metadata formats, with appropriate workflows
Support for management of metadata in bulk Continuous lifecycle chain initiated before
publication
Academic Libraries need a new model of library management
Not an Integrated Library System or Library Management System
The ILS/LMS was designed to help libraries manage print collections
Generally did not evolve to manage electronic collections
Other library automation products evolved: Electronic Resource Management Systems –
OpenURL Link Resolvers – Digital Library Management Systems -- Institutional Repositories
Library Services Platform
Library-specific software. Designed to help libraries automate their internal operations, manage collections, fulfillment requests, and deliver services
Services Service oriented architecture Exposes Web services and other API’s Facilitates the services libraries offer to their users
Platform General infrastructure for library automation Consistent with the concept of Platform as a Service Library programmers address the APIs of the platform to
extend functionality, create connections with other systems, dynamically interact with data
Library Services Platform Characteristics
Highly Shared data models Knowledgebase architecture Some may take hybrid approach to accommodate local
data stores Delivered through software as a service
Multi-tenant Unified workflows across formats and media Flexible metadata management
MARC – Dublin Core – VRA – MODS – ONIX Bibframe New structures not yet invented
Open APIs for extensibility and interoperability
Library Services Platforms
Category WorldShare Management Services
Alma Intota Sierra Services Platform
Kuali OLE
Responsible Organization
OCLC. Ex Libris Serials Solutions
Innovative Interfaces, Inc
Kuali Foundation
Key precepts Global network-level approach to management and discovery based on central data: stores WorldCat + holdings + Items
Consolidate workflows, unified management: print, electronic, digital; Hybrid data model
Knowledgebase driven. Pure multi-tenant SaaS
Service-oriented architectureTechnology uplift for Millennium ILS. More open source components, consolidated modules and workflows
Manage library resources in a format agnostic approach. Integration into the broader academic enterprise infrastructure
Software model
Proprietary Proprietary
Proprietary Proprietary Open Source
Library Services Platforms
Category WorldShare Management Services
Alma Intota Sierra Services Platform
Kuali OLE
Status In Production:100+ libraries
In production
In Development:
In production: 150+ libraries. (Mostly Millennium migrations)
In Development. Some early adopting partners expect production in 2013 (2014?)
Discovery? Designed for WorldCat Local, Partnership with EDS as alternative
Designed for Primo / Primo Central, APIs for others
Designed for Summon, APIs for other
Designed for Encore, EDS for Discovery Index
No Discovery: APIs available. Initial partners will use Blacklight, Summon, etc.
Development Resources (2011)Company Dev Sup Sales Admin Other Total
Ex Libris 170 231 54 44 13 512Follett Software Company 87 143 86 49 0 365Innovative Interfaces, Inc. 83 158 43 24 3 311SirsiDynix Corporation 84 166 51 23 56 380Serials Solutions 80 50 46 4 57 237Axiell 57 66 34 35 34 226The Library Corporation 39 91 28 13 28 199Polaris Library Systems 27 42 15 2 86VTLS Inc. 24 48 12 8 18 110KohaByWater Solutions 3 12 3 3 1 13Catalyst IT 3 BibLibre 4 3 Koha Total (estimated) 15PTFS 5 16 8 8 155EvergreenEquinox Software 6 5 2 3 5 21
Open Systems
Achieving openness has risen as the key driver behind library technology strategies
Libraries need to do more with their data Ability to improve customer experience and
operational efficiencies Demand for Interoperability Open source – full access to internal
program of the application Open API’s – expose programmatic
interfaces to data and functionality
Open Source Integrated Library Systems
Major thread in library systems development Koha Evergreen Kuali OLE
Con
solid
ate
d in
dex
Unified Presentation LayerSearch:
Digital Coll
ProQuest
EBSCO…
JSTOR
Other Resour
ces
New Library Management Model
`
API Layer
Library Services Platform
LearningManageme
nt
LearningManageme
nt
Enterprise ResourcePlanning
Enterprise ResourcePlanning
StockManageme
nt
StockManageme
nt
Self-Check /
Automated Return
Self-Check /
Automated Return
Authentication
Service
Authentication
Service
Smart Cad /
Payment systems
Smart Cad /
Payment systems
Discovery
Service
Development / Deployment perspective
Beginning of a new cycle of transition Over the course of the next decade,
academic libraries will replace their current legacy products with new platforms
Not just a change of technology but a substantial change in the ways that libraries manage their resources and deliver their services
Eventual product consolidation Alma for resource management
Eventual transition of Voyager and Aleph Immediate transition of Verde SFX DigiTool for digital collections
Primo / Primo Central for Discovery Rosetta for Preservation
Possible integration into Alma?
Progressive consolidation of library services
Centralization of technical infrastructure of multiple libraries within a campus
Resource sharing support Direct borrowing among partner institutions
Shared infrastructure between institutions Examples: 2CUL (Columbia University /
Cornell University) Orbis Cascade Alliance (37 independent
colleges and universities to merge into shared LSP)
Traditional Proprietary Commercial ILS Aleph, Voyager, Millennium, Symphony, Polaris, BOOK-IT, DDELibra, Libra.se LIBERO, Amlib, Spydus, TOTALS II, Talis Alto, OpenGalaxy
Traditional Open Source ILS Evergreen, Koha
New generation Library Services Platforms Ex Libris Alma Kuali OLE (Enterprise, not cloud) OCLC WorldShare Management Services, Serials Solutions Intota Innovative Interfaces Sierra (evolving)
Competing Models of Library Automation
Convergence
Discovery and Management solutions will increasingly be implemented as matched sets Ex Libris: Primo / Alma Serials Solutions: Summon / Intota OCLC: WorldCat Local / WorldShare Platform Except: Kuali OLE, EBSCO Discovery Service
Both depend on an ecosystem of interrelated knowledge bases
API’s exposed to mix and match, but efficiencies and synergies are lost
Leveraging the Cloud
Moving legacy systems to hosted services provides some savings to individual institutions but does not result in dramatic transformation
Globally shared data and metadata models have the potential to achieve new levels of operational efficiencies and more powerful discovery and automation scenarios that improve the position of libraries overall.