Honanchoi Nda in Korea

Digital Archiving and Preservation Activities in Korea

Ho Nam Choi [email protected]

http://ndsl.or.kr http://kesli.or.kr

Outline

• Business Plan • Functional Model • NDA Progresses • NDA Services • NDA Circumstances• NDA Strategies• Expected Effects of NDA

NDA Mission

Responsibilities

Business Scope

Expected Effects

Business Overview

1. Publisher Negotiation 2. Content Collecting 3. Preservation 4. Service5. Technology 6. Reliability Securing 7. Promotion 8. Organization 9. Fund Raising

Business Strategies

• Ingest• Archival Storage• Access• Data Management• Preservation Planning• Administration

Functional Model

• Metadata Definition• OAIS Information Model• NDSL Metadata• NDA Metadata Structure• Preservation Metadata• Metadata management process

Data Model

Logical role model

Organization of Operations Unit

Organizational Model

Business Plan

• System configuration• Software Congiguration• Applications Configuration

Technology Structure

NDA Functional Model

NDA Progresses

• 10.1999 : KESLI, a National Consortium was set up• 01.2000 : 160 libraries participating for licensing of 2,100 e-journals from 6 publishers • 05.2001 : A National Scholarly Portal, NDSL(National Digital Science Library) launched based on KESLI• 05.2003 : Data Collecting for NDA started (from Kluwer)• 07.2004 : ISP for building a NDA completed• 12.2006 : NDA Testbed system developed• 01.2007 : KESLI expanded to 368 member libraries for 10,655 e-journals from 86 publishers• 02.2007 : Completed surveys on “Feasibility on Building a National Digital Archive” against 368 libraries 221 responses.

NDA Progresses

• Data Collecting– Contracted or Agreed with 20 publishers – 6,900,000 e-fulltext data from 4,900 journals collected 8 tera byte storage required

• A test bed archiving system constructed – Service Platform: NDSL– Digital Repository System: ExLibris’ DigiTool – Test running with 30,000 fulltexts from 5 publishers

NDSL

Our LibrarysubscriptionOur Librarysubscription

Search,BrowseSearch,Browse

Web Services

Digitalfull-text

Full-textMetadata

SOAPSOAPAPIAPI

DomesticPublisher X Publisher Y

Society Z …

OverseasPublisher A Publisher B

Society C …

e-Marketplace

ContractContract

ClaimClaim

NegotiationNegotiation

OrderOrder

KESLIContent Providers

Repository

View e-fulltext

View e-fulltext

e-Gate DB

Individual Library OPAC

KESLI member institutions

My NDSLMy NDSL

DDSDDS

Non-KESLI member institutions

NDA Services - to be configured

① Repository Management

② Search at the NDSL Platform

③ Search Result(Brief) Display

④ Search Result(Detail) Display

⑤ Fulltext Delivery Service

NDA Services – being tested

Total 439 libraries participating in the KESLI consortium Joint purchasing: 368 libraries with 109 suppliers

- 18,547 e-journals, 10,607 e-proceedings, 12,579 e-standards, 37,380 e-books, 16 databases and other 6 products DDS: 272 libraries

KESLI

서울대 등 141 개대학교

서울대 등 141 개대학교

서울대 등 141 개대학교

universities 216 서울대 등 141 개

대학교서울대 등 141 개

대학교

서울대 등 141 개대학교

research institutes74 서울대 등 141 개

대학교서울대 등 141 개

대학교

서울대 등 141 개대학교

medical institutes46

서울대 등 141 개대학교

서울대 등 141 개대학교

서울대 등 141 개대학교

private companies74 서울대 등 141 개

대학교서울대 등 141 개

대학교

서울대 등 141 개대학교

public bodies29

Business Status of KESLIBusiness Status of KESLI

NDA Circumstances

typecriteria

e-journalse-

proceedingse-book

necessity

invested money

long term use

attainability

Archiving priority by content type

lower

higher[legend]

Target content – Archiving priority

Content Strategies

e-Journals : Archiving priority

Evaluation criteria

Measuring means

Remarks

Perpetuity of use

Half-life periodLonger half-life period journal needs long term preservation due to low demand elasticity against aging.

Content significance

SCI Impact Factor

Higher SCI Impact Factor journal contributes more to research activities

Size of user Use frequencyHigher use frequency journal has more users, bringing bigger benefit scope

Invested costLicense fee per journal

Unit cost = total license fee of consortium package / number of

titles

E-journal evaluation criteria for archiving priority

Content Strategies

Target publishers: determining publisher priority

How hard? data collecting

e-Journal Cost Economic aspects

Usability• Below 50• 50 ~ 99• 100 ~ 299• 300

On-going access fee

Number of down-loads

Journal quality

Volume of content

Sum of SCI Impact Factor

Additional cost for perpetual access

Criteria for high priority publishers

Higher Priority

Lower Priority

KESLI needs to find concerned interests with archiving from each participating publisher.

Publisher priority should be considered when selecting publisher for negotiating or comparing publisher’s terms and condition with others’.

Later Scoring Guide should be prepared for evaluation of negotiated agreements with publisher.

Bigger pentagon, higher priority.

Content Strategies

• Reliability Reliability – Standardized Contract– Operations Manual– DRM – Reliable competency to tightly control access

• Compensation plan for publishersCompensation plan for publishers• Joint efforts with KESLI members and consortium

Buying Power • In case of Dark Archive contract consider the means

of checking integrity and usability of the collected content

Negotiating Strategies

• Higher priority given to long term preservation need rather than urgency of use

• Whether to preserve or not should be determined at the time of data collecting

• Content storage format to be determined with the preservation considerations at the time of collecting

• e-journal fulltext that is collected by individual library should be also included in the archiving target

• When collecting content make the copyright and intellectual property matter clear

• When negotiating content collecting matter with publishers, Make the best use of survey results that KESLI members are strongly and urgently claiming of NDA construction

Content Collecting Strategies

Preservation Strategies

• Fulltext data and its metadata should be preserved together

• Regular inspection of stored data for maintaining integrity Correcting process

• Configuration management for system environment• Implementing activities to check the migration

timing according to the concerned plan• Implementation of migration should be executed

when the standards of new technology is securely established

Service Strategies

• Service development and operations to go through conforming processes to the agreement with publisher

• The target user of archiving services should be preferentially KESLI members, but include nationwide potential users outside KESLI.

• The service should be developed to meet the demands from both current customers and potential ones.

• Archiving cost should be born by the beneficiaries, and charged on an annual basis

• Continuous service improvement to be planned through customer feed back reflected evaluation

• Localized Services with a meter-rate system

SUPPLY

USER

DI

AIP AIP

DI

DIPSIP

Management

DataManagement

Administration

ArchivalStorage

PreservationPlanning

Ingest Access

DI : Descriptive InformationSIP : Submission Information PackageAIP : Archival Information PackageDIP : Dissemination Information Package

Production System

Archiving System

Delivery System

Technical Strategies

Technical Strategies

• File format for storage and preservation should be controlled in collaboration with publishers– Text Document : PDF, HTML– Metadata : XML– Color Images : GIF / JPEG

• Preservation Description Information (metadata) and Content Information (fulltext data) should be separately stored and managed

• Outbound links of paper should NOT be generated by KESLI, but be created with information sent by publisher

• Business Process Server to be configured into distributed system, but database server into centralized one. Storage devices configured in three types such as memory, disk and tapes depending on the use level

• The archiving data should be stored and managed in three copies– Source copy– Delivery copy– Preserving copy: separately and remotely

• Suggest to make business relations with overseas digital archiving institution in order to enhance technical expertise

Reliability Securing Strategies

• Efforts to be an archiving center for overseas e-publications– To develop institutional apparatus– To secure consensus from member libraries and other concerned

parties

• To acquire official accreditation for competency of archiving activities;– Professional expertiseProfessional expertise– ProgramsPrograms– Business processes: Business processes: ISO 9000, Public Record Office

Standard(Victoria), Public Record Office(UK), BSI DISC 0008 – Data: Data: ISO 9000:2000

Most of KESLI member libraries(71%) think KESLI(under KISTI) to be a executing agency of Digital Archive Project KISTI 71%, KERIS 15%, NLK 8%

* Feb. 2007 Survey against KESLI

Most of KESLI member libraries(71%) think KESLI(under KISTI) to be a executing agency of Digital Archive Project KISTI 71%, KERIS 15%, NLK 8%

* Feb. 2007 Survey against KESLI

Promotion Strategies

• Promotion for publishers should be one through direct face to face contact and high level communication

• Promotion for users should be designed based on surveys from them

• Promotion targeted for government should be focused in two ways: – 1) identifying the concerned government officers together with

finding a decision making process and giving information prior to going through main process

– 2) having other outside group affecting the decision makers persuade and convince them of its feasibility and necessity.

• For technical cooperations focus on the other digital archiving agency

Operations Strategies

Project Manager (1)

System development & operations (4)

Planning & adm.(2)

Content develop(2)

Standards & Preservation mgmt(2)Service operations

(2)

Organization: 5 units 13 persons

• Business plan• New product plan• Price policy• Rights management• develop policy & strategies

• archiving / submission agreement negotiation

• content inspection, • conversion for preservation

• Data format & documentation standard• Process standards• Data integrity• Statistics & reports generating• System configuration management

• user profile• usage history• Help Desk

• establish preservation plan• develop data standard, template • develop, test, evaluate prototype • technology monitoring• implementation plan of migration • technical consulting

Operations Strategies

Type of Initiating Body Type of Initiating Body

Type of Initiating Institution of Digital Archive ProjectNational/Public Institution 94%, Individual Library 2%, Others 4% etc

Executing Agency of Digital Archive ProjectKISTI 71%, KERIS 15%, National Library of Korea 8% etc * Feb. 2007 Survey against KESLI

Executing AgencyExecuting Agency

others4%

National/Public institution94%

Overseas company (ex: Portico, etc)

0%Individual institution

2%

publisher0%

NLK8%

others6%

KERIS15%

KISTI71%

Operations Strategies

• Basic plan required for securing technical manpower to maintain job consistency

• In principle, developing organizations and operations organization should be separated, but some of developing personnel should be involved in the operations organizations

• Personnel in charge of Preservation Planning should NOT be responsible for other jobs

Fund Raising Strategies

• Initial development cost to be fully covered by central government fund

• Operations cost to be covered partly by the central government, but mostly by the beneficiaries of value added information services that will be developed using the archived data

• To institutionalize creating a fund, since NDA can be treated as an intellectual public property that is inherited for good.

• To find and manipulate related government funding projects• To create profit models making the best use of KESLI

Buying Power and to invest the profit into NDA• To promote donations: the public good.

Building a national base archiving service system that enables domesticresearchers to have perpetual access to the electronic scholarly content

• Reduce the supplier’s burden to do archiving and preservation for long time

• Extra income is expected from NDA’s localized information services for the domestic individuals

SupplierEnd userGovernment

• Even in case of publisher bankruptcy, merging, and irresistible disaster e-journal services will not suspended since NDA will immediately take over the responsibilities.

• Under the mutual agreement with suppliers various information services can be provided in more convenient manner and reasonable price.

• By enabling perpetual access even after the license termination the stable manipulation of national intellectual property is secured

• By integrating NDSL, a successful scholarly portal, with NDA the synergy and ROI will be enhanced.

Expected Effects of NDA

Contribution to alleviation of information divideContribution to alleviation of information divideContribution to alleviation of information divideContribution to alleviation of information divideNew electronic services for the alienated sectors such as small industries, private hospitals,

general individualsEnhancement of usability by employing domestic researcher oriented interface and merging of

digital content from various providers

Maintaining economics of electronic information costMaintaining economics of electronic information costMaintaining economics of electronic information costMaintaining economics of electronic information costCost saving compared with the case of individual archive (368 KESLI members as of 2006)

Initial development cost: US$12.5 million vs US$180 million US$167.5 millionOperations cost: US$1.5 million vs US$33 million / year US$31.5

Provision of new value added services using archived data at economic pricesMutual agreement with data providers Price of services much lower due to most of investment covered by NDA convergence with patent/fact data/scholarly information, etc.

Solutions to perpetual access uncertainty faced on KESLI membersSolutions to perpetual access uncertainty faced on KESLI membersSolutions to perpetual access uncertainty faced on KESLI membersSolutions to perpetual access uncertainty faced on KESLI membersFree from burden of Ongoing Access Fee Avoid duplicated investment resulted from individual archiving and preservation activitiesGuarantee stable usability of overseas electronic information paid a lot annually

Expected Effects of NDA

Expected Effects of NDA

Basic role of building a National Knowledge RepositoryBasic role of building a National Knowledge RepositoryBasic role of building a National Knowledge RepositoryBasic role of building a National Knowledge Repository Integrated management of overseas electronic information imported in various channel and

format as national resourcesBuild a Korean service model based on NDA flexibly networking with global services Knowledge and experience gained can be shared for domestic cultural archive

Accumulation of preservation technology Accumulation of preservation technology Accumulation of preservation technology Accumulation of preservation technology As many standards as possible applied for future consistent improvementDissemination of standardized technologies for archving and preservation

Linking with other resources and digital archivesLinking with other resources and digital archivesLinking with other resources and digital archivesLinking with other resources and digital archivesNew value added fusion services with various types of information resources: patent+papers,

research output + personal information + papers, etc.

Linking with National Library of Korea, National Archives and Records Service, Korea film

Archive

Thank you !