Update on UDFR (Unified Digital Format Registry) NDIIPP Meeting June 25, 2009 Andrea Goethals.

Update on UDFR (Unified Digital Format Registry)

NDIIPP Meeting June 25, 2009Andrea Goethals

Today’s agenda

• Why do we need a format registry for digital preservation?

• UDFR background and process

Why do we need a format registry for digital preservation?

Usability

• A key goal of digital preservation is to maintain the usability of the information content stored in digital form

• We need to be able to:– Determine if it’s already or likely to become

unusable– Make plans to take action if its already or likely to

become unusable

Using information content

informationcontent

bitsformats

SWHW

HW (paper)informationcontent

HW (paper)

symbols

language

Analog bookUnmediated use

Digital bookTechnology-mediated use

Formats are key to determining usability

informationcontent

bitsformats

SWHW

supporti

ng

tech

nologie

s

digita

l

conte

nt

Formats are the bridge between the content we want to preserve and supporting technologies

How do we know if it’s usable?

1. Determine content’s format2. Based on format, assess content

– What current technologies can render this format?

– Are there sustainability issues related to this format?

– How is this format viewed by the preservation community?

What do we do if its unusable?

• Based on the format, develop plan for action– What alternative formats could be used for the

content?– What software can transform between these

formats?– What technologies can emulate this format?– Is there enough documentation to write a

renderer for this format?

Format registry: pooled knowledge

For theseformats…

Repository A

For theseformats…

Repository B

For theseformats…

Repository C

For theseformats…

Repository D

• What current technologies can render this format?

• Are there sustainability issues related to this format?

• How is this format viewed by the preservation community?

• What alternative formats could be used for the content?

• What software can transform between these formats?

• What technologies can emulate this format?

• Is there enough documentation to write a renderer for this format?

Format Registry

• Format information + much more• Common format model & identifiers

A base for a network of preservation tools and services

FormatRegistry

Repository A

Repository B

Repository C

Repository D

AssessmentServices

FormatValidation

Tools

FormatTransformation

Tools

FormatIdentification

Tools

MigrationServices

Tech.Watch

Services

EmulationServices

UDFR background and process

Unified Digital Format Registry

• Combination of two format registry initiatives – PRONOM (UK National Archives)

• Make use of software and reuse data

– Global Digital Format Registry (GDFR)• Support use cases, data model and distributed

architectural model

• Plus additional features– Local registry extensions– Distributed data input & quality vetting

UDFR Governance

• Interim governing body (April - Nov. 2009)–Library and Archives Canada–The National Archives UK–Harvard University Library–The British Library–University of Illinois UC

• Permanent governing body (Nov. 2009 -)

–Georgia Institute of Technology–NARA–Koninklijke Bibliotheek –Library of Congress

Interim Process: 2 working groups

• Technical working group – Subset of interim governing body members +

some additional experts/consultants

• Governance working group– All interim governing body members

Schedule

• Have a 1.5 year roadmap• It’s very ambitious! Maybe too ambitious?

June-September 2009

• Technical Working Group– Use cases / functional requirements– Data model– Investigate technologies for distributed data input – Phase 1 registry requirements– Phase 1 development plan

June-September 2009

• Governance Working Group– Organizational structure– Financial model– Registry operations– Membership constraints and responsibilities– IP policy for registry software and data

September – October 2009

• Invitation for public comment on:– Proposed governance charter– Proposed registry policy for IP– UDFR Phase 1 functional requirements– UDFR Phase 1 development plan

October 2009

• Technical working group– Oversee technical specification development

• Governance working group– Proposal for editorial process for vetting

contributed data

November 2009

• Permanent governing body established– Establishes funding model– Takes over all interim body work– Revises schedule if necessary

• UDFR Phase 1 development begins

According to plan…

• Feb. 2010: UDFR Phase 1 ready for testing• March 2010: UDFR Phase 1 in production• June 2010: UDFR Phase 2 ready for testing• July 2010: UDFR Phase 2 in production

– Includes editorial process for data contributions

Questions?

• http://www.udfr.org • Pam Armstrong ([email protected])

• Andrea Goethals ([email protected])