Using Informatics & Visualizations to Understand Digital Preservation Activity

Using Informatics & Visualizationsto Understand Digital Preservation Activity

Katherine Skinner, Executive Director, Educopia InstituteChristina Drummond, Research Associate Professor, University of North Texas

CNI Fall Forum - 2013Washington D.C.December 10, 2013

Data Visualization for Education

Skinner and Drummond 2013CNI Fall Forum - 2013



How can analytics guide the development of a niche field?Digital Preservation

Metrics1) ACTIVITY PERFORMANCE Success

Impact other projects, sectors

Seeding follow-on projects

Sustainability Collaborators

Sector diversity Geographic diversity

ACADEMIC PERFORMANCE Publications

Prestige Frequency Quantity

Grants Dollar value Quantity Frequency

Awards Collaborators Activity level

Leadership Sector diversity Program creation, hosting

2) ORGANIZATION PERFORMANCE

Skinner and Drummond 2013

CNI Fall Forum - 2013

Metrics1) ACTIVITY PERFORMANCE Success

Impact other projects, sectors

Seeding follow-on projects

Sustainability Collaborators

Sector diversity Geographic diversity

Activity level Leadership

Sector diversity Program creation, hosting

2) ORGANIZATION PERFORMANCE

3) COMPOSITE STATE PERFORMANCE Activity involvement Organizational

involvement

Skinner and Drummond 2013


Enter ICONC

Pilot Data SourcesReports:

National Forum on Archival Continuing Education …(2002) Connecting the Archival Community (2002) Electronic Records Agenda Report (2003) Status of the Preservation of Electronic Records by State Archives (2004) Survey of State Historical Records Advisory Boards (2006) State of State Records…(2007) NDIIPP Preserving our Digital Heritage… (2010) NDIIPP States of Sustainability…(2012) SERI Phase 1 (2012) State Historical Records Advisory Boards…(2013) NEH NCRR Evaluation Report (2013)

Websites: LC Digital Preservation Partners Best Practices Exchange conferences SAA, SERI, NASCIO, NAGARA, Legal Information Preservation Alliance, OCLC, LOCKSS, LC,

Repository ExchangeSurveys:

NASCIO and NAGARA membersGrant awards:

IMLS, NEH, NHPRC, NSF (incl. DataNet), NIH, DOE, Mellon FoundationCNI Fall Forum - 2013

Data CollectionWho: Post-doctoral researchers Digital preservation field experts

Caveats: Sector and organizational type taxonomies need to be

refined. Required publically accessible URL to validate data. Disproportionately represents efforts with open

collaborator lists.

Aspire to opennessCNI Fall Forum - 2013

Pilot Inclusion Criteria

1. Collaborative across institutions Institutional repositories generally not

included

2. Stated digital preservation aim3. U.S. partners

Events: Hosts, planning committeesCNI Fall Forum - 2013

Pilot Dataset3298 records211 unique collaborative activities1856 organizations

1274 based in U.S.A.▪ including organizational subunits


Activity DataGeneral info: Name, URL, short

descriptionActivity type classificationStart and End YearGeographic focusFounding institutionCurrent host


Collaborating Organization DataActivity involvement

Organizational role Primary contact (if known)

AddressStructure (e.g. nonprofit, academic)Organizational Type (e.g. library,

museum)Thematic Focus (e.g. legal, health,

aerospace)CNI Fall Forum - 2013

Data Interface 1/3

Excel: Raw data store Pivot tables, mockups, printable reports

• Relational data in flat data structure• Relational database more ideal, more

costly


Activities within States


Organizational Engagement


Directory Function


Geographic Analysis

Geographic QuestionsConcentration of activities,

organizationsUnder-representation

Activity location = organizational collaborator locations


Data Interface 2/3

Web-based mapsSQL based, customizableEase-of-use factor – simple GUI,

quick results


http://cdb.io/1bf9zwUCNI Fall Forum - 2013

http://cdb.io/17vbRuxCNI Fall Forum - 2013

Interactive Queries

Interactive Queries

Dynamic filtering of viewsFor activities:

by state, NDIIPP funding, activity type, end date

For organizations: by state, sector (structure), organization

type, field


Data Interface 3/3

Combination of Excel and CartoDB functionality

Web-based, open data accessFree

Risk of pilot data being overextended as final


Organization Dashboard


Activity Dashboard


Engagement by Activity Characteristics


Measures for Investigation

Geographic hubs Under-represented areasSector, disciplinary engagementBalance of activity offerings and

organization engagement


Which Sectors Dominate Efforts in an Area?

ChronopolisData Preservation Alliance for the Social Sciences - Data-PASS

DataONE - Data Observation Network on EarthDPN - Digital Preservation Network

ECHO DEPository - Exploring Collaborations to Harness Objects with a Digital Environment for Preservation

GPO LOCKSS Pilot ProjectHathiTrust

IIPC - International Internet Preservation CoalitionLOCKSS Alliance

MetaArchiveTerra Populus

USDocs - Digital Federal Depository Library Program

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Sector Diversity Among Washington D.C. Collabo-rators

Preservation Networks

Academia Not-for-Profit U.S.A. Federal Government


State-based Collaboration

Number of Involved Organizations

Number of

Activities

Many Activities,Few Players

Few Activities,Few Players

Many Activities,Many Players

Few Activities,Many Players

Increase Outreach / Engagement

Increase Programmatic Opportunities


0 20 40 60 80 100 120 140 1600

20

40

60

80

100

120

DC

WA

MI

MDNC

MAVA

TX

IL

NY

PA

CA

Number of Organizations

Number of Activities


Most activities fewest

collaborators

Fewest activities with

most collaborators


Should data driven dashboards support digital stewardship policy and program development?

How?

Skinner and Drummond 2013CNI Fall Forum 2013

Who is best positioned to actas data stewards?

As interface stewards?


Which metrics or relationshipsare most useful to measure impact?


Which metrics or relationshipsare most useful to identify opportunities?


Which metrics or relationshipsare most useful to identify risks?


Next phase

Funding contingentActivity lineage tree

Track impact on program development

Individual level data Identify champions, creators

Transition from pilot to refined taxonomies, maintained data


Using Informatics & Visualizations to Understand Digital Preservation Activity

Documents

committees cni fall

openness cni fall forum

national forum

state archives

digital heritage

education skinner

data collectionwho

data visualization