Using Informatics & Visualizations to Understand Digital Preservation Activity

Using Informatics & Visualizationsto Understand Digital Preservation Activity

Katherine Skinner, Executive Director, Educopia InstituteChristina Drummond, Research Associate Professor, University of North Texas

CNI Fall Forum - 2013Washington D.C.December 10, 2013

Data Visualization for Education

Skinner and Drummond 2013CNI Fall Forum - 2013

Skinner and Drummond 2013CNI Fall Forum - 2013

Skinner and Drummond 2013CNI Fall Forum - 2013

How can analytics guide the development of a niche field?Digital Preservation

Metrics1) ACTIVITY PERFORMANCE Success

Impact other projects, sectors

Seeding follow-on projects

Sustainability Collaborators

Sector diversity Geographic diversity

ACADEMIC PERFORMANCE Publications

Prestige Frequency Quantity

Grants Dollar value Quantity Frequency

Awards Collaborators Activity level

Leadership Sector diversity Program creation, hosting

2) ORGANIZATION PERFORMANCE

Skinner and Drummond 2013

CNI Fall Forum - 2013

Metrics1) ACTIVITY PERFORMANCE Success

Impact other projects, sectors

Seeding follow-on projects

Sustainability Collaborators

Sector diversity Geographic diversity

Activity level Leadership

Sector diversity Program creation, hosting

2) ORGANIZATION PERFORMANCE

3) COMPOSITE STATE PERFORMANCE Activity involvement Organizational

involvement

Skinner and Drummond 2013

CNI Fall Forum - 2013

Enter ICONC

Pilot Data SourcesReports:

National Forum on Archival Continuing Education …(2002) Connecting the Archival Community (2002) Electronic Records Agenda Report (2003) Status of the Preservation of Electronic Records by State Archives (2004) Survey of State Historical Records Advisory Boards (2006) State of State Records…(2007) NDIIPP Preserving our Digital Heritage… (2010) NDIIPP States of Sustainability…(2012) SERI Phase 1 (2012) State Historical Records Advisory Boards…(2013) NEH NCRR Evaluation Report (2013)

Websites: LC Digital Preservation Partners Best Practices Exchange conferences SAA, SERI, NASCIO, NAGARA, Legal Information Preservation Alliance, OCLC, LOCKSS, LC,

Repository ExchangeSurveys:

NASCIO and NAGARA membersGrant awards:

IMLS, NEH, NHPRC, NSF (incl. DataNet), NIH, DOE, Mellon FoundationCNI Fall Forum - 2013

Data CollectionWho: Post-doctoral researchers Digital preservation field experts

Caveats: Sector and organizational type taxonomies need to be

refined. Required publically accessible URL to validate data. Disproportionately represents efforts with open

collaborator lists.

Aspire to opennessCNI Fall Forum - 2013

Pilot Inclusion Criteria

1. Collaborative across institutions Institutional repositories generally not

included

2. Stated digital preservation aim3. U.S. partners

Events: Hosts, planning committeesCNI Fall Forum - 2013

Pilot Dataset3298 records211 unique collaborative activities1856 organizations

1274 based in U.S.A.▪ including organizational subunits

CNI Fall Forum - 2013

Activity DataGeneral info: Name, URL, short

descriptionActivity type classificationStart and End YearGeographic focusFounding institutionCurrent host

CNI Fall Forum - 2013

Collaborating Organization DataActivity involvement

Organizational role Primary contact (if known)

AddressStructure (e.g. nonprofit, academic)Organizational Type (e.g. library,

museum)Thematic Focus (e.g. legal, health,

aerospace)CNI Fall Forum - 2013

Data Interface 1/3

Excel: Raw data store Pivot tables, mockups, printable reports

• Relational data in flat data structure• Relational database more ideal, more

costly

CNI Fall Forum - 2013

Activities within States

CNI Fall Forum - 2013

Organizational Engagement

CNI Fall Forum - 2013

Directory Function

CNI Fall Forum - 2013

Geographic Analysis

Geographic QuestionsConcentration of activities,

organizationsUnder-representation

Activity location = organizational collaborator locations

CNI Fall Forum - 2013

Data Interface 2/3

Web-based mapsSQL based, customizableEase-of-use factor – simple GUI,

quick results

CNI Fall Forum - 2013

http://cdb.io/1bf9zwUCNI Fall Forum - 2013

http://cdb.io/17vbRuxCNI Fall Forum - 2013

Interactive Queries

Interactive Queries

Dynamic filtering of viewsFor activities:

by state, NDIIPP funding, activity type, end date

For organizations: by state, sector (structure), organization

type, field

CNI Fall Forum - 2013

Data Interface 3/3

Combination of Excel and CartoDB functionality

Web-based, open data accessFree

Risk of pilot data being overextended as final

CNI Fall Forum - 2013

Organization Dashboard

CNI Fall Forum - 2013

Activity Dashboard

CNI Fall Forum - 2013

Engagement by Activity Characteristics

CNI Fall Forum - 2013

Measures for Investigation

Geographic hubs Under-represented areasSector, disciplinary engagementBalance of activity offerings and

organization engagement

CNI Fall Forum - 2013

Which Sectors Dominate Efforts in an Area?

ChronopolisData Preservation Alliance for the Social Sciences - Data-PASS

DataONE - Data Observation Network on EarthDPN - Digital Preservation Network

ECHO DEPository - Exploring Collaborations to Harness Objects with a Digital Environment for Preservation

GPO LOCKSS Pilot ProjectHathiTrust

IIPC - International Internet Preservation CoalitionLOCKSS Alliance

MetaArchiveTerra Populus

USDocs - Digital Federal Depository Library Program

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Sector Diversity Among Washington D.C. Collabo-rators

Preservation Networks

Academia Not-for-Profit U.S.A. Federal Government

CNI Fall Forum - 2013

State-based Collaboration

Number of Involved Organizations

Number of

Activities

Many Activities,Few Players

Few Activities,Few Players

Many Activities,Many Players

Few Activities,Many Players

Increase Outreach / Engagement

Increase Programmatic Opportunities

CNI Fall Forum - 2013

0 20 40 60 80 100 120 140 1600

20

40

60

80

100

120

DC

WA

MI

MDNC

MAVA

TX

IL

NY

PA

CA

Number of Organizations

Number of Activities

CNI Fall Forum - 2013

Most activities fewest

collaborators

Fewest activities with

most collaborators

CNI Fall Forum - 2013

Should data driven dashboards support digital stewardship policy and program development?

How?

Skinner and Drummond 2013CNI Fall Forum 2013

Who is best positioned to actas data stewards?

As interface stewards?

Skinner and Drummond 2013CNI Fall Forum 2013

Which metrics or relationshipsare most useful to measure impact?

Skinner and Drummond 2013CNI Fall Forum 2013

Which metrics or relationshipsare most useful to identify opportunities?

Skinner and Drummond 2013CNI Fall Forum 2013

Which metrics or relationshipsare most useful to identify risks?

Skinner and Drummond 2013CNI Fall Forum 2013

Next phase

Funding contingentActivity lineage tree

Track impact on program development

Individual level data Identify champions, creators

Transition from pilot to refined taxonomies, maintained data

CNI Fall Forum - 2013