OCWC Global 2014 - A Framework for Publicly Sharing Dynamic Metrics on OER Platform

A Framework to Integrate Public, Dynamic Metrics into an OER Platform

Jaclyn Zetta Cohen, Kathleen Ludewig Omollo, Dave Malicke{jczetta, kludewig, dmalicke}@umich.edu

Open.Michigan Initiative, University of MichiganDownload slides: [shortlink]

OCWC Global, April 2014

All content in this presentation unless otherwise noted is © 2014 Regents of the University of Michigan and licensed under a CC-BY license. http://creativecommons.org/licenses/by/4.0

key points● we (the Open.Michigan Initiative team) did user

research and took several different types of data into account when thinking about how to share our usage data, and this is making the work we do better

● we discovered that sharing metrics dynamically at a specific, individual level is valuable to many

notable background● we publish OER on our website● we have a Google Analytics account that’s

accessible only to those who are granted account access

● we work with community members to publish OER

the dynamic metrics and analytics project

...was initiated with a goal of

publicly sharing Open.Michigan usage data,

identifying interesting patterns in OER use,

updating displays of that data dynamically.

metrics and analyticsmetrics are raw data

analytics are meaningful patterns

metrics come first

corollary questions, Iwhat context is important? (a lot)

what questions do we want to answer? (many)

can metrics help answer those questions? (yes, we think so)

corollary questions, II● how to share usage data? how do we

organize it?

● what does “use” mean for us?

● how can we share metrics in a sustainable and useful way?

how do we organize OER?Hierarchical system, Drupal-based(https://open.umich.edu/wiki/OERbit)

how do we organize OER?A hierarchy of units, courses, resources...

Image source: Open.Michigan Initiative medical collection, open.umich.edu/education/med, CC-BY http://creativecommons.org/licenses/cc-by/4.0

cont.

Image source: Open.Michigan M2 Cardiovascular, http://open.umich.edu/education/med/m2/cardio, http://creativecommons.org/licenses/by-nc-sa/3.0/

repository/referratorywe host and help publish OER (open.umich.edu)

we provide links to third-party platforms and services which host relevant OER (youtube.com, slideshare.com, amara.org)

how do we measure content use?Google Analytics, third-party-platform analytics interfaces, access to APIs...

Image source: Google Analytics, charts

technical architecture

… informs information architecture.

(e.g. Our hierarchical site structure allowed us to easily answer some individual questions with the first phrase release of this project.)

project: first phase

Image source: Open.Michigan M2 Cardiovascular, http://open.umich.edu/education/med/m2/cardio, http://creativecommons.org/licenses/by-nc-sa/3.0/

user research → ● changes in action/use over time ● visual clarity● ease of access● availability of totals (lifetime numbers)● evidence of reach● evidence of use

user research →

there is

qualitatively measurable value in providing individual metrics

in clear ways

project: second phaseCurrently in development,a dashboard to share raw metrics for individual courses.

Image source: Open.Michigan dashboard, in progress.© Regents of the University of Michigan, CC-BY 4.0.

we know we want to compare views and downloads over time

conclusions● tech architecture informs information architecture

● metrics can be used to justify costs of OER production, and serve to strengthen relationships

● user research may lead to ‘better’ analytics

● more to come!

future endeavors● more data sharing: SlideShare, Amara.org

● continual development of visuals, user research

● movement toward increased analytics

comments? questions?email: [email protected]: @jczetta, @open_michigan

learn more: http://openmi.ch/dynmetricsread the paper (to be published): http://openpraxis.org

thanks!to all who provided assistance with and support for this project, especially:

Kevin Coffman, Pieter Kleymeer, Susan Topol, Trisha Paul, Bob Riddle, Stephanie Dascola, Margaret Ann Murphy, Emily Puckett Rodgers, Pierre Clement, Michael Hess, Karen Kost; all interviewees and Open.Michigan Initiative collaborators