1 TIR Monitoring & Evaluation: tracking usage & impact Ina Smith Presented during the Annual DATAD Conference, 24-26 August 2016, AAU & Lupane State University, Bulawayo, Zimbabwe
1
TIR Monitoring & Evaluation: tracking usage & impact
Ina Smith
Presented during the Annual DATAD Conference, 24-26 August 2016, AAU & Lupane State
University, Bulawayo, Zimbabwe
Agenda
• Why & What is M&E?• Bibliometrics/Alternative metrics/Item level
metrics/Article level metrics• Tools
Why Monitoring & Evaluation (M&E)?• Management tool• Informs strategic planning, direction• Assist with performance evaluation: institutional,
departmental, individual• Process that helps improve performance and
achieve results• Goal: to improve current and future management of
resources, outputs, outcomes and impact• Assess performance of IR
Evaluation• Systematic & objective examination re the
relevance, effectiveness, efficiency and impact of activities in the light of IR and OA objectives• From evaluation provide recommendations• Establish the return on investment
Monitoring• Continuous assessment • Aim: provide all stakeholders with early detailed
information on the progress or delay of the ongoing assessed activities• Determine if outputs, deliveries and schedules
planned have been reached so that action can be taken to correct the deficiencies as quickly as possible
Bibliometrics• Citation analysis & Publication analysis• Statistical analysis of published scientific output
(articles, books and more)• Analyse citations: number, disciplines, individuals,
self-citations etc.
Alternative metrics• Altmetrics manifesto http://altmetrics.org/manifesto/ • Article/item level metrics• Assess use of item on item level• Item = data set, video clip, article, thesis, image,
dissertation and more• Look beyond counting and emphasize semantic
content like usernames, timestamps, and tag
Try It!
DSpace Statistics
DSpace Statistics
DSpace Statistics
DSpace Statistics
DSpace Statistics
http://centaur.reading.ac.uk/32621/
Try It!
Add to your IR for free! Today!https://www.altmetric.com/products/free-tools/institutional-repository-badges/
http://plumanalytics.com/plumx-leverages-dspace-communities-for-simple-integration/
https://plu.mx/uwa-au/a/-27uGJrEP7EwUSBQUnw0ofmo0navWCq__TX-eUXJTE8/?display-tab=summary-content
http://facpubs.tourolib.org/publications/faculty/aruoma-okezie
Altmetric
PlumX
http://d-scholarship.pitt.edu/17829/
Try It!
Google Scholar Profile: IndividualGoogle Scholar Citations provide a simple way for authors to keep track of citations to their articles. An author can check who is citing his/her publications, graph citations over time, and compute several citation metrics. The author can also make his/her profile public, so that it may appear in Google Scholar results when people search for the researcher name, e.g. robin crewe
Also create a Google Scholar Profile for your IR!
Google Scholar Profile: IR
Number of c
itations
per item
Set up alerts for new items addedto
profile, citations to items in profile
https://impactstory.org/
Impactstory for individual researchers
http://v1.impactstory.org/CarlBoettiger
http://analytics.google.com
Google Analytics for IR
SUNScholar Piwik
Activity• Login with your Gmail account for your IR:
gmail.com• Go to https://
scholar.google.co.za/intl/en/scholar/citations.html • Create a Google Scholar profile for your IR• Add items to the profile to track
Try It!
Showcase stats, report on it …
Demo Only
Thank you!Ina SmithSciELO Planning Manager, [email protected]