1. 1
TIR Monitoring & Evaluation:
tracking usage & impact
Ina Smith
Presented during the Annual DATAD Conference, 24-26
August 2016, AAU & Lupane State University, Bulawayo,
Zimbabwe
2. Agenda
• Why & What is M&E?
• Bibliometrics/Alternative metrics/Item level
metrics/Article level metrics
• Tools
3. Why Monitoring & Evaluation (M&E)?
• Management tool
• Informs strategic planning, direction
• Assist with performance evaluation: institutional,
departmental, individual
• Process that helps improve performance and achieve
results
• Goal: to improve current and future management of
resources, outputs, outcomes and impact
• Assess performance of IR
4. Evaluation
• Systematic & objective examination re the relevance,
effectiveness, efficiency and impact of activities in the
light of IR and OA objectives
• From evaluation provide recommendations
• Establish the return on investment
5. Monitoring
• Continuous assessment
• Aim: provide all stakeholders with early detailed
information on the progress or delay of the ongoing
assessed activities
• Determine if outputs, deliveries and schedules planned
have been reached so that action can be taken to correct
the deficiencies as quickly as possible
6. Bibliometrics
• Citation analysis & Publication analysis
• Statistical analysis of published scientific output (articles,
books and more)
• Analyse citations: number, disciplines, individuals, self-
citations etc.
7. Alternative metrics
• Altmetrics manifesto http://altmetrics.org/manifesto/
• Article/item level metrics
• Assess use of item on item level
• Item = data set, video clip, article, thesis, image,
dissertation and more
• Look beyond counting and emphasize semantic content
like usernames, timestamps, and tag
Try It!
19. Google Scholar Profile: Individual
Google Scholar Citations provide a simple way for authors
to keep track of citations to their articles. An author can
check who is citing his/her publications, graph citations
over time, and compute several citation metrics. The
author can also make his/her profile public, so that it may
appear in Google Scholar results when people search for
the researcher name, e.g. robin crewe
Also create a Google Scholar Profile for your IR!
20. Google Scholar Profile: IR
Set up alerts for new
items addedto
profile, citations to
items in profile
26. Activity
• Login with your Gmail account for your IR: gmail.com
• Go to
https://scholar.google.co.za/intl/en/scholar/citations.html
• Create a Google Scholar profile for your IR
• Add items to the profile to track
Try It!