Rachel Frick, OCLC Executive Director of the OCLC Research Library Partnership, reviews some of the broad agenda items and recent publications related to the work of OCLC Research. Rachel is then joined for two presentations on specific research topics. First, Sharon Streams (OCLC Director of WebJunction) and Monika Sengul-Jones (OCLC Wikipedian-in-Residence) present on “Public Libraries and Wikipedia.” Next, Kenning Arlitsch (Dean, Montana State University Library) and Jeff Mixter (OCLC Senior Software Engineer) share their findings on “Accurate Institutional Repository Download Measurement using RAMP, the Repository Analytics and Metrics Portal.”

1. June 22 – 27, 2017
OCLC Research Update
Rachel L. Frick, Emcee
Executive Director, OCLC Research Library Partnership
Please Note: session is videotaped & live streamed!

2. oc.lc/fifty

3. OCLC Research:
Scaling and accelerating library
learning and innovation.

4. Reports
Upcoming Reports:
Web Archiving Metadata Working Group
Publishing three reports: July 2017
Shifting Gears: 2nd Edition
Realities of Research Data Management
Demystifying IT: A Framework for Shared
Understanding
Advancing the National Digital Platform

5. Research & Learning Agenda for
Special Collections and Archives
Led by Chela Weber, assisted by Merrilee Proffitt and Jackie Dooley
• Goal: a framework to inform OCLC research areas and RLP
programs
• Status: draft document currently being reviewed and commented
on through in-person meetings (RBMS and SAA) as well as
virtual small groups and one on one interviews
• Final report and conversations slated for RLP Regional Meeting,
Nov. 1
• More info at hangingtogether.org/?p=5973

6. Digital Visitors and Residents Research
Led by Lynn Silipigni Connaway, PhD
• Work sees to understand how learners engage with the
internet and how educational services and systems can
attract and sustain lifelong learners
• New upcoming report: The Many Faces of Digital
Visitors and Residents: Facets of Online Engagement
• Provides insight on how and why individuals engage
with technology and each other and how they get
information online in their professional & personal lives.
• Findings are based on work with institutions in the US,
UK, Spain, Italy and Hong Kong.
• More soon at oc.lc/manyfaces

7. Research Collaborations
ITHAKA S+R: University Futures; Library Futures
• What happens when libraries differentiate themselves in terms of services,
not collection size; are there multiple models of success?
• Roger C. Schonfeld, Constance Malpas
• Funded by Andrew W. Mellon Foundation
• www.insidehighered.com/news/2017/04/11/ithaka-sr-oclc-research-examine-
how-universities-libraries-are-changing
• www.sr.ithaka.org/blog/university-futures-library-futures/
LIBER: Persistent Identifiers’ Role in Research Information Management
• Compliments RIM research efforts – more at oc.lc/rim
• Rebecca Bryant, Annette Dortmund, Constance Malpas
• www.oclc.org/en/news/releases/2017/201716dublin.html

8. Stay Connected:
Hanging Together
hangingtogether.org
Works In Progress Webinar Series
www.oclc.org/research/events/works-in-progress-webinar-series.html
Like OCLC Research on Facebook
www.facebook.com/OCLCResearch/
Follow #OCLCResearch on Twitter
Updates: www.oclc.org/research/news.html

9. Upcoming Events:
SAA: Pop-up Session, Merrilee Proffitt and Jackie Dooley
LIBER Conference: Rebecca Bryant
ARC17 OCLC Americas Regional Council Meeting
Baltimore, October 30-31
oc.lc/arc17
RLP Partner Meeting
Baltimore, October 31-November 1
www.oclc.org/research/events/2017/10-31.html

11. OCLC Research Team
http://www.oclc.org/research.html

12. OCLC Research Update - June 26, 2017
Public Libraries & Wikipedia
Sharon Streams
Director, WebJunction
Monika Sengul-Jones
OCLC Wikipedian-in-Residence

13. El Paso, Texas — a patron asks a public
librarian for references on
https://en.wikipedia.org/wChihuahuita,
a border neighborhood named
“endangered” by the National
Trust for Historic Preservation
Wikipedia extends the reach of a
librarian’s work in El Paso

14. El Paso, Texas --- a patron asks a public
librarian for references on
https://en.wikipedia.org/wikiChihuahuita
a border neighborhood named
“endangered” by the National
Trust for Historic Preservation
Wikipedia extends the reach of a
librarian’s work in El Paso

17. Page View Analysis, Wikimedia Foundation Labs
392 page views in < two months

18. Susan Barnum found and uploaded this public domain image to
the Women’s Club Movement Wikipedia article.
Credit: Public domain, Library of Congress Catalog.

19. www.webjunction.org/news/webjunction/librarians-wikipedia-susan.html

20. oc.lc/oclc-wikilib

21. 1. Research and build awareness
*Take our survey www.surveymonkey.com/r/wikilib-ala
2. Online training program for US public library staff,
Sept. 13 – Nov. 15, registration opens July 19
* Register now for the preview webinar on July 19!
www.webjunction.org/events/webjunction/wikipedia-for-libraries.html
3. Evaluation; case studies, learnings and resources published
Our project
Project duration: December 2016 – May 2018

22. The mission of the Wikimedia Foundation is
to empower and engage people around
the world to collect and develop
educational content under a free
license or in the public domain, and to
disseminate it effectively and globally.
Imagine a world in which every single
human being can freely share in the
sum of all knowledge. That's our
commitment.

23. Information literacy with Wikipedia at Glendale
Free Library
Allison Frick, left, (Glendale Free Library in
Pennsylvania) and Christina Riehman-Murphy (Penn
State) organized an information literacy event focused
on women and science. Photo: Courtesy Allison Frick
Gummy worms get patrons
curious and participating in
Glendale.
User: Stopsign CC 2.0

24. 96% of higher education instructors
consider Wikipedia more valuable
for teaching digital literacy than
traditional assignments
̶ 2017 Wiki Education Foundation report
https://commons.wikimedia.org/wiki/File:Student_Learning_O
utcomes_using_Wikipedia-
based_Assignments_Fall_2016_Research_Report.pdf
Editing Wikipedia promotes digital
information literacy

25. On Wikipedia, ISBNs can link to WorldCat

26. Strengthen cross-organizational partnerships
with Wikipedia
Dallas Public Library
+
The Dallas Architecture
Forum
+
The Cedars Union (Arts
incubator)

27. News, stories and more on WebJunction
oc.lc/oclc-wikilib

28. Free online training program
• Wikipedia + Libraries: Better Together
• September 13 – November 15, 2017
• Six live online sessions
• Free
• Registration opens July 19, 2017
• Up to 500 US public library staff enrollees
Learn Wikipedia with other
U.S. public library staff.
Credit: Pax Ahimsa
Gethen, Own work, CC
BY-SA 4.0

29. Preview webinar
• Wikipedia for Libraries preview webinar on
July 19, 3:00 to 4:00 p.m. ET
• Free
• Register now!
• Guest speaker: Tiffany Bailey, Dallas
Public LibraryTiffany Bailey will speak
in the preview webinar.
Credit: Tiffany Bailey

30. Follow, share and learn
Survey:
www.surveymonkey.com/r/wikilib-ala
#oclcwikilib
oc.lc/oclc-wikilib

31. OCLC Research Update - June 26, 2017
Accurate IR File Download Measurement
RAMP – Repository Analytics and Metrics Portal
Kenning Arlitsch
Dean, Montana State University Library
Jeff Mixter
Senior Software Engineer, OCLC Research

32. Research Funded by IMLS Grant
“Measuring Up: Assessing Accuracy of Reported Use and Impact of Digital
Repositories” scholarworks.montana.edu/xmlui/handle/1/8924

33. Today’s Agenda
• A New Reporting Model
• Accuracy of Analytics Reporting Tools
• Page Tagging
• Log file
• RAMP
• Big Picture Potential
• What Can We Do With The Data?

34. A New Reporting Model
Page Type Definition Examples
Citable Content
Downloads
Non-HTML scholarly content
that may be formally cited in
the research process
● Publication (.pdf)
● Presentation (.ppt)
● Data Sets (.csv)
Item Summary
HTML pages to help user decide
to download the full publication
● Title & Abstract
● Item Metadata
Ancillary
HTML pages that provide
general information or
navigation
● Search Results
● Browse by Author
● Statistics

38. CURRENT REPORTING METHODS

39. Two Classes of Web Analytics
HTML
Analytics Service (SaaS)
1
Log Files
2Page Tagging
{JavaScript}

40. Show Google Scholar direct link graphic

41. Page tagging does not track non-HTML CCD
Non-HTML
Search Analytics
Does!

42. SO, WE DEVELOPED A METHOD…

43. Study Participant IR Platform URL
Montana State University ScholarWorks DSpace scholarworks.montana.edu
McMaster University MacSphere DSpace macsphere.mcmaster.ca
University of New Mexico LoboVault DSpace repository.unm.edu
University of Utah USpace CONTENTdm uspace.utah.edu
Data set: Jan 5 - May 17, 2016 (n = 134 days)

44. 51%
54%
52%
63%
35%
27%
20%
20%
14%
19%
28%
17%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
~51% to 63% of Citable IR Activity is Unreported by Google Analytics
01/05/16 - 05/17/16 (days=134)
Citable Content Downloads Item Sumary PV Ancillary PV
Most IR Activity is Citable Content Downloads

45. 54.3%
46.2%
47.9%
42.5%
45.7%
53.8%
52.1%
57.5%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Most IR Activity is Unreported by Google Analytics
01/05/16 - 05/17/16 (days=134)
Reported Invisible
Most IR Activity is Unreported by Google Analytics

46. Ancillary Page Views and
Item Summary Page Views vs CCD

47. All four IR use Google Analytics
Page Type
Analytics Search Console
Pages Events Search Analytics
Citable Content
Downloads
- 26,355 562,933
Item Summary 284,303 - -
Ancillary 201,793 - -
CCD Tracking Improvement
2,000%

48. Challenges With Our Method
• Missing non-Google direct link CCD events
• Yahoo
• Bing
• Email
• FB
• GSC limits time and access
• Moving 90-day window
• Programing skills to access API and gather granular data

49. WE CREATED RAMP
Repository Analytics and Metrics Portal

50. RAMP
• Cloud-based Web service
• No installation
• Minimal training and configuration
• Consistent method and terminology
• Benchmarking across time and organization

51. • http://ramp.montana.edu/
• The landing page can be
accessed by anyone
• Provides links to related
articles
• Access to the application
requires an access code
Accessing RAMP

52. 12 RAMP IR
as of June 20, 2017
Currently tracking 250,000+
digital items from 12 IR and
capturing an average of 14,000
CCD per day that were
previously invisible.
RAMP Landing Page
Current support for 4 IR
Application Stacks

53. Organization Dashboard – Daily Statistics

54. Organization Dashboard – Daily Statistics

55. Organization Dashboard – Daily Statistics

56. Organization Dashboard – Daily Statistics

57. Citable
Content
Click
Through URL Country Device Position Date
Impressio
ns Clicks
No 0 http://scholarworks.montana.edu/xmlui/handle/1/9348 hrv DESKTOP 31 3/8/17 1 0
Yes 0
http://scholarworks.montana.edu/xmlui/bitstream/handle/1/8705/Whiten
S0814.pdf;sequence=1 pan MOBILE 6 3/8/17 1 1
Yes 0
http://scholarworks.montana.edu/xmlui/bitstream/handle/1/3670/317620
01131281.pdf;sequence=1 fra DESKTOP 24 3/8/17 1 0
Yes 0
http://scholarworks.montana.edu/xmlui/bitstream/handle/1/7215/317621
01989810.pdf?sequence=1 chn DESKTOP 13 3/8/17 2 0
Yes 0
http://scholarworks.montana.edu/xmlui/bitstream/handle/1/11518/15-
002_Surface-attached_cells_biofilms_A1b.pdf?sequence=1 gbr DESKTOP 10 3/8/17 1 1
Yes 0
http://scholarworks.montana.edu/xmlui/bitstream/1/1091/1/ColemanT12
12.pdf kwt MOBILE 3 3/8/17 1 1
No 0 http://scholarworks.montana.edu/xmlui/handle/1/9049 gbr DESKTOP 9 3/8/17 1 0
No 0 http://scholarworks.montana.edu/xmlui/handle/1/2567 egy DESKTOP 44 3/8/17 1 0
Yes 0
http://scholarworks.montana.edu/xmlui/bitstream/handle/1/7546/317621
02468723.pdf;sequence=1 twn DESKTOP 14 3/8/17 1 1
No 0 http://scholarworks.montana.edu/xmlui/handle/1/1854 tur DESKTOP 128 3/8/17 1 0
No 0 http://scholarworks.montana.edu/xmlui/handle/1/11498 usa DESKTOP 7 3/8/17 2 0
Sample Rows from Data Set

58. Organization Dashboard – Cumulative Statistics

59. Organization Dashboard – Cumulative Statistics

60. Organization Dashboard – Organization Settings
• If you are accessing your own
organization’s Dashboard, you
can make simple
modifications to add
additional sites to analyze and
turn on/off daily statistics
logging

61. THE BIG [DATA] PICTURE

62. An Easy Diagnosis
Identify IR underperforming due to SEO problems

63. Future Development of RAMP
• Expand reporting and analysis capability
• Visualization and statistics
• Benchmark comparison across repositories
• Aggregate data from multiple providers
• Bing
• Yahoo!
• Facebook
• Twitter

64. Enhance Data Set for Research
• Use available API’s to harvest metadata about each document
• Reconcile key entry fields (subject headings, creators, etc.)
• With existing vocabularies (LCSH, VIAF, FAST, etc).
• Integrate descriptive metadata with RAMP analytics data

65. Research Vision for Enhanced Data
• Evaluate scholarly record across IR
• Review corpus of IR content
• Gap analysis between searched and found
• How visible are IR items in SERP?
• Assess impact of IR on scholarly record
• Time to citation
• Number of citations

66. RAMP Development Team
• Montana State University
• Kenning Arlitsch, Dean of the Library @kenning_msu
• Patrick OBrien, Semantic Web Research Director @sempob
• Leila Sterman, Scholarly Communication Librarian @calamityleila
• OCLC Research
• Jeff Mixter, Senior Software Engineer @jeffmixter
• University of New Mexico
• Jonathan Wheeler, Data Curation Librarian

67. Publications
Patrick OBrien, Kenning Arlitsch, Leila Sterman, Jeff Mixter, Jonathan Wheeler, and Susan
Borda. “Undercounting File Downloads from Institutional Repositories,” Journal of Library
Administration, vol. 56, no. 7, 2016
Patrick OBrien, Kenning Arlitsch, Leila Sterman, Jeff Mixter, Jonathan Wheeler. “RAMP:
Repository Analytics and Metrics Portal: A Prototype Web Service that Accurately Counts
Item Downloads from Institutional Repositories,” Library Hi Tech, v35n1, March 2017
Proposal funded by IMLS:
”Measuring Up: Assessing Accuracy of Reported Use and Impact of Digital Repositories” -
scholarworks.montana.edu/xmlui/handle/1/8924

68. Join us on July 6
OCLC Research Library Partnership “Works in Progress” webinar about RAMP
www.oclc.org/research/events/2017/07-06.html