Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

OCLC Research Update at ALA Chicago. June 26, 2017.

618 views

Published on

Rachel Frick, OCLC Executive Director of the OCLC Research Library Partnership, reviews some of the broad agenda items and recent publications related to the work of OCLC Research. Rachel is then joined for two presentations on specific research topics. First, Sharon Streams (OCLC Director of WebJunction) and Monika Sengul-Jones (OCLC Wikipedian-in-Residence) present on “Public Libraries and Wikipedia.” Next, Kenning Arlitsch (Dean, Montana State University Library) and Jeff Mixter (OCLC Senior Software Engineer) share their findings on “Accurate Institutional Repository Download Measurement using RAMP, the Repository Analytics and Metrics Portal.”

Published in: Education
  • Be the first to comment

  • Be the first to like this

OCLC Research Update at ALA Chicago. June 26, 2017.

  1. 1. June 22 – 27, 2017 OCLC Research Update Rachel L. Frick, Emcee Executive Director, OCLC Research Library Partnership Please Note: session is videotaped & live streamed!
  2. 2. oc.lc/fifty
  3. 3. OCLC Research: Scaling and accelerating library learning and innovation.
  4. 4. Reports Upcoming Reports: Web Archiving Metadata Working Group Publishing three reports: July 2017 Shifting Gears: 2nd Edition Realities of Research Data Management Demystifying IT: A Framework for Shared Understanding Advancing the National Digital Platform
  5. 5. Research & Learning Agenda for Special Collections and Archives Led by Chela Weber, assisted by Merrilee Proffitt and Jackie Dooley • Goal: a framework to inform OCLC research areas and RLP programs • Status: draft document currently being reviewed and commented on through in-person meetings (RBMS and SAA) as well as virtual small groups and one on one interviews • Final report and conversations slated for RLP Regional Meeting, Nov. 1 • More info at hangingtogether.org/?p=5973
  6. 6. Digital Visitors and Residents Research Led by Lynn Silipigni Connaway, PhD • Work sees to understand how learners engage with the internet and how educational services and systems can attract and sustain lifelong learners • New upcoming report: The Many Faces of Digital Visitors and Residents: Facets of Online Engagement • Provides insight on how and why individuals engage with technology and each other and how they get information online in their professional & personal lives. • Findings are based on work with institutions in the US, UK, Spain, Italy and Hong Kong. • More soon at oc.lc/manyfaces
  7. 7. Research Collaborations ITHAKA S+R: University Futures; Library Futures • What happens when libraries differentiate themselves in terms of services, not collection size; are there multiple models of success? • Roger C. Schonfeld, Constance Malpas • Funded by Andrew W. Mellon Foundation • www.insidehighered.com/news/2017/04/11/ithaka-sr-oclc-research-examine- how-universities-libraries-are-changing • www.sr.ithaka.org/blog/university-futures-library-futures/ LIBER: Persistent Identifiers’ Role in Research Information Management • Compliments RIM research efforts – more at oc.lc/rim • Rebecca Bryant, Annette Dortmund, Constance Malpas • www.oclc.org/en/news/releases/2017/201716dublin.html
  8. 8. Stay Connected: Hanging Together hangingtogether.org Works In Progress Webinar Series www.oclc.org/research/events/works-in-progress-webinar-series.html Like OCLC Research on Facebook www.facebook.com/OCLCResearch/ Follow #OCLCResearch on Twitter Updates: www.oclc.org/research/news.html
  9. 9. Upcoming Events: SAA: Pop-up Session, Merrilee Proffitt and Jackie Dooley LIBER Conference: Rebecca Bryant ARC17 OCLC Americas Regional Council Meeting Baltimore, October 30-31 oc.lc/arc17 RLP Partner Meeting Baltimore, October 31-November 1 www.oclc.org/research/events/2017/10-31.html
  10. 10. OCLC Research Team http://www.oclc.org/research.html
  11. 11. OCLC Research Update - June 26, 2017 Public Libraries & Wikipedia Sharon Streams Director, WebJunction Monika Sengul-Jones OCLC Wikipedian-in-Residence
  12. 12. El Paso, Texas — a patron asks a public librarian for references on https://en.wikipedia.org/wChihuahuita, a border neighborhood named “endangered” by the National Trust for Historic Preservation Wikipedia extends the reach of a librarian’s work in El Paso
  13. 13. El Paso, Texas --- a patron asks a public librarian for references on https://en.wikipedia.org/wikiChihuahuita a border neighborhood named “endangered” by the National Trust for Historic Preservation Wikipedia extends the reach of a librarian’s work in El Paso
  14. 14. Page View Analysis, Wikimedia Foundation Labs 392 page views in < two months
  15. 15. Susan Barnum found and uploaded this public domain image to the Women’s Club Movement Wikipedia article. Credit: Public domain, Library of Congress Catalog.
  16. 16. www.webjunction.org/news/webjunction/librarians-wikipedia-susan.html
  17. 17. oc.lc/oclc-wikilib
  18. 18. 1. Research and build awareness *Take our survey www.surveymonkey.com/r/wikilib-ala 2. Online training program for US public library staff, Sept. 13 – Nov. 15, registration opens July 19 * Register now for the preview webinar on July 19! www.webjunction.org/events/webjunction/wikipedia-for-libraries.html 3. Evaluation; case studies, learnings and resources published Our project Project duration: December 2016 – May 2018
  19. 19. The mission of the Wikimedia Foundation is to empower and engage people around the world to collect and develop educational content under a free license or in the public domain, and to disseminate it effectively and globally. Imagine a world in which every single human being can freely share in the sum of all knowledge. That's our commitment.
  20. 20. Information literacy with Wikipedia at Glendale Free Library Allison Frick, left, (Glendale Free Library in Pennsylvania) and Christina Riehman-Murphy (Penn State) organized an information literacy event focused on women and science. Photo: Courtesy Allison Frick Gummy worms get patrons curious and participating in Glendale. User: Stopsign CC 2.0
  21. 21. 96% of higher education instructors consider Wikipedia more valuable for teaching digital literacy than traditional assignments ̶ 2017 Wiki Education Foundation report https://commons.wikimedia.org/wiki/File:Student_Learning_O utcomes_using_Wikipedia- based_Assignments_Fall_2016_Research_Report.pdf Editing Wikipedia promotes digital information literacy
  22. 22. On Wikipedia, ISBNs can link to WorldCat
  23. 23. Strengthen cross-organizational partnerships with Wikipedia Dallas Public Library + The Dallas Architecture Forum + The Cedars Union (Arts incubator)
  24. 24. News, stories and more on WebJunction oc.lc/oclc-wikilib
  25. 25. Free online training program • Wikipedia + Libraries: Better Together • September 13 – November 15, 2017 • Six live online sessions • Free • Registration opens July 19, 2017 • Up to 500 US public library staff enrollees Learn Wikipedia with other U.S. public library staff. Credit: Pax Ahimsa Gethen, Own work, CC BY-SA 4.0
  26. 26. Preview webinar • Wikipedia for Libraries preview webinar on July 19, 3:00 to 4:00 p.m. ET • Free • Register now! • Guest speaker: Tiffany Bailey, Dallas Public LibraryTiffany Bailey will speak in the preview webinar. Credit: Tiffany Bailey
  27. 27. Follow, share and learn Survey: www.surveymonkey.com/r/wikilib-ala #oclcwikilib oc.lc/oclc-wikilib
  28. 28. OCLC Research Update - June 26, 2017 Accurate IR File Download Measurement RAMP – Repository Analytics and Metrics Portal Kenning Arlitsch Dean, Montana State University Library Jeff Mixter Senior Software Engineer, OCLC Research
  29. 29. Research Funded by IMLS Grant “Measuring Up: Assessing Accuracy of Reported Use and Impact of Digital Repositories” scholarworks.montana.edu/xmlui/handle/1/8924
  30. 30. Today’s Agenda • A New Reporting Model • Accuracy of Analytics Reporting Tools • Page Tagging • Log file • RAMP • Big Picture Potential • What Can We Do With The Data?
  31. 31. A New Reporting Model Page Type Definition Examples Citable Content Downloads Non-HTML scholarly content that may be formally cited in the research process ● Publication (.pdf) ● Presentation (.ppt) ● Data Sets (.csv) Item Summary HTML pages to help user decide to download the full publication ● Title & Abstract ● Item Metadata Ancillary HTML pages that provide general information or navigation ● Search Results ● Browse by Author ● Statistics
  32. 32. CURRENT REPORTING METHODS
  33. 33. Two Classes of Web Analytics HTML Analytics Service (SaaS) 1 Log Files 2Page Tagging {JavaScript}
  34. 34. Show Google Scholar direct link graphic
  35. 35. Page tagging does not track non-HTML CCD Non-HTML Search Analytics Does!
  36. 36. SO, WE DEVELOPED A METHOD…
  37. 37. Study Participant IR Platform URL Montana State University ScholarWorks DSpace scholarworks.montana.edu McMaster University MacSphere DSpace macsphere.mcmaster.ca University of New Mexico LoboVault DSpace repository.unm.edu University of Utah USpace CONTENTdm uspace.utah.edu Data set: Jan 5 - May 17, 2016 (n = 134 days)
  38. 38. 51% 54% 52% 63% 35% 27% 20% 20% 14% 19% 28% 17% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% ~51% to 63% of Citable IR Activity is Unreported by Google Analytics 01/05/16 - 05/17/16 (days=134) Citable Content Downloads Item Sumary PV Ancillary PV Most IR Activity is Citable Content Downloads
  39. 39. 54.3% 46.2% 47.9% 42.5% 45.7% 53.8% 52.1% 57.5% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Most IR Activity is Unreported by Google Analytics 01/05/16 - 05/17/16 (days=134) Reported Invisible Most IR Activity is Unreported by Google Analytics
  40. 40. Ancillary Page Views and Item Summary Page Views vs CCD
  41. 41. All four IR use Google Analytics Page Type Analytics Search Console Pages Events Search Analytics Citable Content Downloads - 26,355 562,933 Item Summary 284,303 - - Ancillary 201,793 - - CCD Tracking Improvement 2,000%
  42. 42. Challenges With Our Method • Missing non-Google direct link CCD events • Yahoo • Bing • Email • FB • GSC limits time and access • Moving 90-day window • Programing skills to access API and gather granular data
  43. 43. WE CREATED RAMP Repository Analytics and Metrics Portal
  44. 44. RAMP • Cloud-based Web service • No installation • Minimal training and configuration • Consistent method and terminology • Benchmarking across time and organization
  45. 45. • http://ramp.montana.edu/ • The landing page can be accessed by anyone • Provides links to related articles • Access to the application requires an access code Accessing RAMP
  46. 46. 12 RAMP IR as of June 20, 2017 Currently tracking 250,000+ digital items from 12 IR and capturing an average of 14,000 CCD per day that were previously invisible. RAMP Landing Page Current support for 4 IR Application Stacks
  47. 47. Organization Dashboard – Daily Statistics
  48. 48. Organization Dashboard – Daily Statistics
  49. 49. Organization Dashboard – Daily Statistics
  50. 50. Organization Dashboard – Daily Statistics
  51. 51. Citable Content Click Through URL Country Device Position Date Impressio ns Clicks No 0 http://scholarworks.montana.edu/xmlui/handle/1/9348 hrv DESKTOP 31 3/8/17 1 0 Yes 0 http://scholarworks.montana.edu/xmlui/bitstream/handle/1/8705/Whiten S0814.pdf;sequence=1 pan MOBILE 6 3/8/17 1 1 Yes 0 http://scholarworks.montana.edu/xmlui/bitstream/handle/1/3670/317620 01131281.pdf;sequence=1 fra DESKTOP 24 3/8/17 1 0 Yes 0 http://scholarworks.montana.edu/xmlui/bitstream/handle/1/7215/317621 01989810.pdf?sequence=1 chn DESKTOP 13 3/8/17 2 0 Yes 0 http://scholarworks.montana.edu/xmlui/bitstream/handle/1/11518/15- 002_Surface-attached_cells_biofilms_A1b.pdf?sequence=1 gbr DESKTOP 10 3/8/17 1 1 Yes 0 http://scholarworks.montana.edu/xmlui/bitstream/1/1091/1/ColemanT12 12.pdf kwt MOBILE 3 3/8/17 1 1 No 0 http://scholarworks.montana.edu/xmlui/handle/1/9049 gbr DESKTOP 9 3/8/17 1 0 No 0 http://scholarworks.montana.edu/xmlui/handle/1/2567 egy DESKTOP 44 3/8/17 1 0 Yes 0 http://scholarworks.montana.edu/xmlui/bitstream/handle/1/7546/317621 02468723.pdf;sequence=1 twn DESKTOP 14 3/8/17 1 1 No 0 http://scholarworks.montana.edu/xmlui/handle/1/1854 tur DESKTOP 128 3/8/17 1 0 No 0 http://scholarworks.montana.edu/xmlui/handle/1/11498 usa DESKTOP 7 3/8/17 2 0 Sample Rows from Data Set
  52. 52. Organization Dashboard – Cumulative Statistics
  53. 53. Organization Dashboard – Cumulative Statistics
  54. 54. Organization Dashboard – Organization Settings • If you are accessing your own organization’s Dashboard, you can make simple modifications to add additional sites to analyze and turn on/off daily statistics logging
  55. 55. THE BIG [DATA] PICTURE
  56. 56. An Easy Diagnosis Identify IR underperforming due to SEO problems
  57. 57. Future Development of RAMP • Expand reporting and analysis capability • Visualization and statistics • Benchmark comparison across repositories • Aggregate data from multiple providers • Bing • Yahoo! • Facebook • Twitter
  58. 58. Enhance Data Set for Research • Use available API’s to harvest metadata about each document • Reconcile key entry fields (subject headings, creators, etc.) • With existing vocabularies (LCSH, VIAF, FAST, etc). • Integrate descriptive metadata with RAMP analytics data
  59. 59. Research Vision for Enhanced Data • Evaluate scholarly record across IR • Review corpus of IR content • Gap analysis between searched and found • How visible are IR items in SERP? • Assess impact of IR on scholarly record • Time to citation • Number of citations
  60. 60. RAMP Development Team • Montana State University • Kenning Arlitsch, Dean of the Library @kenning_msu • Patrick OBrien, Semantic Web Research Director @sempob • Leila Sterman, Scholarly Communication Librarian @calamityleila • OCLC Research • Jeff Mixter, Senior Software Engineer @jeffmixter • University of New Mexico • Jonathan Wheeler, Data Curation Librarian
  61. 61. Publications Patrick OBrien, Kenning Arlitsch, Leila Sterman, Jeff Mixter, Jonathan Wheeler, and Susan Borda. “Undercounting File Downloads from Institutional Repositories,” Journal of Library Administration, vol. 56, no. 7, 2016 Patrick OBrien, Kenning Arlitsch, Leila Sterman, Jeff Mixter, Jonathan Wheeler. “RAMP: Repository Analytics and Metrics Portal: A Prototype Web Service that Accurately Counts Item Downloads from Institutional Repositories,” Library Hi Tech, v35n1, March 2017 Proposal funded by IMLS: ”Measuring Up: Assessing Accuracy of Reported Use and Impact of Digital Repositories” - scholarworks.montana.edu/xmlui/handle/1/8924
  62. 62. Join us on July 6 OCLC Research Library Partnership “Works in Progress” webinar about RAMP www.oclc.org/research/events/2017/07-06.html

×