Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Ucr summon


Published on

Presentation by Dave Pattern and Martin Philp on the University of Huddersfield's use of the Summon library discovery system, delivered at UCR Yorkshire and Humberside's Discovering Discovery Tools event, 16th May 2011

Published in: Education, Technology
  • Be the first to comment

  • Be the first to like this

Ucr summon

  1. 1. Summon at Huddersfield<br />Dave Pattern<br />Martin Philip<br />University of Huddersfield<br /><br />
  2. 2. Background<br />Why Summon?<br />Summon implementation & launch<br />Student focus groups<br />Quick tour of Summon!<br />Usage stats<br />Contents<br />[2]<br />
  3. 3. E-Resource ProvisionA Word Document! (2000)<br />
  4. 4. E-Resource ProvisionITS OneLog (2003)<br />
  5. 5. E-Resource ProvisionEx Libris Metalib (2006)<br />
  6. 6. E-Resource ProvisionWoot! Woot! Federated Search!<br />
  7. 7. E-Resource ProvisionFederated Search?! Meh… <br />
  8. 8. Meanwhile, in the real world…Google Scholar (launched Nov 2004)<br />
  9. 9. “To provide ease of searching and access for the user, whilst reducing the workload for Systems and Technical Services, and remaining within current budget levels.”<br />Electronic Resources ReviewApril 2009<br />
  10. 10. “Make recommendations for future provision, e.g. for the next 5 years, taking into account system interoperability and future-proofing.”<br />Electronic Resources ReviewApril 2009<br />
  11. 11. First class search engine<br /> - relevancy ranking, facets, fast results, etc<br />The “one-stop shop”<br /> - personalisation, reduce silos of data, etc<br />Improved systems management<br /> - interoperability, usage stats, open standards, etc<br />Improved value for money<br />Electronic Resources Review“The Vision”<br />
  12. 12. Small selection of suppliers invited to give 45 minute product demos<br />Products rated against “The Vision”<br />Report to Library Management Group<br />3 options for moving forward with pros & cons<br />Electronic Resources Review“The Vision”<br />
  13. 13. Huddersfield Adopts SummonAugust 2009<br />“This is the transformational technology which has long been needed to meet student and academic staff expectations in an increasingly complex information environment.”<br />
  14. 14. 94% of our subscribed journals were already full-text indexed in Summon…<br />other vendors were unable and/or unwilling to supply data<br />…therefore, no need to make do with a compromise(d) solution using federated search for the non-indexed material<br />Why Summon?<br />
  15. 15. New platform, developed with Open Source software<br />Serial Solutions have fed their improvements back to the Lucene/SOLR developer community<br />Excellent developer APIs<br />for both Summon and 360 Link<br />Why Summon?<br />
  16. 16. Summon Implementation<br />
  17. 17. Sep 2009 implementation starts<br />Oct 2009 Summon instance delivered<br />Feb 2009 360 Link goes live<br />Mar 2010 Summon “soft launch”<br />Aug 2010 Summon replaces Metalib<br />Implementation Timelinetaking it nice and slow!<br />…actually, we were ready togo fully live in January 2010!<br />
  18. 18. 18<br />Implementationtechnical stuff<br /><ul><li>Access predominantly via EZproxy
  19. 19. resolved majority of off-campus issues
  20. 20. more seamless than Athens & Shibboleth
  21. 21. Students encouraged to report problems
  22. 22. Journal print holdings added to 360 Core
  23. 23. …although these initially displayed as being “available online” within Summon!</li></li></ul><li>19<br />Implementationtechnical stuff<br /><ul><li>Electronic Resources Wiki
  24. 24.
  25. 25. provides access to a selection of databases
  26. 26. linked to from within Summon via “dummy” MARC records
  27. 27. Journal title links added to Summon
  28. 28. using “dummy” MARC records</li></li></ul><li>20<br />Implementationtechnical stuff<br /><ul><li>Serials Solutions 360 Core
  29. 29. Knowledge base for Summon and 360 Link
  30. 30. Journals staff found it extremely simple and quick to use</li></li></ul><li>21<br />Summon Launch<br />
  31. 31. 22<br />Summon Launch<br /><ul><li>Promoted internally from Nov 2009
  32. 32. Promoted to all staff from early 2010
  33. 33. Formally launched by PVC for Research & Enterprise during the University’s annual Research Festival (Mar 2010)</li></li></ul><li>23<br />Summon Launch<br /><ul><li>From March 2010 onwards, promoted to students from within Metalib
  34. 34. “Coming soon…”
  35. 35. “Get ahead of the game…”
  36. 36. “Test drive it today and give us your feedback!”
  37. 37. Summon replaced Metalib at end of July</li></li></ul><li>24<br />Summon Launch<br /><ul><li>Lots of promotional items & materials…
  38. 38. Summon pens with logo & URL
  39. 39. bags with “Summon – Research in the bag”
  40. 40. Two main slogans:
  41. 41. “Research has never been so easy”
  42. 42. “A serious Research engine”
  43. 43.</li></li></ul><li>25<br />Summon Launchon-campus publicity<br />
  44. 44. 26<br />Summon Launchon-campus publicity<br />
  45. 45. 27<br />Summon Launchon-campus publicity<br />
  46. 46. 28<br />Summon Launch…did the publicity work?<br /><ul><li>On average, since the launch, just over 4,000 students use Summon every week
  47. 47. by Dec 2010, logins were up 20% on the same period in 2009
  48. 48. 83.8% of students have heard of Summon and have used it at least once
  49. 49. 2011 Computing & Library Services Student Survey</li></li></ul><li>29<br />Focus Groups<br />
  50. 50. Conducted as part of the implementation of Summon (and my dissertation)<br />5 Focus Groups (33 students)<br />18 PG Taught<br />13 UG<br />2 PG Research<br />30<br />Focus Groups<br />
  51. 51. To examine the existing search behaviours of students<br />questionnaire<br />To observe how students use Summon<br />observation and group discussion <br />To explore participants initial responses to using Summon<br />observation and group discussion<br />31<br />Focus Groupsobjectives<br />
  52. 52. Completed before taking part in the search task and group discussion<br />Collected demographic information from participants<br />name, course, level, year of study<br />32<br />Focus Groupsquestionnaire<br />
  53. 53. General questions asked about their experience of using resource discovery products, e.g.<br />“When searching for information, do you type one or two words into the search box?” <br />“Do you use advanced search?”<br />33<br />Focus Groupsquestionnaire<br />
  54. 54. Structured task used alongside questionnaire and group discussions<br />Lasting around 15 to 20 minutes, designed to replicate real situation of a participant using Summon to find information for their studies <br />Sample questions provided<br />if students couldn’t think of anything to search of<br />34<br />Focus Groupsobservation<br />
  55. 55. Notable behaviour was recorded using checklist <br />body language<br />more specific information seeking-related behaviours<br />inspired by Stephan et al’s (2006) usability study of a university library homepage<br />One facilitator with approximately three observers per participant<br />35<br />Focus Groupsobservation<br />
  56. 56. Discussion inspired by Brantley et al (2006)<br />User comments are extremely useful for identifying navigation and layout problems<br />data gathered from this study enabled us to evaluate Summon and it’s intuitiveness<br />6 Group discussions recorded and transcribed<br />36<br />Focus Groupsgroup discussion <br />
  57. 57. Inputting one or two keywords into search engines was most popular search method<br />Recorded in previous studies, Tallent (2004:70)<br />37<br />Focus Groupsfindings<br />
  58. 58. Evidence from this and other studies, clearly shows that students are transferring their search behaviour from web search engines, to academic research<br />38<br />Focus Groupsfindings<br />
  59. 59. 18 out of 33 participants said they regularly made use of the advanced search function within search engines<br />39<br />Focus Groupsfindings – advanced search<br />
  60. 60. Limitation of this study <br />majority of participants were MSc, so it is to be expected that they had more advanced skills than undergraduates. (Oberhelman, 2006)<br />40<br />Focus Groupsfindings – advanced search<br />
  61. 61. Before observation, majority of students stated that they use a search engine regularly for academic research<br />Only 8 participants said they didn’t use Metalib or an equivalent more than once a week<br />Evidence that as one student puts it “they can find lots of useful information on Google” <br />41<br />Focus Groupsfindings<br />
  62. 62. Preview of article feature was joint most used feature in in Summon <br />30 out of the 33 participants made use of this feature, which suggests they found it a very useful tool for their research<br />Although intuitive and relevant results retrieved, resource discovery products need such features that add-value<br />Literature is littered with examples of students’ frustrations with poor resource discovery systems<br />42<br />Focus Groupsfindings<br />
  63. 63. Generally, participants did not use the refining facets within Summon <br />reason may be 20 minutes time during structured search task<br />could also be impatience? (Oberhelman, 2006)<br />43<br />Focus Groupsfindings – refining facets<br />
  64. 64. Interesting to note prominence of facets:<br />Google added refining facets onto their results page in 2009<br />students therefore maybe more likely to use such features on Summon when conducting academic research<br />44<br />Focus Groupsfindings – refining facets<br />
  65. 65. General consensus from students, after using Summon and sharing their thoughts, was that they were very impressed<br />easy and intuitive, especially when compared with Metalib<br />quick to retrieve results<br />received lots of results<br />some more experienced users questioned the quality of results<br />45<br />Focus Groupsgroup discussion<br />
  66. 66. 46<br />Focus Group Commentseasy/intuitive<br />I felt like there was a lot you could do without needing any help.<br />You’ve not got as many fiddly bits to do; you just type in what you want. It’s almost like Google Scholar, so I like it for that.<br />Richard<br />Nicole<br />I think if you were coming across both (Metalib and Summon) for the first time, you’d probably have more success straight away with Summon on your own.<br />Maria<br />
  67. 67. 47<br />Focus Group Commentslots of results<br />I think you get a lot more articles from Summon because (in Metalib) you’ve got to search within each different database and your research takes you a little bit longer.<br />Caroline<br />
  68. 68. 48<br />Focus Group Commentsquality of results<br />What’s coming up? Or is this really what I was looking for? [I] wasn’t particularly sure about how useful [results] were for what I was trying to find out about.<br />Jo<br />...some useful, some not so useful but that’s the way it is with everything; it’s the same with a Google search and Metalib search, any search. The more you refine it, the more relevant your results will be.<br />Richard<br />
  69. 69. (Morrison, 2005) argues implementation of resource discovery systems is key to their success <br />products generally regarded by users as good systems and appear to satisfy the need of the students, are still not used by students – instead they turn to Google<br />lack of promotion<br />49<br />Focus Groups<br />
  70. 70. Literature suggests despite excellent feedback on Summon, at least for undergraduates, it doesn’t yet have strong enough brand presence<br />wasn’t fully launched until July 2010<br />Ongoing promotion required – likelihood of users forgetting Summon and inevitably defaulting back to Google<br />50<br />Focus Groups<br />
  71. 71. The purpose of study was to see if students liked Summon and to compare findings with the current literature<br />51<br />Focus Groupssummary of findings<br />
  72. 72. Summary:<br />the sample of students used Summon and thought it was excellent<br />based on the observational data collected it was clear participants thought Summon to be a vast improvement on Metalib<br />they found it to be intuitive; fast at retrieving results and also that it provided lots of results<br />52<br />Focus Groupssummary of findings<br />
  73. 73. Summary:<br />the participants felt they needed some instruction when making use of the additional features such as the refining facets<br />it was suggested that more advanced users would require specific instruction as well, to best make use of the additional features<br />53<br />Focus Groupssummary of findings<br />
  74. 74. Summary:<br />hoped this research can contribute to the ongoing discussion surrounding resource discovery system<br />many of the findings correspond with much of literature – suggests that undergraduate students would like a good quality one-stop-shop to use for their academic research<br />54<br />Focus Groupssummary of findings<br />
  75. 75. Summary:<br />because of Summon, there were some continuing students who were very much looking forward to their studies next year! <br />55<br />Focus Groupssummary of findings<br />
  76. 76. Brantley, S, Armstrong, A, and Lewis K. M. (2006). "Usability Testing of a Customizable Library Web Portal", College & Research Libraries, 67 (2), 146-163.<br />Flick, U. (2009). An Introduction to Qualitative Research. London: SAGE Publications.<br />Gibson, I, Goddard, C. L. and Gordon, S. (2008). "One Box to Search Them All: Implementing Federated Search at an Academic Library." Library Hi Tech, 27 (1), 118-133.<br />Korah, A, and Cassidy, E. D. (2010). "Students and Federated Searching: A Survey of Use and Satisfaction" Reference & User Services Quarterly, 49 (4), 325-332.<br />Morrison, P. J. (2005). "The Patron Strikes Back: A Review of Recent Library Web Site Usability Studies". [Online] Kent State University Information Use and Services. [Accessed 14 July 2010].<br />Oberhelman, D. (2006). "The Time Machine: Federated Searching Today and Tomorrow." Reference Reviews, 20 (3), 6-8.<br />Stephan, L. M., Cheng, D. T., and Young, L. M. (2006). "A Usability Study at the University of Mississippi Libraries for the Improvement of the Library Homepage." [Online] Journal of Academic Librarianship, 32 (1), 35-51.<br />Stubbings, R. (2003). "MetaLib and SFX at Loughborough University Library." Vine, 33(1), 25-32.<br />Tallent, E. (2004). "Metasearching in Boston College Libraries – a case study of user" reactions. New Library World, 105(1/2), 69-75.<br />56<br />Focus Groupsbibliography<br />
  77. 77. 57<br />A Quick Tour of Summon<br />
  78. 78. Library catalogue<br />books, videos, DVDs, scores, etc<br />Journals (print & electronic)<br />mixture of subscription & Open Access content<br />University repository<br />Off-air TV & radio recordings (UniTube)<br />58<br />What’s in Summon now?<br />
  79. 79. University Archives<br />Embedded multimedia<br />e.g. off-air recordings<br />59<br />What’s not Summon yet?<br />
  80. 80. 60<br /><br />
  81. 81. 61<br /><br />
  82. 82. 62<br />Summonrefine to peer-reviewed articles…<br />
  83. 83. 63<br />Summoninclude/exclude subject terms…<br />
  84. 84. 64<br />Summoninclude/exclude subject terms…<br />
  85. 85. 65<br />SummonWeb of Science citation counts…<br />
  86. 86. 66<br />Summonsearch beyond the library collection…<br />
  87. 87. 67<br />Summonaccessing full-text…<br />
  88. 88. 68<br />Summonaccessing full-text…<br />
  89. 89. 69<br />Summonaccessing full-text…<br />
  90. 90. 70<br />Summonaccessing full-text…<br />
  91. 91. 71<br />Electronic Resources<br />
  92. 92. 72<br />Electronic Resources<br /><ul><li>…</li></li></ul><li>73<br />Electronic Resources<br />
  93. 93. 74<br />Electronic Resources<br />
  94. 94. 75<br />Electronic Resources Blog<br />
  95. 95. 76<br />“Report a Problem” <br />
  96. 96. 77<br />Usage Stats<br />
  97. 97. 78<br />Full Text Downloadsresource 1<br />
  98. 98. 79<br />Full Text Downloadsresource 2<br />
  99. 99. 80<br />Full Text Downloads resource 3<br />
  100. 100. 81<br />Full Text Downloadsresource 4<br />
  101. 101. 82<br />One final word...<br />
  102. 102. “Summon is bloody brilliant. It blows Metalib out of the water! It gives fast, efficient and above all relevant research results. I found on Summon in 2 days what would have taken 2 weeks on Metalib.”<br />Abdul, PHD student and part-time lecturer<br />83<br />One final word...<br />
  103. 103. Any questions?<br /><br /><br />84<br />Thank you!<br />