Your SlideShare is downloading. ×
Don’t Go There!Providing Discovery Services Locally,       not at a Vendor’s Site           Ken Varnum     Web Systems Man...
Overview•   University of Michigan Library’s web site•   Why we built it the way we did•   What we’ve changed/added since ...
[Dis]Integrated Discovery• We recognized that we did not know enough  to build an integrated search interface• Our old sit...
Benefits of Homegrown• We can track full-text clicks• Provide problem reporting mechanism• For authenticated users – we ca...
A Note about Tracking• Dictated by our privacy policy• Raw log files kept a very limited time• Users shown as campus, unit...
Discovery• Discovery is the heart of the library site• It is, broadly, what people come do
Bento Box            Flickr user xadrian
Bento Box Search Results
Search Tabs
How Do People Actually Search? Search Kind   Count     %MLibrary       402,568     55.3%ArticlesPlus   304,671     41.8%Ca...
Bento Box Search Results
How Do People Actually Search?       Search Options                           Count          %MLibrary: All               ...
Where do Searchers Go?Category                                         CountMirlyn                                        ...
Long-Term Patterns: Catalog                                                     Catalog Searches Winter Semesters9000     ...
Long-Term Patterns: Articles                                             Article Searches Winter Semesters6000            ...
Now, Articles• Article discovery looks different:  – Different level of data needed by users  – Different functionality (f...
Article Discovery
Article Clicking• Article full-text links clicked: 134,095• There were 310,171 article searches• Problem reporting is buil...
Results of Error Reporting• Reports go to our online reference service, Ask  a Librarian• Each one reviewed & responded to...
Problem ReportingBefore “Direct Linking”• 548 problem reports (112,138 searches)• Reports per 1,000 searches: 4.9After tur...
Before Direct Linking (n=548)    hathitrust_uninvert_mdp, 1.1                 %  webofscience_primary_A, 1.5            32...
After Direct Linking (n=656)webofscience_primary_A, 1.4            %                                     36 more sources, ...
Favorites• Have “silos” of favorites for  articles, catalog, and the database & journal  finder• Launching an integrated t...
What We’ve Learned• We’re learning lots about our users• Interesting that most of our site visitors don’t  authenticate• P...
Tools are (Mostly) Open Source•   Site is Drupal•   Exhibits tool (launching soon) is Omeka•   Library catalog is VuFind• ...
Apron Strings• We don’t want our users to leave home  without making sure they know where they’re  going• We want to provi...
Questions?   Ken Varnumvarnum@umich.edu     @varnum
Don't Go There! Providing Discovery Services Locally, not at a Vendor's Site
Upcoming SlideShare
Loading in...5
×

Don't Go There! Providing Discovery Services Locally, not at a Vendor's Site

1,886

Published on

Published in: Education, Technology
0 Comments
4 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,886
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
0
Comments
0
Likes
4
Embeds 0
No embeds

No notes for slide
  • Start with stuff about me… Background, etc.We’re going ton concentrate on the library web site, which is separate from the catalog (although catalog results are available in the library site). Confusing. To our users, too.
  • Our users told us they wanted the mystery of where to start removed from their lives
  • I’ll talk about each of these in the following slides
  • When I talk about user data, it’s limited and anonymized.
  • Bento-box approach to resultsJapanese bento box –
  • The ‘bento box’ approach to search presents results by category – some of this, some of that, with each section labeled differently. We show things, broken down by usage patterns (last reorganized about 15 months ago). Most-used resources are on top, less used to the right and down Subject specialists are dynamically presented based on query; “Ask a Librairan” always there. Staff directory is below the Research Help section; journals are below Catalog.
  • Not necessarily a good idea. We’ve receive a lot of commentary about the search boxes.At the same time, our users have figured it out.
  • This is searches entered from the “find bar” only.MLibrary – no surprise, it’s the default searchArticlesPlus – launched September 2010. Thing it replaced had 3.7% of searches in Summer 2010. (MLibrary was 92.2%, Catalog was 4.1%).
  • But to get back to the site search…. What do users do when they get here?
  • MLibrary – no surprise, it’s the default searchArticlesPlus – launched September 2010. Thing it replaced had 3.7% of searches in Summer 2010. (MLibrary was 92.2%, Catalog was 4.1%).
  • Not all searches result in clicks. Some searches result in multiple clicks. There are 200,000 “clicks” and (from earlier slide) just over 400,000 searches. Numbers don’t add up to total searches.Interesting… People are using the “one search” the way we intended; not going to the catalog tab, but doing their searches here. Of course, some people are looking for databases & journals, finding the Mirlyn entry, going there, and then clicking into the database. Individual database titles & creative misspellings are the most frequent searches by raw numbers. Mirlyn is the most frequently clicked result (databases & journals appear there)The long tail is VERY longA few hundred searches make up the top queriesAfter that – lots of one-off queriesArticles NOT included in site search. Frankly, we don’t know where to put it.Just added ILL & Uborrow to list (after semester ended)
  • Searches conducted from MLibrary tabStarted recording data in April 2010 (note where blue line starts)Remarkably consistent
  • Library catalog also remarkably consistent. Outlier in early 2012 – a singleIP address grabbed a LOT of ISSNs from our catalog. Who knows why?
  • This is a sign of a true success story. We had data for the last month or so of the old product in 2010. For 2011, usage started out higher than the old one. For 2012, it was consistently higher. Yet peaks & troughs are remarkably similar.
  • Replicates functionality of Summon interfaceIt’s a Drupal module, available to any library that wants to use it. Drupal 6 for now, but there’s a French library that’s started a Drupal 7 version.Gives us some added goodnessFavorites – persistent citations. Summon is session-only. - Coming this summer – save & organize favorites across catalog, journals, databases, articlesProblem reporting
  • Data independent of vendorData since March 1All of these are proxies for utility to user.Matched with query & user informationFavoritingProblem links. Do they use it? Boy, do they ever. 1070 times in winter semester from 310,000 searches (these numbers are different from Google’s – it’s what was searched,
  • Proxy: the resource isn’t proxied at all, or a new “hop” was put in place between the original URL and the targetUser account: all sorts of odd things. Expired users, alumni who don’t know they can’t have access; registrar problems, you name itResource: the database doesn’t work, it’s no longer licensed, catalog is wrong
  • Privacy concerns. Once users click the link… they’re gone.Extras include problem reporting, providing a friendly face to a query, getting people to better resourcesWe know what people look for & access from our site; exploring how that differs from vendor site. Noticed (as has anyone else using web-scale discovery tools) that full text is up, native database searching in broad aggregators is down. Poses a challenge for future contracts.
  • Transcript of "Don't Go There! Providing Discovery Services Locally, not at a Vendor's Site"

    1. 1. Don’t Go There!Providing Discovery Services Locally, not at a Vendor’s Site Ken Varnum Web Systems Manager University of Michigan Library
    2. 2. Overview• University of Michigan Library’s web site• Why we built it the way we did• What we’ve changed/added since then• How discovery happens
    3. 3. [Dis]Integrated Discovery• We recognized that we did not know enough to build an integrated search interface• Our old sites were a hot mess• Where to start?• Information, not Location
    4. 4. Benefits of Homegrown• We can track full-text clicks• Provide problem reporting mechanism• For authenticated users – we can explore resource use• Once users leave the library, they’re on their own
    5. 5. A Note about Tracking• Dictated by our privacy policy• Raw log files kept a very limited time• Users shown as campus, unit, & role – UMAA – LS&A – Student: Second Year• User IDs & IP addresses not saved
    6. 6. Discovery• Discovery is the heart of the library site• It is, broadly, what people come do
    7. 7. Bento Box Flickr user xadrian
    8. 8. Bento Box Search Results
    9. 9. Search Tabs
    10. 10. How Do People Actually Search? Search Kind Count %MLibrary 402,568 55.3%ArticlesPlus 304,671 41.8%Catalog 21,128 2.9%Total 728,367 100.0% Winter term 2012
    11. 11. Bento Box Search Results
    12. 12. How Do People Actually Search? Search Options Count %MLibrary: All 402047 55.2%ArticlesPlus: none 232317 31.9%ArticlesPlus: scholarly 29910 4.1%ArticlesPlus: fulltext, scholarly 13057 1.8%ArticlesPlus: fulltext 9392 1.3%ArticlesPlus: fulltext, scholarly, newspapers 9291 1.3%ArticlesPlus: local, fulltext, scholarly, 5847 0.8% newspapersArticlesPlus: fulltext, newspapers 3179 0.4%ArticlesPlus: scholarly, newspapers 3121 0.4%ArticlesPlus: newspapers 2415 0.3%Everything Else 17791 2.4%TOTAL SEARCHES from Find Bar 728367 100.0% Winter term 2012
    13. 13. Where do Searchers Go?Category CountMirlyn 106,388Database 77,019Online Journals 7,749Research Guides 3,795Didnt Find It (total) * 3,196Staff Directory 2,917Library Contacts 436Collections 167* Didnt Find It (total) 3,196-- Articles 2,523-- Browse 190-- Deep Blue 192-- HathiTrust 291 January 1 – April 30, 2012
    14. 14. Long-Term Patterns: Catalog Catalog Searches Winter Semesters9000 Winter 2010 Winter 20118000 Winter 20127000600050004000300020001000 0 1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 52 55 58 61 64 67 70 73 76 79 82 85 88 91 94 97 100 103 106 109 112 115
    15. 15. Long-Term Patterns: Articles Article Searches Winter Semesters6000 Winter 2010 (Metalib) Winter 2011 (Summon)5000 Winter 2012 (Summon)4000300020001000 0 1 4 7 10 13 16 19 22 25 28 31 34 37 40 43 46 49 52 55 58 61 64 67 70 73 76 79 82 85 88 91 94 97 100 103 106 109 112 115
    16. 16. Now, Articles• Article discovery looks different: – Different level of data needed by users – Different functionality (facets, full-text linking)• Found it hard to integrate into site search• Users seem to understand it as separate thing
    17. 17. Article Discovery
    18. 18. Article Clicking• Article full-text links clicked: 134,095• There were 310,171 article searches• Problem reporting is built in to our interface
    19. 19. Results of Error Reporting• Reports go to our online reference service, Ask a Librarian• Each one reviewed & responded to (phew!)• Frequent classes of problems: – User account problems – Proxy problems – Resource problems
    20. 20. Problem ReportingBefore “Direct Linking”• 548 problem reports (112,138 searches)• Reports per 1,000 searches: 4.9After turning on “Direct Linking”• 656 problem reports (198,033 searches)• Reports per 1,000 searches: 2.6• Reports per 1,000 MGet It clicks: 3.8
    21. 21. Before Direct Linking (n=548) hathitrust_uninvert_mdp, 1.1 % webofscience_primary_A, 1.5 32 others, 9.9% % credo_entries, 2.2% gale_primary, 4.0% crossref_primary, 4.4% LOGICAL, 41.1% pubmed_primary, 6.0%webofscience_primary, 8.6% proquest_dll, 21.4%
    22. 22. After Direct Linking (n=656)webofscience_primary_A, 1.4 % 36 more sources, 11.0% eric_primary_EJ, 1.4% doaj_primary_oai, 1.5% gale_primary, 2.6%pubmed_primary, 4.4% LOGICAL, 42.1% crossref_primary, 4.4% webofscience_primary, 13.4% proquest_dll, 17.8%
    23. 23. Favorites• Have “silos” of favorites for articles, catalog, and the database & journal finder• Launching an integrated tool with folders• Beginning to analyze data from 9,000 favorite items / 1,000 patrons• Have longer-term goal of dynamically connecting resources & classes
    24. 24. What We’ve Learned• We’re learning lots about our users• Interesting that most of our site visitors don’t authenticate• Provide help in context
    25. 25. Tools are (Mostly) Open Source• Site is Drupal• Exhibits tool (launching soon) is Omeka• Library catalog is VuFind• But… – ILS is Aleph – Research Guides are SpringShare’s LibGuides
    26. 26. Apron Strings• We don’t want our users to leave home without making sure they know where they’re going• We want to provide extras when we can• Can compare our usage with vendor reports
    27. 27. Questions? Ken Varnumvarnum@umich.edu @varnum

    ×