<ul><li>Karen Calhoun WorldCat and Metadata Services 27 May 2009 </li></ul><ul><li>[email_address] </li></ul><ul><li>http:...
With thanks to Janet Hawk,  Joanne Cantrell, Peggy Gallagher, OCLC Market Research  Photo by allw3ndy http://flickr.com/ph...
Online Catalogs:  What Users and Librarians Want <ul><li>End-Users expect online catalogs: </li></ul><ul><li>to look like ...
Where does the library profession’s definition of “catalog quality” come from? Charles A. Cutter. Rules for a dictionary c...
Where does an end user’s definition of “quality” come from? <ul><li>“ Users bring expectations developed through Internet ...
What factors influence an end user’s definition of “catalog quality” today? <ul><li>“ Dewey arranged books by subject, but...
What is “full”? + 3 more screens Product description and purchase information; ‘ More like this’ Editorial reviews and aut...
The Task Before Us <ul><li>“ What is needed now is to integrate the best of both worlds in new, expanded definitions of wh...
Objectives of our metadata  quality research <ul><li>Start over with a blank page </li></ul><ul><li>Identify and compare m...
Research methodologies and demographics <ul><li>Focus groups </li></ul><ul><ul><li>Conducted by Blue Bear, LLC </li></ul><...
What did we learn? End-user focus group results <ul><li>Key observations: </li></ul><ul><li>Delivery is as important, if n...
What did we learn? Pop-up survey suggestions Changes to help identify an item? End users (n=7535)
End-user recommendations <ul><li>Improve search relevance </li></ul><ul><li>Add more links to online full text (and make l...
Librarian/staff survey results Recommended enhancements to WorldCat Total librarian responses
Recommended enhancements to WorldCat Total end-user responses End-User Results:  Recommended Enhancements 4 Librarian/Staf...
What did we learn? Librarians’ Perceptions Compared to End-users Recommended enhancements to WorldCat
What did we learn? Librarians’ Perceptions Compared to End-users Recommended enhancements to WorldCat
What did we learn? Librarian survey results Respondents Who Reported Roles in Cataloging: Upgrade Brief Records  Recommend...
What did we learn? Librarian survey results Respondents Who Reported Roles as Library Directors: More Clickable Links to O...
Recommendations from librarian survey <ul><li>Merge duplicates – New Duplication Detection and Resolution software in fina...
What Does It Mean For Aligning What Technical Services  Does  with What Users  Want ? By: David Wulff http://www.flickr.co...
Matching Up What Technical Services  Does  to What End Users  Want <ul><li>“ A persistent shortcoming in the decision-maki...
Two Starting Points <ul><li>Paying attention to what’s important about records </li></ul><ul><li>Aligning technical servic...
“Evidence-Based Cataloging” <ul><li>Assess quality on external measures rather than subjective expert opinion </li></ul><u...
Data Source: Hilder and Tan, p. 358.
Data Source: Hilder and Tan, p. 354-5.
Buying What Users Want: Trends in Book, Media, Journal, and E-Resource Expenditures As reported in  The Bowker Annual , 20...
ARL Library User Priorities: What Do They Want to Use, and Where?  <ul><li>The ‘wild user’ wants to use the library’s coll...
Shift effort to unique collections of value to local communities Posted 6/17/2008: Digital Collections Technology Libraria...
Digital Collections Slide - Citations <ul><li>[1] Data source for chart and photo: University of Wisconsin Digital Collect...
From: Andreadis, Debra K., et al. 2007. Cooperative Workflow Redesign in Library Technical Services at Denison University ...
A New Context for Technical Services Adapted from Calhoun, Karen. Technology, productivity, and change in library technica...
Examples of What Other Technical Services Leaders and Librarians Have Done (1) <ul><li>Adopt evidence-based cataloging </l...
Examples of What Other Technical Services Leaders and Librarians Have Done (2) – Workflow Redesign for Print <ul><li>Study...
Examples of What Other Technical Services Leaders and Librarians Have Done (3) – Not Going It Alone <ul><li>Commit to and ...
Start Small, But  Start <ul><li>We are staffed and trained for a print world—this MUST change! </li></ul><ul><li>Realign o...
Upcoming SlideShare
Loading in …5
×

Choosing What to Hold and What to Fold: Database Quality Decisions in Tough Times

1,340 views
1,283 views

Published on

Presentation delivered on May 27, 2009 at the NELINET conference "Considering the Catalog and Its Data: Serving the Needs of Users and Staff" [Presented by T. Fons on behalf of Karen Calhoun]

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,340
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
4
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Choosing What to Hold and What to Fold: Database Quality Decisions in Tough Times

  1. 1. <ul><li>Karen Calhoun WorldCat and Metadata Services 27 May 2009 </li></ul><ul><li>[email_address] </li></ul><ul><li>http:// community.oclc.org/metalogue </li></ul>Choosing What to Hold and What to Fold Database Quality Decisions in Tough Times NELINET Considering the Catalog and its Data
  2. 2. With thanks to Janet Hawk, Joanne Cantrell, Peggy Gallagher, OCLC Market Research Photo by allw3ndy http://flickr.com/photos/allw3ndy/2757149584/
  3. 3. Online Catalogs: What Users and Librarians Want <ul><li>End-Users expect online catalogs: </li></ul><ul><li>to look like popular Web sites </li></ul><ul><li>to have summaries, abstracts, tables of contents </li></ul><ul><li>to help find needed information </li></ul><ul><li>Librarians expect online catalogs: </li></ul><ul><li>to serve end users’ information needs </li></ul><ul><li>to help staff carry out work responsibilities </li></ul><ul><li>to have accurate, structured data </li></ul><ul><li>to exhibit classical principles of organization </li></ul>http://www.oclc.org/us/en/reports/onlinecatalogs/default.htm
  4. 4. Where does the library profession’s definition of “catalog quality” come from? Charles A. Cutter. Rules for a dictionary catalog.
  5. 5. Where does an end user’s definition of “quality” come from? <ul><li>“ Users bring expectations developed through Internet use into library environments.”—Alison Dellit and Tony Boston, National Library of Australia </li></ul><ul><li>“ Due to the popularity of web search engines ... users think they can find everything on a topic with a few well-chosen words.”—Roy Tennant </li></ul><ul><li>“ More and more, users want, expect, and pursue full text.”—Norm Medeiros </li></ul>
  6. 6. What factors influence an end user’s definition of “catalog quality” today? <ul><li>“ Dewey arranged books by subject, but Amazon tries to find every way we might want to get from the A of a book we know to the B, C, and Z of books we don’t know, including the fact that lots of other people bought Z.” </li></ul><ul><li>--David Weinberger, Everything is Miscellaneous, p. 62. </li></ul>
  7. 7. What is “full”? + 3 more screens Product description and purchase information; ‘ More like this’ Editorial reviews and author info ‘ Inside the book’ tags, ratings, customer reviews, lists and more With thanks to David Lankes: http://quartz.syr.edu/rdlankes/Presentations/2007/ALCTS.pdf Bibliographic information Library holdings Details Subjects Editions Reviews Bibliographic information Australian library holdings
  8. 8. The Task Before Us <ul><li>“ What is needed now is to integrate the best of both worlds in new, expanded definitions of what “quality” means in library online catalogs.”— Online Catalogs report </li></ul><ul><li>How can what technical services does better reflect what end users want ? </li></ul>
  9. 9. Objectives of our metadata quality research <ul><li>Start over with a blank page </li></ul><ul><li>Identify and compare metadata expectations </li></ul><ul><ul><ul><li>End users </li></ul></ul></ul><ul><ul><ul><li>Librarians </li></ul></ul></ul><ul><li>Compare expectations of types of librarians </li></ul><ul><li>Determine end-user satisfaction with WorldCat.org </li></ul><ul><li>Define a new WorldCat quality program </li></ul><ul><ul><li>Considering the perspectives of all constituencies of WorldCat </li></ul></ul><ul><ul><ul><li>End users (and subgroups of end users) </li></ul></ul></ul><ul><ul><ul><li>Librarians (and subgroups of librarians) </li></ul></ul></ul>
  10. 10. Research methodologies and demographics <ul><li>Focus groups </li></ul><ul><ul><li>Conducted by Blue Bear, LLC </li></ul></ul><ul><ul><li>Three sessions: College students, general public, scholars </li></ul></ul><ul><li>Pop-up survey on WorldCat.org </li></ul><ul><ul><li>Conducted by ForeSee Results </li></ul></ul><ul><ul><li>11,000+ responses: Students (28%), educators (22%), business professionals (19%), other; mix of ages; 44% from outside U.S. </li></ul></ul><ul><li>Librarian survey </li></ul><ul><ul><li>Conducted by Marketing Backup </li></ul></ul><ul><ul><li>1,397 responses; North America (64%) and outside North America (36%); academic, public, special libraries; staff with roles in technical and public services, ILL, directors </li></ul></ul>
  11. 11. What did we learn? End-user focus group results <ul><li>Key observations: </li></ul><ul><li>Delivery is as important, if not more important, than discovery </li></ul><ul><ul><li>Seamless, easy flow from discovery through delivery is critical </li></ul></ul><ul><li>Summaries and tables of contents are key elements of a description </li></ul><ul><li>Improved search relevance is necessary </li></ul>
  12. 12. What did we learn? Pop-up survey suggestions Changes to help identify an item? End users (n=7535)
  13. 13. End-user recommendations <ul><li>Improve search relevance </li></ul><ul><li>Add more links to online full text (and make linking easy) </li></ul><ul><li>Add more summaries/abstracts: Make summaries more prominent </li></ul><ul><li>Add more details in the search results (e.g., cover art and summaries) </li></ul>
  14. 14. Librarian/staff survey results Recommended enhancements to WorldCat Total librarian responses
  15. 15. Recommended enhancements to WorldCat Total end-user responses End-User Results: Recommended Enhancements 4 Librarian/Staff Results: Highlighted Differences 9 1
  16. 16. What did we learn? Librarians’ Perceptions Compared to End-users Recommended enhancements to WorldCat
  17. 17. What did we learn? Librarians’ Perceptions Compared to End-users Recommended enhancements to WorldCat
  18. 18. What did we learn? Librarian survey results Respondents Who Reported Roles in Cataloging: Upgrade Brief Records Recommended enhancements to WorldCat
  19. 19. What did we learn? Librarian survey results Respondents Who Reported Roles as Library Directors: More Clickable Links to Online Content Recommended enhancements to WorldCat
  20. 20. Recommendations from librarian survey <ul><li>Merge duplicates – New Duplication Detection and Resolution software in final testing phase </li></ul><ul><li>Make it easier to make corrections to records (fix typos; do upgrades); Expert Community Experiment began Feb. 15 </li></ul><ul><li>More emphasis on accuracy/currency of library holdings </li></ul><ul><li>Enrichment — TOCs, summaries, cover art — work with content suppliers, use APIs, etc. </li></ul><ul><li>More communication about what users say they want </li></ul>
  21. 21. What Does It Mean For Aligning What Technical Services Does with What Users Want ? By: David Wulff http://www.flickr.com/photos/dwulff/5357629/
  22. 22. Matching Up What Technical Services Does to What End Users Want <ul><li>“ A persistent shortcoming in the decision-making process that needs to be addressed is the lack of serious research into user needs and benefits, and the actual impact on users of database quality decisions.”—Janet Swan Hill </li></ul>Hill, Janet Swan, “Is it worth it? Management decisions related to database quality,” Cataloging and Classification Quarterly 46 (1) (2008): 5–26.
  23. 23. Two Starting Points <ul><li>Paying attention to what’s important about records </li></ul><ul><li>Aligning technical services priorities with end user priorities </li></ul><ul><ul><li>E-resources, books, media, unique digital collections </li></ul></ul><ul><ul><li>Redesigning workflows </li></ul></ul>
  24. 24. “Evidence-Based Cataloging” <ul><li>Assess quality on external measures rather than subjective expert opinion </li></ul><ul><li>Acknowledge other functions of records besides ‘find’ (FRBR tasks find, identify, select, obtain ) </li></ul><ul><li>HIlder and Tan research: construct a measure of record quality from empirical research into catalog use </li></ul><ul><ul><li>July-October 2007 </li></ul></ul><ul><ul><li>National Library Board (Singapore) and State Library of Victoria (Australia) </li></ul></ul>Hilder, Philip and Tan, Kah-Ching. 2008. Constructing Record Quality Measures Based on Catalog Use. Cataloging & Classification Quarterly 46:4. “ [Catalogers] need to practice evidence-based cataloging . They need to catalog based on the evidence that they can find for the effectiveness of particular practices, and they need to judge their output according to this evidence.”
  25. 25. Data Source: Hilder and Tan, p. 358.
  26. 26. Data Source: Hilder and Tan, p. 354-5.
  27. 27. Buying What Users Want: Trends in Book, Media, Journal, and E-Resource Expenditures As reported in The Bowker Annual , 2004 and 2007 editions; based on data taken from the American Library Directory .
  28. 28. ARL Library User Priorities: What Do They Want to Use, and Where? <ul><li>The ‘wild user’ wants to use the library’s collections: </li></ul><ul><ul><li>At a distance from the library </li></ul></ul><ul><ul><li>Independently and self-sufficiently </li></ul></ul><ul><li>This is an international phenomenon </li></ul><ul><li>Martha Kyrillidou and Ann-Christin Persson. 2005. The New Library User in Sweden: </li></ul><ul><li>a LibQUAL+™ study at Lund University. Conference presentation. Available: </li></ul><ul><li>http://www.libqual.org/documents/admin/sweden_finalpaper3.doc </li></ul>Print and/or electronic journal collections I require for my work Making information easily accessible for independent use A library Web site enabling me to locate information on my own Easy-to-use access tools that allow me to find things on my own Making electronic resources accessible from my home or office Five Most Desired Items Overall
  29. 29. Shift effort to unique collections of value to local communities Posted 6/17/2008: Digital Collections Technology Librarian, North Carolina State University Libraries, Raleigh, North Carolina DIGITAL COLLECTIONS TECHNOLOGY LIBRARIAN The Digital Collections Technology Librarian will investigate and develop solutions to provide access to and long-term management of heterogeneous collections including text, images, video, and data… “ The availability of primary sources has been crucial for the success of my teaching in history. Students have remarked what a difference it has made, and I have noticed a big difference between this course with the availability of online primary resources to those I have taught before that were based on printed resources.” –History instructor, University of California [2] “ The function of searching across collections is a dream frequently discussed but seldom realized at a robust level. This paper … discusses how we might move from isolated digital collections to interoperable digital libraries.” — Howard Besser [3] Digital visibility creates use: uncover those hidden resources! [4]
  30. 30. Digital Collections Slide - Citations <ul><li>[1] Data source for chart and photo: University of Wisconsin Digital Collections Center. Summary Statistics. http://uwdcc.library.wisc.edu/usageStats/publicView.shtml </li></ul><ul><li>[2] Quote from survey respondent as reported in Harley, Diane. 2007. Use and users of digital resources. Educause Quarterly 4, p. 12-20. http://net.educause.edu/ir/library/pdf/EQM0742.pdf </li></ul><ul><li>[3] Besser, Howard. 2002. The next stage: moving from digital collections to interoperable digital libraries. First Monday 7:6. http://firstmonday.org/htbin/cgiwrap/bin/ojs/index.php/fm/article/view/958/879 </li></ul><ul><li>[4] For much more on the topic of digital collections’ visibility, see Research Information Network. 2007. Uncovering hidden collections. http://www.rin.ac.uk/files/hidden-resources-final-report.pdf </li></ul>
  31. 31. From: Andreadis, Debra K., et al. 2007. Cooperative Workflow Redesign in Library Technical Services at Denison University and Kenyon College. In: Library Workflow Redesign: Six Case Studies , ed. Marilyn Mitchell. Washington DC: CLIR. http://www.clir.org/pubs/reports/pub139/pub139.pdf 80% to FastCat 20% to Cataloging Workflows
  32. 32. A New Context for Technical Services Adapted from Calhoun, Karen. Technology, productivity, and change in library technical services. Library Collections, Acquisitions, and Technical Services Volume 27, Issue 3, Autumn 2003, Pages 281-289
  33. 33. Examples of What Other Technical Services Leaders and Librarians Have Done (1) <ul><li>Adopt evidence-based cataloging </li></ul><ul><ul><li>Don’t sweat the small stuff (and figure out what the “small stuff” is) </li></ul></ul><ul><ul><li>Let go of the perfect on behalf of the good </li></ul></ul><ul><ul><li>Accept that fast and convenient availability are essential aspects of quality </li></ul></ul><ul><li>Redeploy, re-skill, and refocus human efforts on (1) organizing the materials your end user communities use or want the most AND (2) what cannot be automated </li></ul><ul><ul><li>E-resources </li></ul></ul><ul><ul><li>Media </li></ul></ul><ul><ul><li>Digital collections </li></ul></ul>
  34. 34. Examples of What Other Technical Services Leaders and Librarians Have Done (2) – Workflow Redesign for Print <ul><li>Study your processes with workflow maps starting with selection and ending with access (for e-) or on the shelf </li></ul><ul><li>Outsource or automate the ordinary (e.g., obtain MARC record sets for e-journals) </li></ul><ul><li>Maximize use of approval plans and/or vendor or OCLC record supply services (e.g., WorldCat Cataloging Partners) </li></ul><ul><li>Receive as much as possible shelf-ready (and spot check only ) </li></ul><ul><li>Do as much processing (FastCat) as possible in acquisitions; save copy and original catalogers for the work only they can do </li></ul><ul><li>Stop editing CIP copy; examine and adopt automated tools (e.g.,, OCLC Bibliographic Notification) to capture upgrades </li></ul><ul><li>Stop special cuttering practices; close the shelflist card catalog </li></ul><ul><li>Consolidate multiple tech services departments (where it makes sense to do so) </li></ul><ul><li>Reduce the number of times materials are handled, moved, searched </li></ul><ul><li>Seek out and eliminate as many workflow “exceptions” as possible </li></ul><ul><li>Seek out and eliminate routines or subprocesses that take time but don’t add value </li></ul><ul><li>Get rid of multiple processes that accomplish the same thing </li></ul><ul><li>What else? </li></ul>
  35. 35. Examples of What Other Technical Services Leaders and Librarians Have Done (3) – Not Going It Alone <ul><li>Commit to and invest in collective action with </li></ul><ul><ul><li>--other libraries and consortia --other OCLC members --like organizations (local museums, archives, historical societies, cultural organizations) --vendors --other metadata communities --end users (your local communities) </li></ul></ul>
  36. 36. Start Small, But Start <ul><li>We are staffed and trained for a print world—this MUST change! </li></ul><ul><li>Realign our efforts to match </li></ul><ul><ul><li>How collections are changing </li></ul></ul><ul><ul><li>How users are changing </li></ul></ul><ul><ul><li>How the Web is changing </li></ul></ul>Highway By: SFAntti http://flickr.com/photos/sfantti/274905309/

×