SlideShare a Scribd company logo
1 of 41
Sorting out the answersMichigan Library Association 2009 A Case Study of the Clinton-Macomb Public Library
What Are You Doing Here? You want to know what ‘Card Sorting’ is You’re looking to (re)design your website You’re looking for constructive methods for redesigning The other programs were not of interest to you You are anti-Buckeye ‘Wii’ are not amused Construction projects this year?  You’re kidding, right? You were born in the 1900s and think FIC goes in the 800s.
What Are We Doing Here? Our website had become outdated… And we needed a kinder, more gentle site. So first, we had to figure out what process to use when creating our new site.
How Do You Get There? GOOD to Have MUST Have COOL to Have
Information Elements Know your elements! Calendar Catalog Social Media Policies WOAH! STOP!How do we organize all this stuff? ,[object Object]
Newberry Winners
A Link to Local Law-Enforcement
Storytimes
Summer Reading Program
Volunteer Sign-Up
Card Applications
Hours and Location(s)
Fines and Fees,[object Object]
Intuitive Navigation
Fully Conceptualized
Totally Wrong
Card Sorting: What is it? Sorting cards.  Yep, that simple. The Card Catalogue and AACR2 are classic examples of card sorting
Survey Results [screen shot of survey we handed out]
OptimalSort.com Free! 90-day subscription is $199 ,[object Object]
 Unlimited number of cards to sort
 Unlimited number of active projects
 Results spreadsheet
 Library logo,[object Object]
You can add contextual information to each card that the user sees when they hover over the card.
What is Open Sort? Open sort is when your users group information elements into arbitrary (user-defined) categories.
Can link from anyone of the cards to get all the categories this card was placed in.
Open Sort 1 week in October 2008 26 unique and complete responses For the information element – Book Club Information here are the responses we received: Do Events & Activities Library Activities What's Happening? Reading help Fun stuff to do or things that help you and your community.
Closed Sort Closed sort is when your users group information elements into pre-defined categories.
Going from Open to Closed Sort Majority rules, go with your gut for organizing information. 10 Categories Find It	 About Us	 Who We Are Children Circulation Using Your Library Get Involved Services	 Teen	 What's Happening
Closed Sort Categories Find It	 About Us	 Who We Are	 Children	 Using Your Library	 Get Involved	 Teen	 What's Happening	 Research	 Local Interest	 Guides	 Recommendations 12 Categories – wanted to settle on 7
218 Responses completed in November 2008

More Related Content

Similar to Sorting out the_answers

Wisconsin racine2011
Wisconsin racine2011Wisconsin racine2011
Wisconsin racine2011Stephen Abram
 
Making the Ask webinar
Making the Ask webinarMaking the Ask webinar
Making the Ask webinarHeather Yandow
 
NCompass Live: Turning Your Library Around - Part 2: 4 Years Later
NCompass Live: Turning Your Library Around - Part 2: 4 Years LaterNCompass Live: Turning Your Library Around - Part 2: 4 Years Later
NCompass Live: Turning Your Library Around - Part 2: 4 Years LaterNebraska Library Commission
 
[r]evolution - High School Workshop Slides
[r]evolution - High School Workshop Slides[r]evolution - High School Workshop Slides
[r]evolution - High School Workshop SlidesNathanielCarlson2
 
Ap Human Geography Essay Questions. Online assignment writing service.
Ap Human Geography Essay Questions. Online assignment writing service.Ap Human Geography Essay Questions. Online assignment writing service.
Ap Human Geography Essay Questions. Online assignment writing service.Paula Poer
 
NCompass Live: Conducting Surveys I: Introduction and Questionnaire Design
NCompass Live: Conducting Surveys I: Introduction and Questionnaire Design NCompass Live: Conducting Surveys I: Introduction and Questionnaire Design
NCompass Live: Conducting Surveys I: Introduction and Questionnaire Design Nebraska Library Commission
 
Legacy Management Systems Slide Show
Legacy Management Systems Slide ShowLegacy Management Systems Slide Show
Legacy Management Systems Slide Showguestd84642
 
NPTechClubATX: Prospecting - Reviewing Your Own Databases for Hidden Gems
NPTechClubATX: Prospecting - Reviewing Your Own Databases for Hidden GemsNPTechClubATX: Prospecting - Reviewing Your Own Databases for Hidden Gems
NPTechClubATX: Prospecting - Reviewing Your Own Databases for Hidden GemsNetSquared
 
Legacy Management Systems Slide Show
Legacy Management Systems Slide ShowLegacy Management Systems Slide Show
Legacy Management Systems Slide Showguestd334a0a
 
Ielts Essay Task 1 Pie Chart
Ielts Essay Task 1 Pie ChartIelts Essay Task 1 Pie Chart
Ielts Essay Task 1 Pie ChartPatty Loen
 
Building Great Programs for Patrons in their 20s and 30s Workshop - July 2016
Building Great Programs for Patrons in their 20s and 30s Workshop - July 2016Building Great Programs for Patrons in their 20s and 30s Workshop - July 2016
Building Great Programs for Patrons in their 20s and 30s Workshop - July 2016ALATechSource
 

Similar to Sorting out the_answers (20)

Web2.012 speech
Web2.012 speechWeb2.012 speech
Web2.012 speech
 
Wisconsin racine2011
Wisconsin racine2011Wisconsin racine2011
Wisconsin racine2011
 
MLS Chicago
MLS ChicagoMLS Chicago
MLS Chicago
 
Lvaf posr copy
Lvaf posr copyLvaf posr copy
Lvaf posr copy
 
Cla Montreal
Cla MontrealCla Montreal
Cla Montreal
 
Advocacy potsdam
Advocacy potsdamAdvocacy potsdam
Advocacy potsdam
 
Lianza2010
Lianza2010Lianza2010
Lianza2010
 
Making the Ask webinar
Making the Ask webinarMaking the Ask webinar
Making the Ask webinar
 
North dakotafinal
North dakotafinalNorth dakotafinal
North dakotafinal
 
NCompass Live: Turning Your Library Around - Part 2: 4 Years Later
NCompass Live: Turning Your Library Around - Part 2: 4 Years LaterNCompass Live: Turning Your Library Around - Part 2: 4 Years Later
NCompass Live: Turning Your Library Around - Part 2: 4 Years Later
 
[r]evolution - High School Workshop Slides
[r]evolution - High School Workshop Slides[r]evolution - High School Workshop Slides
[r]evolution - High School Workshop Slides
 
Ap Human Geography Essay Questions. Online assignment writing service.
Ap Human Geography Essay Questions. Online assignment writing service.Ap Human Geography Essay Questions. Online assignment writing service.
Ap Human Geography Essay Questions. Online assignment writing service.
 
NCompass Live: Conducting Surveys I: Introduction and Questionnaire Design
NCompass Live: Conducting Surveys I: Introduction and Questionnaire Design NCompass Live: Conducting Surveys I: Introduction and Questionnaire Design
NCompass Live: Conducting Surveys I: Introduction and Questionnaire Design
 
Cosugi2010
Cosugi2010Cosugi2010
Cosugi2010
 
Cosugi2010
Cosugi2010Cosugi2010
Cosugi2010
 
Legacy Management Systems Slide Show
Legacy Management Systems Slide ShowLegacy Management Systems Slide Show
Legacy Management Systems Slide Show
 
NPTechClubATX: Prospecting - Reviewing Your Own Databases for Hidden Gems
NPTechClubATX: Prospecting - Reviewing Your Own Databases for Hidden GemsNPTechClubATX: Prospecting - Reviewing Your Own Databases for Hidden Gems
NPTechClubATX: Prospecting - Reviewing Your Own Databases for Hidden Gems
 
Legacy Management Systems Slide Show
Legacy Management Systems Slide ShowLegacy Management Systems Slide Show
Legacy Management Systems Slide Show
 
Ielts Essay Task 1 Pie Chart
Ielts Essay Task 1 Pie ChartIelts Essay Task 1 Pie Chart
Ielts Essay Task 1 Pie Chart
 
Building Great Programs for Patrons in their 20s and 30s Workshop - July 2016
Building Great Programs for Patrons in their 20s and 30s Workshop - July 2016Building Great Programs for Patrons in their 20s and 30s Workshop - July 2016
Building Great Programs for Patrons in their 20s and 30s Workshop - July 2016
 

Sorting out the_answers

  • 1. Sorting out the answersMichigan Library Association 2009 A Case Study of the Clinton-Macomb Public Library
  • 2. What Are You Doing Here? You want to know what ‘Card Sorting’ is You’re looking to (re)design your website You’re looking for constructive methods for redesigning The other programs were not of interest to you You are anti-Buckeye ‘Wii’ are not amused Construction projects this year? You’re kidding, right? You were born in the 1900s and think FIC goes in the 800s.
  • 3. What Are We Doing Here? Our website had become outdated… And we needed a kinder, more gentle site. So first, we had to figure out what process to use when creating our new site.
  • 4.
  • 5. How Do You Get There? GOOD to Have MUST Have COOL to Have
  • 6.
  • 8. A Link to Local Law-Enforcement
  • 14.
  • 18. Card Sorting: What is it? Sorting cards. Yep, that simple. The Card Catalogue and AACR2 are classic examples of card sorting
  • 19. Survey Results [screen shot of survey we handed out]
  • 20.
  • 21. Unlimited number of cards to sort
  • 22. Unlimited number of active projects
  • 24.
  • 25.
  • 26.
  • 27.
  • 28.
  • 29. You can add contextual information to each card that the user sees when they hover over the card.
  • 30. What is Open Sort? Open sort is when your users group information elements into arbitrary (user-defined) categories.
  • 31.
  • 32.
  • 33.
  • 34. Can link from anyone of the cards to get all the categories this card was placed in.
  • 35. Open Sort 1 week in October 2008 26 unique and complete responses For the information element – Book Club Information here are the responses we received: Do Events & Activities Library Activities What's Happening? Reading help Fun stuff to do or things that help you and your community.
  • 36. Closed Sort Closed sort is when your users group information elements into pre-defined categories.
  • 37. Going from Open to Closed Sort Majority rules, go with your gut for organizing information. 10 Categories Find It About Us Who We Are Children Circulation Using Your Library Get Involved Services Teen What's Happening
  • 38. Closed Sort Categories Find It About Us Who We Are Children Using Your Library Get Involved Teen What's Happening Research Local Interest Guides Recommendations 12 Categories – wanted to settle on 7
  • 39.
  • 40.
  • 41. 218 Responses completed in November 2008
  • 42. Now What? Fake it, ‘til you make it
  • 43. And Then? Testing 1, 2, 3
  • 44. More? Tweak! Second (and third and fourth) time’s the charm
  • 45. What Card Sorting Teaches You Really “terrific” ideas aren’t always what they seem
  • 46. What Card Sorting Teaches You Categories can be confusing and should be tested
  • 47. Polls Are Your Friend
  • 48. What Card Sorting Teaches You Just because it seems logical, doesn’t necessarily mean your patrons will get it
  • 49. Six-Point Checklist Gather your elements Design an open sort Confirm (or debunk) open sort results with a closed sort Mock up a site Test site with real users Tweak design and test some more Tighten it until it squeaks
  • 50.
  • 51. Questions? Aaron Green, Technology Manageragreen@cmpl.org Juliane Morian, Associate Directorjmorian@cmpl.org Jamie Morris, Community Relations Specialistjmorris@cmpl.org

Editor's Notes

  1. Welcome to MLA, this is sorting out the answers session. A reminder, this is on the tech track *read blurb from Juliane*I’m Aaron Green, *intro JM & JM*, and we’re from the CMPL.
  2. Coldstone: : Like It/Love It/Gotta Have It*mention rotator as *good*must: catalog, events*cool: social media, RSS feeds, etc…Stats from site showed *EXTREMELY* high catalog usageStats from community survey showed equation of site to PAC
  3. Information elements: what are they? They’re whatmay going on your site, no matter how big, no matter how small.*mention juliane’s slide of the tiny-print survey results to explain why font shrinks at bottom: too many elements
  4. Doing it right (insert joke about driving) – everyone thinks they do it correctlyCheese metaphor – You’re hosting a party for twenty or thirty people…and you ask everyone what kind of cheese they’d like. They’ll all pick a different kind (gruyere, havarti, swiss, parmesan, bleu cheese, meunster, and one weirdo who likes limburger). However, if you give them only 3 options (brie, cheddar, monterey jack), they’ll all pick one of the three.
  5. *Talk about basic concept, but ONLY BRIEFLY. *Ask audience to look past lack of polish to underlying concept. SPACE THESE COMMENTS OUT ACROSS ALL 3 SLIDES!This is one way to mock up a website.This majestic webscape is an accurate visual representation of how I think.I thought it was amazing, and completely intuitive. I had it all thought out…every pageEveryone else…Did not.YOU are not always right. If a category or navigational structure that you are in love with does NOT test well…DITCH IT!
  6. This is one way to mock up a website.This majestic webscape is an accurate visual representation of how I think.I thought it was amazing, and completely intuitive. Everyone else…Did not.YOU are not always right. If a category or navigational structure that you are in love with does NOT test well…DITCH IT!
  7. This is one way to mock up a website.This majestic webscape is an accurate visual representation of how I think.I thought it was amazing, and completely intuitive. Everyone else…Did not.YOU are not always right. If a category or navigational structure that you are in love with does NOT test well…DITCH IT!
  8. Like organizing a deck of cards. You can sort by suit, by number, by odds/evens, faces vs non, split into Euchre, etc.Now take it to the next level. This can be done with more complex information as well. If you take the time, a survey can be turned into a card sort by gathering the results together and…sorting them into categories (predefined, or otherwise).We all organize information differently. [screencap of survey]You’ve all seen websites where you can’t figure out how to get what you want, but when you show someone else, they find it in seconds. You’re looking at the information differently from the other person. But a website shouldn’t be geared for just one mode of thought. Else, you might end up with something like this: (insert Aaron’s ugly yellow/blue/green mess)(the card catalogue) – yep, the one in the wooden drawers – is an ‘old-school’
  9. See how different the responses are? But the majority of you thought to sort XXXX into XXXX.]But it’s really hard to tally up results from a paper-based survey
  10. Free account allows you to create 3 different card sorting projects with 30 cards per project. It will tally ten responses per project so you can see the results.
  11. New accounts come loaded with example of open and closed sorts, which is helpful. It give you an idea of how to set up your sort properly.I’ll go into more detail on the open versus close sort shortly.
  12. CLICK!In the free version of software you still have nice control over informationCan sort a set number of responses from the 10, example, you only want 5 responses per dayCan set a closing date for the survey
  13. CLICK!You can customize your messages to make them more personal and professional to add a level of trust to your sortCustomize a welcome message, instructions, etc.
  14. CLICK!Optimal Sort makes it easy. To keep your wording consistent you can just copy the text you have created to new projects.Especially helpful when going from open to closed sort.
  15. CLICK!This is your list of elements. What you want to sort. You have 30 elements in the free version. You have unlimited elements in the subscription version.
  16. Example: Some people may think that Book Club Information refers to starting their own book club. What we envisioned Book Club Information being was information on attending one of our book clubs. That information can be clarified when you set up the sort.
  17. So now we’re ready to set up our exercise. Start with an open sort.Ex: In the exercise we did at the beginning, we could have given you the list of elements (all the animals), if we let you define the categories they belonged in, we might have gotten categories such as reptiles, pets, furry creatures and more.The world is your oyster when it comes to open sort.
  18. This is an example of the open sort. The elements are the left hand side and you simply drag them to the left hand side of the page to create categories.
  19. Example of the personalized thank you screen.
  20. Once you’re finished, the back end of Optimal Sort give you access to all the elements and it will tell you all the categories the element was placed in.
  21. CLICK! (6 times)129 categories were created by 26 users for 30 elements. Information overload and clearly categories aren’t truly useful.
  22. CLICK!Coming back to cheese: As Aaron said, if you ask everyone what cheese they’d like, there will be a variety of different answers. If you come up with a small number of cheeses, everyone will find at least one they are comfortable with. This is how you go from open to closed sort. Take the best of the open sort and test effectiveness.Small number of categories that works with the scale of your website.If you use the same 30 elements, it can help to reaffirm you have picked the right categories.
  23. This is the hard part.Here is an example of how we tried to work through the 129 categories generated by the open sort.We attempted to whittle down the categories to a manageable number of 10 and then we tried to place the elements.
  24. Ultimately decided on 12 categories to test again with the public, knowing that we wanted to reduce some.
  25. Example of our closed sort. Back to Optimal Sort. At this point we opted to pay for the service to get more responses.We gave users the same 25 information elements, but this time we asked them to place them in one of 12 categories. Some categories, like What’s Happening, we labels that were suggested in the Open Sort, which we liked.
  26. This is the type of feedback you get when you use the paid version of Optimal SortFor example, 100 people decided that they would look for the Events calendar under the What’s Happening category.
  27. You’ve got a ton of good information, what do you do with it?Your patrons are willing to help you! Initial card-sorting exercise was just posted as a link in the catalog with no advertising and people browsing just did it. Ask for help with usability testing by posting something online or in the library newsletter. Mock up your site in Photoshop or another program with basic hyperlinks to mimic the architecture of your new site
  28. Usability testing is where your site mock up is going to come in handy.We advertised for help with usability testing in our newsletter, people e-mailed us and we made appointments with them to test the site. Had about 30 responses. People came for a 30-45 min. test (gave them CMPL notecards as a thank you for time)Have a list of tasks you’d like them to accomplish and have them click on your mock up. Tangible evidence of what works and what doesn’t.
  29. Based on usability testing tweak your design, labels, whatever you need to changeSet up shop at reference desks and test the changes you’ve made to design with walk-ups. Also test specific demographics. We tested Parents/Children tab in story time room right after story time ended to get our specific demographic
  30. Find It: patrons didn’t know what it meant, too many items grouped under categoryRecommendations:(Lots of variations: Top Ten, Best of…, Recommended, Recommendations, We Recommend, Suggestions)Parents: (Killed the children’s tab and though Parents would work. Card sorting told us that it might work, but usability testing told us that it was confusing)
  31. We were trying to rename a category from our old site that was called Good Reads. It housed bibliographies, librarian recommendations and read-alikes. Since the 1999 web site, the page also expanded to include movie and music recommendations so Good Reads was no longer a good name. We had six variations on the name for one category.
  32. Polldaddy.com allows you to post free polls and surveys on your web site. You tell them the question and choices and they generate the code for free.We were so conflicted and had differing responses from public that we decided to test the top five labels with a poll.
  33. Children/Teens categories didn’t seem to justify the information found there.Parceled out the information to other categoriesFeedback we got from TAC was that their parents found info re: library events and the children’s page used to be designed for parents to get info so the Parents tab seemed logical.Tested it and found that most parents weren’t sure what info was supposed to be housed under this tab.
  34. Real users: Important! Staff cannot be a patronEven if using content management system, you still need elements and categories that test well
  35. Final site design. Seven categories. Includes everything on our Must Have list.