Card sorting af Lars Bo Larsen, AAU
•Download as PPTX, PDF•
0 likes•950 views
Oplægget blev holdt ved InfinIT-arrangementet "Hands-on workshop: Usability og interaktionsdesign" afholdt den 28. september 2011. Læs mere om arrangementet på http://infinit.dk/dk/hvad_kan_vi_goere_for_dig/viden/reportager/kig_ind_i_hovedet_paa_din_bruger.htm
Recommended
Recommended
More Related Content
Similar to Card sorting af Lars Bo Larsen, AAU
Similar to Card sorting af Lars Bo Larsen, AAU (20)
More from InfinIT - Innovationsnetværket for it
More from InfinIT - Innovationsnetværket for it (20)
Recently uploaded
Recently uploaded (20)
Card sorting af Lars Bo Larsen, AAU
- 1. Card-sorting InfinIT hands-on Workshop 28/9 2011 - Lars Bo Larsen, Søren Færch, Signe Skelgaard
- 2. Infinit Hands-on Workshop LBL/Jan-13 Program • Intro til workshoppen og Card Sorting / Lars Bo ▫ Hvorfor card-sorting? ▫ Kort intro til metoden ▫ Program • Intro til IP-telefon case / Søren • Intro til BrainsBusiness case / Signe • Pause: ▫ opdeling i teams på ca 3 personer • Sortering – vi bytter case midtvejs • Pause • Opsummering af aflutning 2
- 3. Infinit Hands-on Workshop LBL/Jan-13 Hvorfor workshop om Card-sorting? • Oprindeligt et ønske fra InfinITs medlemmer at der bliver afholdt ”Hands-on” aktiviteter om konkrete metoder til ”værktøjskassen” • Card sorting er en metode, som er: ▫ nem (og hurtig) at lære og anvende ▫ nem for deltagerne at forstå ▫ billig ▫ giver gode resulater i forhold til ressourcerne ▫ en explorativ metode, der kan benyttes i den indledende fase af et projekt 3
- 4. Infinit Hands-on Workshop LBL/Jan-13 Og hvad er Card Sorting så? Det er præcist hvad navnet siger! ▫ Du beder et antal personer sortere nogle kort i et antal bunker ▫ Det kan gøres individuelt eller i små teams ▫ Det kan gøres med fysiske kort eller på en computer – lokalt eller på nettet Lo-Tek metode – billig og hurtig at opstille, nem at forklare og forstå ▫ Det tager typisk 25-30 minutter ▫ Det krævende er at definere indholdet og analysere resultaterne 4
- 5. Infinit Hands-on Workshop LBL/Jan-13 5
- 6. Infinit Hands-on Workshop LBL/Jan-13 Hvad får man ud af det? • Det ene resultat er de kategorier, som deltagerne opdeler kortene i: ▫ Disse bruges til at få et indblik i hvordan brugerene opfatter og grupperer funktioner og informationer i systemet (fx organisationen af et website eller en menu struktur) ▫ Mao. giver card sorting et indblik i brugernes ”mentale model” over domænet • Det andet meget vigtige resultat er selve processen, der leder frem til kategorierne ▫ Observeres under selve sorteringen 6
- 7. Infinit Hands-on Workshop LBL/Jan-13 Selve udførelsen • Kort oversigt over hvilke skridt der indgår i planlægningen • Vi gemmer analysen til efter I har prøvet de to cases • Vi skifter til engelsk. 7
- 8. Infinit Hands-on Workshop LBL/Jan-13 The procedures follow: CARD SORTING -Designing Usable Categories by DONNA SPENCER • http://www.rosenfeldmedia.com/books/cardsorting/ • En kort introduktion: • http://www.boxesandarrows.com/view/card_sorting_a_definitive_guide • Slide Illustrations are from the Card Sorting book ▫ Availble from website (flickr) 8
- 9. Infinit Hands-on Workshop LBL/Jan-13 Planning the card sort 1. Decide what you need to learn. 2. Select the method (open or closed, face- to face or remote, manual or software). 3. Choose content. 4. Choose and invite participants. 5. Run the card sort and record the data 6. Analyse the outcomes 9
- 10. Infinit Hands-on Workshop LBL/Jan-13 2. Select the method: Open Sort Open Card Sort (participants chooses the categories) We’ll do this! • By far most common • Need not be completely open – can specify sort criteria, e.g: ▫ Main audience groups ▫ Main tasks they are likely to do ▫ Steps or stages of a process 11
- 11. Infinit Hands-on Workshop LBL/Jan-13 Closed Sorts Closed Card Sort (you choose the categories) • Collects less information (you dont get the categories) ▫ When the categories are fixed beforehand (e.g. extend system) ▫ Much easier to analyse 12
- 12. Infinit Hands-on Workshop LBL/Jan-13 Participants • Number of participants ▫ It depends.... ▫ Must be enough for consistent patterns to emerge ▫ Less for explorative/qualitative, more if rely on statistics or webbased tools ▫ Small teams or individual sorts? ▫ Maybe several user groups? ▫ 15 has been suggested by some researchers 13
- 13. Infinit Hands-on Workshop LBL/Jan-13 Small teams or Individual? • Using small teams (3-4 persons) will allow you to observe the process leading to the grouping of the cards – arguments, difficulties, doubts, etc.. ▫ Outcome might depend on group dynamics ▫ More time-consuming • Doing individual sorts gives more data (one sort per participant) ▫ but gives less deep insights ▫ Well-suited for online card sorts 14
- 14. Infinit Hands-on Workshop LBL/Jan-13 Create the cards: Recommended number: 30-100 cards 15
- 15. Infinit Hands-on Workshop LBL/Jan-13 Running the sort 0. Do a Pilot. 1. Introduce the activity. 2. Hand out cards and materials. 3. Participants sort the cards. 4. Participants label the cards. 5. Ask follow-up questions. 6. Record the outcomes. 16
- 16. Infinit Hands-on Workshop LBL/Jan-13 Intro to the two cases: • Ip-telephone ▫ Søren • BrainsBusiness Website ▫ Signe 17
- 17. Infinit Hands-on Workshop LBL/Jan-13 Do the Sorts • Switch cases after approx 30 minutes ▫ Remember: Cards may only go into one group! Break! • Analyse results 18
- 18. Infinit Hands-on Workshop LBL/Jan-13 Analyse the results – debriefing participants Ask the participants about e.g. : • Overall rationale for their grouping approach • Best examples from each group/category • Is the team is happy with the overall outcome • What were the easy and hard parts 19
- 19. Infinit Hands-on Workshop LBL/Jan-13 Analysing the results – exploratory analysis • What group/categories people form. • What classification schemes people use • What content is placed in each group. • Where individual cards are placed. • What words people use to describe their groups. 20
- 20. Infinit Hands-on Workshop LBL/Jan-13 Quantitative Analysis • Purpose: ▫ Perform in-depth detailed analysis ▫ To determine consistent (and inconsistent!) patterns ▫ To investigate differences between user groups ▫ To get statistical evidence 21
- 21. Infinit Hands-on Workshop LBL/Jan-13 Standardise the Group Terms The participants will come up with a number of similar, but slightly different names for the groups. These need to be standadised before the statistical analysis 22
- 22. Infinit Hands-on Workshop LBL/Jan-13 Spot Patterns 23
- 23. Infinit Hands-on Workshop LBL/Jan-13 Statistical Analysis Perform well-known statistcal analyses • K-means cluster analysis • Hierarchical cluster analysis (HCA) • Multidimensional scaling (MDS) Remember (as always): • Statistics tell you what, not necessarily why: ▫ Manage conditions/control variables ▫ Can spot patterns but usually not why they’re there ▫ Can find consistencies, but maybe inconsistencies were more important 24
- 24. Infinit Hands-on Workshop LBL/Jan-13 25
- 25. Infinit Hands-on Workshop LBL/Jan-13 MDS – Multi Dimenasional Scaling • Dissimilarity Matrix ▫ Contains the distances (usually Euclidian, usually metric type) between cards ▫ Symmetric aorund the diagonal – often only triangle view ▫ Can be in more dimensions (hard to interpret visually above 3) 26
- 26. Infinit Hands-on Workshop LBL/Jan-13 MDS – visualisation 27
- 27. Infinit Hands-on Workshop LBL/Jan-13 The Results from our cases: • Input to come 28
- 28. Infinit Hands-on Workshop LBL/Jan-13 Your comments, questions and opinions? 29
- 29. Infinit Hands-on Workshop LBL/Jan-13 Always combine methods! Other methods used with card sorting: • Interviews 70% • Existing sources of user data, such as website statistics, and search logs 66% • Usability tests 53% • Task analysis 46% • Surveys or questionnaires 42% • Focus groups 6% 30
- 30. Infinit Hands-on Workshop LBL/Jan-13 Summary • Careful preparation is (as always) the key to success • Pay attention to the discussions, arguments, etc of the participants • Team sorts provide richer material • Individual sorts provides more material and can be run online • Nice tools available out there – many are free • Be careful not to be carried away by the statistical analysis • Use card sorting as a supplement to other methods 31
- 31. Infinit Hands-on Workshop LBL/Jan-13 32
- 32. Infinit Hands-on Workshop LBL/Jan-13 Tools and Ressources • Card Sorting book website (spreadsheet, examples) • Optimalsort by Optimal workshop.com See demo • xSort (free download from Apple), for Mac OS X • Matlab, R, SPSS libraries • WebSort site 33
Editor's Notes
- We also have one student from Arts and technology – pls wave if you’re here!
- Vi har fokuseret på usability og evaluering i tidligere workshops, her fokuserer vi på værktøjer til at hjælpe med design af IAVi har tre timer til at lære og afprøve teknikken!
- Stacks: Either users label the stacks (open) or a set of labels have been provided (closed)Mental model: how users think something works.
- Youtube video: http://www.youtube.com/watch?v=NTW3aGq9jiI (Start approx 20 seconds into video)
- Save tool discussion until later
- Need to learn broad ideasNeed to check you’re on trackNeed to explore an idea in detailNeed to compare peopleJustify a recommendation
- Det er den vi vil anvende i dag.
- Save the tools part to later
- Dominant member <> many compromisesLarger teams are not effective – takes much longer time and makes many compromisesTime consuming, if video filem and transcribed.
- Use script, explain purpose.Dont hand out cards until intro is doneSpread cards on table instead of a tight bunchObserve the sort – lots of additional info here – little interference needed from facilitatorListen to group discussion and note cards that are hard to place – first or last etc.Spatial grouping - fotos
- Not necessary for closed sort!!
- Can be reorganised into a similarity matrix, see example later
- K-Means is one of the simplest forms of cluster analysis. Reseracher determines number of clustersIt is a particularly useful method for exploring different ways data can be grouped and for determining group boundaries.Outcome depends on the initialisation – might provide different clustersRun a number of times.HCA and K-Means are similar in that they are both clustering methods, but HCA is different from K-Means in that it does not assign cards to groups—it builds a hierarchy made of clusters of cards.
- Dendrogram, HCAnote that the numbers at the bottom are a calculation of the measure of distance between two items—ifthere is a vertical bar between two items at 0, the distance is 0 and the two items were placed together by every participant.Everything else is a relative measure of closeness
- Multidimensional scaling (MDS) is a method that provides a visual representation of thecloseness of items. MDS plots objects on a map—objects that are similar to eachother are close together, and objects that are different from each other are far away fromeach other.
- From book – survey among UX professionals
- Optimal sort and websort have cool drag and drop interfaces