This document provides an overview of card sorting, which is a methodology used to organize information by having participants group and label index cards or post-it notes. It discusses open and closed card sorting, case studies using the technique, conducting a sample card sorting exercise in class, and how the results can be used to build consensus on terminology and create site maps and navigation structures.
The document summarizes different methods for validating information architecture (IA), including card sorting techniques. It then presents a case study where multiple validation methods were used to evaluate the IA of a healthcare website. An open card sort revealed how users naturally grouped content and identified difficult items. A closed card sort showed better alignment with the proposed IA structure. The combination of methods provided valuable insights to improve the site's organization and findability.
Card sorting is a technique used in user-centered design to help structure and organize website content according to how users perceive it. Participants are given cards with content items and asked to sort them into logical groups. This provides insights into how users would naturally organize information. The results can then be used to improve the findability and intuitiveness of a website's information architecture. The goal of card sorting is to design websites around user perceptions rather than stakeholder assumptions in order to create more optimal user experiences.
This document provides an overview of asset mapping for community organizations. It defines asset mapping as a deliberate process to synthesize organizational resources to build on strengths and address challenges. The information generated from asset mapping can be used for awareness, economic development, planning, and collaboration. It outlines a 4-step process for asset mapping: 1) brainstorm people, places, groups associated with the organization; 2) refine the list; 3) create a visual map; and 4) periodically maintain and update the map. The goal of asset mapping is to identify community assets to leverage growth and inform decision-making.
The document discusses qualitative research design and methods for data analysis. It provides guidance on developing a purpose statement, designing data collection strategies, analyzing data through coding and categorization, ensuring validity, and developing findings and conclusions from the analysis. Key aspects covered include determining the central phenomenon of study, sampling participants, triangulating data sources, constructing categories through constant comparison, coding data, identifying themes, and determining conclusions based on the findings.
Information Architecture Basics,
Main components of IA: organization schemes, structure, labeling, logic, search
Card sorting, Tree testing, IA performance, Content modeling, Task Flows, Site Maps
This document provides an introduction to analytic thinking by outlining its key components and principles. It explains that all thinking can be broken down into eight elements and that to analyze thinking, one must learn to identify and question these elements and understand intellectual standards. The document aims to provide students with a model for analyzing various subjects by examining elements like purpose, evidence, assumptions, and implications. It argues that learning to analyze is an important skill that can help students think more skillfully across disciplines.
Asset mapping is a planning tool. It\'s the synthesizing of your organizational resources – networks, people, links, and patterns – in order to build on what’s working and address challenges. Asset mapping may be the spark your need to discover, access, and mobilize unrecognized resources, and engage people who can participate in your community/organization/vision.
This document provides an overview of card sorting, which is a methodology used to organize information by having participants group and label index cards or post-it notes. It discusses open and closed card sorting, case studies using the technique, conducting a sample card sorting exercise in class, and how the results can be used to build consensus on terminology and create site maps and navigation structures.
The document summarizes different methods for validating information architecture (IA), including card sorting techniques. It then presents a case study where multiple validation methods were used to evaluate the IA of a healthcare website. An open card sort revealed how users naturally grouped content and identified difficult items. A closed card sort showed better alignment with the proposed IA structure. The combination of methods provided valuable insights to improve the site's organization and findability.
Card sorting is a technique used in user-centered design to help structure and organize website content according to how users perceive it. Participants are given cards with content items and asked to sort them into logical groups. This provides insights into how users would naturally organize information. The results can then be used to improve the findability and intuitiveness of a website's information architecture. The goal of card sorting is to design websites around user perceptions rather than stakeholder assumptions in order to create more optimal user experiences.
This document provides an overview of asset mapping for community organizations. It defines asset mapping as a deliberate process to synthesize organizational resources to build on strengths and address challenges. The information generated from asset mapping can be used for awareness, economic development, planning, and collaboration. It outlines a 4-step process for asset mapping: 1) brainstorm people, places, groups associated with the organization; 2) refine the list; 3) create a visual map; and 4) periodically maintain and update the map. The goal of asset mapping is to identify community assets to leverage growth and inform decision-making.
The document discusses qualitative research design and methods for data analysis. It provides guidance on developing a purpose statement, designing data collection strategies, analyzing data through coding and categorization, ensuring validity, and developing findings and conclusions from the analysis. Key aspects covered include determining the central phenomenon of study, sampling participants, triangulating data sources, constructing categories through constant comparison, coding data, identifying themes, and determining conclusions based on the findings.
Information Architecture Basics,
Main components of IA: organization schemes, structure, labeling, logic, search
Card sorting, Tree testing, IA performance, Content modeling, Task Flows, Site Maps
This document provides an introduction to analytic thinking by outlining its key components and principles. It explains that all thinking can be broken down into eight elements and that to analyze thinking, one must learn to identify and question these elements and understand intellectual standards. The document aims to provide students with a model for analyzing various subjects by examining elements like purpose, evidence, assumptions, and implications. It argues that learning to analyze is an important skill that can help students think more skillfully across disciplines.
Asset mapping is a planning tool. It\'s the synthesizing of your organizational resources – networks, people, links, and patterns – in order to build on what’s working and address challenges. Asset mapping may be the spark your need to discover, access, and mobilize unrecognized resources, and engage people who can participate in your community/organization/vision.
This document discusses system thinking and the critical thinking process for computer educators. It outlines the 3Rs of reading, writing, and arithmetic as well as the 7Cs of skills needed for the 21st century such as critical thinking, creativity, collaboration, and more. It then explains the process of critical thinking as involving informed opinions, integrating facts, autonomous thinking, observations, active listening, questioning, and reaching unbiased conclusions. It also discusses Benjamin Bloom's taxonomy of learning including remembering, understanding, applying, analyzing, evaluating, and creating. Evaluation models and references are then listed.
Adviser : Asst. Prof. Dr.Charuni Samat
Member : Miss Tita Karkhammart 563050424-2
Miss Tiwawna Racho 563050425-0
Miss Pimchanok Matawong 563050431-5
Miss Rapeepan Siriwongkan 563050434-9
Mr.Poramin Attane 563050175-7
Mr.Supakorn Saamsak 563050439-9
Miss Chayanit Panpa 563050170-7
COMPUTER EDCATION
KHONKAEN UNIVERSITY
27 creativity and innovation tools - in one-pagers!Marc Heleven
27 creativity & innovation tools is an overview of various commonly used techniques in creativity, innovation, research & development processes.
All in one-pagers!
The techniques are grouped by:
- Diverging & Converging techniques
- Open & Closed challenges / problems
- Products & Services situations
- Individual & Group techniques
Techniques can be classified in many, many ways, yet the only real
measure is the passion and comfort you feel with a technique.
The only way to really get to know the techniques is to use them.
So go ahead, try them and share your experiences.
Enjoy the overview!
Ramon Vullings & Marc Heleven
http://www.RamonVullings.com
http://www.7ideas.net
Designing an effective information architectureoptimalworkshop
It’s such a waste when stuff is hard to find. In the book Ambient Findability, Peter Morville quotes a study that estimates that in a medium-sized hospital, 8,000 hours a year of staff time are spent explaining signs and redirecting people. That’s 4 person years!
Finding stuff online is even worse. According to IBM’s chairman, it’s estimated that there will be 44 times as much data and content coming over the next decade, reaching 35 zettabytes by 2020. That’s 35 followed by 21 zeros.
There is one thing you can do to help the madness. You can create an effective information architecture (IA) to connect people with the content that they’re looking for. In this practical workshop you’ll learn how to create an effective IA which will help ensure that your stuff is easy to find and provide your visitors with a great experience. You’ll leave with an armload of practical insights and tips, and with the inspiration to refine and test your own IA.
The document contains a list of words related to beliefs, principles, opinions and perspectives repeated multiple times. It also contains sections about various creative thinking tools and techniques such as forced relationships, idea grids, checklists, PCP analysis, hits and misses ranking, and value grids. The tools are described as ways to generate new ideas through combinations, analyses and evaluations for problem solving.
The document contains a list of words related to beliefs, principles, opinions and perspectives repeated multiple times. It also contains sections about various creative thinking tools and techniques such as forced relationships, idea grids, checklists, PCP analysis, hits and misses ranking, and value grids. The tools are described as ways to generate new ideas through combinations, analysis and evaluation for problem solving.
The document provides an overview of user experience (UX) design for startups. It discusses:
1) What UX design is and how UX designers work to identify problems and find solutions to create a seamless user experience.
2) When to bring in UX designers, which should be early in the process to allow for collaboration with engineers.
3) The importance of user research through methods like focus groups, interviews and usability testing to understand users and inform the design.
4) How to develop personas, functions lists, information architecture and user scenarios/flows to map the optimal website structure and organization.
Designing Structure Part II: Information ArchtectureChristina Wodtke
Part two on Designing Structure for my General Assembly class on User Experience is about Information Architecture. We cover why classification is important, types of classification and trends in IA.
The document discusses several instructional strategies for teaching and learning, including direct, indirect, experiential, and independent strategies. Direct strategies include lecture and explicit teaching, while indirect strategies involve problem solving and inquiry. Experiential strategies incorporate field trips, simulations, and role-playing. Independent strategies comprise essays, computer-assisted instruction, and research projects. The strategies presented require close attention to methods for effectively presenting material in ways that engage students and match their development, interests, and experiences.
South-East UX - Analysing the results of card sortingMargaret Hanley
A presentation to the South-East UX meet-up in Melbourne Australia. The focus was learning how to interpret the results of card sorting to create categorisation and navigation.
This document discusses various pre-ideation and ideation methods:
- Pre-ideation methods include slicing large challenges into smaller pieces using techniques like the Six Thinking Hats and attribute listing. This allows ideation to focus on more manageable parts of the challenge.
- Ideation methods for generating ideas encompass brainstorming, brainwriting, and 10 plus 10. Additional methods like bodystorming and using cards add depth and diversity.
- Methods for understanding, clustering and ranking ideas include octopus clustering, Benny Hill sorting, idea portfolios and decision matrices.
- Techniques for reducing options include quick voting and physical commitment activities.
The document provides details on applying several of these methods and
Understand concepts around Deep Learning, Machine Learning, Pattern Recognition and more. See AEM scenarios powered with Adobe Sensei. Understand the latest roadmap on AEM and Sensei.
This document provides an overview of 27 creativity and innovation techniques organized into categories of diverging and converging techniques. It encourages the reader to try different techniques and share experiences. Techniques include brainwriting, challenging assumptions, Osborn's checklist, and biomimicry. The document emphasizes that the best way to learn techniques is through use and that passion and comfort with a technique are the real measures of its value.
Juliette Melton - Mobile User Experience ResearchWeb Directions
Most user experience research takes place sitting behind a computer. And yet these days, most networked experiences are happening on mobile devices. Some common user experience research methods work well in a mobile environment — others don’t. In this talk, Juliette Melton will guide you through how to use some great existing research methods in a mobile context, how to incorporate some new (and fun!) methods into your arsenal, and propose next generation tools and services to make mobile user experience research even better.
Juliette has ten years of experience building, managing, and researching digital environments and is a human factors researcher based at IDEO in San Francisco. She’s deeply interested in the intersections between digital culture, learning, and communication. Her work has spanned a broad range of industries including social media, casual gaming, education administration, electronic publishing, corporate banking, computer hardware, and public health.
Community education — through workshops, lectures, and writing — is an important part of her work. Remote user experience methods, agile project management, and research program planning are frequent topics.
Juliette holds an MEd from the Technology, Innovation, and Education program at the Harvard Graduate School of Education where she focused on developing models for innovative networked learning applications. She also has a BA in Comparative Literature from Haverford College.
Follow Juliette on Twitter: @j
The document provides an overview of exploratory analysis techniques for card sorting data. It discusses preparing the data by entering it into a spreadsheet and standardizing labels. The key steps of exploratory analysis are examining the groups created by participants to look for consistency and differences, analyzing where individual cards were placed, and analyzing the labels participants used for groups. The goal is to gain insights into how participants think about and categorize the content, and to inform the design of an optimal information architecture.
Everything you ever wanted to know about Google Analytics, but were afraid to...SoCal UX Camp
Event: SoCal UX Camp 2016
Presented by: David LaFontaine
This is a hands-on exploration on how to move beyond the basics with Google Analytics. Why should designers have to deal with all these confusing spreadsheets, numbers, charts and graphs?
Well, without at least a decent grasp of how to read web analytics, creative professionals are going to continue to lose control of their creations, because to decision-makers, the charts and graphs and spreadsheets seem to be the very essence of unassailable logic. Worse,designers will lose out on the opportunity to make what their sites better, by gaining insights into the needs, desires and motivations of their users.
Too many digital experiences are being carefully crafted by UX Designers to "surprise and delight" users -- only to lose that human essence at the end, when final decisions are made, based solely upon surface-level analysis of audience behavior.
It need not be so. In fact, we desperately need to start putting the "human touch" back into what we create. Because the alternative is just so much over-processed brainmush. Slideshows, listicles and clickbait are not what we were put on this earth to create nor consume.
Bus infoengineers january_25_2013_engr185_final in classMichael Oppenheim
The document discusses strategies and sources for locating business information. It outlines developing an efficient research strategy and sample product research strategies. These include using an interactive libguide on business information for engineers and finding industry, company, market, and consumer information. It also discusses finding government information on consumers and regulations. Sources mentioned include IBISWorld, MarketLine Advantage, Business Source Complete, Factiva, SimplyMap, American FactFinder, and various government websites. The document encourages following up with the librarian for any future questions.
Physical and Online Card Sorts: A Practical Overview and Case StudyBob Thomas
This is a practical case study where I worked with an educational testing and assessment company to help them redesign their information architecture for their corporate intranet, using an open card sort.
So many companies build corporate intranets and then don’t do anything with them, so they just languish and are ignored by employees.
The company clearly saw the benefit of a corporate intranet and wanted to improve the site for its employees. It saw this as a competitive advantage.
MindCanvas is an online research platform that uses game-like elicitation methods and interactive visualizations to conduct qualitative and quantitative user research remotely. It was created to make research faster, more engaging for participants, and easier to share findings visually. Current methods on MindCanvas include open sorting, tree sorting, free listing, and more. The platform aims to enable high-quality user research while being convenient for busy designers and participants.
The document describes MindCanvas, an online research platform that aims to make qualitative research faster, cheaper, and more engaging for participants. It uses game-like elicitation methods and interactive visualizations to gather and analyze user data. The platform was created to address limitations of traditional qualitative research methods, such as being time-consuming and not engaging users. It allows researchers to remotely conduct studies, aggregate and statistically analyze large datasets, and share visualized findings with stakeholders.
This presentation by OECD, OECD Secretariat, was made during the discussion “Competition and Regulation in Professions and Occupations” held at the 77th meeting of the OECD Working Party No. 2 on Competition and Regulation on 10 June 2024. More papers and presentations on the topic can be found at oe.cd/crps.
This presentation was uploaded with the author’s consent.
This presentation by OECD, OECD Secretariat, was made during the discussion “Artificial Intelligence, Data and Competition” held at the 143rd meeting of the OECD Competition Committee on 12 June 2024. More papers and presentations on the topic can be found at oe.cd/aicomp.
This presentation was uploaded with the author’s consent.
More Related Content
Similar to Card Sort - UXRA Education Series_2022-06-16l.pptx
This document discusses system thinking and the critical thinking process for computer educators. It outlines the 3Rs of reading, writing, and arithmetic as well as the 7Cs of skills needed for the 21st century such as critical thinking, creativity, collaboration, and more. It then explains the process of critical thinking as involving informed opinions, integrating facts, autonomous thinking, observations, active listening, questioning, and reaching unbiased conclusions. It also discusses Benjamin Bloom's taxonomy of learning including remembering, understanding, applying, analyzing, evaluating, and creating. Evaluation models and references are then listed.
Adviser : Asst. Prof. Dr.Charuni Samat
Member : Miss Tita Karkhammart 563050424-2
Miss Tiwawna Racho 563050425-0
Miss Pimchanok Matawong 563050431-5
Miss Rapeepan Siriwongkan 563050434-9
Mr.Poramin Attane 563050175-7
Mr.Supakorn Saamsak 563050439-9
Miss Chayanit Panpa 563050170-7
COMPUTER EDCATION
KHONKAEN UNIVERSITY
27 creativity and innovation tools - in one-pagers!Marc Heleven
27 creativity & innovation tools is an overview of various commonly used techniques in creativity, innovation, research & development processes.
All in one-pagers!
The techniques are grouped by:
- Diverging & Converging techniques
- Open & Closed challenges / problems
- Products & Services situations
- Individual & Group techniques
Techniques can be classified in many, many ways, yet the only real
measure is the passion and comfort you feel with a technique.
The only way to really get to know the techniques is to use them.
So go ahead, try them and share your experiences.
Enjoy the overview!
Ramon Vullings & Marc Heleven
http://www.RamonVullings.com
http://www.7ideas.net
Designing an effective information architectureoptimalworkshop
It’s such a waste when stuff is hard to find. In the book Ambient Findability, Peter Morville quotes a study that estimates that in a medium-sized hospital, 8,000 hours a year of staff time are spent explaining signs and redirecting people. That’s 4 person years!
Finding stuff online is even worse. According to IBM’s chairman, it’s estimated that there will be 44 times as much data and content coming over the next decade, reaching 35 zettabytes by 2020. That’s 35 followed by 21 zeros.
There is one thing you can do to help the madness. You can create an effective information architecture (IA) to connect people with the content that they’re looking for. In this practical workshop you’ll learn how to create an effective IA which will help ensure that your stuff is easy to find and provide your visitors with a great experience. You’ll leave with an armload of practical insights and tips, and with the inspiration to refine and test your own IA.
The document contains a list of words related to beliefs, principles, opinions and perspectives repeated multiple times. It also contains sections about various creative thinking tools and techniques such as forced relationships, idea grids, checklists, PCP analysis, hits and misses ranking, and value grids. The tools are described as ways to generate new ideas through combinations, analyses and evaluations for problem solving.
The document contains a list of words related to beliefs, principles, opinions and perspectives repeated multiple times. It also contains sections about various creative thinking tools and techniques such as forced relationships, idea grids, checklists, PCP analysis, hits and misses ranking, and value grids. The tools are described as ways to generate new ideas through combinations, analysis and evaluation for problem solving.
The document provides an overview of user experience (UX) design for startups. It discusses:
1) What UX design is and how UX designers work to identify problems and find solutions to create a seamless user experience.
2) When to bring in UX designers, which should be early in the process to allow for collaboration with engineers.
3) The importance of user research through methods like focus groups, interviews and usability testing to understand users and inform the design.
4) How to develop personas, functions lists, information architecture and user scenarios/flows to map the optimal website structure and organization.
Designing Structure Part II: Information ArchtectureChristina Wodtke
Part two on Designing Structure for my General Assembly class on User Experience is about Information Architecture. We cover why classification is important, types of classification and trends in IA.
The document discusses several instructional strategies for teaching and learning, including direct, indirect, experiential, and independent strategies. Direct strategies include lecture and explicit teaching, while indirect strategies involve problem solving and inquiry. Experiential strategies incorporate field trips, simulations, and role-playing. Independent strategies comprise essays, computer-assisted instruction, and research projects. The strategies presented require close attention to methods for effectively presenting material in ways that engage students and match their development, interests, and experiences.
South-East UX - Analysing the results of card sortingMargaret Hanley
A presentation to the South-East UX meet-up in Melbourne Australia. The focus was learning how to interpret the results of card sorting to create categorisation and navigation.
This document discusses various pre-ideation and ideation methods:
- Pre-ideation methods include slicing large challenges into smaller pieces using techniques like the Six Thinking Hats and attribute listing. This allows ideation to focus on more manageable parts of the challenge.
- Ideation methods for generating ideas encompass brainstorming, brainwriting, and 10 plus 10. Additional methods like bodystorming and using cards add depth and diversity.
- Methods for understanding, clustering and ranking ideas include octopus clustering, Benny Hill sorting, idea portfolios and decision matrices.
- Techniques for reducing options include quick voting and physical commitment activities.
The document provides details on applying several of these methods and
Understand concepts around Deep Learning, Machine Learning, Pattern Recognition and more. See AEM scenarios powered with Adobe Sensei. Understand the latest roadmap on AEM and Sensei.
This document provides an overview of 27 creativity and innovation techniques organized into categories of diverging and converging techniques. It encourages the reader to try different techniques and share experiences. Techniques include brainwriting, challenging assumptions, Osborn's checklist, and biomimicry. The document emphasizes that the best way to learn techniques is through use and that passion and comfort with a technique are the real measures of its value.
Juliette Melton - Mobile User Experience ResearchWeb Directions
Most user experience research takes place sitting behind a computer. And yet these days, most networked experiences are happening on mobile devices. Some common user experience research methods work well in a mobile environment — others don’t. In this talk, Juliette Melton will guide you through how to use some great existing research methods in a mobile context, how to incorporate some new (and fun!) methods into your arsenal, and propose next generation tools and services to make mobile user experience research even better.
Juliette has ten years of experience building, managing, and researching digital environments and is a human factors researcher based at IDEO in San Francisco. She’s deeply interested in the intersections between digital culture, learning, and communication. Her work has spanned a broad range of industries including social media, casual gaming, education administration, electronic publishing, corporate banking, computer hardware, and public health.
Community education — through workshops, lectures, and writing — is an important part of her work. Remote user experience methods, agile project management, and research program planning are frequent topics.
Juliette holds an MEd from the Technology, Innovation, and Education program at the Harvard Graduate School of Education where she focused on developing models for innovative networked learning applications. She also has a BA in Comparative Literature from Haverford College.
Follow Juliette on Twitter: @j
The document provides an overview of exploratory analysis techniques for card sorting data. It discusses preparing the data by entering it into a spreadsheet and standardizing labels. The key steps of exploratory analysis are examining the groups created by participants to look for consistency and differences, analyzing where individual cards were placed, and analyzing the labels participants used for groups. The goal is to gain insights into how participants think about and categorize the content, and to inform the design of an optimal information architecture.
Everything you ever wanted to know about Google Analytics, but were afraid to...SoCal UX Camp
Event: SoCal UX Camp 2016
Presented by: David LaFontaine
This is a hands-on exploration on how to move beyond the basics with Google Analytics. Why should designers have to deal with all these confusing spreadsheets, numbers, charts and graphs?
Well, without at least a decent grasp of how to read web analytics, creative professionals are going to continue to lose control of their creations, because to decision-makers, the charts and graphs and spreadsheets seem to be the very essence of unassailable logic. Worse,designers will lose out on the opportunity to make what their sites better, by gaining insights into the needs, desires and motivations of their users.
Too many digital experiences are being carefully crafted by UX Designers to "surprise and delight" users -- only to lose that human essence at the end, when final decisions are made, based solely upon surface-level analysis of audience behavior.
It need not be so. In fact, we desperately need to start putting the "human touch" back into what we create. Because the alternative is just so much over-processed brainmush. Slideshows, listicles and clickbait are not what we were put on this earth to create nor consume.
Bus infoengineers january_25_2013_engr185_final in classMichael Oppenheim
The document discusses strategies and sources for locating business information. It outlines developing an efficient research strategy and sample product research strategies. These include using an interactive libguide on business information for engineers and finding industry, company, market, and consumer information. It also discusses finding government information on consumers and regulations. Sources mentioned include IBISWorld, MarketLine Advantage, Business Source Complete, Factiva, SimplyMap, American FactFinder, and various government websites. The document encourages following up with the librarian for any future questions.
Physical and Online Card Sorts: A Practical Overview and Case StudyBob Thomas
This is a practical case study where I worked with an educational testing and assessment company to help them redesign their information architecture for their corporate intranet, using an open card sort.
So many companies build corporate intranets and then don’t do anything with them, so they just languish and are ignored by employees.
The company clearly saw the benefit of a corporate intranet and wanted to improve the site for its employees. It saw this as a competitive advantage.
MindCanvas is an online research platform that uses game-like elicitation methods and interactive visualizations to conduct qualitative and quantitative user research remotely. It was created to make research faster, more engaging for participants, and easier to share findings visually. Current methods on MindCanvas include open sorting, tree sorting, free listing, and more. The platform aims to enable high-quality user research while being convenient for busy designers and participants.
The document describes MindCanvas, an online research platform that aims to make qualitative research faster, cheaper, and more engaging for participants. It uses game-like elicitation methods and interactive visualizations to gather and analyze user data. The platform was created to address limitations of traditional qualitative research methods, such as being time-consuming and not engaging users. It allows researchers to remotely conduct studies, aggregate and statistically analyze large datasets, and share visualized findings with stakeholders.
Similar to Card Sort - UXRA Education Series_2022-06-16l.pptx (20)
This presentation by OECD, OECD Secretariat, was made during the discussion “Competition and Regulation in Professions and Occupations” held at the 77th meeting of the OECD Working Party No. 2 on Competition and Regulation on 10 June 2024. More papers and presentations on the topic can be found at oe.cd/crps.
This presentation was uploaded with the author’s consent.
This presentation by OECD, OECD Secretariat, was made during the discussion “Artificial Intelligence, Data and Competition” held at the 143rd meeting of the OECD Competition Committee on 12 June 2024. More papers and presentations on the topic can be found at oe.cd/aicomp.
This presentation was uploaded with the author’s consent.
This presentation by Professor Giuseppe Colangelo, Jean Monnet Professor of European Innovation Policy, was made during the discussion “The Intersection between Competition and Data Privacy” held at the 143rd meeting of the OECD Competition Committee on 13 June 2024. More papers and presentations on the topic can be found at oe.cd/ibcdp.
This presentation was uploaded with the author’s consent.
XP 2024 presentation: A New Look to Leadershipsamililja
Presentation slides from XP2024 conference, Bolzano IT. The slides describe a new view to leadership and combines it with anthro-complexity (aka cynefin).
Why Psychological Safety Matters for Software Teams - ACE 2024 - Ben Linders.pdfBen Linders
Psychological safety in teams is important; team members must feel safe and able to communicate and collaborate effectively to deliver value. It’s also necessary to build long-lasting teams since things will happen and relationships will be strained.
But, how safe is a team? How can we determine if there are any factors that make the team unsafe or have an impact on the team’s culture?
In this mini-workshop, we’ll play games for psychological safety and team culture utilizing a deck of coaching cards, The Psychological Safety Cards. We will learn how to use gamification to gain a better understanding of what’s going on in teams. Individuals share what they have learned from working in teams, what has impacted the team’s safety and culture, and what has led to positive change.
Different game formats will be played in groups in parallel. Examples are an ice-breaker to get people talking about psychological safety, a constellation where people take positions about aspects of psychological safety in their team or organization, and collaborative card games where people work together to create an environment that fosters psychological safety.
This presentation by OECD, OECD Secretariat, was made during the discussion “Pro-competitive Industrial Policy” held at the 143rd meeting of the OECD Competition Committee on 12 June 2024. More papers and presentations on the topic can be found at oe.cd/pcip.
This presentation was uploaded with the author’s consent.
This presentation by Juraj Čorba, Chair of OECD Working Party on Artificial Intelligence Governance (AIGO), was made during the discussion “Artificial Intelligence, Data and Competition” held at the 143rd meeting of the OECD Competition Committee on 12 June 2024. More papers and presentations on the topic can be found at oe.cd/aicomp.
This presentation was uploaded with the author’s consent.
Suzanne Lagerweij - Influence Without Power - Why Empathy is Your Best Friend...Suzanne Lagerweij
This is a workshop about communication and collaboration. We will experience how we can analyze the reasons for resistance to change (exercise 1) and practice how to improve our conversation style and be more in control and effective in the way we communicate (exercise 2).
This session will use Dave Gray’s Empathy Mapping, Argyris’ Ladder of Inference and The Four Rs from Agile Conversations (Squirrel and Fredrick).
Abstract:
Let’s talk about powerful conversations! We all know how to lead a constructive conversation, right? Then why is it so difficult to have those conversations with people at work, especially those in powerful positions that show resistance to change?
Learning to control and direct conversations takes understanding and practice.
We can combine our innate empathy with our analytical skills to gain a deeper understanding of complex situations at work. Join this session to learn how to prepare for difficult conversations and how to improve our agile conversations in order to be more influential without power. We will use Dave Gray’s Empathy Mapping, Argyris’ Ladder of Inference and The Four Rs from Agile Conversations (Squirrel and Fredrick).
In the session you will experience how preparing and reflecting on your conversation can help you be more influential at work. You will learn how to communicate more effectively with the people needed to achieve positive change. You will leave with a self-revised version of a difficult conversation and a practical model to use when you get back to work.
Come learn more on how to become a real influencer!
This presentation by OECD, OECD Secretariat, was made during the discussion “The Intersection between Competition and Data Privacy” held at the 143rd meeting of the OECD Competition Committee on 13 June 2024. More papers and presentations on the topic can be found at oe.cd/ibcdp.
This presentation was uploaded with the author’s consent.
This presentation by Professor Alex Robson, Deputy Chair of Australia’s Productivity Commission, was made during the discussion “Competition and Regulation in Professions and Occupations” held at the 77th meeting of the OECD Working Party No. 2 on Competition and Regulation on 10 June 2024. More papers and presentations on the topic can be found at oe.cd/crps.
This presentation was uploaded with the author’s consent.
This presentation by Yong Lim, Professor of Economic Law at Seoul National University School of Law, was made during the discussion “Artificial Intelligence, Data and Competition” held at the 143rd meeting of the OECD Competition Committee on 12 June 2024. More papers and presentations on the topic can be found at oe.cd/aicomp.
This presentation was uploaded with the author’s consent.
This presentation by Tim Capel, Director of the UK Information Commissioner’s Office Legal Service, was made during the discussion “The Intersection between Competition and Data Privacy” held at the 143rd meeting of the OECD Competition Committee on 13 June 2024. More papers and presentations on the topic can be found at oe.cd/ibcdp.
This presentation was uploaded with the author’s consent.
Carrer goals.pptx and their importance in real lifeartemacademy2
Career goals serve as a roadmap for individuals, guiding them toward achieving long-term professional aspirations and personal fulfillment. Establishing clear career goals enables professionals to focus their efforts on developing specific skills, gaining relevant experience, and making strategic decisions that align with their desired career trajectory. By setting both short-term and long-term objectives, individuals can systematically track their progress, make necessary adjustments, and stay motivated. Short-term goals often include acquiring new qualifications, mastering particular competencies, or securing a specific role, while long-term goals might encompass reaching executive positions, becoming industry experts, or launching entrepreneurial ventures.
Moreover, having well-defined career goals fosters a sense of purpose and direction, enhancing job satisfaction and overall productivity. It encourages continuous learning and adaptation, as professionals remain attuned to industry trends and evolving job market demands. Career goals also facilitate better time management and resource allocation, as individuals prioritize tasks and opportunities that advance their professional growth. In addition, articulating career goals can aid in networking and mentorship, as it allows individuals to communicate their aspirations clearly to potential mentors, colleagues, and employers, thereby opening doors to valuable guidance and support. Ultimately, career goals are integral to personal and professional development, driving individuals toward sustained success and fulfillment in their chosen fields.
The importance of sustainable and efficient computational practices in artificial intelligence (AI) and deep learning has become increasingly critical. This webinar focuses on the intersection of sustainability and AI, highlighting the significance of energy-efficient deep learning, innovative randomization techniques in neural networks, the potential of reservoir computing, and the cutting-edge realm of neuromorphic computing. This webinar aims to connect theoretical knowledge with practical applications and provide insights into how these innovative approaches can lead to more robust, efficient, and environmentally conscious AI systems.
Webinar Speaker: Prof. Claudio Gallicchio, Assistant Professor, University of Pisa
Claudio Gallicchio is an Assistant Professor at the Department of Computer Science of the University of Pisa, Italy. His research involves merging concepts from Deep Learning, Dynamical Systems, and Randomized Neural Systems, and he has co-authored over 100 scientific publications on the subject. He is the founder of the IEEE CIS Task Force on Reservoir Computing, and the co-founder and chair of the IEEE Task Force on Randomization-based Neural Networks and Learning Systems. He is an associate editor of IEEE Transactions on Neural Networks and Learning Systems (TNNLS).
1. Jason Telner, Ph.D., Colin Crehan, Mark Wise, Ph.D.
Card Sorting:
There is so much more to learn than you think you already know
UXPA Conference 2022
San Diego, USA
June 20, 2022
4. Presentation title
IBM | Project/team name
A good system shortens the road to
the goal.
- Orison Swett Marden
4 UXPA Card Sort | IBM CIO Design
5. Presentation title
IBM | Project/team name
Card sorting is a research method used
to help define, design, or evaluate the
information architecture of a site.
6. Presentation title
IBM | Project/team name
Web Site Navigation
Content Categorization
Menu Structure
7. Card Sort
Used to define the organization of
content to help design menus,
navigation, groups of similar
content, and site information
architecture.
What it is good for
Overview
A card sort is typically conducted
early early in the design process to
inform how to group content
within a page/screen, and across a
website or application.
When to use
Participants sort a set of “cards”
that represent content and group
them into categories that make
logical sense to them.
The results are collated across
participants to define categories
that should make the most sense
to the most people.
How it is conducted
Web based tools like Optimal Sort,
Userlytics, Alchemer, or UserZoom
can be used to collect data and
analyze results.
… OR Index cards, Post-it Notes,
Markers, and Rubber Bands … but
the tools make analysis easier.
Tools and materials
7 UXPA Card Sort | IBM CIO Design
10. Memory Organization
Information categorization allows
humans to organize things, objects,
ideas that exist around them to
their understanding of the world.
The hippocampus is
the hub of the brain
system that supports
memory organization.
11. Organizing Information
Aristotle was the first to attempt to classify
animals in his Historia Animalium (History of
Animals)
He grouped the types of creatures according to
their similarities:
• animals with blood and animals without
blood,
• animals that live on water and animals that
live on land.
Historia
Animalium
- Aristotle
~350 BC
11 UXPA Card Sort | IBM CIO Design
12. Information Organization
To Immanual Kant, a category is a characteristic of the
appearance of any object in general, before it has been
experienced (a priori).
Following Aristotle, Kant uses the term 'categories' to
describe the "pure concepts of the understanding,
which apply to objects of intuition in general a priori…”.
"They are concepts of an object in general, by means of
which its intuition is regarded as determined with
regard to one of the logical functions for judgments."
1781
12 UXPA Card Sort | IBM CIO Design
13. Neuropsychological Testing
The ability to generate categories is used in
neuropsychology to test elements of cognitive
function and mental capacity.
Wisconsin Card Sorting Test (1948) presents
participants with several stimulus cards. They are
told to match the cards, but not the characteristic to
match on.
• Participants are told whether a particular match is
right or wrong.
• Measures competence in abstract reasoning, and
the ability to change problem-solving strategies
when needed.
Wisconsin Card SortingTest
Shape
Color
Quantity
No
match
1948
14. Magical Number Seven
George Miller (1956) investigated limitations in
human information processing and determined
that most adults can store between 5 and 9 items
in their working memory.
However, humans can remember more than nine
pieces of information, if the items are grouped
(chunked) into categories.
“My problem is that I have been persecuted by an integer… This
number assumes a variety of disguises, being sometimes a little
larger and sometimes a little smaller than usual, but never
changing so much as to be unrecognizable.”
George A. Miller (1956). “The Magical Number Seven, Plus or Minus Two:
Some Limits on Our Capacity for Processing Information”
1956
14 UXPA Card Sort | IBM CIO Design
15. Memory Coding and Chunking of
Data
During his studies on memory recall, Cohen (1966)
observed that participants “readily detect the
categorized nature of the word lists, store some
coded representation of each category in
memory, and attempt to retrieve this coded
information during recall.”
Humans naturally categorize information into
chunks, according to common properties or
characteristics.
Train
Bus
Glider
Car
Canoe
Tank
Helicopter
Sailboat
Hot air balloon
Motorcycle
Submarine
Land vehicles
Train
Bus
Car
Tank
Motorcycle
Air vehicles
Hot air balloon
Helicopter
Glider
Plane
Water vehicles
Canoe
Sailboat
Submarine
1966
15 UXPA Card Sort | IBM CIO Design
16. Individual Differences
A study by Losche et al. (1991) had participants
group 60 graphical images into categories.
Found a difference between categories graphic
artists and other participants.
In general, participants will not always create the
same categories, nor will they put the same items
items into the same categories.
Need to test a representative sample of end users.
1991
16 UXPA Card Sort | IBM CIO Design
19. X
Card Sort
UXPA Card Sort | IBM CIO Design
Prepare
Execute
Analyze
19 UXPA Card Sort | IBM CIO Design
20. X
Card Sort
UXPA Card Sort | IBM CIO Design
Prepare
1. Pick a Method
2. Build the Card Deck
3. Refine the Card Deck
4. Write Invite + Instructions
5. Debrief Questions
6. Recruit Users
7. Prep & Test the Sort
Execute
1. User Groups Cards
2. User Labels Groups (open)
3. Debrief each User
4. (opt: Iterate & Consolidate)
Analyze
1. Review and Analyze
2. Propose the IA
3. User Validate the IA
20 UXPA Card Sort | IBM CIO Design
22. Open Card Sort
Typically, the right place to start fresh – open!
User’s Groups + Labels - User will create card-
groups, and also label each group they form.
Closed Card Sort
Often used to validate an IA after an open sort
Tester’s Groups + Labels - User will place cards
inside your predetermined, pre-labeled groups.
22 UXPA Card Sort | IBM CIO Design
23. Open Card Sort
Typically, the right place to start fresh – open!
User’s Groups + Labels - User will create card-
groups, and also label each group they form.
Closed Card Sort
Often used to validate an IA after an open sort
Tester’s Groups + Labels - User will place cards
inside your predetermined, pre-labeled groups.
? ? ? ?
…
23 UXPA Card Sort | IBM CIO Design
24. Open Card Sort
Typically, the right place to start fresh – open!
User’s Groups + Labels - User will create card-
groups, and also label each group they form.
Closed Card Sort
Often used to validate an IA after an open sort
Tester’s Groups + Labels - User will place cards
inside your predetermined, pre-labeled groups.
? ? ? ?
…
X Y Z
24 UXPA Card Sort | IBM CIO Design
25. Open Card Sort
Typically, the right place to start fresh – open!
User’s Groups + Labels - User will create card-
groups, and also label each group they form.
Discover patterns and generate ideas about how to
how to organize information
Closed Card Sort
Often used to validate an IA after an open sort
Tester’s Groups + Labels - User will place cards
inside your predetermined, pre-labeled groups.
Reveals the extent of agreement. Verify and
validate categories + labels + add new items.
? ? ? ?
…
X Y Z
26. Open Card Sort
Typically, the right place to start fresh – open!
User’s Groups + Labels - User will create card-
groups, and also label each group they form.
Closed Card Sort
Often used to validate an IA after an open sort
Tester’s Groups + Labels - User will place cards
inside your predetermined, pre-labeled groups.
START Validated
X Y Z
? ? ? ?
…
27. Open Card Sort
Typically, the right place to start fresh – open!
User’s Groups + Labels - User will create card-
groups, and also label each group they form.
Closed Card Sort
Hybrid
Card Sort
Often used to validate an IA after an open sort
Tester’s Groups + Labels - User will place cards
inside your predetermined, pre-labeled groups.
A closed sort ... with
an option to add new groups
X Y Z ?
START Validated
X Y Z
? ? ? ?
…
29. Open Card Sort
Revolutionary
… start new / start over
Generate new Information Architecture ideas
Qualitative analysis with a quantitative boost
Closed Card Sort
Evolutionary
… validate / update an existing structure
Test an existing Information Architecture
Qualitative analysis with a quantitative boost
? ? ? ?
…
X Y Z
29 UXPA Card Sort | IBM CIO Design
30. Open Card Sort
Revolutionary
… start new / start over
Generate new Information Architecture ideas
Qualitative analysis with a quantitative boost
Closed Card Sort
Evolutionary
… validate / update an existing structure
Test an existing Information Architecture
Qualitative analysis with a quantitative boost
? ? ? ?
…
X Y Z
30 UXPA Card Sort | IBM CIO Design
31. Open Card Sort
Revolutionary
… start new / start over
Generate new Information Architecture ideas
Qualitative analysis with a quantitative boost
Tree Test
Evolutionary
… validate / update an existing structure
Test an existing Information Architecture
Quantitative
… sometimes called a ”Reverse Card Sort”
? ? ? ?
… X
Y
Z
Tree
31 UXPA Card Sort | IBM CIO Design
34. X
Y
Z
Tree
? ? ? ?
…
Open
X Y Z
Closed
Mix & Match Methods to get what you need
34 UXPA Card Sort | IBM CIO Design
35. X
Y
Z
Tree
? ? ? ?
…
Open
X Y Z
Closed
OR
New Site / IA
Validated
Validated
Start
Fresh
35 UXPA Card Sort | IBM CIO Design
36. X
Card Sort
UXPA Card Sort | IBM CIO Design
? ? ? ?
…
Open
X
D
E
Tree
Q
Y
M
Tree
P
E
Z
Tree
New Site / IA
Start
Fresh
36 UXPA Card Sort | IBM CIO Design
37. X
Card Sort
UXPA Card Sort | IBM CIO Design
? ? ? ?
…
Open
X
D
E
Tree
Q
Y
M
Tree
P
E
Z
Tree
New Site / IA
Start
Fresh
37 UXPA Card Sort | IBM CIO Design
38. X
Card Sort
UXPA Card Sort | IBM CIO Design
X
Y
Z
Tree
? ? ? ?
…
Open
X
D
E
Tree
Q
Y
M
Tree
P
E
Z
Tree
New Site / IA
Validated
Start
Fresh
38 UXPA Card Sort | IBM CIO Design
39. X
Card Sort
UXPA Card Sort | IBM CIO Design
X
Y
Z
Tree
Q
Y
Z
Tree
Existing Site / IA
Current
Site
Validated
39 UXPA Card Sort | IBM CIO Design
40. X
Card Sort
UXPA Card Sort | IBM CIO Design
X
Y
Z
Tree
? ? ? ?
…
Open
W
D
E
Tree
Q
Y
Z
Tree
Existing Site / IA
Current
Site
START
OVER
Validated
40 UXPA Card Sort | IBM CIO Design
41. X
Card Sort
UXPA Card Sort | IBM CIO Design
X
Y
Z
Tree
? ? ? ?
…
Open
W
D
E
Tree
Q
Y
Z
Tree
Existing Site / IA
X Y Z
Closed
Current
Site
START
OVER
Validated
Validated
41 UXPA Card Sort | IBM CIO Design
45. How many cards?
20 30 50
100
IA Value
45 UXPA Card Sort | IBM CIO Design
46. How many cards?
20 30 50
100
Less than 20
cards is not
typically
insightful
IA Value
46 UXPA Card Sort | IBM CIO Design
47. How many cards?
20 30 50
100
Less than 20
cards is not
typically
insightful
30 to 50 cards is often
the sweet-spot … a lot
of data, but not too
fatiguing
IA Value
47 UXPA Card Sort | IBM CIO Design
48. How many cards?
20 30 50
100
Less than 20
cards is not
typically
insightful
30 to 50 cards is often
the sweet-spot … a lot
of data, but not too
fatiguing
IA Value
More than 50
cards can be
risky. Tired
users don’t give
quality insights.
48 UXPA Card Sort | IBM CIO Design
49. How many cards?
20 30 50
100
Less than 20
cards is not
typically
insightful
30 to 50 cards is often
the sweet-spot … a lot
of data, but not too
fatiguing
100 cards is
doable … but only
in limited
circumstances that
reduce user
fatigue
IA Value
More than 50
cards can be
risky. Tired
users don’t give
quality insights.
49 UXPA Card Sort | IBM CIO Design
50. How many cards?
20 30 50
100
Less than 20
cards is not
typically
insightful
30 to 50 cards is often
the sweet-spot … a lot
of data, but not too
fatiguing
100 cards is
doable … but
only in limited
circumstances
that reduce user
fatigue
IA Value
More than 50
cards can be
risky. Tired
users don’t give
quality insights.
Don’t go
over 100
cards
50 UXPA Card Sort | IBM CIO Design
51. How many cards?
20 30 50
100
Less than 20
cards is not
typically
insightful
30 to 50 cards is often
the sweet-spot … a lot
of data, but not too
fatiguing
100 cards is
doable … but
only in limited
circumstances
that reduce user
fatigue
Don’t go
over 100
cards
More than 50
cards can be
risky. Tired
users don’t give
quality insights.
Bounded by User Fatigue
51 UXPA Card Sort | IBM CIO Design
52. How many cards?
20 30 50
100
Less than 20
cards is not
typically
insightful
30 to 50 cards is often
the sweet-spot … a lot
of data, but not too
fatiguing
100 cards is
doable … but
only in limited
circumstances
that reduce user
fatigue
Don’t go
over 100
cards
More than 50
cards can be
risky. Tired
users don’t give
quality insights.
Bounded by User Fatigue
52 UXPA Card Sort | IBM CIO Design
53. How many cards?
20 30 50
100
Less than 20
cards is not
typically
insightful
30 to 50 cards is often
the sweet-spot … a lot
of data, but not too
fatiguing
100 cards is
doable … but
only in limited
circumstances
that reduce user
fatigue
IA Value
More than 50
cards can be
risky. Tired
users don’t give
quality insights.
Don’t go
over 100
cards
53 UXPA Card Sort | IBM CIO Design
54. How many cards?
20 30 50
100
Less than 20
cards is not
typically
insightful
30 to 50 cards is often
the sweet-spot … a lot
of data, but not too
fatiguing
100 cards is
doable … but
only in limited
circumstances
that reduce user
fatigue
Don’t go
over 100
cards
More than 50
cards can be
risky. Tired
users don’t give
quality insights.
Bounded by User Fatigue
IA Value
54 UXPA Card Sort | IBM CIO Design
55. Find a natural split
Too Many Cards? … Last Resort: Divide into 2 Card Sorts
55 UXPA Card Sort | IBM CIO Design
56. More Fatigue … Less Cards
• Sentences take longer to read & digest
• Complex & Unfamiliar concepts add fatigue
• Time: over 30 minutes will tax attention
• If Unmoderated, users will trail off sooner
• Boring & Uninteresting topics will lead to users
abandoning the sort early.
• 12+ Categories expected
• Tool Complexity yeah … usability matters
Less Fatigue … More Cards
• 1-3 Word Titles: short & clear (use hover help for
examples and clarifying descriptions)
• Easily Understood: simple or an area of the users’
expertise.
• Time: closer to 15 minutes is a good length
• If Moderated, users will try give it extra effort
• Interesting topics will keep users’ attention
• 7 +/- 2 Categories expected
Too Many Cards? … Much better option: Reduce the Fatigue
60. X
Card Sort
UXPA Card Sort | IBM CIO Design
Adobe
Captivate
Adobe Captivate is an authoring
tool for creating eLearning
content with interactive
elements, which you can then
publish to desktops and mobile
devices.
60 UXPA Card Sort | IBM CIO Design
61. X
Card Sort
UXPA Card Sort | IBM CIO Design
Adobe
Captivate
Adobe Captivate is an authoring
tool for creating eLearning
content with interactive
elements, which you can then
publish to desktops and mobile
devices.
The Card Title is the most
important element
… and the only
mandatory piece
61 UXPA Card Sort | IBM CIO Design
62. X
Card Sort
UXPA Card Sort | IBM CIO Design
Adobe
Captivate
Adobe Captivate is an authoring
tool for creating eLearning
content with interactive
elements, which you can then
publish to desktops and mobile
devices.
An Optional Description
can help clarify, and help
keep the Title short
The Card Title is the
most important element
… and the only
mandatory piece
62 UXPA Card Sort | IBM CIO Design
63. X
Card Sort
UXPA Card Sort | IBM CIO Design
Adobe
Captivate
Adobe Captivate is an authoring
tool for creating eLearning
content with interactive
elements, which you can then
publish to desktops and mobile
devices.
An Optional Description
can help clarify, and help
keep the Title short
An Optional Icon
or Pic looks cool
… but can be
dangerous,
distracting users
to sort by visual
style - Be careful
The Card Title is the
most important element
… and the only
mandatory piece
63 UXPA Card Sort | IBM CIO Design
64. Card Labels & Terms
Can we do it all? (in my experience, not usually)
If you can test every item in a catalog or every navigation
item on your site … with its actual wording – great!
… more often, you will need to make choices:
• Wording choices
• Conceptual choices
• Representation choices
Take your time to do this right … it will greatly affect
everything that follows
Kitchen sink
too?
64 UXPA Card Sort | IBM CIO Design
65. Card Labels & Terms … What’s wrong with this deck?
1. Gala Apples
2. Oranges
3. Broccoli
4. Lightlife
5. Produce
6. Lasagnea
7. Bacon
8. Cherimoya
9. Grab’n’Go Sandwiches
10.Ginger Ale
11.Bread
12.Apple Pies
13.Cereal
14.Kellogg’s Cereal Bars,
Assorted Family Pack
15.Canned Soup
16.Salad Bar
17.Beans
18.Breakfast
19.Kellogg's Frosted Flakes
20.Vegetarian Prepared Meals
21.Apple, Honeydew
22.Cakes
23.Grab’n’Go Hot Lunch
24.Popcorn
25.Generic Brands
26.Fruit Filling
27.Orange Fanta
28.Vegetables (frozen)
29.Paper Products (e.g., Toilet
Paper, Paper Towels,
Napkins, etc.)
30.Fresh Salsa
31.Dole Bananas
32.Canned Ravioli
33.Oatmeal
34.On Sale
35.Stuff to serve for a large
group of guests at a dinner
party
36.Pastries
37.Pepsi
38.Fruit Rollups
39.Lipton’s Instant Soup
40.Grab’n’Go Ravioli
41.Bagels
42.Chef Boy’R’Dee
43.Plant-based Bacon
44.Flowers
45.Dole Pineapple Chunks
46.Ramen Noodles
47.Bird’s Eye Stir Fry Mix
48.Pie Crusts
49.Tomatoes
50.Dole Fruit-in-a-Cup
65 UXPA Card Sort | IBM CIO Design
66. Card Labels & Terms … get the Concepts & Wording done right
Concepts
1. Representative sampling – a few items from groups that
you expect, with at least one prototypical example
2. Test the edges – extra cards to represent edge cases that
are non-obvious
3. Right-sized … each card’s topic should not be too broad
OR overly focused
4. Bias - Beware word recognition … cards that all start with
the same word may lead to thoughtless grouping
5. Loners - No need to test a single card that is profoundly
different from all others
6. Absence - Look again for what is missing.
Wording
1. Long sentences & lists on
one card
2. Rare, unknown terms
3. Brand Names, unless they
help describe
4. Awkward language &
misspellings
5. Key attributes must ALL be
conveyed … then let the user
decide
6. Descriptions, use as needed
66 UXPA Card Sort | IBM CIO Design
70. Manual
Easy, tactile, natural – but extra work to analyze
Automated
Usability of the tool can impact fatigue
vs
70 UXPA Card Sort | IBM CIO Design
71. Manual Cards … capture the decks with a picture AND rubber bands
71 UXPA Card Sort | IBM CIO Design
72. Moderated
In Person or Remote
Pro 1 - Observed: You can ask users to speak
aloud, and get a deeper understanding of WHY
sort … and if they misunderstand a label
Pro 2 - Interactive: You can revisit and debrief in
person … and go deeper
Pro 3 - Time: Users will spend more time sorting
Con 1 - Synchronous: 1:1 meetings mean this will
take more time
Unmoderated
Remote
Pro 1 - Asynchronous: LOTS more users can
perform the sort and give you a lot of data, fast
Con 1 - Insight: Harder to observe the users’
reasoning, or to follow-up with additional
debriefing questions
Con 2 - Time: Users will abandon the sort
sooner
vs
72 UXPA Card Sort | IBM CIO Design
73. Post Sort - Revisit
Double Check
As you sort, the categories become clearer …
moment to check your work:
1 – Any cards you want to move?
2 – Any categories seem too large or small?
3 – Are the category names good?
Post Sort - Debrief
Ask for extra insight
As you sort, the categories become clearer
1 – Which items were especially easy to sort?
2 – Which items were difficult to sort?
3 – Which items seemed to belong in two or
more groups?
4 – Why were some items left unsorted?
73 UXPA Card Sort | IBM CIO Design
74. How it’s organized … How it’s labeled
74 UXPA Card Sort | IBM CIO Design
81. Results
Frequency table
• Summarizes the frequency with with each item was
associated with a given category
• Alchemer only presents results in tabular format
Dendrogram
• Visualization of the clustering of similarly organized
cards
• Can adjust minimum strength of the relationships
between items to create more/fewer groupings
• UserZoom displays results using a dendrogram and
other results (table)
81 UXPA Card Sort | IBM CIO Design
96. App Categories
New Categories
Accessibility
File Storage & Sharing
IT Performance
Purchasing & Registration
New
New
New
New
Not a strong category … but I think
this will be important for the PwD
audience
Very strong category … helps
clean up awkward prior categorizations
Very weak category … consider
merging with Cloud Platform and/or
Role: Developer
Good category … potentially could
merge with Assets & Devices, but
would be hard to name
96 UXPA Card Sort | IBM CIO Design
98. Apps: Category Names
New Categories
Assets & Devices
Client Sales & Marketing
Cloud Platform
Collaboration & Teaming
Data & Analytics
HR: Career & Learning
HR: Employee
HR: Management
Productivity
Role: Design
Role: Developer
Security, Access & Backup
Do these extra words help make
categories clearer?
… if not, drop them
I think these cat/subcategory
markers will help users scan the
list (especially if in alpha-order)
We felt we needed to group these
3 items together. Unsure is “Access”
naturally falls under “Security”, etc.
98 UXPA Card Sort | IBM CIO Design
99. Apps: Category Order
Note 2 – there are enough categories
that I would consider keeping them
in alphabetical order for scanability
(order of use can be disorienting).
99 UXPA Card Sort | IBM CIO Design
100. Apps that were difficult to sort
Note 2 – even with our descriptions,
not all users will know the Apps well enough
to make an expert categorization.
100 UXPA Card Sort | IBM CIO Design
101. w3U-Apps that were difficult to sort >15%
101 UXPA Card Sort | IBM CIO Design
102. Apps … Do we agree with user re-Categorizations?
App Name
Red Hat
CIO Hybrid Cloud
FileZilla FTP
Box@IBM
Slack
Mural@IBM
Box Notes
Adobe Photoshop CC
InVision Enterprise
Carbon Design System
GitHub Enterprise
New Relic
Eclipse
Devices@IBM
eAMT Lite Asset Management
Capitol Request Tool (WWCT)
Orca
Jira@IBM
Microsoft PowerPoint
w3 Publisher
Buy@IBM (BonD)
Adobe Acrobat Reader
AccessHub
7-Zip
App Name
Your Career & Learning
Lighthouse
IBM Leadership Academy
IBM Cognos Analysis for Microsoft Excel (CAFE)
BI@IBM Portal
Microsoft Project Standard Edition
1Password@IBM
Cisco Anyconnect Secure Mobility Client
Code42 CrashPlan
IBM Cybersecurity
Update Password
Checkpoint
BCG: Business Conduct Guidelines
Concerns & Appeals
IBM Recognition Center
Jobs: Global Opportunity Marketplace
Professional Marketplace
Travel@IBM: Travel & Expenses
Workday@IBM
AskHR
CV Wizard
IBM Cogni-Pay
Manager Essentials
SalesTools@IBM
BlueMine
Client Success Central (CSC)
Old Category
Cloud
Cloud
Cloud
Collaboration
Collaboration
Collaboration
Collaboration
Design
Design
Design
Development
Development
Development
Devices
Devices
Devices
Devices
Productivity
Productivity
Productivity
Productivity
Productivity
Productivity
Productivity
Old Category
Career & Learning
Career & Learning
Career & Learning
Data & Analytics
Data & Analytics
Data & Analytics
Help & Security
Help & Security
Help & Security
Help & Security
Help & Security
HR & Employee
HR & Employee
HR & Employee
HR & Employee
HR & Employee
HR & Employee
HR & Employee
HR & Employee
HR & Employee
HR & Employee
Management
Management
Sales
Sales
Sales
New Category
Cloud Platform
Cloud Platform
File Storage & Sharing
Collaboration & Teaming
Collaboration & Teaming
Collaboration & Teaming
Collaboration & Teaming
Productivity
Role: Design
Role: Design
Role: Developer
IT Performance
Role: Developer
Assets & Devices
Assets & Devices
Purchasing & Registration
Accessibility
Role: Developer
Productivity
Collaboration & Teaming
Purchasing & Registration
Productivity
Security, Access & Backup
File Storage & Sharing
New Category
HR: Career & Learning
HR: Career & Learning
HR: Career & Learning
Data Analytics
Data Analytics
Productivity
Security, Access & Backup
Security, Access & Backup
Security, Access & Backup
Security, Access & Backup
Security, Access & Backup
HR: Employee
HR: Employee
HR: Employee
HR: Employee
HR: Career & Learning
HR: Career & Learning
HR: Employee
HR: Employee
HR: Employee
HR: Career & Learning
HR: Management
HR: Management
Client Sales & Marketing
Client Sales & Marketing
Client Sales & Marketing
102 UXPA Card Sort | IBM CIO Design
103. w3U-Apps in multiple Categories
Note 3 – some Apps can (and SHOULD)
be put in more than one category
103 UXPA Card Sort | IBM CIO Design
104. w3U-Apps in multiple Categories
Need to crawl through the data & comments to make recommendations
>15%
104 UXPA Card Sort | IBM CIO Design
106. Don’t be afraid to modify research
activities to better answer your specific
research questions
On Demand Workplace example
• Designing the first user configurable w3 homepage
• There were over two dozen “porlets” that contained
• Research question: “What is the best default layout of
portlets that would satisfy most users’ needs?”
Modified card sort
• Created a blank homepage canvas
• Created “cards” for each portlet
• Participants arranged according to their preference
• The average position of each portlet was calculated to
decide its default location on the page
106 UXPA Card Sort | IBM CIO Design
107. Card Sort
Reverse card sorting
• Validating an existing structure of categories and sub-
categories
• Users are given tasks (e.g., locate the Mango card) and
asked to complete them navigating a collection of
• Evaluates the categories and structure in isolation,
mitigating the effects of navigational aids, visual design,
other factors.
Modified-Delphi card sorting
• the first participant does a full card sort of organizing
arranging items
• The next participant iterates on the first participant's
then the third participant iterates on the second's
and so on.
• The idea is that with each iteration the card sort gets
refined with fewer participants and consensus is built
sooner.
118. Survey platform When to use it? Setup of survey Number of
categories
Layout Analysis, reporting and
data
Optimal
Sort
All types of surveys. Usability tests
and unmoderated).
Card sort feature is more advanced and
automated.
Great for closed sorts with large number of
items or open sorts if expect less than 12
categories.
Easier to use
Little stats knowledge needed and no SPSS
as creates dendrograms
Both open and closed
sorts.
Easy to setup.
Automatic fields for
descriptions and
Automatic post-sort
questions (difficulty &
more than 1 category).
Unlimited for both
open and closed
sorts.
Cannot specify number
of columns in sort task.
No layout limitations,
page scrolls up nicely
items remain in view for
participant.
Dendrograms,
participant summary,
card and category
frequency summaries,
similarity grid (% of
respondents classified
item under each
category).
Can export to Excel and
SPSS.
User
Zoom
All types of surveys. Usability tests
and unmoderated).
Card sort feature is more advanced and
automated.
Great for closed sorts with large number of
items or open sorts if expect less than 12
categories.
Easier to use
Little stats knowledge needed and no SPSS
as creates dendrograms
Both open and closed
sorts.
Easy to setup.
Automatic fields for
descriptions and
Automatic post-sort
questions (difficulty &
more than 1 category).
Max of 12 for
open sort.
No limit for closed
sort.
Cannot specify number
of columns in sort task.
No layout limitations,
page scrolls up nicely
items remain in view for
participant.
Dendrograms,
participant summary,
card and category
frequency summaries,
similarity grid (% of
respondents classified
item under each
category).
Can export to Excel and
SPSS.
119. Survey platform When to use it? Setup of survey Number of
categories
Layout Analysis, reporting and
data
Userlytics
All types of surveys. Usability tests
and unmoderated).
Useful for open and closed card sorts
Records participants and screen as video
they do the task
Both open and closed
sorts.
-Easy to setup
-Does not appear to
support image uploads
-Must manually enter
item descriptions.
Must create post-sort
questions yourself
Unlimited for both
open and closed
sorts.
Cannot specify number
of columns in sort task.
No layout limitations,
page scrolls up nicely
items remain in view for
participant.
-Frequency table of
items to categories
-Category report that
explains best option for
each item, tells items
did not quite fit but
correlation of where
could go (warning
for items did not fit
anywhere with low
correlations).
-AI algorithm
recommends where
item could fit best
Alchemer
All types of surveys, however card sort
more rudimentary and requires more
manual entries.
Useful for open sort if expect > 12 categories
however display issues.
Good knowledge of stats and data (cluster
analysis).
Both open and closed
sorts
Can customize font
and styles.
Must manually enter
descriptions.
Must create post-sort
questions yourself
(difficulty & more than
category).
Unlimited for both
open and closed
sorts.
Can customize number
columns in sort task.
Layout limitations when
sorting many items i.e. >
30, participant must
down the page due to
layout limits and items
get out of view for
participant.
Frequency table only
no dendrograms.
Can export to Excel
SPSS.
+
168. Optimal Sort card sort exercise –setup
Card Sort
UXPA 2022, San Diego
Using Optimal Sort create an open sort survey for the following 30 items to determine the best
categories for the CNN.com website.
• Latest US news
• Crime and Justice
• Extreme weather
• Africa
• US election
• Biden Presidency
• Media
• Fitness
• Markets
• Tech
• Social Commentary
• Sleep
• Food
• Relationships
• Screen
• Stars
• Culture
• Space and Science
• Investing
• Retirement
• Work transformed
• Success
• Covid
• Real estate
• Innovative cities
• Energy
• Money
• Cars
• Homes
• Risk takers
169. Optimal Sort Card sort exercise –Dendrogram for items
Card Sort
UXPA 2022, San Diego
Agreement
100% 0%
Latest US news
US Election
Biden Presidency
Crime and Justice
Extreme weather
Covid
Sleep
Food
Relationships
Fitness
Work transformed
Success
Risk takers
Retirement
Money
Markets
Investing
Real estate
Homes
Cars
Tech
Space and Science
Energy
Innovative cities
Social Commentary
Culture
Africa
Media
Screen
Stars
170. Optimal Sort Card sort exercise –Dendrogram for categories
Card Sort
UXPA 2022, San Diego
Agreement
100% 0%
US news
US politics
National News
Local news
Culture
International News
Environment
Earth
Health and Wellness
Lifestyle
Life
Career
Jobs
Personal opinion
Consumer
Home products
Science and Tech
Innovation
Technology
Finance
Money
Investing
Entertainment
TV and Film
173. Alchemer Open Card Sort Setup
Select open card
sort from
question type.
Enter question,
items to sort and
their font size
and style.
Enter items to
sort and their
font size and
style.
Card Sort
UXPA 2022, San Diego
174. Alchemer Open Card Sort Setup
Can customize
layout- number
of columns and
ordering.
Card Sort
UXPA 2022, San Diego
175. Alchemer Open Card Sort Setup
Can ask
participants about
difficulty and items
that were difficult
to sort.
Can ask
participants about
items they wanted
to sort into more
than one category.
Card Sort
UXPA 2022, San Diego
176. Alchemer Open Card Sort Preview
Welcome
page
Card Sort
UXPA 2022, San Diego
177. Alchemer Open Card Sort Preview
Participant asked to
sort the items into as
many categories as
they want.
Recommended is 30-
50 items per open
sort.
Card Sort
UXPA 2022, San Diego
178. Alchemer Open Card Sort Preview
Participant drags
items from the left
side to create a new
category then can
type in the name.
Participant drag
additional items that
fit that category
below the other
items.
Pros: participant
can create as
many categories
as they want.
Cons: Participant
must scroll down
the page due to
layout limits and
items can get out
of view.
Card Sort
UXPA 2022, San Diego
179. Alchemer Open Card Sort Preview
Pros: participant
can create as
many categories
as they want.
Cons: Participant
might have to scroll
down the page due
to layout limits and
items can get out
of view.
Card Sort
UXPA 2022, San Diego
180. Alchemer Card Sort Analysis of Results and Dendrograms
Frequency table from
open card sort, must
combine categories that
participants named into
meaningful category
names, this involves
domain domain and
looking at the table.
Alchemer only
provides a frequency
table of items by
category and no
Dendrograms. Must
create Dendrograms
yourself using
hierarchical cluster
analysis.
Card Sort
UXPA 2022, San Diego
181. Alchemer Card Sort Analysis of Results and Dendrograms
Copy frequency
data in SPSS and
run hierarchical
cluster analysis to
create Dendrogram
plot.
Card Sort
UXPA 2022, San Diego
182. Alchemer Card Sort Analysis of Results and Dendrograms
Category names are
labels and sorted
items are variables.
Select statistics,
plots, method for
further selections.
Card Sort
UXPA 2022, San Diego
183. Alchemer Card Sort Analysis of Results and Dendrograms
Statistics Plots Methods
Card Sort
UXPA 2022, San Diego
184. Alchemer Card Sort Analysis of Results and Dendrograms
This shows the
distance of the items,
the closer the
distance the stronger
the association or
grouping.
Collaboration
& teaming
Role:
Design Assets &
Devices
Cloud
platform
File
storing &
sharing
Domain
knowledge helps
to know that
Orca shown on
its own can pair
with Github as
developer also
shown on its
own.
Card Sort
UXPA 2022, San Diego
187. Alchemer Card Sort Analysis of Results and Dendrograms
Can manually create
question asking about
items that were difficult
to sort –gives insight
into renaming
items/categories
Verbatims help
understand the reason
an item was difficult to
sort
Card Sort
UXPA 2022, San Diego
188. Alchemer Card Sort Analysis of Results and Dendrograms
Verbatims help
understand the reason
an item could be placed
into more than one
category
Can manually create
question asking about
items that could be
placed into more than
one category–gives
insight into renaming
items/categories
Card Sort
UXPA 2022, San Diego
189. Alchemer Closed Card Sort Setup
Enter question
Enter Category
names
Enter items
Card Sort
UXPA 2022, San Diego
190. Alchemer Closed Card Sort Setup
Participant
drags items
from left into
predefined
categories.
Card Sort
UXPA 2022, San Diego
191. Alchemer Closed Card Sort Setup
Drawback is the
layout and scrolling
down the page that
may be required for
the participant if large
number of items
placed into single
category.
Card Sort
UXPA 2022, San Diego
192. Alchemer Card Sort Analysis of Results and Dendrograms
Alchemer only
provides a frequency
table of items by
category and no
Dendrograms. Must
create Dendrograms
yourself using
hierarchical cluster
analysis.
Card Sort
UXPA 2022, San Diego
193. Alchemer Card Sort Analysis of Results and Dendrograms
This shows the
distance of the items,
the closer the
distance the stronger
the association or
grouping.
Collaboration
& teaming
Role:
Design Assets &
Devices
Cloud
platform
File
storing &
sharing
Domain
knowledge helps
to know that
Orca shown on
its own can pair
with Github as
developer also
shown on its
own.
Card Sort
UXPA 2022, San Diego
195. Alchemer card sort exercise –setup
Card Sort
UXPA 2022, San Diego
Using Alchemer create an open sort survey for the following 30 items to determine the best
categories for the Wells Fargo banking website.
• Checking
• Credit cards
• Investing
• Savings
• Business Resources
• Payroll Services
• Wealth Management
• Commercial Capitol
• Middle Market Banking
• Commercial Real Estate
• Global Treasury Management
• Global Services
• Auto Loans
• Savings and CDs
• Education and Tools
• Home Loans
• Merchant Services
• Lines and Loans
• Insights and Reports
• Insights and Economics
• Everyday checking
• Prime Checking
• Refinance your mortgage
• Online trading
• Money management
• Way2Save Savings
• Equities
• Asset backed finance
• Business line of credit
• Payment processing options
196. Alchemer Card sort exercise –Dendrogram for items
Card Sort
UXPA 2022, San Diego
Agreement
100% 0%
Checking
Everyday Checking
Prime checking
Savings
Savings and CDs
Way2Save Savings
Credit cards
Auto loans
Home loans
Refinance mortgage
Education and tools
Investing
Online trading
Wealth management
Merchant Services
Lines and Loans
Payroll Services
Business Resources
Business Line of Credit
Payment processing options
Commercial Capitol
Middle Market Banking
Equities
Asset Backed Finance
Commercial Real Estate
Global treasury Management
Global Services
Insights and Reports
Insights and Economics
197. Alchemer Card sort exercise –Dendrogram for categories
Card Sort
UXPA 2022, San Diego
Agreement
100% 0%
Personal
Personal banking
Everyday banking
Daily banking
My banking
Investing
Wealth management
Trading
Small business
Retailers
Businesses
Large business banking
Large business finance
Commercial banking
Commercial finance
Non personal banking
Corporate banking
Investment banking
Corporate finance
Real estate
Global services
Global banking
Insights and reports
Economic reports and insights
200. Userlytics Open Card Sort Setup
User must
select
create new
study
User must
select
unmoderated
study
User must give name
to study, a starting
webpage, max session
time, and study
language
User must select
participant device,
recording method,
participant source, number
of participants, other
recruiting demographics
Card Sort
UXPA 2022, San Diego
201. Userlytics Open Card Sort Setup
User must
select card
sort.
User must
enter in
card names
in card tab.
User must
select open
sort.
User can
preview their
study in
preview
mode.
User can
randomize
the cards
User can edit
instructional
text
Card Sort
UXPA 2022, San Diego
202. Userlytics Open Card Sort Setup
To test the study in
the participant mode,
user must install a
browser extension
(for the video
recording and web
link).
User can
test the card
sort in
participant
mode.
Card Sort
UXPA 2022, San Diego
203. Userlytics Open Card Sort Setup
Participant is
first prompted
that screener
questions may
be presented
Participant is
shown the
webpage or
application that
is being tested
from the link
provided
Participant must
click get started
link to begin card
sort and start
recording.
Participant
must click the
box to create
new category
Participant must type
in category name then
click add and drag
items from left side
into the category
Card Sort
UXPA 2022, San Diego
204. Userlytics Closed Card Sort Setup
User must
input card
names in card
tab.
User can
preview
the card
sort.
User can
preview the
card sort
Card Sort
UXPA 2022, San Diego
205. Userlytics Closed Card Sort Setup
User must
select card
sort
User must
input category
names in
category tab.
User can
add new
category
User can
randomize
category
names
Card Sort
UXPA 2022, San Diego
206. Userlytics Closed Card Sort Setup
User can test
the card sort
in participant
mode.
Participant is
shown the
webpage or
application that
is being tested
from the link
provided
Participant must
click get started
link to begin card
sort and start
recording.
Participant drag items
from left side into the
appropriate category.
Card Sort
UXPA 2022, San Diego
207. Userlytics Analysis of Results
Card Sort
UXPA 2022, San Diego
Find the metrics
option from the
Userlytics
dashboard
Click on the card
sorting task within
your test to view the
detailed metrics from
participant’s results
208. Userlytics Analysis of Results
Card Sort
UXPA 2022, San Diego
Card report shows
how participants
sorted each card or
item, gives category
% item falls into –
this item is clearly
better in the ”drinks
"cards category.
Three types of
analysis of
participant results –
Cards, Categories
and
Recommendations
209. Userlytics Analysis of Results
Card Sort
UXPA 2022, San Diego
Category gives
information about
any categories
participants created
and the % of cards
listed under each
category.
Lets you know what cards
were placed in each
category by the majority of
participants and which cards
were placed in each
category at least once.
210. Userlytics Analysis of Results
Card Sort
UXPA 2022, San Diego
Clicking on any of these
metrics will expand and give
greater detail on the % of
participants that placed
specific cards in each
category
211. Userlytics Analysis of Results
Card Sort
UXPA 2022, San Diego
“View as Table” shows the number of
participants that placed each card
within a given category. Red color
indicates all participants placed card in
same category, colors appear lighter as
fewer participants place cards within
specific category.
212. Userlytics Analysis of Results
Card Sort
UXPA 2022, San Diego
Recommendations gives
recommendations on
categories and cards that
should be considered
removed or revisited.
Algorithm creates warnings
for specific cards and
categories that may need to
be removed or renamed as
have minimal data to
support them.
213. Userlytics card sort exercise –setup
Card Sort
UXPA 2022, San Diego
Using Userlytics create an open sort survey for the following 30 items to determine the best
categories for the eBay website.
• Women’s winter gloves
• Men’s ties
• Refurbished Macbook Pro
• Speed boat
• iPhone 7
• Fitbit
• Cabbage patch kids doll
• Superman comic book
• Cookware
• Sun tan lotion
• GPS device
• Caliper
• Patio furniture
• Snowmobile parts
• Drone
• Men’s belt
• Motorcycle
• HDMI cord
• Body fat scale
• Star Wars Han Solo figurine
• Blender
• Women’s handbag
• Skin care for women
• Vitamins
• Electric toothbrush
• Hedge trimmer
• Scrabble board game
• Dyson vacuum cleaner
• Chain saw
• Men’s wallet
214. Women’s winter gloves
Men’s ties
Men’s belt
Women’s handbag
Men’s wallet
Skin care for women
Sun tan lotion
Vitamins
Patio furniture
Hedge trimmer
Snowmobile parts
Chain saw
Motorcycle
Speed boat
Dyson vacuum cleaner
Electric toothbrush
Blender
Cookware
Refurbished Macbook Pro
iPhone 7
HDMI cord
Fitbit
GPS device
Caliper
Body fat scale
Cabbage patch kid’s doll
Star Wars Han Solo figurine
Scrabble board game
Superman comic book
Drone
Userlytics Card sort exercise –Dendrogram for items
Card Sort
UXPA 2022, San Diego
Agreement
100% 0%
215. Userlytics Card sort exercise –Dendrogram for categories
Card Sort
UXPA 2022, San Diego
Agreement
100% 0%
Clothes
Men’s clothes
Women’s clothes
Accessories
Men’s accessories
Women’s accessories
Health and beauty
Lotion
Outdoor furniture
Home products
Kitchen products
Motorized vehicles
Transport
Outdoor and leisure
Equipment
Home equipment
Fitness
Health and fitness
Gadgets
Mobile devices
Technology
Computers and accessories
Electronic products
Games
Board games
Children’s toys
Toys and games
218. User Zoom Open Card Sort Setup
Set up is
straight forward
and wizard like.
Choose
create new
project.
Choose
unmoderated.
Choose
card sort.
Choose
both
desktop &
tablet.
Card Sort
UXPA 2022, San Diego
219. User Zoom Open Card Sort Setup
Name project
and provide
description.
Card Sort
UXPA 2022, San Diego
220. User Zoom Open Card Sort Setup
Can invite own
participants,
specify number
and get survey
link.
Card Sort
UXPA 2022, San Diego
221. User Zoom Open Card Sort Setup
Enter in welcome
page, review
legal consent,
and enter in any
other survey
questions such as
demographics
etc.
Enter in task
description
Choose
range of
categories,
max is 12.
Select ask for
category
description and
names.
Best to order
randomly
Choose open
categories
Card Sort
UXPA 2022, San Diego
222. User Zoom Open Card Sort Setup
Insert each item on
separate line, click
create.
Can add in
description and
image easily.
Card Sort
UXPA 2022, San Diego
223. User Zoom Open Card Sort Preview
Welcome page,
privacy consent
and
demographic
questions.
Card Sort
UXPA 2022, San Diego
224. User Zoom Open Card Sort Preview
Instructions are
very detailed
and clear.
Card Sort
UXPA 2022, San Diego
225. User Zoom Open Card Sort Preview
Drag items from
left to grey boxes
to create category
or place into a
category.
Hovering cursor
over the “i” gives
item description.
Type inside
category name field
to give category a
name.
Card Sort
UXPA 2022, San Diego
226. User Zoom Open Card Sort Set 1 data –Dendrograms from 33 respondents and 168
cases for items
File
sharing/storage
Productivity
software
Cloud software
Design software
Asset
management/purchase
Collaboration/project
management
Card Sort
UXPA 2022, San Diego
227. User Zoom Open Card Sort Set 1 data –Dendrogram open categories
228. User Zoom Open Card Sort Set 1 data -Difficulty
Card Sort
UXPA 2022, San Diego
229. User Zoom Open Card Sort Set 1 data -Difficulty
Card Sort
UXPA 2022, San Diego
230. User Zoom Open Card Sort Set 1 data –More than one category
Card Sort
UXPA 2022, San Diego
231. User Zoom Open Card Sort Set 1 data –More than one category
Card Sort
UXPA 2022, San Diego
232. User Zoom Closed Card Sort Setup
Enter in welcome
page, review
legal consent,
and enter in any
other survey
questions such as
demographics
etc.
Select closed
categories
Best to order
randomly
First start by
adding in
category
names.
Card Sort
UXPA 2022, San Diego
233. User Zoom Closed Card Sort Setup
Add category
names
Add item
names
Card Sort
UXPA 2022, San Diego
234. User Zoom Closed Card Sort Setup
Add
descriptions of
categories.
Add
descriptions of
items.
Add images for
items.
235. User Zoom Closed Card Sort Preview
Task
instructions are
very clear.
Card Sort
UXPA 2022, San Diego
236. User Zoom Closed Card Sort Preview
Drag items
from left into
categories on
right.
Scrolling items
prevents items
from going out
of view and can
accommodate a
lot of items.
Hover over “i”
to get more
description of
item.
Card Sort
UXPA 2022, San Diego
237. User Zoom Closed Card Sort Preview
Post-task
questions are
automatically
generated.
Card Sort
UXPA 2022, San Diego
238. The researcher can adjust
the threshold of
agreement between
items to create clusters
depending on how many
they want.
User Zoom Card Sort Analysis of Results and Dendrograms
File storing
and sharing
Cloud
This scale shows the
% of agreement
between the items,
the higher % the less
they form the same
cluster.
Client sales
and
marketing
Collaboration
and teaming
Role: Design
HR
management
Data and
analytics
Role developer
239. User Zoom Card Sort Analysis of Results and Dendrograms
The similarity matrix
further helps
establish clusters
between items, the
darker color shows
more clustering.
Card Sort
UXPA 2022, San Diego
244. Card Sort
Open card sort
• Participants create their own labels for categories
• Used to discover patterns in how participants
which in turn helps generate ideas for organizing
information
• Can be an open number of buckets or a fixed
Closed card sorting
• Set of predetermined category names.
• Assign the cards to the fixed categories
• Reveals the extent of agreement on which cards
under each category
• Typically used to verify and validate category
add new items into an existing taxonomy
Apple
Asparagus
Cantaloupe
Carrot
Eggplant
Broccoli
Cheese
Orange
Pear
Potato
Mango
Zucchini
Eggs
Breakfast Lunch
Dinner Snack
245. Card sorting is used in defining and designing the information
architecture, workflows, menu structure, or web site navigation
paths.
A card sort is often used when designing a navigation structure for
an application or environment that offers a variety of content and
functions (i.e., website).
The way the items are organized should make sense to the target
audience.
If an accepted and standardized taxonomy exists for a subject
(biological taxonomy, Dewey Decimal), it would be natural to apply
that taxonomy.
Information Architecture
Presentation title
IBM | Project/team name
246. No existing taxonomy is available to organize the items.
The variety of items to organize is too large and/or diverse to
into conventional categories.
Similarities among the items make them difficult to divide
clearly into categories.
User groups differ in how they view the similarities among
the appropriate groupings of items.
When to use card sorting
Presentation title
IBM | Project/team name
247. Tools
Moderated/In person
• Benefit of discussing choices to understand the logic
the categories
• Use web-based tools (UserZoom, Alchemer) or physical
assets (cards)
Unmoderated/Remote
• Web based tools (UserZoom, Alchemer)
• Opportunity for larger number of participants in less
• Lose the context and logic for participants’
decisions
247 UXPA Card Sort | IBM CIO Design
248. Variations on the Card Sort
The occupational card sort is a technique used by
career counselors the people with present or
future vocational choices. Sort jobs cards into
three piles: Might Choose, Probably Would Not
Not Choose, or Undecided.
Like a rating scale, however instead of adding a
a rating to an object, you move the object to the
rating/bucket.
Similarly, a 1967 study was designed to
understand individual differences in reactions to
taking LSD. Participants rated their level of
enjoyment for each of 156 common LSD
experiences (written on cards). They added a card
to one of five groups according to how much they
they did, or did not, like the experience.
1967
248 UXPA Card Sort | IBM CIO Design
249. Neuropsychological Testing
California Verbal Learning Test (1987)
measures episodic verbal learning and
Participants are read a list of 16 words, each
belonging to four semantic categories (tools,
fruits, clothing, spices and herbs).
People with advanced abstract reasoning
categorize the words as a memory
1987
249 UXPA Card Sort | IBM CIO Design
250.
251.
252.
253. Card Sort
Open card sort
• Participants create their own labels for categories
• Used to discover patterns in how participants
which in turn helps generate ideas for organizing
information
• Can be an open number of buckets or a fixed
Closed card sorting
• Set of predetermined category names.
• Assign the cards to the fixed categories
• Reveals the extent of agreement on which cards
under each category
• Typically used to verify and validate category
add new items into an existing taxonomy
Apple
Asparagus
Cantaloupe
Carrot
Eggplant
Broccoli
Cheese
Orange
Pear
Potato
Mango
Zucchini
Eggs
Breakfast Lunch
Dinner Snack
254. (Open) Card Sort
Participants sort “cards” and place them in
categories that make sense to them.
1. A representative user receives a randomized
set of cards with terms (and sometime
definitions)
2. The participant groups the terms in according
to what is logical and meaningful
3. The participant then labels the category
4. This process is repeated this for several group
of test participants
5. The results are analyzed to uncover and
patterns that emerge
Apple
Asparagus
Cantaloupe
Carrot
Eggplant
Broccoli
Cheese
Orange
Pear
Potato
Mango
Zucchini
Eggs
Fruits Vegetables
Foods I don’t like Misc
Card Sort
UXPA Card Sort | IBM CIO Design
255. X
Card Sort
UXPA Card Sort | IBM CIO Design
X
Y
Z
Tree
X
Y
Z
Tree
? ? ? ?
…
Open
X Y Z
Closed
X Y Z
Closed