SlideShare a Scribd company logo
Knowledge Elicitation
Concept Sorting
Knowledge Elicitation (Introduction)
• Knowledge Elicitation is the process of acquiring knowledge about a
specific domain.
• It is one of the most important and a crucial task of the development of an
expert system since it directly has an impact on the overall quality of the
system.
• Knowledge elicitation is also often viewed as the bottleneck in the
development of expert systems or knowledge based systems as it is difficult
and time consuming activity.
• Among various known Knowledge Elicitation techniques available choice to
be used depends on the nature of the situation within which the
knowledge is elicited, the domain knowledge and availability of experts.
Knowledge Elicitation (Introduction) Cont…
• Knowledge Elicitation process gets tricky as the vast amount of information
is often kept inside the heads of domain experts.
• This makes the entire process complicated as the domain experts may not
be willing to disclose the information, due to worries of being sidelined or
becoming less important or getting redundant.
• There are various techniques used in the Knowledge Elicitation process :
• Interview
• Protocol Analysis
• Laddering
• Concept Sorting (Will be discussing)
• Repertory Grid
• Structural Assessment
When to use which technique?
• For Knowledge identification
• Unstructured interview, laddering
• For Knowledge specification
• Domain schema: Concept Sorting, repertory grid
• Template selection: self report
• Task & inference knowledge: self report
• For Knowledge Refinement
• Structured interview
What is Concept Sorting ?
• Concept sorting is a psychological technique that is useful in tapping
organization knowledge.
• It a way of finding out how an expert compares, orders concepts and relates
among a set of concepts.
• Used to capture conceptual knowledge and tacit knowledge.
• Can also sort objects or pictures instead of cards
• It works best on small group.
• Simple to apply
• Its is also Called Card Sorting.
• Simplest form is Concept Sorting
• Collection of concepts (or other knowledge objects) are written on separate cards
• Cards sorted into piles by an expert in to piles - each card in a pile must have something
in common
• Each time the cards are sorted it will be based on an attribute and each pile will
represent a value
Concept Sorting – How To ?
• To apply this technique , the KE follows the following steps:
1- First , KE Decide what classes of concepts he/she want to explore
(in particular their properties – attributes and values).
2- Consults a textbook, training manual, or in-house domain expert to
identify the major top-level concepts represented in the domain.
3- Place write the name of each concept on a separate note card .
4- Next, the KE asks the domain expert to begin sorting these cards
placing them in groups according to those that belong together.
5- As the domain expert sorts the cards the KE uses questioning
techniques to determine why they are placed together.
6- Repeat steps 4, and 5 until the expert can’t sort anymore
Example 1: Classification based of Habitat
Star
Fish
Bear
Cat Shark
Deer
Seahorse
Crab
Crocodile
Frog
Elephant
Dolphin
Example 1: Classification based of Habitat
Cont…
Dolphin
Aquatic Animals
ns
Terrestrial Animal
Star
Fish
Bear
Cat
Shark
Elephant
Deer
Seahorse
Crab
Crocodile
Frog
Amphibia
Card Habitat Size Eating Habit Vertebrate / Invertebrate
Mammals/
Non Mammals
Elephant 1 3 1 1 1
Cat 1 1 3 1 1
Deer 1 2 1 1 1
Bear 1 3 3 1 1
Crab 2 1 2 2 2
Crocodile 2 3 2 1 2
Frog 2 1 2 1 2
Dolphin 3 2 3 2 1
Starfish 3 1 3 2 2
Sea Horse 3 1 3 1 2
Shark 3 3 2 1 2
1-Teresstrial 1-Small 1-Herbivorous 1-Vertebrate 1-Mammals
2- Amphibia 2-Medium 2-Carnivorous 2-Invertebrate 2-Non-mammal
3-Aquatic 3-Large 3-Omnivorous
Example 2
• The Number of 15 models of cars may be grouped into two categories named “Foreign"
and “Domestic
• Then re-sorted into three categories; “Sedan" , “Hatchback", and “Sports";
• Then re-sorted into four categories; " Expensive Domestic", " Less Expensive Domestic",
" Expensive Foreign", “Less Expensive Foreign“.
• A hierarchy tree may be created expressing the group categories as levels within the
hierarchy.
Based on Cost
Based on Design and
Performance
Based on Design and
Performance
Based on Cost
Example 2 Cont…
Domestic
Cars
Foreign
Less Expensive
Expensive SedanHatchback Sports
Less Expensive
ExpensiveSedanHatchback Sports
Application of Concept Sorting
• Concept sorting is basically used in several disciplines like
- Knowledge Engineering
- Psychology
- Marketing etc.
Pros and Cons
• Pros
• Fast to apply and easy to analyze
• Often instructive to the expert in a sense that it may lead expert to see
structure that he himself has not consciously articulated before
• Time saving by not having to transcribe and analyze lengthy verbal reports
• Can be used for images and objects as well
Pros and Cons Cont…
• Cons
• Experts can often confound dimensions by not consistently applying the same
semantic distinctions throughout an elicitation session
• May face problem in categorization of elements in meaningful way
Conclusion
• Card Sorting techniques provide a means of achieving a more focused
or systematic understanding of the classifications and relationships in
the expert's domain.
Reference
http://liris.cnrs.fr/amille/enseignements/MasterCode/IC_IA/Session1_
2008/commonkads/06-km-process.ppt
http://www.cse.aucegypt.edu/~rafea/csce485es/slides/ch.10.pdf
http://studentnet.cs.manchester.ac.uk/ugt/COMP34512/slides/day2.p
df
http://academic.cankaya.edu.tr/~agorur/AI/lect/knowledge.html

More Related Content

Similar to Knowledge Elicitation Techiniques Concept Sorting

Jeff Lopez - To Affinity and Beyond
Jeff Lopez - To Affinity and BeyondJeff Lopez - To Affinity and Beyond
Jeff Lopez - To Affinity and Beyond
Agile Impact Conference
 
Jeff Lopez - To Affinity and Beyond
Jeff Lopez - To Affinity and BeyondJeff Lopez - To Affinity and Beyond
Jeff Lopez - To Affinity and Beyond
Agile Impact
 
!#$&()&#+,$)!#$$&())• +,-.$0$12,#-34-$#3.docx
!#$&()&#+,$)!#$$&())• +,-.$0$12,#-34-$#3.docx!#$&()&#+,$)!#$$&())• +,-.$0$12,#-34-$#3.docx
!#$&()&#+,$)!#$$&())• +,-.$0$12,#-34-$#3.docx
katherncarlyle
 
Game Design 2: Expert Evaluation of User Interfaces
Game Design 2: Expert Evaluation of User InterfacesGame Design 2: Expert Evaluation of User Interfaces
Game Design 2: Expert Evaluation of User InterfacesDavid Farrell
 
Information Architecture. Card Sorting
Information Architecture. Card SortingInformation Architecture. Card Sorting
Information Architecture. Card Sorting
DCU_MPIUA
 
Expert systems
Expert systemsExpert systems
Expert systems
Dr. C.V. Suresh Babu
 
KAI, the Information Specialist
KAI, the Information SpecialistKAI, the Information Specialist
KAI, the Information Specialist
aik762
 
Introduction to Machine Learning
Introduction to Machine LearningIntroduction to Machine Learning
Introduction to Machine Learning
Rahul Jain
 
data analysis.pptx
data analysis.pptxdata analysis.pptx
data analysis.pptx
HanaKassahun1
 
data analysis.ppt
data analysis.pptdata analysis.ppt
data analysis.ppt
HanaKassahun1
 
The Art of Project Estimation
The Art of Project EstimationThe Art of Project Estimation
The Art of Project Estimation
Return on Intelligence
 
Team dynamics: The Joys and Sorrows of Diverse Teams by Rebecca Parsons, CTO,...
Team dynamics: The Joys and Sorrows of Diverse Teams by Rebecca Parsons, CTO,...Team dynamics: The Joys and Sorrows of Diverse Teams by Rebecca Parsons, CTO,...
Team dynamics: The Joys and Sorrows of Diverse Teams by Rebecca Parsons, CTO,...
Thoughtworks
 
Using an Agile Inception to Kick Off a Project
Using an Agile Inception to Kick Off a ProjectUsing an Agile Inception to Kick Off a Project
Using an Agile Inception to Kick Off a Project
Victor Bonacci
 
eSource Stakeholders Group 18mar2016
eSource Stakeholders Group  18mar2016eSource Stakeholders Group  18mar2016
eSource Stakeholders Group 18mar2016
Michael Ibara
 
Managing your Metadata w/ SharePoint 2010
Managing your Metadata w/ SharePoint 2010Managing your Metadata w/ SharePoint 2010
Managing your Metadata w/ SharePoint 2010
vman916
 
Requirements Management Part 1 - Management and Elicitation
Requirements Management Part 1 - Management and ElicitationRequirements Management Part 1 - Management and Elicitation
Requirements Management Part 1 - Management and ElicitationMohamed Shaaban
 
MIS Unit-2.pptx
MIS Unit-2.pptxMIS Unit-2.pptx
MIS Unit-2.pptx
ZulfequarAliAhmad
 
Sdec11.agile ina day
Sdec11.agile ina daySdec11.agile ina day
Sdec11.agile ina day
sdeconf
 

Similar to Knowledge Elicitation Techiniques Concept Sorting (20)

Jeff Lopez - To Affinity and Beyond
Jeff Lopez - To Affinity and BeyondJeff Lopez - To Affinity and Beyond
Jeff Lopez - To Affinity and Beyond
 
Jeff Lopez - To Affinity and Beyond
Jeff Lopez - To Affinity and BeyondJeff Lopez - To Affinity and Beyond
Jeff Lopez - To Affinity and Beyond
 
!#$&()&#+,$)!#$$&())• +,-.$0$12,#-34-$#3.docx
!#$&()&#+,$)!#$$&())• +,-.$0$12,#-34-$#3.docx!#$&()&#+,$)!#$$&())• +,-.$0$12,#-34-$#3.docx
!#$&()&#+,$)!#$$&())• +,-.$0$12,#-34-$#3.docx
 
Game Design 2: Expert Evaluation of User Interfaces
Game Design 2: Expert Evaluation of User InterfacesGame Design 2: Expert Evaluation of User Interfaces
Game Design 2: Expert Evaluation of User Interfaces
 
Information Architecture. Card Sorting
Information Architecture. Card SortingInformation Architecture. Card Sorting
Information Architecture. Card Sorting
 
Expert systems
Expert systemsExpert systems
Expert systems
 
KAI, the Information Specialist
KAI, the Information SpecialistKAI, the Information Specialist
KAI, the Information Specialist
 
Lecture - Data Mining
Lecture - Data MiningLecture - Data Mining
Lecture - Data Mining
 
Introduction to Machine Learning
Introduction to Machine LearningIntroduction to Machine Learning
Introduction to Machine Learning
 
data analysis.pptx
data analysis.pptxdata analysis.pptx
data analysis.pptx
 
data analysis.ppt
data analysis.pptdata analysis.ppt
data analysis.ppt
 
The Art of Project Estimation
The Art of Project EstimationThe Art of Project Estimation
The Art of Project Estimation
 
Team dynamics: The Joys and Sorrows of Diverse Teams by Rebecca Parsons, CTO,...
Team dynamics: The Joys and Sorrows of Diverse Teams by Rebecca Parsons, CTO,...Team dynamics: The Joys and Sorrows of Diverse Teams by Rebecca Parsons, CTO,...
Team dynamics: The Joys and Sorrows of Diverse Teams by Rebecca Parsons, CTO,...
 
Using an Agile Inception to Kick Off a Project
Using an Agile Inception to Kick Off a ProjectUsing an Agile Inception to Kick Off a Project
Using an Agile Inception to Kick Off a Project
 
eSource Stakeholders Group 18mar2016
eSource Stakeholders Group  18mar2016eSource Stakeholders Group  18mar2016
eSource Stakeholders Group 18mar2016
 
Managing your Metadata w/ SharePoint 2010
Managing your Metadata w/ SharePoint 2010Managing your Metadata w/ SharePoint 2010
Managing your Metadata w/ SharePoint 2010
 
Requirements Management Part 1 - Management and Elicitation
Requirements Management Part 1 - Management and ElicitationRequirements Management Part 1 - Management and Elicitation
Requirements Management Part 1 - Management and Elicitation
 
MIS Unit-2.pptx
MIS Unit-2.pptxMIS Unit-2.pptx
MIS Unit-2.pptx
 
Ai overview
Ai overviewAi overview
Ai overview
 
Sdec11.agile ina day
Sdec11.agile ina daySdec11.agile ina day
Sdec11.agile ina day
 

Recently uploaded

Planning Of Procurement o different goods and services
Planning Of Procurement o different goods and servicesPlanning Of Procurement o different goods and services
Planning Of Procurement o different goods and services
JoytuBarua2
 
space technology lecture notes on satellite
space technology lecture notes on satellitespace technology lecture notes on satellite
space technology lecture notes on satellite
ongomchris
 
6th International Conference on Machine Learning & Applications (CMLA 2024)
6th International Conference on Machine Learning & Applications (CMLA 2024)6th International Conference on Machine Learning & Applications (CMLA 2024)
6th International Conference on Machine Learning & Applications (CMLA 2024)
ClaraZara1
 
block diagram and signal flow graph representation
block diagram and signal flow graph representationblock diagram and signal flow graph representation
block diagram and signal flow graph representation
Divya Somashekar
 
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&BDesign and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Sreedhar Chowdam
 
HYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generationHYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generation
Robbie Edward Sayers
 
Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024
Massimo Talia
 
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
AJAYKUMARPUND1
 
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Dr.Costas Sachpazis
 
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
obonagu
 
Cosmetic shop management system project report.pdf
Cosmetic shop management system project report.pdfCosmetic shop management system project report.pdf
Cosmetic shop management system project report.pdf
Kamal Acharya
 
NUMERICAL SIMULATIONS OF HEAT AND MASS TRANSFER IN CONDENSING HEAT EXCHANGERS...
NUMERICAL SIMULATIONS OF HEAT AND MASS TRANSFER IN CONDENSING HEAT EXCHANGERS...NUMERICAL SIMULATIONS OF HEAT AND MASS TRANSFER IN CONDENSING HEAT EXCHANGERS...
NUMERICAL SIMULATIONS OF HEAT AND MASS TRANSFER IN CONDENSING HEAT EXCHANGERS...
ssuser7dcef0
 
Hierarchical Digital Twin of a Naval Power System
Hierarchical Digital Twin of a Naval Power SystemHierarchical Digital Twin of a Naval Power System
Hierarchical Digital Twin of a Naval Power System
Kerry Sado
 
weather web application report.pdf
weather web application report.pdfweather web application report.pdf
weather web application report.pdf
Pratik Pawar
 
Fundamentals of Electric Drives and its applications.pptx
Fundamentals of Electric Drives and its applications.pptxFundamentals of Electric Drives and its applications.pptx
Fundamentals of Electric Drives and its applications.pptx
manasideore6
 
CME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional ElectiveCME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional Elective
karthi keyan
 
Heap Sort (SS).ppt FOR ENGINEERING GRADUATES, BCA, MCA, MTECH, BSC STUDENTS
Heap Sort (SS).ppt FOR ENGINEERING GRADUATES, BCA, MCA, MTECH, BSC STUDENTSHeap Sort (SS).ppt FOR ENGINEERING GRADUATES, BCA, MCA, MTECH, BSC STUDENTS
Heap Sort (SS).ppt FOR ENGINEERING GRADUATES, BCA, MCA, MTECH, BSC STUDENTS
Soumen Santra
 
Forklift Classes Overview by Intella Parts
Forklift Classes Overview by Intella PartsForklift Classes Overview by Intella Parts
Forklift Classes Overview by Intella Parts
Intella Parts
 
ML for identifying fraud using open blockchain data.pptx
ML for identifying fraud using open blockchain data.pptxML for identifying fraud using open blockchain data.pptx
ML for identifying fraud using open blockchain data.pptx
Vijay Dialani, PhD
 
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdfGoverning Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
WENKENLI1
 

Recently uploaded (20)

Planning Of Procurement o different goods and services
Planning Of Procurement o different goods and servicesPlanning Of Procurement o different goods and services
Planning Of Procurement o different goods and services
 
space technology lecture notes on satellite
space technology lecture notes on satellitespace technology lecture notes on satellite
space technology lecture notes on satellite
 
6th International Conference on Machine Learning & Applications (CMLA 2024)
6th International Conference on Machine Learning & Applications (CMLA 2024)6th International Conference on Machine Learning & Applications (CMLA 2024)
6th International Conference on Machine Learning & Applications (CMLA 2024)
 
block diagram and signal flow graph representation
block diagram and signal flow graph representationblock diagram and signal flow graph representation
block diagram and signal flow graph representation
 
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&BDesign and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
 
HYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generationHYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generation
 
Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024
 
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
 
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
 
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
在线办理(ANU毕业证书)澳洲国立大学毕业证录取通知书一模一样
 
Cosmetic shop management system project report.pdf
Cosmetic shop management system project report.pdfCosmetic shop management system project report.pdf
Cosmetic shop management system project report.pdf
 
NUMERICAL SIMULATIONS OF HEAT AND MASS TRANSFER IN CONDENSING HEAT EXCHANGERS...
NUMERICAL SIMULATIONS OF HEAT AND MASS TRANSFER IN CONDENSING HEAT EXCHANGERS...NUMERICAL SIMULATIONS OF HEAT AND MASS TRANSFER IN CONDENSING HEAT EXCHANGERS...
NUMERICAL SIMULATIONS OF HEAT AND MASS TRANSFER IN CONDENSING HEAT EXCHANGERS...
 
Hierarchical Digital Twin of a Naval Power System
Hierarchical Digital Twin of a Naval Power SystemHierarchical Digital Twin of a Naval Power System
Hierarchical Digital Twin of a Naval Power System
 
weather web application report.pdf
weather web application report.pdfweather web application report.pdf
weather web application report.pdf
 
Fundamentals of Electric Drives and its applications.pptx
Fundamentals of Electric Drives and its applications.pptxFundamentals of Electric Drives and its applications.pptx
Fundamentals of Electric Drives and its applications.pptx
 
CME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional ElectiveCME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional Elective
 
Heap Sort (SS).ppt FOR ENGINEERING GRADUATES, BCA, MCA, MTECH, BSC STUDENTS
Heap Sort (SS).ppt FOR ENGINEERING GRADUATES, BCA, MCA, MTECH, BSC STUDENTSHeap Sort (SS).ppt FOR ENGINEERING GRADUATES, BCA, MCA, MTECH, BSC STUDENTS
Heap Sort (SS).ppt FOR ENGINEERING GRADUATES, BCA, MCA, MTECH, BSC STUDENTS
 
Forklift Classes Overview by Intella Parts
Forklift Classes Overview by Intella PartsForklift Classes Overview by Intella Parts
Forklift Classes Overview by Intella Parts
 
ML for identifying fraud using open blockchain data.pptx
ML for identifying fraud using open blockchain data.pptxML for identifying fraud using open blockchain data.pptx
ML for identifying fraud using open blockchain data.pptx
 
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdfGoverning Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
 

Knowledge Elicitation Techiniques Concept Sorting

  • 2. Knowledge Elicitation (Introduction) • Knowledge Elicitation is the process of acquiring knowledge about a specific domain. • It is one of the most important and a crucial task of the development of an expert system since it directly has an impact on the overall quality of the system. • Knowledge elicitation is also often viewed as the bottleneck in the development of expert systems or knowledge based systems as it is difficult and time consuming activity. • Among various known Knowledge Elicitation techniques available choice to be used depends on the nature of the situation within which the knowledge is elicited, the domain knowledge and availability of experts.
  • 3. Knowledge Elicitation (Introduction) Cont… • Knowledge Elicitation process gets tricky as the vast amount of information is often kept inside the heads of domain experts. • This makes the entire process complicated as the domain experts may not be willing to disclose the information, due to worries of being sidelined or becoming less important or getting redundant. • There are various techniques used in the Knowledge Elicitation process : • Interview • Protocol Analysis • Laddering • Concept Sorting (Will be discussing) • Repertory Grid • Structural Assessment
  • 4. When to use which technique? • For Knowledge identification • Unstructured interview, laddering • For Knowledge specification • Domain schema: Concept Sorting, repertory grid • Template selection: self report • Task & inference knowledge: self report • For Knowledge Refinement • Structured interview
  • 5. What is Concept Sorting ? • Concept sorting is a psychological technique that is useful in tapping organization knowledge. • It a way of finding out how an expert compares, orders concepts and relates among a set of concepts. • Used to capture conceptual knowledge and tacit knowledge. • Can also sort objects or pictures instead of cards • It works best on small group. • Simple to apply • Its is also Called Card Sorting. • Simplest form is Concept Sorting • Collection of concepts (or other knowledge objects) are written on separate cards • Cards sorted into piles by an expert in to piles - each card in a pile must have something in common • Each time the cards are sorted it will be based on an attribute and each pile will represent a value
  • 6. Concept Sorting – How To ? • To apply this technique , the KE follows the following steps: 1- First , KE Decide what classes of concepts he/she want to explore (in particular their properties – attributes and values). 2- Consults a textbook, training manual, or in-house domain expert to identify the major top-level concepts represented in the domain. 3- Place write the name of each concept on a separate note card . 4- Next, the KE asks the domain expert to begin sorting these cards placing them in groups according to those that belong together. 5- As the domain expert sorts the cards the KE uses questioning techniques to determine why they are placed together. 6- Repeat steps 4, and 5 until the expert can’t sort anymore
  • 7. Example 1: Classification based of Habitat Star Fish Bear Cat Shark Deer Seahorse Crab Crocodile Frog Elephant Dolphin
  • 8. Example 1: Classification based of Habitat Cont… Dolphin Aquatic Animals ns Terrestrial Animal Star Fish Bear Cat Shark Elephant Deer Seahorse Crab Crocodile Frog Amphibia
  • 9. Card Habitat Size Eating Habit Vertebrate / Invertebrate Mammals/ Non Mammals Elephant 1 3 1 1 1 Cat 1 1 3 1 1 Deer 1 2 1 1 1 Bear 1 3 3 1 1 Crab 2 1 2 2 2 Crocodile 2 3 2 1 2 Frog 2 1 2 1 2 Dolphin 3 2 3 2 1 Starfish 3 1 3 2 2 Sea Horse 3 1 3 1 2 Shark 3 3 2 1 2 1-Teresstrial 1-Small 1-Herbivorous 1-Vertebrate 1-Mammals 2- Amphibia 2-Medium 2-Carnivorous 2-Invertebrate 2-Non-mammal 3-Aquatic 3-Large 3-Omnivorous
  • 10. Example 2 • The Number of 15 models of cars may be grouped into two categories named “Foreign" and “Domestic • Then re-sorted into three categories; “Sedan" , “Hatchback", and “Sports"; • Then re-sorted into four categories; " Expensive Domestic", " Less Expensive Domestic", " Expensive Foreign", “Less Expensive Foreign“. • A hierarchy tree may be created expressing the group categories as levels within the hierarchy.
  • 11. Based on Cost Based on Design and Performance Based on Design and Performance Based on Cost Example 2 Cont… Domestic Cars Foreign Less Expensive Expensive SedanHatchback Sports Less Expensive ExpensiveSedanHatchback Sports
  • 12. Application of Concept Sorting • Concept sorting is basically used in several disciplines like - Knowledge Engineering - Psychology - Marketing etc.
  • 13. Pros and Cons • Pros • Fast to apply and easy to analyze • Often instructive to the expert in a sense that it may lead expert to see structure that he himself has not consciously articulated before • Time saving by not having to transcribe and analyze lengthy verbal reports • Can be used for images and objects as well
  • 14. Pros and Cons Cont… • Cons • Experts can often confound dimensions by not consistently applying the same semantic distinctions throughout an elicitation session • May face problem in categorization of elements in meaningful way
  • 15. Conclusion • Card Sorting techniques provide a means of achieving a more focused or systematic understanding of the classifications and relationships in the expert's domain.