This document summarizes a group project report on clustering in data mining. It discusses different types of clustering algorithms including K-means clustering and agglomerative hierarchical clustering. For K-means clustering, it provides an example showing how clusters are formed by assigning objects to centroids and recalculating centroids over iterations. For hierarchical clustering, it shows how clusters are merged based on distances recorded in a distance matrix and represented through a dendrogram. The document contains examples and diagrams to illustrate key steps and concepts in clustering techniques.
1. Clustering in Data Mining
Lesson: Data Mining
Professor: Mrs M.Hosseini
Group Members: Mojtaba Derakhshandi,S.Mostafa Sayyedi,Mojtaba Sadeghi
2. Clustering in Data Mining
Our Group:
Mr. Mojtaba Derakhshandi:
*Introduction
*Example Usage of Clustering
*Two Dimensional Space
*Example
*Centroid
Mr. Mojtaba Sadeghi:
Mr. S.Mostafa Sayyedi:
*K-Means Clustering
*Example
*Finding the Best Set of Clusters
*Agglomerative Hierarchical Clustering
*Example
*Recording the Distance Between Clusters
4. Page 4
unlimited
Economics Application
We Might be Interested in Finding Countries
Whose Economies are Similar.
Financial Application
We Might Wish to Find Clusters of Companies
that Have Similar Financial Performance.
Marketing Application
We Might Wish to Find Clusters of Customers
With Similar Buying Behavior.
Medical Application
We Might Wish to Find Clusters of Patients With
Similar Symptoms.
Document Retrieval Application
We Might Wish to Find Clusters of Documents
With Related Content.
Crime Analysis Application
We Might Look for Clusters of High Volume Crimes Such
as Burglaries or Try to Cluster Together Much Rarer (But
Possibly Related) Crimes Such as Murders.
01
02
03
04
05
06
Example Usage of Clustering
Clustering in Data Mining
Mojtaba Derakhshandi
Page: 2
5. Two Dimensional Space
Clustering in Data Mining
Mojtaba Derakhshandi
Object for Clustering Clustering of Objects (First Version)
Page: 3
7. Page 7
unlimited
Centroid:
Clustering in Data Mining
Page: 5
‘Centre’ of a Cluster, Generally Called its Centroid.
So the Centroid of the Four Points (With 6 Attributes):
Would Be:
Mojtaba Derakhshandi
11. Page 11
unlimited
Example:
Clustering in Data Mining
S.Mostafa Sayyedi
Initial Choice of Centroids
Page: 9
Step2: Select k Objects in an Arbitrary Fashion. Use These as the Initial Set of k Centroids
12. Page 12
unlimited
Example:
Clustering in Data Mining
S.Mostafa Sayyedi
Objects for Clustering (Augmented)Page: 10
Step3: Assign Each of the Objects to the Cluster for Which it is Nearest to the Centroid
14. Page 14
unlimited
Example:
Clustering in Data Mining
S.Mostafa Sayyedi
Centroids After First Iteration
Page: 12
Revised Clusters
Step 5: Repeat Steps 3 and 4 Until the Centroids no Longer Move
16. Page 16
unlimited
Finding the Best Set of Clusters:
Clustering in Data Mining
S.Mostafa Sayyedi
Value of Objective Function for Different Values of k
Page: 14
17. Page 17
unlimited
Clustering in Data Mining
Mojtaba Sadeghi
Agglomerative Hierarchical Clustering:
Agglomerative Hierarchical Clustering: Basic Algorithm
Page: 15
19. Clustering in Data Mining
Mojtaba Sadeghi
Original Data (11 Objects) Clusters After Two Passes
Page: 17
20. Clustering in Data Mining
Mojtaba Sadeghi
Without Knowing the Precise Distances Between Each Pair of Objects, a Plausible Sequence of Events is as Follows.
Page: 18
21. Clustering in Data Mining
Mojtaba Sadeghi
A Possible Dendrogram CorrespondingPage: 19
22. Clustering in Data Mining
Mojtaba Sadeghi
Example of a Distance Matrix
Page: 20
Recording the Distance Between Clusters:
23. Clustering in Data Mining
Mojtaba Sadeghi
Distance Matrix After First Merger (Incomplete)
Page: 21
Distance Matrix After First Merger
Recording the Distance Between Clusters:
24. Clustering in Data Mining
Mojtaba Sadeghi
Distance Matrix After Two Merger (Incomplete)
Page: 22
Recording the Distance Between Clusters:
Distance Matrix After Two Merger
25. Clustering in Data Mining
Mojtaba Sadeghi
Distance Matrix After Three Mergers (Incomplete)
Page: 23
Recording the Distance Between Clusters:
Distance Matrix After Three Mergers
26. Clustering in Data Mining
Mojtaba Sadeghi
Distance Matrix After Four Mergers (Incomplete)
Page: 24
Recording the Distance Between Clusters:
Distance Matrix After Four Mergers
27. Clustering in Data Mining
Mojtaba Sadeghi
Dendrogram Corresponding to Hierarchical Clustering Process
Page: 25
29. Resource
Principles of Data Mining
Third Edition
Prof. Max Bramer
School of Computing
University of Portsmouth
Portsmouth, Hampshire, UK
Publisher: Springer
29
Section Break “All Content is editable
How Edit/Fill Shape Color -> “Right Click” on the Object, select “Format Shape”, choose “Fill” a color from color pallete (bucket icon-on the right side on New Powerpoint)
How to Group an Object/Shape -> “Right Click” on the Object (More than 1), select “Group” > “Group”
How to Ungroup an Object/Shape -> “Right Click” on the Object, select “Group” > “Ungroup”
Book Option “All Content is editable
How Edit/Fill Shape Color -> “Right Click” on the Object, select “Format Shape”, choose “Fill” a color from color pallete (bucket icon-on the right side on New Powerpoint)
How to Group an Object/Shape -> “Right Click” on the Object (More than 1), select “Group” > “Group”
How to Ungroup an Object/Shape -> “Right Click” on the Object, select “Group” > “Ungroup”
INTRODUCTION page “All Content is editable
For edit Footer or visible content you must getting to the Master Slide -> click “VIEW” tab -> in the “Master Views” group, click “Slide Master”. (–and- or you can changeyour logo on there”)
INTRODUCTION page “All Content is editable
For edit Footer or visible content you must getting to the Master Slide -> click “VIEW” tab -> in the “Master Views” group, click “Slide Master”. (–and- or you can changeyour logo on there”)
Timeline page “All Content is editable
How Edit/Fill Shape Color -> “Right Click” on the Object, select “Format Shape”, choose “Fill” a color from color pallete (bucket icon-on the right side on New Powerpoint)
NOTE: Please ungroup the object/shape before, if you want to change an individual shape.
How to Group an Object/Shape -> “Right Click” on the Object (More than 1), select “Group” > “Group”
How to Ungroup an Object/Shape -> “Right Click” on the Object, select “Group” > “Ungroup”
Timeline page “All Content is editable
How Edit/Fill Shape Color -> “Right Click” on the Object, select “Format Shape”, choose “Fill” a color from color pallete (bucket icon-on the right side on New Powerpoint)
NOTE: Please ungroup the object/shape before, if you want to change an individual shape.
How to Group an Object/Shape -> “Right Click” on the Object (More than 1), select “Group” > “Group”
How to Ungroup an Object/Shape -> “Right Click” on the Object, select “Group” > “Ungroup”
Timeline page “All Content is editable
How Edit/Fill Shape Color -> “Right Click” on the Object, select “Format Shape”, choose “Fill” a color from color pallete (bucket icon-on the right side on New Powerpoint)
NOTE: Please ungroup the object/shape before, if you want to change an individual shape.
How to Group an Object/Shape -> “Right Click” on the Object (More than 1), select “Group” > “Group”
How to Ungroup an Object/Shape -> “Right Click” on the Object, select “Group” > “Ungroup”
Timeline page “All Content is editable
How Edit/Fill Shape Color -> “Right Click” on the Object, select “Format Shape”, choose “Fill” a color from color pallete (bucket icon-on the right side on New Powerpoint)
NOTE: Please ungroup the object/shape before, if you want to change an individual shape.
How to Group an Object/Shape -> “Right Click” on the Object (More than 1), select “Group” > “Group”
How to Ungroup an Object/Shape -> “Right Click” on the Object, select “Group” > “Ungroup”
Timeline page “All Content is editable
How Edit/Fill Shape Color -> “Right Click” on the Object, select “Format Shape”, choose “Fill” a color from color pallete (bucket icon-on the right side on New Powerpoint)
NOTE: Please ungroup the object/shape before, if you want to change an individual shape.
How to Group an Object/Shape -> “Right Click” on the Object (More than 1), select “Group” > “Group”
How to Ungroup an Object/Shape -> “Right Click” on the Object, select “Group” > “Ungroup”
Timeline page “All Content is editable
How Edit/Fill Shape Color -> “Right Click” on the Object, select “Format Shape”, choose “Fill” a color from color pallete (bucket icon-on the right side on New Powerpoint)
NOTE: Please ungroup the object/shape before, if you want to change an individual shape.
How to Group an Object/Shape -> “Right Click” on the Object (More than 1), select “Group” > “Group”
How to Ungroup an Object/Shape -> “Right Click” on the Object, select “Group” > “Ungroup”
Timeline page “All Content is editable
How Edit/Fill Shape Color -> “Right Click” on the Object, select “Format Shape”, choose “Fill” a color from color pallete (bucket icon-on the right side on New Powerpoint)
NOTE: Please ungroup the object/shape before, if you want to change an individual shape.
How to Group an Object/Shape -> “Right Click” on the Object (More than 1), select “Group” > “Group”
How to Ungroup an Object/Shape -> “Right Click” on the Object, select “Group” > “Ungroup”
Timeline page “All Content is editable
How Edit/Fill Shape Color -> “Right Click” on the Object, select “Format Shape”, choose “Fill” a color from color pallete (bucket icon-on the right side on New Powerpoint)
NOTE: Please ungroup the object/shape before, if you want to change an individual shape.
How to Group an Object/Shape -> “Right Click” on the Object (More than 1), select “Group” > “Group”
How to Ungroup an Object/Shape -> “Right Click” on the Object, select “Group” > “Ungroup”
Timeline page “All Content is editable
How Edit/Fill Shape Color -> “Right Click” on the Object, select “Format Shape”, choose “Fill” a color from color pallete (bucket icon-on the right side on New Powerpoint)
NOTE: Please ungroup the object/shape before, if you want to change an individual shape.
How to Group an Object/Shape -> “Right Click” on the Object (More than 1), select “Group” > “Group”
How to Ungroup an Object/Shape -> “Right Click” on the Object, select “Group” > “Ungroup”
Timeline page “All Content is editable
How Edit/Fill Shape Color -> “Right Click” on the Object, select “Format Shape”, choose “Fill” a color from color pallete (bucket icon-on the right side on New Powerpoint)
NOTE: Please ungroup the object/shape before, if you want to change an individual shape.
How to Group an Object/Shape -> “Right Click” on the Object (More than 1), select “Group” > “Group”
How to Ungroup an Object/Shape -> “Right Click” on the Object, select “Group” > “Ungroup”
Timeline page “All Content is editable
How Edit/Fill Shape Color -> “Right Click” on the Object, select “Format Shape”, choose “Fill” a color from color pallete (bucket icon-on the right side on New Powerpoint)
NOTE: Please ungroup the object/shape before, if you want to change an individual shape.
How to Group an Object/Shape -> “Right Click” on the Object (More than 1), select “Group” > “Group”
How to Ungroup an Object/Shape -> “Right Click” on the Object, select “Group” > “Ungroup”
Hand Attractive “All Content is editable
How Edit/Fill Shape Color -> “Right Click” on the Object, select “Format Shape”, choose “Fill” a color from color pallete (bucket icon-on the right side on New Powerpoint)
How to Group an Object/Shape -> “Right Click” on the Object (More than 1), select “Group” > “Group”
How to Ungroup an Object/Shape -> “Right Click” on the Object, select “Group” > “Ungroup”