Self-organizing map

7,820 views

Published on

Self-organizing map (SOM) for Dimensionality Reduction

Published in: Education, Technology
1 Comment
7 Likes
Statistics
Notes
  • Thank you for sharing a wonderful file!
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total views
7,820
On SlideShare
0
From Embeds
0
Number of Embeds
56
Actions
Shares
0
Downloads
645
Comments
1
Likes
7
Embeds 0
No embeds

No notes for slide
  • cluster
  • What is dimensions?ClusteringKohonen map
  • In machine learningIt is distinguished from supervised learning HOW?(Instead of teaching the system by example we just unload data on it and let the system itself sort it out.)
  • In machine learningIt is distinguished from supervised learning HOW?
  • Represent each fruit as a data point and plot them in a graph
  • Represent each fruit as a data point and plot them in a graphMore dimensions -> more complexity
  • Units
  • Is learning rules
  • Is learning rulesที่จริงดูหลายที่มีหลาย models มาก แต่ที่เอามาเข้าใจง่ายสุดa is a factor called learning rate.regulates how fast the unit will move towards the data point.d(p,x) is a distance scaling function.the larger the distance between p and x, the smaller d(p,x) will be.
  • When a unit tries to run away in a direction, it will be pulled back by the strings that are attached to neighboring units in the grid.
  • Each input vector computes Euclidean Distance to find best matching unit (BMU).
  • neighborhood function Θ (v, t) depends on the lattice distance between the BMU and neuron(the grid)
  • Units
  • Self-organizing map

    1. 1. Self-organizing map (SOM)<br />Presented by<br />Sasinee Pruekprasert48052112<br />ThatchapholSaranurak49050511<br />TaratDiloksawatdikul 49051006<br />Department of Computer Engineering, Faculty of Engineering, Kasetsart University<br />
    2. 2. Title<br />What SOM?<br />Unsupervisedlearning<br />Competitivelearning<br />Algorithm<br />DimensionalityReduction<br />Application<br />Coding<br />
    3. 3. What is SOM?<br />The self-organizing mapalso known as a Kohonenmap.<br />SOM is a technique which reduce the dimensions of data through the use of self-organizing neural networks.<br />The model was first described as <br /> an artificial neural network by <br />professorTeuvo Kohonen.<br />
    4. 4. Unsupervised learning<br />Unsupervised learning is a class of problems in which one seeks to determine how the data are organized.<br />One form of unsupervised learning is clustering.<br />
    5. 5. Unsupervised learning<br />How could we know what constitutes “different” clusters?<br />Green Apple and Banana Example.<br />two features: shape and color.<br />
    6. 6. Unsupervised learning<br />
    7. 7. Unsupervised learning<br />intra cluster distances<br />extra cluster distances<br />
    8. 8. Competitive learning<br />
    9. 9. Unit<br />Unit, also called artificial particle and agent, is a special type of data point.<br />The difference between unit and the regular data points is that the units are dynamic <br />
    10. 10. Competitive learning<br />the position of the unit for each data point can be expressed as follows:<br />p(t+1) = a(p(t)-x)d(p(t),x)<br />a is a factor called learning rate.<br />d(p,x) is a distance scaling function.<br />p<br />x<br />
    11. 11. Competitive learning<br />Competitive learning is useful for clustering of input patterns into a discrete set of output clusters.<br />
    12. 12. The Self-Organizing Map (SOM)<br />SOM is based on competitive learning.<br />The difference is units are all interconnected in a grid.<br />
    13. 13. The Self-Organizing Map (SOM)<br />The unit closet to the input vector is call Best Matching Unit (BMU).<br />The BMU and other units will adjust its position toward the input vector.<br />The update formula is<br />Wv(t + 1) = Wv(t) + Θ (v, t) α(t)(D(t) - Wv(t))<br />
    14. 14. The Self-Organizing Map (SOM)<br />Wv(t + 1) = Wv(t) + Θ (v, t)α(t)(D(t) - Wv(t))<br />Wv(t) = weight vector <br />α(t) = monotonically decreasing learning coefficient<br />D(t) = the input vector<br />Θ (v, t) = neighborhood function <br />This process is repeated for each input vector for a (usually large) number of cycles λ.<br />
    15. 15. Algorithm<br />1. Randomize the map&apos;s nodes&apos; weight vectors<br />
    16. 16. Algorithm<br />2. Grab an input vector<br />
    17. 17. Algorithm<br />3. Traverse each node in the map<br />
    18. 18. Algorithm<br /> 4. Update the nodes in the neighbourhood of BMU by pulling them closer to the input vector<br />Wv(t + 1) = Wv(t) + Θ(t)α(t)(D(t) - Wv(t))<br />
    19. 19. Algorithm<br /> 5. Increment t and repeat from 2 while t &lt; λ<br />
    20. 20. SOM in 3D<br />
    21. 21. Visualization with the SOM<br />Maplet<br />
    22. 22. Visualization with the SOM<br />Blue color -&gt; low value<br />Red color -&gt; High value<br />
    23. 23. SOM showing US congress voting results<br />
    24. 24. Dimension Reduction<br />2D<br />3D<br />
    25. 25. Dimension Reduction<br />Input vector<br />BMU<br />Unit 2D<br />
    26. 26. Application<br />Dimensionality Reduction using SOM based Technique for Face Recognition.<br />A comparative study of PCA, SOM and ICA.<br />SOM is better than the other techniques for the given face database and the classifier used.<br />The results also show that the <br /> performance of the system decreases<br /> as the number of classes increase<br />Journal of Multimedia, May 2008 <br />by Dinesh Kumar, C. S. Rai, Shakti Kumar<br />
    27. 27. Application<br />Gene functions can be analyzed using an adaptive method – SOM.<br />Clustering with the SOM Visualizer- create a standard neural network based classifier based on the results. <br />
    28. 28. Application<br /><ul><li>A neural network comprised of a plurality of layers of nodes. </li></ul>A system for organization of multi-dimensional pattern data into a two-dimensional representation comprising<br />It allows for a reduced-dimension description of a body of pattern data to be representative of the original body of data.<br />US Patent 5734796 Issued on March 31, 1998 <br />Yoh Han Pao,ClevelandHeights,Ohin<br />
    29. 29. References<br /><ul><li> http://en.wikipedia.org/wiki/Self-organization
    30. 30. http://blog.peltarion.com/2007/04/10/the-self-organized-gene-part-1
    31. 31. http://www.freepatentsonline.com/5734796.pdf
    32. 32. http://www.britannica.com/bps/additionalcontent/18/32480508/</li></ul> Dimensionality-Reduction-using-SOM-based-Technique-for-Face-<br /> Recognition<br /><ul><li> http://www.cis.hut.fi/projects/somtoolbox/documentation/</li></li></ul><li>Q & A<br />

    ×