• Save
A system of clothes matching for visually impaired persons
Upcoming SlideShare
Loading in...5
×

Like this? Share it with your network

Share
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
864
On Slideshare
822
From Embeds
42
Number of Embeds
2

Actions

Shares
Downloads
0
Comments
0
Likes
1

Embeds 42

http://lab501-homework.blogspot.tw 38
http://lab501-homework.blogspot.com 4

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. A system of clothes matching for visually impaired persons 為視障者自動 搭、配 衣物 學生:楊鴻志 參考文獻Shuai YuanOctober 2010ASSETS 10: Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility
  • 2. Outline• Introduction• Systems and Interface• Methodology for Clothes Matching  Clothes Color Detection and Matching  Pattern Detection  Pattern Matching• Experimental Results• Conclusion and Future Work
  • 3. IntroductionIn everyday’s life, people need to find appropriate clothes towear. It is a challenging problem for blind people to find clotheswith suitable color and pattern.In computer vision and image processing research, many methodswere developed for pattern matching and color detection.However, three issues are critical for successful clothes matching.The first is the issue of color constancy under people’s perception.Secondly, shadows and wrinkles are often part of the pattern ofclothes and cause errors. Lastly, many clothes have designs withcomplex patterns and multiple colors.285 million people are visually impaired worldwide: 39 million are blindand 246 have low vision.Reference: World Health Organization
  • 4. Figure 1: Match clothes with multiple colors and complex patterns byusing color and pattern information. (a) Three pairs of images of clothes.(b) Color classification results. (c)Pattern detection. (d) Patternsimilarity measurement results. (e) Final audio outputs.
  • 5. Outline• Introduction• Systems and Interface• Methodology for Clothes Matching  Clothes Color Detection and Matching  Pattern Detection  Pattern Matching• Experimental Results• Conclusion and Future Work
  • 6. Systems and InterfaceThe computer vision-based clothes matching prototype for blindpersons integrates a camera, a microphone, a computer, andspeakers as shown in Fig. 2. The matching results are describedto the blind user by verbal display with minimal distraction ofthe user’s hearing sense. The user can control the system byspeech via microphones.Fig. 2. Prototype hardware and architecture design of computer vision-based clothes matching aid for blind persons
  • 7. Outline• Introduction• Systems and Interface• Methodology for Clothes Matching  Clothes Color Detection and Matching  Pattern Detection  Pattern Matching• Experimental Results• Conclusion and Future Work
  • 8. Methodology for Clothes Matching Clothes Color Detection and MatchingOur color classifier is based on acquiring a normalized colorhistogram for each image of the clothes in bi-conic (hue,saturation, luminance) HSL space. The key idea is to intelligentlyquantize color space based on using the relationships betweenhue, saturation and luminance. Pattern DetectionBased on the color detection results from previous section, if thereis only one dominate color, the input image of clothes has nopattern. Only for the images with multiple dominate colors, wecontinue to check if the multiple colors are caused by texturepatterns. Pattern MatchingHere we introduce a new approach for pattern analysis usingRadon transform, Wavelet features and Gray co-occurrence matrix.we employ Radon transform for estimating the orientation information then rotate the image with orientation as0 degree.Next, Haar Wavelet transform is applied to obtain features on 3 directions (horizontal, vertical and diagonal).Finally, the pattern matching is performed based on statistical classification included six features, e.g. mean,variance, smoothness, energy, homogeneity, and entropy.
  • 9. Outline• Introduction• Systems and Interface• Methodology for Clothes Matching  Clothes Color Detection and Matching  Pattern Detection  Pattern Matching• Experimental Results• Conclusion and Future Work
  • 10. Experimental ResultsFigure 3. Examples of results for clothes matching. Original image pairs, wavelet features, gray co-occurrence matrix images and color detection results are gave respectively.
  • 11. Outline• Introduction• Systems and Interface• Methodology for Clothes Matching  Clothes Color Detection and Matching  Pattern Detection  Pattern Matching• Experimental Results• Conclusion and Future Work
  • 12. Conclusion and Future WorkWe have developed an efficient system to match clothes with multiplecolors and complex patterns to assist visually impaired and blind(including color blind) people by distinguish both pattern and colorinformation.To handle complex patterns and lighting changes, we combine Radontransform, wavelet features,and co-occurrence matrix for patternmatching. Our algorithm for color matching is based on normalized colorin HSL color space.In addition, we have developed a color classifier to detect multiple colorsincluding red, green, blue, yellow, cyan, magenta, black, grey, and white.The algorithm is evaluated by two databases contain clothes images witha variety of texture patterns, colors,and illumination changes.