Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
www.tugraz.at
Institute of Information Systems and Computer Media
OmniColor
Google Glass app for colorblind individuals an...
2
Agenda
1. Motivation
2. Colorblindness
3. Smartglasses
4. OmniColor Prototype
5. Evaluation and Results
6. Outlook
Georg...
3
Motivation
Motivation
Fig. 1: Raw meat
Fig. 2: Clothes
Fig. 3: Traffic Lights, taken from wikipedia.org1
Fig. 4: Bananas,...
4
Colorblindness
Colorblindness
Human Eye
Consists of rods and cones
Cones classified in three different types
L (long-) wa...
5
Colorblindness
Colorblindness types
Anomalous trichromacy
Protanomaly
Deuteranomaly
Tritanomaly
Dichromatism
Protanopia
...
6
Colorblindness
Colorblindness Testing Methods
Color arrangement test
Ishihara color plate test
Fig. 6: Color arrangement...
7
Colorblindness
Daltonization
Doesn’t affect each pixel
Color shifting algorithm
Algorithm consisting of 4 steps:
RGB to ...
8
Smartglasses
Devices
Smartphones
+ computation power
+ distribution
+ costs
- handfree navigation
- availability
Smartgl...
9
Smartglasses
Google Glass
Optical Head-mounted
display
Released in February
2013
Upgraded Model(2GB
RAM)
costs ∼1500$
In...
10
OmniColor Prototype
OmniColor Prototype
Non-real time
All computations performed on Glass
No network connection require...
11
Evaluation and Results
Evaluation
Ishihara color plate test
without OmniColor
with OmniColor
Individual appointments
14...
12
Evaluation and Results
Results (Colorblinds)
Participant
age
CVD* Without OmniColor With OmniColor
36 protanomaly 7/17 ...
13
Outlook
Outlook
Hardware issues with Google Glass
Google Glass discontinued in January 2015
Great potential of smartgla...
14
Thank you for your
attention!
Georg Lausegger, BSc.,
December 15th, 2016
14/16
15
References I
[1] David Flatla and Carl Gutwin. “SSMRecolor: Improving Recoloring Tools with Situation-specific
Models of...
16
References II
[7] Brooke E. Schefrin. “Diagnosis of Defective Colour Vision, by Jennifer Birch, Oxford University
Press...
Upcoming SlideShare
Loading in …5
×

of

Google Glass app for colorblind individuals and people with impaired vision Slide 1 Google Glass app for colorblind individuals and people with impaired vision Slide 2 Google Glass app for colorblind individuals and people with impaired vision Slide 3 Google Glass app for colorblind individuals and people with impaired vision Slide 4 Google Glass app for colorblind individuals and people with impaired vision Slide 5 Google Glass app for colorblind individuals and people with impaired vision Slide 6 Google Glass app for colorblind individuals and people with impaired vision Slide 7 Google Glass app for colorblind individuals and people with impaired vision Slide 8 Google Glass app for colorblind individuals and people with impaired vision Slide 9 Google Glass app for colorblind individuals and people with impaired vision Slide 10 Google Glass app for colorblind individuals and people with impaired vision Slide 11 Google Glass app for colorblind individuals and people with impaired vision Slide 12 Google Glass app for colorblind individuals and people with impaired vision Slide 13 Google Glass app for colorblind individuals and people with impaired vision Slide 14 Google Glass app for colorblind individuals and people with impaired vision Slide 15 Google Glass app for colorblind individuals and people with impaired vision Slide 16
Upcoming SlideShare
Der Einsatz von freien Bildungsressourcen im Unterrichtsfach Informatik - eine Feldstudie
Next
Download to read offline and view in fullscreen.

0 Likes

Share

Download to read offline

Google Glass app for colorblind individuals and people with impaired vision

Download to read offline

Präsentation Mastarbeit, TU Graz, Dezember 2016

Related Books

Free with a 30 day trial from Scribd

See all

Related Audiobooks

Free with a 30 day trial from Scribd

See all
  • Be the first to like this

Google Glass app for colorblind individuals and people with impaired vision

  1. 1. www.tugraz.at Institute of Information Systems and Computer Media OmniColor Google Glass app for colorblind individuals and people with impaired vision December 15th, 2016 Georg Lausegger, BSc.
  2. 2. 2 Agenda 1. Motivation 2. Colorblindness 3. Smartglasses 4. OmniColor Prototype 5. Evaluation and Results 6. Outlook Georg Lausegger, BSc., December 15th, 2016 2/16
  3. 3. 3 Motivation Motivation Fig. 1: Raw meat Fig. 2: Clothes Fig. 3: Traffic Lights, taken from wikipedia.org1 Fig. 4: Bananas, taken from banabay.com2 (1) https://de.wikipedia.org/wiki/Ampel , (2) http://www.banabay.com/press-room/going-green/ Georg Lausegger, BSc., December 15th, 2016 3/16
  4. 4. 4 Colorblindness Colorblindness Human Eye Consists of rods and cones Cones classified in three different types L (long-) wavelength (Red) M (middle-) wavelength (Green) S (short-) wavelength (Blue) Colorblindness = lack or disfunction of one or more cone type(s) Georg Lausegger, BSc., December 15th, 2016 4/16
  5. 5. 5 Colorblindness Colorblindness types Anomalous trichromacy Protanomaly Deuteranomaly Tritanomaly Dichromatism Protanopia Deuteranopia Tritanopia Monochromacy Fig. 5: The three colorblindness types, taken from Johaness Ahlmann3 (3) https://www.flickr.com/photos/entirelysubjective/6146852926 Georg Lausegger, BSc., December 15th, 2016 5/16
  6. 6. 6 Colorblindness Colorblindness Testing Methods Color arrangement test Ishihara color plate test Fig. 6: Color arrangement test, taken from color-blindness.com4 Fig. 7: Ishihara color plate test, taken from color-blindness.com4 (4) http://www.color-blindness.com/ Georg Lausegger, BSc., December 15th, 2016 6/16
  7. 7. 7 Colorblindness Daltonization Doesn’t affect each pixel Color shifting algorithm Algorithm consisting of 4 steps: RGB to LMS color space Simulation of the specific color blindness type Calculate compensation Convert LMS values back to RGB Georg Lausegger, BSc., December 15th, 2016 7/16
  8. 8. 8 Smartglasses Devices Smartphones + computation power + distribution + costs - handfree navigation - availability Smartglasses + handfree navigation + availability - computation power - distribution - costs Georg Lausegger, BSc., December 15th, 2016 8/16
  9. 9. 9 Smartglasses Google Glass Optical Head-mounted display Released in February 2013 Upgraded Model(2GB RAM) costs ∼1500$ Input via voice commands, touchpad or head gestures Fig. 8: Sergey Brin wearing Google Glass, taken from Andrew Kelly/Reuters5 (5) http://www.computerworld.com/article/2495675/personal-technology/google-s-sergey-brin-rips-smartphones– shows-off-glass.html Georg Lausegger, BSc., December 15th, 2016 9/16
  10. 10. 10 OmniColor Prototype OmniColor Prototype Non-real time All computations performed on Glass No network connection required Uses OpenCV library OmniColor Flow Design Georg Lausegger, BSc., December 15th, 2016 10/16
  11. 11. 11 Evaluation and Results Evaluation Ishihara color plate test without OmniColor with OmniColor Individual appointments 14 Participants Five colorblind people Nine people with normal color vision Fig. 9: Ishihara color plate test performed with by participant with OmniColor Georg Lausegger, BSc., December 15th, 2016 11/16
  12. 12. 12 Evaluation and Results Results (Colorblinds) Participant age CVD* Without OmniColor With OmniColor 36 protanomaly 7/17 12/17 48 protanomaly 2/17 11/17 37 protanomaly 3/17 12/17 28 protanomaly 7/17 13/17 41 protanomaly 8/17 14/17 Tab. 1: Results of the Ishihara color plate test performed by colorblind participants *Color Vision Deficiency Georg Lausegger, BSc., December 15th, 2016 12/16
  13. 13. 13 Outlook Outlook Hardware issues with Google Glass Google Glass discontinued in January 2015 Great potential of smartglasses Further work Other approaches and algorithms Performance optimization (offloading) Support for other Android Smartglasses Georg Lausegger, BSc., December 15th, 2016 13/16
  14. 14. 14 Thank you for your attention! Georg Lausegger, BSc., December 15th, 2016 14/16
  15. 15. 15 References I [1] David Flatla and Carl Gutwin. “SSMRecolor: Improving Recoloring Tools with Situation-specific Models of Color Differentiation”. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. CHI ’12. Austin, Texas, USA: ACM, 2012, pp. 2297–2306. ISBN: 978-1-4503-1015-4. DOI: 10.1145/2207676.2208388. URL: http://doi.acm.org/10.1145/2207676.2208388. [2] Jia-Bin Huang et al. “IEEE Int’l Conf on Acoustics, Speech and Signal Processing, (ICASSP 2009)”. In: Image Recolorization For The Colorblind. Apr. 2009. [3] Luke Jefferson and Richard Harvey. “An Interface to Support Color Blind Computer Users”. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. CHI ’07. San Jose, California, USA: ACM, 2007, pp. 1535–1538. ISBN: 978-1-59593-593-9. DOI: 10.1145/1240624.1240855. URL: http://doi.acm.org/10.1145/1240624.1240855. [4] D. S. Khurge and B. Peshwani. “Modifying Image Appearance to Improve Information Content for Color Blind Viewers”. In: Computing Communication Control and Automation (ICCUBEA), 2015 International Conference on. Feb. 2015, pp. 611–614. DOI: 10.1109/ICCUBEA.2015.125. [5] Viet Nguyen and Marco Gruteser. “First Experiences with GOOGLE GLASS in Mobile Research”. In: GetMobile: Mobile Comp. and Comm. 18.4 (Jan. 2015), pp. 44–47. ISSN: 2375-0529. DOI: 10.1145/2721914.2721931. URL: http://doi.acm.org/10.1145/2721914.2721931. [6] H´elio M. de Oliveira, J. Ranhel, and R. B. A. Alves. “Simulation of Color Blindness and a Proposal for Using Google Glass as Color-correcting Tool”. In: CoRR abs/1502.03723 (2015). URL: http://arxiv.org/abs/1502.03723. Georg Lausegger, BSc., December 15th, 2016 15/16
  16. 16. 16 References II [7] Brooke E. Schefrin. “Diagnosis of Defective Colour Vision, by Jennifer Birch, Oxford University Press, New York, 1993, Paperback, 187 pp., $35.00.” In: Color Research & Application 19.6 (1994), pp. 484–484. ISSN: 1520-6378. DOI: 10.1002/col.5080190608. URL: http://dx.doi.org/10.1002/col.5080190608. [8] N. A. Semary and H. M. Marey. “An evaluation of computer based color vision deficiency test: Egypt as a study case”. In: Engineering and Technology (ICET), 2014 International Conference on. Apr. 2014, pp. 1–7. DOI: 10.1109/ICEngTechnol.2014.7016817. Georg Lausegger, BSc., December 15th, 2016 16/16

Präsentation Mastarbeit, TU Graz, Dezember 2016

Views

Total views

1,006

On Slideshare

0

From embeds

0

Number of embeds

321

Actions

Downloads

1

Shares

0

Comments

0

Likes

0

×