DBI World Conference 2019 - Converting vibrotactile information in daily practice of people with deafblindness

A
Eric van Heuvelen
assistive technology specialist
Bartiméus, the Netherlands
Converting vibrotactile information
in daily practice for people with
deafblindness
no conflicts of interest to disclose
Centre of Expertise
B:
support assisted livingeducation
Some context:
• one of two centres of expertise
• 17 million inhabitants
• 350.000 visually impaired
• 80.000 – 85.000 people with deafblindness
• 2.000 people congenital
• 1.500 acquired
• Approxmately 80.000 elderly
Existing adapted tools
FabLabsmart technology for people with a disability
Bartiméus FabLab
Mission
Centre of expertise on deafblindness
Dreaming about an accessible life
Brainstorming sessions with people with deafblindness
• one tool
• different devices
• signaling as warning, attention, recognition
One of the main conclusions :
• who is at the door?
But also:
• when someone is approaching you in the garden
• smoke detection
• a smart status detector: the status of household electrical
appliances e.g. whether a coffee maker is switched on or
off
Developing the “Smart doorbell”
Prototype
Evaluation
• evaluation of prototype with people with deafblindness
• options for improvement were discussed
• use of regular consumer technology (smartwatch)
• integration of more devices
• pre-alert, color and text
First results
Conclusion so far…..
Worked well in lab conditions, but…….
Problems:
• using own wifi network to set up
• small range
• poor reliabilty
• poor wifi strenght
• not easy to start up after break down
Follow up
Further development by Bartiméus
1. explore the perception of vibrotactile
patterns (tactons) with people with
deafblindness (master thesis)
2. user needs to work with mainstream
(consumer) technology
Conditions
Research
• what kind of vibrotactile patterns should be
used
• how many different tactons can be
distinguished
• will these patterns be recognized when a
user is going about his day doing regular
daily activities?
• can tactons be accurately detected and linked to a
specific meaning when presented on the wrist?
• can these tactons also be recognized when
participants are engaged in cognitive and distracting
activities?
• the effect of long-term memory on tacton detection
and recognition in a call-back testing setting
Current Research
Tacton parameters
• amplitude
• frequency
• timing
Tactons presented to the wrist have shown to be
effective in providing information to people with
deafblindness.
Research result
Let‘s get practical!
• smart remote control
• connects to all your devices
• control device with your voice or
smartphone
Homey
• Wi-Fi, Bluetooth, Infra-red, Zigbee, NFC/NRF,
433 MHz and Z-Wave
• Homey app: to create scenes and set up
responses to events
• developers can create own applications (API)
• open platform (easily integrated with other
solutions)
Homey
Homey and the smartwatch
• building an application
• smartwatch app
• using API
Further development by Bartiméus
Testing
• testing with at least 5 people with
deafblindness at their home
• testing is currently in progress.
Results 1:
• male, 65 years old, blind, hard of hearing
• hearing aid
• strongly focused on hearing
• prefers short vibrations
• vibrations too weak, other wearable?
• nice addition: high user-friendliness
Results 2:
• female, 70 years old, hard of hearing
• tunnel vision
• vibrations were strong enough, also during activities
• increase of sense of security
DBI World Conference 2019 - Converting vibrotactile information in daily practice of people with deafblindness
DBI World Conference 2019 - Converting vibrotactile information in daily practice of people with deafblindness
DBI World Conference 2019 - Converting vibrotactile information in daily practice of people with deafblindness
DBI World Conference 2019 - Converting vibrotactile information in daily practice of people with deafblindness
Feedback
• watersensor: watch vibrates as long as the tap is
running
• possible feedback to doorbel (i’m coming!)
• facial recognition
How to continue…
Connect more devices
Integrate in daily practice
Magic 7!
Final conlusion
The projects shows:
Mainstream technology can cause more
safety and self-sufficiency to those living
with deafblindness.
Tactile information is key.
Questions?
www.bartimeus.nl/fablab
evheuvelen@bartimeus.nl
Eric van Heuvelen
Bartiméus, the Netherlands
1 of 37

Recommended

ChatGPT and the Future of Work - Clark Boyd by
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
22.6K views69 slides
Getting into the tech field. what next by
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
5.5K views22 slides
Google's Just Not That Into You: Understanding Core Updates & Search Intent by
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
6.2K views99 slides
How to have difficult conversations by
How to have difficult conversations How to have difficult conversations
How to have difficult conversations Rajiv Jayarajah, MAppComm, ACC
4.7K views19 slides
Introduction to Data Science by
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data ScienceChristy Abraham Joy
82.2K views51 slides
Time Management & Productivity - Best Practices by
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
169.7K views42 slides

More Related Content

Recently uploaded

Sodium Sulphate Manufacturing Plant Project Report 2024 by
Sodium Sulphate Manufacturing Plant Project Report 2024Sodium Sulphate Manufacturing Plant Project Report 2024
Sodium Sulphate Manufacturing Plant Project Report 2024AlinaEllis1
9 views16 slides
Renal cell carcinoma- non clear cell.pptx by
Renal cell carcinoma- non clear cell.pptxRenal cell carcinoma- non clear cell.pptx
Renal cell carcinoma- non clear cell.pptxDr. Sumit KUMAR
9 views41 slides
MEAUREMENT OF STATIC AND DYNAMIC POWER TEST.pptx by
MEAUREMENT OF STATIC AND DYNAMIC POWER TEST.pptxMEAUREMENT OF STATIC AND DYNAMIC POWER TEST.pptx
MEAUREMENT OF STATIC AND DYNAMIC POWER TEST.pptxRishab Mishra
44 views14 slides
Presentation1 BLACKTOWN AND DRUITT HOSPITALS YOU ARE ALL SCUM.pptx by
Presentation1 BLACKTOWN AND DRUITT HOSPITALS YOU ARE ALL SCUM.pptxPresentation1 BLACKTOWN AND DRUITT HOSPITALS YOU ARE ALL SCUM.pptx
Presentation1 BLACKTOWN AND DRUITT HOSPITALS YOU ARE ALL SCUM.pptxBraydenStoch2
10 views1 slide
RENAL DIET by
RENAL DIET RENAL DIET
RENAL DIET RasmoniPradhan
6 views10 slides
AI in Healthcare SKH 25 Nov 23 by
AI in Healthcare SKH 25 Nov 23AI in Healthcare SKH 25 Nov 23
AI in Healthcare SKH 25 Nov 23Vaikunthan Rajaratnam
37 views140 slides

Recently uploaded(20)

Sodium Sulphate Manufacturing Plant Project Report 2024 by AlinaEllis1
Sodium Sulphate Manufacturing Plant Project Report 2024Sodium Sulphate Manufacturing Plant Project Report 2024
Sodium Sulphate Manufacturing Plant Project Report 2024
AlinaEllis19 views
Renal cell carcinoma- non clear cell.pptx by Dr. Sumit KUMAR
Renal cell carcinoma- non clear cell.pptxRenal cell carcinoma- non clear cell.pptx
Renal cell carcinoma- non clear cell.pptx
Dr. Sumit KUMAR9 views
MEAUREMENT OF STATIC AND DYNAMIC POWER TEST.pptx by Rishab Mishra
MEAUREMENT OF STATIC AND DYNAMIC POWER TEST.pptxMEAUREMENT OF STATIC AND DYNAMIC POWER TEST.pptx
MEAUREMENT OF STATIC AND DYNAMIC POWER TEST.pptx
Rishab Mishra44 views
Presentation1 BLACKTOWN AND DRUITT HOSPITALS YOU ARE ALL SCUM.pptx by BraydenStoch2
Presentation1 BLACKTOWN AND DRUITT HOSPITALS YOU ARE ALL SCUM.pptxPresentation1 BLACKTOWN AND DRUITT HOSPITALS YOU ARE ALL SCUM.pptx
Presentation1 BLACKTOWN AND DRUITT HOSPITALS YOU ARE ALL SCUM.pptx
BraydenStoch210 views
Low Vision Managment, Age Related Macular Degeneration ARMD by mahendra singh
Low Vision Managment, Age Related Macular Degeneration ARMDLow Vision Managment, Age Related Macular Degeneration ARMD
Low Vision Managment, Age Related Macular Degeneration ARMD
mahendra singh6 views
Communication and NPR Presentation.pptx by Winnie
Communication and NPR Presentation.pptxCommunication and NPR Presentation.pptx
Communication and NPR Presentation.pptx
Winnie 9 views
FROSTBITE by A Y
FROSTBITE FROSTBITE
FROSTBITE
A Y6 views
SMART RADIOLOGY : AI INNOVATIONS by vaarunimi
SMART RADIOLOGY  : AI INNOVATIONS SMART RADIOLOGY  : AI INNOVATIONS
SMART RADIOLOGY : AI INNOVATIONS
vaarunimi41 views
Compounding in hospitals.pptx by Komal Sathe
Compounding in hospitals.pptxCompounding in hospitals.pptx
Compounding in hospitals.pptx
Komal Sathe14 views
vital signs...ILAYARAJA SAMPATH by S ILAYA RAJA
vital signs...ILAYARAJA SAMPATHvital signs...ILAYARAJA SAMPATH
vital signs...ILAYARAJA SAMPATH
S ILAYA RAJA223 views
Telecounselling-Manual.pdf by manali9054
Telecounselling-Manual.pdfTelecounselling-Manual.pdf
Telecounselling-Manual.pdf
manali905412 views
Bubble Tea Manufacturing Plant Project Report 2024 by AlinaEllis1
Bubble Tea Manufacturing Plant Project Report 2024Bubble Tea Manufacturing Plant Project Report 2024
Bubble Tea Manufacturing Plant Project Report 2024
AlinaEllis19 views
NURSING AS A PROFESSION, CHARACTERISTICS OF NURSE,NURSING PRINCIPLES.pptx by Krishna Gandhi
NURSING AS A PROFESSION, CHARACTERISTICS OF NURSE,NURSING PRINCIPLES.pptxNURSING AS A PROFESSION, CHARACTERISTICS OF NURSE,NURSING PRINCIPLES.pptx
NURSING AS A PROFESSION, CHARACTERISTICS OF NURSE,NURSING PRINCIPLES.pptx
Krishna Gandhi40 views

Featured

Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present... by
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Applitools
55.5K views138 slides
12 Ways to Increase Your Influence at Work by
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at WorkGetSmarter
401.6K views64 slides
ChatGPT webinar slides by
ChatGPT webinar slidesChatGPT webinar slides
ChatGPT webinar slidesAlireza Esmikhani
30.3K views36 slides
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G... by
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...DevGAMM Conference
3.6K views12 slides
Barbie - Brand Strategy Presentation by
Barbie - Brand Strategy PresentationBarbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationErica Santiago
25.1K views46 slides

Featured(20)

Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present... by Applitools
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Applitools55.5K views
12 Ways to Increase Your Influence at Work by GetSmarter
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
GetSmarter401.6K views
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G... by DevGAMM Conference
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
DevGAMM Conference3.6K views
Barbie - Brand Strategy Presentation by Erica Santiago
Barbie - Brand Strategy PresentationBarbie - Brand Strategy Presentation
Barbie - Brand Strategy Presentation
Erica Santiago25.1K views
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well by Saba Software
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellGood Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Saba Software25.2K views
Introduction to C Programming Language by Simplilearn
Introduction to C Programming LanguageIntroduction to C Programming Language
Introduction to C Programming Language
Simplilearn8.4K views
The Pixar Way: 37 Quotes on Developing and Maintaining a Creative Company (fr... by Palo Alto Software
The Pixar Way: 37 Quotes on Developing and Maintaining a Creative Company (fr...The Pixar Way: 37 Quotes on Developing and Maintaining a Creative Company (fr...
The Pixar Way: 37 Quotes on Developing and Maintaining a Creative Company (fr...
Palo Alto Software88.4K views
9 Tips for a Work-free Vacation by Weekdone.com
9 Tips for a Work-free Vacation9 Tips for a Work-free Vacation
9 Tips for a Work-free Vacation
Weekdone.com7.2K views
How to Map Your Future by SlideShop.com
How to Map Your FutureHow to Map Your Future
How to Map Your Future
SlideShop.com275.1K views
Beyond Pride: Making Digital Marketing & SEO Authentically LGBTQ+ Inclusive -... by AccuraCast
Beyond Pride: Making Digital Marketing & SEO Authentically LGBTQ+ Inclusive -...Beyond Pride: Making Digital Marketing & SEO Authentically LGBTQ+ Inclusive -...
Beyond Pride: Making Digital Marketing & SEO Authentically LGBTQ+ Inclusive -...
AccuraCast3.4K views
Exploring ChatGPT for Effective Teaching and Learning.pptx by Stan Skrabut, Ed.D.
Exploring ChatGPT for Effective Teaching and Learning.pptxExploring ChatGPT for Effective Teaching and Learning.pptx
Exploring ChatGPT for Effective Teaching and Learning.pptx
Stan Skrabut, Ed.D.57.7K views
How to train your robot (with Deep Reinforcement Learning) by Lucas García, PhD
How to train your robot (with Deep Reinforcement Learning)How to train your robot (with Deep Reinforcement Learning)
How to train your robot (with Deep Reinforcement Learning)
Lucas García, PhD42.5K views
4 Strategies to Renew Your Career Passion by Daniel Goleman
4 Strategies to Renew Your Career Passion4 Strategies to Renew Your Career Passion
4 Strategies to Renew Your Career Passion
Daniel Goleman122K views
The Student's Guide to LinkedIn by LinkedIn
The Student's Guide to LinkedInThe Student's Guide to LinkedIn
The Student's Guide to LinkedIn
LinkedIn87.9K views
Different Roles in Machine Learning Career by Intellipaat
Different Roles in Machine Learning CareerDifferent Roles in Machine Learning Career
Different Roles in Machine Learning Career
Intellipaat12.4K views
Defining a Tech Project Vision in Eight Quick Steps pdf by TechSoup
Defining a Tech Project Vision in Eight Quick Steps pdfDefining a Tech Project Vision in Eight Quick Steps pdf
Defining a Tech Project Vision in Eight Quick Steps pdf
TechSoup 9.7K views

DBI World Conference 2019 - Converting vibrotactile information in daily practice of people with deafblindness

  • 1. Eric van Heuvelen assistive technology specialist Bartiméus, the Netherlands Converting vibrotactile information in daily practice for people with deafblindness
  • 2. no conflicts of interest to disclose
  • 3. Centre of Expertise B: support assisted livingeducation
  • 4. Some context: • one of two centres of expertise • 17 million inhabitants • 350.000 visually impaired • 80.000 – 85.000 people with deafblindness • 2.000 people congenital • 1.500 acquired • Approxmately 80.000 elderly
  • 6. FabLabsmart technology for people with a disability Bartiméus FabLab
  • 8. Centre of expertise on deafblindness
  • 9. Dreaming about an accessible life Brainstorming sessions with people with deafblindness
  • 10. • one tool • different devices • signaling as warning, attention, recognition One of the main conclusions :
  • 11. • who is at the door? But also: • when someone is approaching you in the garden • smoke detection • a smart status detector: the status of household electrical appliances e.g. whether a coffee maker is switched on or off Developing the “Smart doorbell”
  • 13. Evaluation • evaluation of prototype with people with deafblindness • options for improvement were discussed
  • 14. • use of regular consumer technology (smartwatch) • integration of more devices • pre-alert, color and text First results
  • 15. Conclusion so far….. Worked well in lab conditions, but……. Problems: • using own wifi network to set up • small range • poor reliabilty • poor wifi strenght • not easy to start up after break down
  • 17. 1. explore the perception of vibrotactile patterns (tactons) with people with deafblindness (master thesis) 2. user needs to work with mainstream (consumer) technology Conditions
  • 18. Research • what kind of vibrotactile patterns should be used • how many different tactons can be distinguished • will these patterns be recognized when a user is going about his day doing regular daily activities?
  • 19. • can tactons be accurately detected and linked to a specific meaning when presented on the wrist? • can these tactons also be recognized when participants are engaged in cognitive and distracting activities? • the effect of long-term memory on tacton detection and recognition in a call-back testing setting Current Research
  • 20. Tacton parameters • amplitude • frequency • timing
  • 21. Tactons presented to the wrist have shown to be effective in providing information to people with deafblindness. Research result
  • 23. • smart remote control • connects to all your devices • control device with your voice or smartphone Homey
  • 24. • Wi-Fi, Bluetooth, Infra-red, Zigbee, NFC/NRF, 433 MHz and Z-Wave • Homey app: to create scenes and set up responses to events • developers can create own applications (API) • open platform (easily integrated with other solutions) Homey
  • 25. Homey and the smartwatch
  • 26. • building an application • smartwatch app • using API Further development by Bartiméus
  • 27. Testing • testing with at least 5 people with deafblindness at their home • testing is currently in progress.
  • 28. Results 1: • male, 65 years old, blind, hard of hearing • hearing aid • strongly focused on hearing • prefers short vibrations • vibrations too weak, other wearable? • nice addition: high user-friendliness
  • 29. Results 2: • female, 70 years old, hard of hearing • tunnel vision • vibrations were strong enough, also during activities • increase of sense of security
  • 34. Feedback • watersensor: watch vibrates as long as the tap is running • possible feedback to doorbel (i’m coming!) • facial recognition
  • 35. How to continue… Connect more devices Integrate in daily practice Magic 7!
  • 36. Final conlusion The projects shows: Mainstream technology can cause more safety and self-sufficiency to those living with deafblindness. Tactile information is key.