SlideShare a Scribd company logo
OTASCE Map: A Mobile Map Tool
with Customizable Audio-Tactile
Cues for the Visually Impaired
Masaki Matsuo1, Takahiro Miura2, Ryosuke Ichikari2,
Karimu Kato1, Takeshi Kurata1,2
1) University of Tsukuba, Japan.
2) Nat’l Inst. of Advanced Industrial Science and Technology (AIST), Japan.
Abstract
ver.0.1
๏OTASCE Map (Oto-Tactile
SCapE Map) that can
represent real-world route
information
Preferred combination of audio-tactile stimuli varies
depending on the degree of a user's disability.
๏Evaluated preferred combinations
of voice/sound/vibration (n=5):
๏Blind: sound + voice + vibration
๏Low vision: single effect
(voice or vibration)
ver.1.0
Outline
• Background and Objective
• Design of the audio-tactile map viewer
• Evaluation of map viewer
• Conclusion and Future work
• After presentation
• Questions and discussions
• Demonstration of OTASCE Map
Background 1
• Several navigation methods for the visually impaired
• Turn-by-turn navigation
• Orientation in relation to points of interest (POIs) near the
starting point or destination of the route
• Learning routes before going out
4
Background 2
• Examples of Various Navigational Aids:
• NavCog: Indoor turn-by-turn navigation system that
enables users to walk easily to destination in building
using audio information.
• BlindSquare: Orientation information systems that delivers
detailed points of interest (POIS) and intersections using
speech and sounds.
5
Background 3
• Examples of Route Learning Systems:
• Method of conveying terrain information for the
visually impaired using tactile and sound information
• Tactile maps: presents graphic information using
raised surfaces
• AR tactile map: recognizes the movement of the
fingertip on the map and informs the information of
the touched location through speech.
6
Problems
• Few map applications feature flexible and customizable kinds
of audio and tactile stimuli.
• Few smartphone applications represent route information from
the starting point to the destination through tactile information.
7
Objective
• To investigate the most useful combinations
of audio-tactile cues for visual impairments.
• Developed an audio-tactile map viewer that can
represent real-world route information and POIs
near the route.
• Improved the viewer with customizable audio-
tactile cues based on feedback from test users at
workshops.
• This app is expected to be used to learn routes
before going out.
8
Outline
• Background and Objective
• Design of the audio-tactile map viewer
• Evaluation of map viewer
• Conclusion and Future work
Design of the audio-tactile map viewer
• The OTASCE Map presents 2D maps using auditory and
tactile stimuli.
• Difference from previous studies
• Customizable audio-tactile cues
• Available for general-purpose devices
• implemented on iPhone
10
Demonstration of
OTASCE map
operated by visually
impaired people
11
How to use
• User experience:
• Operate by trace the touch screen
• Feedback by Sound effects , voice information, vibration pattern
• Screen objects:
• Points Vertices and branches in a route
• Line Lines on the route
12
Two guidance functions
• Free-touch function
• The user can touch routes and POI freely.
• Route-guidance function
• The user can grasp roughly the shape of the route from
the starting point to the destination.
13
Outline
• Background and Objective
• Design of the audio-tactile map viewer
• Evaluation of map viewer
• Conclusion and Future work
Workshop with visually impaired people
• Objective:
• To investigate the most useful combinations of audio-tactile cues for
people with visual impairments including low vision and blindness.
• Participants
• 3 blind, 2 low vision
• Evaluation procedure
• Repeat the audio-tactile effects customizing and map touching
• Explain and discuss their preferred combinations of audio-tactile cues
• Share / discuss customization results
• Survey about usability
15
Views of the system used for workshop
16
Participants of the workshop
17
3 blind &
2 low vision
Video of
customized
results by the
blind
18
Video of
customized
results by the
low vision
19
Two types of
audio-tactile
patterns
designed
based on
the results of
the workshop
20
Summary
• We designed the OTASCE Map viewer for presenting maps and routes
to visually impaired people using customizable audio-tactile effects.
• We found that the preferred combination of audio-tactile
stimuli varies depending on the degree of a user's disability:
• blind participants tend to prefer a combination of two or
more kinds of cues
• while participants with low vision preferred to use only a
single cue.
21
• This app is expected to be used to help the users learn
routes before going out and grasp surrounding POIs.
Future work
• Our final goal
• To develop an audio-tactile mapping tool that allows
blind people to grasp, modify, and create 2D figures
like maps in the real-world. 22
• Future work
• Evaluating two types of audio-tactile patterns quantitatively with a
larger study
• Creating a tutorial mode
• Publishing the OTASCE Map apps
• Extension to mapping tool: prototyping a map-creation tool that
implements combinations of audio-tactile effects and voice cues.
Thank you!
Please check the Twitter
for the OTASCE Map release announcement.
@mmatsuo10
https://twitter.com/mmatsuo10

More Related Content

Similar to OTASCE Map: A Mobile Map Tool with Customizable Audio-Tactile Cues for the Visually Impaired

Eye Ring ppt
Eye Ring pptEye Ring ppt
Eye Ring ppt
Chodi DurgaRao
 
EyeRing PowerPoint Presentation
EyeRing PowerPoint PresentationEyeRing PowerPoint Presentation
EyeRing PowerPoint Presentation
Priyad S Naidu
 
Assistive technologies: experiences from AAL for the blind and visually impai...
Assistive technologies: experiences from AAL for the blind and visually impai...Assistive technologies: experiences from AAL for the blind and visually impai...
Assistive technologies: experiences from AAL for the blind and visually impai...
Andrei Bursuc
 
Wayfinding without visual cues
Wayfinding without visual cuesWayfinding without visual cues
Wayfinding without visual cuesKyung Jin Hong
 
An Immersive Map Exploration System Using Handheld Device
An Immersive Map Exploration System Using Handheld DeviceAn Immersive Map Exploration System Using Handheld Device
An Immersive Map Exploration System Using Handheld Device
Hadziq Fabroyir
 
Blind Children Navigation through Gaming and Associated Brain Plasticity
Blind Children Navigation through Gaming and Associated Brain PlasticityBlind Children Navigation through Gaming and Associated Brain Plasticity
Blind Children Navigation through Gaming and Associated Brain Plasticity
Angelo Tadres
 
Input devices dani
Input devices daniInput devices dani
Input devices dani
Dinesh Kumar
 
eye ring technology 1.pptx
eye ring technology 1.pptxeye ring technology 1.pptx
eye ring technology 1.pptx
Anku34
 
sixth sense technology by pranav mistery
sixth sense technology by pranav misterysixth sense technology by pranav mistery
sixth sense technology by pranav mistery
AmitGajera
 
Mobile Phone Instruments, the Possibilities of Networks, and OSC
Mobile Phone Instruments, the Possibilities of Networks, and OSCMobile Phone Instruments, the Possibilities of Networks, and OSC
Mobile Phone Instruments, the Possibilities of Networks, and OSC
NathanBowen8
 
Sixth sense technology ppt
Sixth sense technology pptSixth sense technology ppt
Sixth sense technology ppt
Mohammad Adil
 
HAND GESTURE VOCALIZER
HAND GESTURE VOCALIZERHAND GESTURE VOCALIZER
HAND GESTURE VOCALIZER
IRJET Journal
 
blind stick using ultrasonic sensor and alarm
blind stick using ultrasonic sensor and alarmblind stick using ultrasonic sensor and alarm
blind stick using ultrasonic sensor and alarm
Hamed Raza
 
Sixth sense technology
Sixth sense technologySixth sense technology
Sixth sense technology
Nikhil Vyas
 
assisting device for visually impaired person
assisting device for visually impaired personassisting device for visually impaired person
assisting device for visually impaired person
Pushpa Gothwal
 
kashif.pptx
kashif.pptxkashif.pptx
kashif.pptx
mdmaaz1232
 
The Sixth Sense Technology
The Sixth Sense TechnologyThe Sixth Sense Technology
The Sixth Sense TechnologyRonak Dumasia
 
Sixth sense technology ppt
Sixth sense technology pptSixth sense technology ppt
Sixth sense technology ppt
OECLIB Odisha Electronics Control Library
 
Sixth sense technology
Sixth sense technologySixth sense technology
Sixth sense technology
JISMI JACOB
 

Similar to OTASCE Map: A Mobile Map Tool with Customizable Audio-Tactile Cues for the Visually Impaired (20)

Eye Ring ppt
Eye Ring pptEye Ring ppt
Eye Ring ppt
 
EyeRing PowerPoint Presentation
EyeRing PowerPoint PresentationEyeRing PowerPoint Presentation
EyeRing PowerPoint Presentation
 
Assistive technologies: experiences from AAL for the blind and visually impai...
Assistive technologies: experiences from AAL for the blind and visually impai...Assistive technologies: experiences from AAL for the blind and visually impai...
Assistive technologies: experiences from AAL for the blind and visually impai...
 
Wayfinding without visual cues
Wayfinding without visual cuesWayfinding without visual cues
Wayfinding without visual cues
 
An Immersive Map Exploration System Using Handheld Device
An Immersive Map Exploration System Using Handheld DeviceAn Immersive Map Exploration System Using Handheld Device
An Immersive Map Exploration System Using Handheld Device
 
Blind Children Navigation through Gaming and Associated Brain Plasticity
Blind Children Navigation through Gaming and Associated Brain PlasticityBlind Children Navigation through Gaming and Associated Brain Plasticity
Blind Children Navigation through Gaming and Associated Brain Plasticity
 
Input devices dani
Input devices daniInput devices dani
Input devices dani
 
eye ring technology 1.pptx
eye ring technology 1.pptxeye ring technology 1.pptx
eye ring technology 1.pptx
 
sixth sense technology by pranav mistery
sixth sense technology by pranav misterysixth sense technology by pranav mistery
sixth sense technology by pranav mistery
 
Mobile Phone Instruments, the Possibilities of Networks, and OSC
Mobile Phone Instruments, the Possibilities of Networks, and OSCMobile Phone Instruments, the Possibilities of Networks, and OSC
Mobile Phone Instruments, the Possibilities of Networks, and OSC
 
47 haptic maps ntu
47 haptic maps ntu47 haptic maps ntu
47 haptic maps ntu
 
Sixth sense technology ppt
Sixth sense technology pptSixth sense technology ppt
Sixth sense technology ppt
 
HAND GESTURE VOCALIZER
HAND GESTURE VOCALIZERHAND GESTURE VOCALIZER
HAND GESTURE VOCALIZER
 
blind stick using ultrasonic sensor and alarm
blind stick using ultrasonic sensor and alarmblind stick using ultrasonic sensor and alarm
blind stick using ultrasonic sensor and alarm
 
Sixth sense technology
Sixth sense technologySixth sense technology
Sixth sense technology
 
assisting device for visually impaired person
assisting device for visually impaired personassisting device for visually impaired person
assisting device for visually impaired person
 
kashif.pptx
kashif.pptxkashif.pptx
kashif.pptx
 
The Sixth Sense Technology
The Sixth Sense TechnologyThe Sixth Sense Technology
The Sixth Sense Technology
 
Sixth sense technology ppt
Sixth sense technology pptSixth sense technology ppt
Sixth sense technology ppt
 
Sixth sense technology
Sixth sense technologySixth sense technology
Sixth sense technology
 

More from Kurata Takeshi

人的資本経営のための地理情報インテリジェンス 作業パターン分析と心身状態把握に関する実証事例
人的資本経営のための地理情報インテリジェンス 作業パターン分析と心身状態把握に関する実証事例人的資本経営のための地理情報インテリジェンス 作業パターン分析と心身状態把握に関する実証事例
人的資本経営のための地理情報インテリジェンス 作業パターン分析と心身状態把握に関する実証事例
Kurata Takeshi
 
Project progress on XR-AI platform for tele-rehab and health guidance
Project progress on XR-AI platform for tele-rehab and health guidanceProject progress on XR-AI platform for tele-rehab and health guidance
Project progress on XR-AI platform for tele-rehab and health guidance
Kurata Takeshi
 
サービス学会国内大会:高速道路サービスエリア施設内での動線データのみを用いた作業行動パターン分析
サービス学会国内大会:高速道路サービスエリア施設内での動線データのみを用いた作業行動パターン分析サービス学会国内大会:高速道路サービスエリア施設内での動線データのみを用いた作業行動パターン分析
サービス学会国内大会:高速道路サービスエリア施設内での動線データのみを用いた作業行動パターン分析
Kurata Takeshi
 
HARC: Human Augmentation Research Center
HARC: Human Augmentation Research CenterHARC: Human Augmentation Research Center
HARC: Human Augmentation Research Center
Kurata Takeshi
 
Work Pattern Analysis with and without Site-specific Information in a Manufac...
Work Pattern Analysis with and without Site-specific Information in a Manufac...Work Pattern Analysis with and without Site-specific Information in a Manufac...
Work Pattern Analysis with and without Site-specific Information in a Manufac...
Kurata Takeshi
 
SC 24でのメタバース関連標準化概要:ヘルスケア応用事例を交えて(ISO/IEC JTC 1/SC 24)
SC 24でのメタバース関連標準化概要:ヘルスケア応用事例を交えて(ISO/IEC JTC 1/SC 24)SC 24でのメタバース関連標準化概要:ヘルスケア応用事例を交えて(ISO/IEC JTC 1/SC 24)
SC 24でのメタバース関連標準化概要:ヘルスケア応用事例を交えて(ISO/IEC JTC 1/SC 24)
Kurata Takeshi
 
Standards and projects of SC 24/WG 9 on Metaverse and Interverse
Standards and projects of SC 24/WG 9 on Metaverse and InterverseStandards and projects of SC 24/WG 9 on Metaverse and Interverse
Standards and projects of SC 24/WG 9 on Metaverse and Interverse
Kurata Takeshi
 
屋内測位技術の応用事例とPDRベンチマーク標準化委員会の活動概要
屋内測位技術の応用事例とPDRベンチマーク標準化委員会の活動概要屋内測位技術の応用事例とPDRベンチマーク標準化委員会の活動概要
屋内測位技術の応用事例とPDRベンチマーク標準化委員会の活動概要
Kurata Takeshi
 
作業エリア遷移モデル生成とそのクラスター分析に基づく製造ラインの作業分析
作業エリア遷移モデル生成とそのクラスター分析に基づく製造ラインの作業分析作業エリア遷移モデル生成とそのクラスター分析に基づく製造ラインの作業分析
作業エリア遷移モデル生成とそのクラスター分析に基づく製造ラインの作業分析
Kurata Takeshi
 
「遠隔リハビリのための多感覚XR-AI技術基盤構築と保健指導との互恵ケア連携」で目指すところ
「遠隔リハビリのための多感覚XR-AI技術基盤構築と保健指導との互恵ケア連携」で目指すところ「遠隔リハビリのための多感覚XR-AI技術基盤構築と保健指導との互恵ケア連携」で目指すところ
「遠隔リハビリのための多感覚XR-AI技術基盤構築と保健指導との互恵ケア連携」で目指すところ
Kurata Takeshi
 
遠隔リハビリ研究とオンライン学会運営から見たコミュニケーションDX
遠隔リハビリ研究とオンライン学会運営から見たコミュニケーションDX遠隔リハビリ研究とオンライン学会運営から見たコミュニケーションDX
遠隔リハビリ研究とオンライン学会運営から見たコミュニケーションDX
Kurata Takeshi
 
Analyzing Operations on a Manufacturing Line using Geospatial Intelligence T...
Analyzing Operations on a Manufacturing Line using Geospatial Intelligence T...Analyzing Operations on a Manufacturing Line using Geospatial Intelligence T...
Analyzing Operations on a Manufacturing Line using Geospatial Intelligence T...
Kurata Takeshi
 
国際標準化におけるAR/MR用語の使われ方
国際標準化におけるAR/MR用語の使われ方国際標準化におけるAR/MR用語の使われ方
国際標準化におけるAR/MR用語の使われ方
Kurata Takeshi
 
XRに基づく遠隔リハの研究・事業事例調査報告
XRに基づく遠隔リハの研究・事業事例調査報告XRに基づく遠隔リハの研究・事業事例調査報告
XRに基づく遠隔リハの研究・事業事例調査報告
Kurata Takeshi
 
「遠隔リハビリのための多感覚XR-AI技術基盤構築と保健指導との互恵ケア連携」の概要
「遠隔リハビリのための多感覚XR-AI技術基盤構築と保健指導との互恵ケア連携」の概要「遠隔リハビリのための多感覚XR-AI技術基盤構築と保健指導との互恵ケア連携」の概要
「遠隔リハビリのための多感覚XR-AI技術基盤構築と保健指導との互恵ケア連携」の概要
Kurata Takeshi
 
サービス学とか何か(応用サービス工学)
サービス学とか何か(応用サービス工学)サービス学とか何か(応用サービス工学)
サービス学とか何か(応用サービス工学)
Kurata Takeshi
 
XR/xDRによる労働生産性の向上、QoW向上
XR/xDRによる労働生産性の向上、QoW向上XR/xDRによる労働生産性の向上、QoW向上
XR/xDRによる労働生産性の向上、QoW向上
Kurata Takeshi
 
地理空間インテリジェンス技術を用いた 製造ラインでの作業分析
地理空間インテリジェンス技術を用いた 製造ラインでの作業分析地理空間インテリジェンス技術を用いた 製造ラインでの作業分析
地理空間インテリジェンス技術を用いた 製造ラインでの作業分析
Kurata Takeshi
 
Geospatial Intelligence for Health and Productivity Management in Japanese Re...
Geospatial Intelligence for Health and Productivity Management in Japanese Re...Geospatial Intelligence for Health and Productivity Management in Japanese Re...
Geospatial Intelligence for Health and Productivity Management in Japanese Re...
Kurata Takeshi
 
製造業・サービス業での人とシステムとの協調
製造業・サービス業での人とシステムとの協調製造業・サービス業での人とシステムとの協調
製造業・サービス業での人とシステムとの協調
Kurata Takeshi
 

More from Kurata Takeshi (20)

人的資本経営のための地理情報インテリジェンス 作業パターン分析と心身状態把握に関する実証事例
人的資本経営のための地理情報インテリジェンス 作業パターン分析と心身状態把握に関する実証事例人的資本経営のための地理情報インテリジェンス 作業パターン分析と心身状態把握に関する実証事例
人的資本経営のための地理情報インテリジェンス 作業パターン分析と心身状態把握に関する実証事例
 
Project progress on XR-AI platform for tele-rehab and health guidance
Project progress on XR-AI platform for tele-rehab and health guidanceProject progress on XR-AI platform for tele-rehab and health guidance
Project progress on XR-AI platform for tele-rehab and health guidance
 
サービス学会国内大会:高速道路サービスエリア施設内での動線データのみを用いた作業行動パターン分析
サービス学会国内大会:高速道路サービスエリア施設内での動線データのみを用いた作業行動パターン分析サービス学会国内大会:高速道路サービスエリア施設内での動線データのみを用いた作業行動パターン分析
サービス学会国内大会:高速道路サービスエリア施設内での動線データのみを用いた作業行動パターン分析
 
HARC: Human Augmentation Research Center
HARC: Human Augmentation Research CenterHARC: Human Augmentation Research Center
HARC: Human Augmentation Research Center
 
Work Pattern Analysis with and without Site-specific Information in a Manufac...
Work Pattern Analysis with and without Site-specific Information in a Manufac...Work Pattern Analysis with and without Site-specific Information in a Manufac...
Work Pattern Analysis with and without Site-specific Information in a Manufac...
 
SC 24でのメタバース関連標準化概要:ヘルスケア応用事例を交えて(ISO/IEC JTC 1/SC 24)
SC 24でのメタバース関連標準化概要:ヘルスケア応用事例を交えて(ISO/IEC JTC 1/SC 24)SC 24でのメタバース関連標準化概要:ヘルスケア応用事例を交えて(ISO/IEC JTC 1/SC 24)
SC 24でのメタバース関連標準化概要:ヘルスケア応用事例を交えて(ISO/IEC JTC 1/SC 24)
 
Standards and projects of SC 24/WG 9 on Metaverse and Interverse
Standards and projects of SC 24/WG 9 on Metaverse and InterverseStandards and projects of SC 24/WG 9 on Metaverse and Interverse
Standards and projects of SC 24/WG 9 on Metaverse and Interverse
 
屋内測位技術の応用事例とPDRベンチマーク標準化委員会の活動概要
屋内測位技術の応用事例とPDRベンチマーク標準化委員会の活動概要屋内測位技術の応用事例とPDRベンチマーク標準化委員会の活動概要
屋内測位技術の応用事例とPDRベンチマーク標準化委員会の活動概要
 
作業エリア遷移モデル生成とそのクラスター分析に基づく製造ラインの作業分析
作業エリア遷移モデル生成とそのクラスター分析に基づく製造ラインの作業分析作業エリア遷移モデル生成とそのクラスター分析に基づく製造ラインの作業分析
作業エリア遷移モデル生成とそのクラスター分析に基づく製造ラインの作業分析
 
「遠隔リハビリのための多感覚XR-AI技術基盤構築と保健指導との互恵ケア連携」で目指すところ
「遠隔リハビリのための多感覚XR-AI技術基盤構築と保健指導との互恵ケア連携」で目指すところ「遠隔リハビリのための多感覚XR-AI技術基盤構築と保健指導との互恵ケア連携」で目指すところ
「遠隔リハビリのための多感覚XR-AI技術基盤構築と保健指導との互恵ケア連携」で目指すところ
 
遠隔リハビリ研究とオンライン学会運営から見たコミュニケーションDX
遠隔リハビリ研究とオンライン学会運営から見たコミュニケーションDX遠隔リハビリ研究とオンライン学会運営から見たコミュニケーションDX
遠隔リハビリ研究とオンライン学会運営から見たコミュニケーションDX
 
Analyzing Operations on a Manufacturing Line using Geospatial Intelligence T...
Analyzing Operations on a Manufacturing Line using Geospatial Intelligence T...Analyzing Operations on a Manufacturing Line using Geospatial Intelligence T...
Analyzing Operations on a Manufacturing Line using Geospatial Intelligence T...
 
国際標準化におけるAR/MR用語の使われ方
国際標準化におけるAR/MR用語の使われ方国際標準化におけるAR/MR用語の使われ方
国際標準化におけるAR/MR用語の使われ方
 
XRに基づく遠隔リハの研究・事業事例調査報告
XRに基づく遠隔リハの研究・事業事例調査報告XRに基づく遠隔リハの研究・事業事例調査報告
XRに基づく遠隔リハの研究・事業事例調査報告
 
「遠隔リハビリのための多感覚XR-AI技術基盤構築と保健指導との互恵ケア連携」の概要
「遠隔リハビリのための多感覚XR-AI技術基盤構築と保健指導との互恵ケア連携」の概要「遠隔リハビリのための多感覚XR-AI技術基盤構築と保健指導との互恵ケア連携」の概要
「遠隔リハビリのための多感覚XR-AI技術基盤構築と保健指導との互恵ケア連携」の概要
 
サービス学とか何か(応用サービス工学)
サービス学とか何か(応用サービス工学)サービス学とか何か(応用サービス工学)
サービス学とか何か(応用サービス工学)
 
XR/xDRによる労働生産性の向上、QoW向上
XR/xDRによる労働生産性の向上、QoW向上XR/xDRによる労働生産性の向上、QoW向上
XR/xDRによる労働生産性の向上、QoW向上
 
地理空間インテリジェンス技術を用いた 製造ラインでの作業分析
地理空間インテリジェンス技術を用いた 製造ラインでの作業分析地理空間インテリジェンス技術を用いた 製造ラインでの作業分析
地理空間インテリジェンス技術を用いた 製造ラインでの作業分析
 
Geospatial Intelligence for Health and Productivity Management in Japanese Re...
Geospatial Intelligence for Health and Productivity Management in Japanese Re...Geospatial Intelligence for Health and Productivity Management in Japanese Re...
Geospatial Intelligence for Health and Productivity Management in Japanese Re...
 
製造業・サービス業での人とシステムとの協調
製造業・サービス業での人とシステムとの協調製造業・サービス業での人とシステムとの協調
製造業・サービス業での人とシステムとの協調
 

Recently uploaded

WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234
AafreenAbuthahir2
 
addressing modes in computer architecture
addressing modes  in computer architectureaddressing modes  in computer architecture
addressing modes in computer architecture
ShahidSultan24
 
Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024
Massimo Talia
 
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
Amil Baba Dawood bangali
 
road safety engineering r s e unit 3.pdf
road safety engineering  r s e unit 3.pdfroad safety engineering  r s e unit 3.pdf
road safety engineering r s e unit 3.pdf
VENKATESHvenky89705
 
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
MdTanvirMahtab2
 
The role of big data in decision making.
The role of big data in decision making.The role of big data in decision making.
The role of big data in decision making.
ankuprajapati0525
 
Immunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary AttacksImmunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary Attacks
gerogepatton
 
COLLEGE BUS MANAGEMENT SYSTEM PROJECT REPORT.pdf
COLLEGE BUS MANAGEMENT SYSTEM PROJECT REPORT.pdfCOLLEGE BUS MANAGEMENT SYSTEM PROJECT REPORT.pdf
COLLEGE BUS MANAGEMENT SYSTEM PROJECT REPORT.pdf
Kamal Acharya
 
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
AJAYKUMARPUND1
 
Standard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - NeometrixStandard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - Neometrix
Neometrix_Engineering_Pvt_Ltd
 
Planning Of Procurement o different goods and services
Planning Of Procurement o different goods and servicesPlanning Of Procurement o different goods and services
Planning Of Procurement o different goods and services
JoytuBarua2
 
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang,  ICLR 2024, MLILAB, KAIST AI.pdfJ.Yang,  ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
MLILAB
 
The Benefits and Techniques of Trenchless Pipe Repair.pdf
The Benefits and Techniques of Trenchless Pipe Repair.pdfThe Benefits and Techniques of Trenchless Pipe Repair.pdf
The Benefits and Techniques of Trenchless Pipe Repair.pdf
Pipe Restoration Solutions
 
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdfTop 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Teleport Manpower Consultant
 
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Dr.Costas Sachpazis
 
Quality defects in TMT Bars, Possible causes and Potential Solutions.
Quality defects in TMT Bars, Possible causes and Potential Solutions.Quality defects in TMT Bars, Possible causes and Potential Solutions.
Quality defects in TMT Bars, Possible causes and Potential Solutions.
PrashantGoswami42
 
CME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional ElectiveCME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional Elective
karthi keyan
 
MCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdfMCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdf
Osamah Alsalih
 
Courier management system project report.pdf
Courier management system project report.pdfCourier management system project report.pdf
Courier management system project report.pdf
Kamal Acharya
 

Recently uploaded (20)

WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234
 
addressing modes in computer architecture
addressing modes  in computer architectureaddressing modes  in computer architecture
addressing modes in computer architecture
 
Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024
 
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
 
road safety engineering r s e unit 3.pdf
road safety engineering  r s e unit 3.pdfroad safety engineering  r s e unit 3.pdf
road safety engineering r s e unit 3.pdf
 
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
 
The role of big data in decision making.
The role of big data in decision making.The role of big data in decision making.
The role of big data in decision making.
 
Immunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary AttacksImmunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary Attacks
 
COLLEGE BUS MANAGEMENT SYSTEM PROJECT REPORT.pdf
COLLEGE BUS MANAGEMENT SYSTEM PROJECT REPORT.pdfCOLLEGE BUS MANAGEMENT SYSTEM PROJECT REPORT.pdf
COLLEGE BUS MANAGEMENT SYSTEM PROJECT REPORT.pdf
 
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
 
Standard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - NeometrixStandard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - Neometrix
 
Planning Of Procurement o different goods and services
Planning Of Procurement o different goods and servicesPlanning Of Procurement o different goods and services
Planning Of Procurement o different goods and services
 
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang,  ICLR 2024, MLILAB, KAIST AI.pdfJ.Yang,  ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
 
The Benefits and Techniques of Trenchless Pipe Repair.pdf
The Benefits and Techniques of Trenchless Pipe Repair.pdfThe Benefits and Techniques of Trenchless Pipe Repair.pdf
The Benefits and Techniques of Trenchless Pipe Repair.pdf
 
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdfTop 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
 
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
 
Quality defects in TMT Bars, Possible causes and Potential Solutions.
Quality defects in TMT Bars, Possible causes and Potential Solutions.Quality defects in TMT Bars, Possible causes and Potential Solutions.
Quality defects in TMT Bars, Possible causes and Potential Solutions.
 
CME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional ElectiveCME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional Elective
 
MCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdfMCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdf
 
Courier management system project report.pdf
Courier management system project report.pdfCourier management system project report.pdf
Courier management system project report.pdf
 

OTASCE Map: A Mobile Map Tool with Customizable Audio-Tactile Cues for the Visually Impaired

  • 1. OTASCE Map: A Mobile Map Tool with Customizable Audio-Tactile Cues for the Visually Impaired Masaki Matsuo1, Takahiro Miura2, Ryosuke Ichikari2, Karimu Kato1, Takeshi Kurata1,2 1) University of Tsukuba, Japan. 2) Nat’l Inst. of Advanced Industrial Science and Technology (AIST), Japan.
  • 2. Abstract ver.0.1 ๏OTASCE Map (Oto-Tactile SCapE Map) that can represent real-world route information Preferred combination of audio-tactile stimuli varies depending on the degree of a user's disability. ๏Evaluated preferred combinations of voice/sound/vibration (n=5): ๏Blind: sound + voice + vibration ๏Low vision: single effect (voice or vibration) ver.1.0
  • 3. Outline • Background and Objective • Design of the audio-tactile map viewer • Evaluation of map viewer • Conclusion and Future work • After presentation • Questions and discussions • Demonstration of OTASCE Map
  • 4. Background 1 • Several navigation methods for the visually impaired • Turn-by-turn navigation • Orientation in relation to points of interest (POIs) near the starting point or destination of the route • Learning routes before going out 4
  • 5. Background 2 • Examples of Various Navigational Aids: • NavCog: Indoor turn-by-turn navigation system that enables users to walk easily to destination in building using audio information. • BlindSquare: Orientation information systems that delivers detailed points of interest (POIS) and intersections using speech and sounds. 5
  • 6. Background 3 • Examples of Route Learning Systems: • Method of conveying terrain information for the visually impaired using tactile and sound information • Tactile maps: presents graphic information using raised surfaces • AR tactile map: recognizes the movement of the fingertip on the map and informs the information of the touched location through speech. 6
  • 7. Problems • Few map applications feature flexible and customizable kinds of audio and tactile stimuli. • Few smartphone applications represent route information from the starting point to the destination through tactile information. 7
  • 8. Objective • To investigate the most useful combinations of audio-tactile cues for visual impairments. • Developed an audio-tactile map viewer that can represent real-world route information and POIs near the route. • Improved the viewer with customizable audio- tactile cues based on feedback from test users at workshops. • This app is expected to be used to learn routes before going out. 8
  • 9. Outline • Background and Objective • Design of the audio-tactile map viewer • Evaluation of map viewer • Conclusion and Future work
  • 10. Design of the audio-tactile map viewer • The OTASCE Map presents 2D maps using auditory and tactile stimuli. • Difference from previous studies • Customizable audio-tactile cues • Available for general-purpose devices • implemented on iPhone 10
  • 11. Demonstration of OTASCE map operated by visually impaired people 11
  • 12. How to use • User experience: • Operate by trace the touch screen • Feedback by Sound effects , voice information, vibration pattern • Screen objects: • Points Vertices and branches in a route • Line Lines on the route 12
  • 13. Two guidance functions • Free-touch function • The user can touch routes and POI freely. • Route-guidance function • The user can grasp roughly the shape of the route from the starting point to the destination. 13
  • 14. Outline • Background and Objective • Design of the audio-tactile map viewer • Evaluation of map viewer • Conclusion and Future work
  • 15. Workshop with visually impaired people • Objective: • To investigate the most useful combinations of audio-tactile cues for people with visual impairments including low vision and blindness. • Participants • 3 blind, 2 low vision • Evaluation procedure • Repeat the audio-tactile effects customizing and map touching • Explain and discuss their preferred combinations of audio-tactile cues • Share / discuss customization results • Survey about usability 15
  • 16. Views of the system used for workshop 16
  • 17. Participants of the workshop 17 3 blind & 2 low vision
  • 19. Video of customized results by the low vision 19
  • 20. Two types of audio-tactile patterns designed based on the results of the workshop 20
  • 21. Summary • We designed the OTASCE Map viewer for presenting maps and routes to visually impaired people using customizable audio-tactile effects. • We found that the preferred combination of audio-tactile stimuli varies depending on the degree of a user's disability: • blind participants tend to prefer a combination of two or more kinds of cues • while participants with low vision preferred to use only a single cue. 21 • This app is expected to be used to help the users learn routes before going out and grasp surrounding POIs.
  • 22. Future work • Our final goal • To develop an audio-tactile mapping tool that allows blind people to grasp, modify, and create 2D figures like maps in the real-world. 22 • Future work • Evaluating two types of audio-tactile patterns quantitatively with a larger study • Creating a tutorial mode • Publishing the OTASCE Map apps • Extension to mapping tool: prototyping a map-creation tool that implements combinations of audio-tactile effects and voice cues.
  • 23. Thank you! Please check the Twitter for the OTASCE Map release announcement. @mmatsuo10 https://twitter.com/mmatsuo10

Editor's Notes

  1. Hello everyone. Thank you all very much for coming today. My name is Masaki Matsuo. I’d like to talk to you about OTASCE Map: a mobile map tool with customizable audio-Tactile cues for the visually impaired.
  2. This slide shows abstract of our study. We designed this audio-tactile map viewer for presenting routes to the visually impaired using customizable audio-tactile effects. We named our map viewer OTASCE map for Oto-Tactile scape map. Otasce means "help" in Japanese. We conducted a workshop test combination of audio-tactile effects using OTASCE map. As a result we found that the preferred combination of audio-tactile stimuli varies depending on the degree of a user's disability: blind users tended to prefer a combination of two or more kinds of cues while low vision users preferred to use only a single cue.
  3. This is a brief outline of my presentation. First, I would like to talk about the Background and objective of this study. Second, I would like to discuss design of Otasce map. Third, I would like to talk about the evaluation of Otasce map. And finally, Conclude and talk briefly about future plans. First, I’d like to start with some background information.
  4. Navigation methods for the visually impaired can be broadly divided into three categories. The first is Turn-by-turn navigation. The second is Orientation in relation to points of interest near the starting point or destination of the route. The third is learning routes before going out.
  5. Examples of Various Navigational Aids: NavCog is an indoor navigation system that enables users to walk easily to a destination in a building using audio information. BlindSquare is Orientation information system. This app delivers detailed points of interest (POIS) and intersections using voice and sound effects.
  6. Examples of Route Learning Systems: Many methods for conveying terrain information to the visually impaired have used either sound or tactile information. Tactile maps present graphic information using raised surfaces. The AR tactile map recognizes the movement of the fingertip on the map and informs the information of the touched location through speech. Space saving is possible because braille is not used, and more information can be stored than regular tactile maps.
  7. The problems is Few map applications feature flexible and customizable kinds of audio and tactile stimuli. In addition, Few smartphone applications represent route information from the starting point to the destination through tactile information.
  8. Therefore, We sought to discover the most useful combinations of audio and tactile cues for blind and visually impaired people. First, we developing an audio and tactile map viewer that can represent real-world route information and POI near the route. and we improved the viewer with customizable audio-tactile cues based on feedback from test users at workshop. We expect this app to be used for learning routes before going out.
  9. Next, I'd like to talk about design of the audio-tactile map viewer.
  10. The OTASCE map viewer presents 2D figures like maps using auditory and tactile stimuli. The difference from the previous study is that audio haptic cues can be customized and available on general-purpose devices. The viewer is implemented on an iPhone.
  11. Watch a video showing how to use the OTASCE map. The mouse icon indicates the user's finger. The user is touching the screen. This sound indicates the route. This sound indicates the POI. The user is tracing a route from the starting point to the destination.
  12. The user is given cues about the route and points of interest (POIs) as they touch the map on the screen. The user can customize the audio-tactile effects with different combinations of sound effects, voice cues, and vibration patterns. The effects convey information about points and lines on the displayed map.
  13. As shown in the previous video, the user can use two types of operating functions. The first is Free-touch function. The user can touch routes and POI freely. The second is Route-guidance function. This function presents the user's upcoming direction of travel on the route by guiding their finger to the starting point, stating the direction to turn at each branch points, and finally guiding the finger to the destination. The user can preview the route from the starting point to the destination.
  14. Let’s continue and move on to the workshop.
  15. We conducted a test combination of audio-tactile effects with visually impaired people using OTASCE Map. First, we asked participants to touch and trace a route in OTASCE Map. Then we asked participants to repeatedly adjust and check audio-tactile effects corresponding to various objects on the map. Subsequently, we asked participants to discuss their preferred combinations of audio-tactile cues. Finally, they answered surveys about usability.
  16. This slide shows screenshots of the map viewer app. This screen shot of the left side shows the settings menu screen. This menu is compatible with Voiceover features included in iOS. Also, the right side shows the Audio-tactile map. After customizing the effects, users can test the audio-tactile presentation by touching the map.
  17. As shown slide on the five participants (3 blind and 2 people with low vision) participated in the workshop. Except for one blind person, all participants had experience in using map and navigation applications while walking outside.
  18. This is an example Video of customized results by blind participants. 3 blind participants preferd a combination of two or more effects, including sound effects, voice cues, and vibrations. All the blind participants were accustomed to distinguishing sound effects.
  19. This is an example Video of customized results by low vision participants with low vision tended to select only a single type of cue; one selected voice while the other selected vibration. Participants with low vision were not accustomed to detecting differences in sounds.
  20. We created two types of audio-tactile patterns designed based on the results of the workshops. First is voice + vibration for low vision users Second is voice + vibration + sound effect for blind users
  21. Let me summarize the point of my presentation. We designed the OTASCE Map viewer for presenting maps and routes to visually impaired people using customizable audio-tactile effects. From a workshop we found that the preferred combination of audio-tactile stimuli varies depending on the degree of a user's disability: blind users tend to prefer a combination of two or more kinds of cues while low vision users preferred to use only a single cue. This app is expected to be used to learn routes before going out and to help the users grasp surrounding POI.
  22. In the future, We plan to evaluate two types of audio-tactile patterns quantitatively with a larger study. Therefore, we will create a tutorial mode to teach users how to operate the map viewer efficiently. To this end, we plan to publish OTASCE Map apps. In addition, we are currently developing a prototype mapping tool that creates 2D maps in the real-world. our goal is to develop an audio-tactile mapping tool that will allow blind people to grasp, modify, and create 2D figures.
  23. Please check the Twitter for the OTASK Map release announcement. Thank you all very much for listening. I would like to close my presentation.