Design Issues and Empirical Study in Mobility Oriented Service Developmentﰀ

Tetsuo Yamabe
Tetsuo YamabeBig Data Engineer at Recruit Marketing Partners Co.,Ltd.
Design Issues and Empirical Study in Mobility Oriented
Service Development

                                              Tetsuo Yamabe

                             Distributed Computing Laboratory
                                            Waseda University
Preamble

¡  How we should design mobile/wearable service interaction, in
   order to improve its mobility for nomadic people?
   ¡  This work aims to explore the service design principles, with developing
       practical services.
   ¡  We are exploring approaches to decrease a user s cognitive load (i.e.
       attention to a mobile service).


   ¡  This work was initiated in Nokia Research Center Tokyo.




Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
Outline

¡  Introduction & Motivation

¡  Design issues in mobile interaction & Our approach

¡  Prototyping & Experimental evaluation

¡  Discussion from findings and comments

¡  Future works

¡  Conclusion




Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
Introduction

!! Nowadays people are too addicted to mobile services.
   !! Using mobile phones while walking, on a bicycle, even driving a car…

!! Current mobile service design is too attention-consuming.
   !! From cognitive psychology point of view, attention is a key factor to
      improve mobile usability in the wild.




Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
Usability degradation on the move

!! Usability of mobile service becomes degraded while moving.
   !! Environmental transition - Situational disabilities forces a user to pay
      more attention.
   !! Multitasking environment - Fragmentation of attention doesn t allow a
      user to concentrate on mobile interaction.

!! Fine usability allows a user to perform tasks with less attention.
   !! Flexible and multimodal interaction is required.




Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
Design issues in mobile interaction

¡  Multimodality
   ¡  Cognitive resource is limited, so mobile services should support multimodal
       interaction to approach available sense.
   ¡  Also wearable devices play important role to change the modality/presentation of
       feedback according to the level of its importance.

¡  Simplicity
   ¡  Direct feedback (stimulus) makes interaction style passive, so that a user doesn t
       have to interact with a mobile service proactively (i.e. event-driven interaction).
   ¡  However, the direct stimulus should be simple in order to decrease cognitive load.

¡  Adaptability
   ¡  System should change the modality of interaction, since available sense changes
       according to mobile context.
   ¡  Also combination of available device changes according to users.



Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
Multi-layered, Multi-modal and Multi-presentation
approach for mobile/wearable interaction

 Pedestrian navigation on a mobile device




Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
Multi-layered, Multi-modal and Multi-presentation
approach for mobile/wearable interaction
                                                                                      Direct feedback:
 Pedestrian navigation on a mobile device                                             symbolic presentation




                                                                                                 Simple format indication
                                                                                                 on a head-mounted display




                          Detailed map on a ordinary
                          mobile phone



Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
Multi-layered, Multi-modal and Multi-presentation
approach for mobile/wearable interaction
                                                                                      Direct feedback:
 Pedestrian navigation on a mobile device                                             symbolic presentation




                                                                                                 Simple format indication
                                                                                                 on a head-mounted display



                                                                                                 LED/LCD indication on a
                                                                                                 wrist watch type device




                          Detailed map on a ordinary
                          mobile phone



Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
Multi-layered, Multi-modal and Multi-presentation
approach for mobile/wearable interaction
                                                       Direct feedback:               Direct feedback:
 Pedestrian navigation on a mobile device              ambient presentation           symbolic presentation




                                                                                                 Simple format indication
                                                                                                 on a head-mounted display



                                                                                                 LED/LCD indication on a
                                                                                                 wrist watch type device




                          Detailed map on a ordinary
                          mobile phone



Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
Multi-layered, Multi-modal and Multi-presentation
approach for mobile/wearable interaction
                                                       Direct feedback:               Direct feedback:
 Pedestrian navigation on a mobile device              ambient presentation           symbolic presentation




                                                                                                 Simple format indication
                                                                                                 on a head-mounted display



                                                                                                 LED/LCD indication on a
                                                                                                 wrist watch type device



                                                                                                 Tactile indication on a
                          Detailed map on a ordinary                                             belt type wearable device
                          mobile phone



Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
Multi-layered, Multi-modal and Multi-presentation
approach for mobile/wearable interaction
                                                       Direct feedback:               Direct feedback:
  Pedestrian navigation on a mobile device             ambient presentation           symbolic presentation




                                                                                                 Simple format indication
                                                                                                 on a head-mounted display
          Text

                                                                                                 LED/LCD indication on a
                                                                                                 wrist watch type device



                                                                                                 Tactile indication on a
                                                                                                 belt type wearable device


A ticker tape style indication      LED indication on an
Audio based indication              ordinary mobile phone
Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
Empirical study on a pedestrian navigation

¡  A pedestrian navigation service
    on N800 Nokia internet tablet.
   ¡  Added some simplified user
       interfaces and route navigation
       feature to maemo-mapper.


¡  3 different presentation styles
    are supported:
   ¡  Simple text sentence
   ¡  Simple voice message
   ¡  Simple visual indication




Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
¡  The event types in the prototype, which makes direct feedback as
      an indication to a user.




Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
1. Determine a user s location with a GPS receiver



                                                               2. Identify event types




Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
3. Navigate the user according to detected event types




Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
Preliminary experimentation

¡  As the first step, we mainly focused on the simplicity in this
    evaluation.
      ¡  How the simplified indication works and affects to a user s behavior?
      ¡  Compared normal interaction mode and simple interaction mode.


¡  Field experiments are performed with using the prototype.
   ¡  5 participants from NRC Tokyo joined.
   ¡  Two tasks are given to each participant.




Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
Tasks

¡  Task A: Participants are instructed to walk Route A only with the normal interaction
    mode. The normal interaction mode shows the user's current location and route to
    the destination. The user can reach the destination by following the route, but the
    shown area on the display is small enough so that the user can not remember the
    entire route.

¡  Task B: Participants are instructed to walk Route B with a combination of the
    simple interaction mode (i.e. blink indication) and the normal interaction mode. In
    this case, the simple interaction mode has to be mainly used and the normal
    interaction mode is used auxiliary when the user has lost his/her way. Users can
    switch modes by manually pushing a hardware key.




Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
¡  Number of corners and total distance are almost same.




Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
Examinee observation

¡  Two observers pursued the participant with video cameras to
    record a user s behavior and surrounding environment.




Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
Experimental results
!! TT [sec]: Total time spent to reach the destination
!! ST [sec]: Total time of stationary state (i.e. just standing without walking)
!! LT [sec]: Total (loss) time spent for walking incorrect route
!! LD [m]: Total (loss) distance of incorrect route walking
!! SP [km/h]: Average walking speed
!! GR [%]: Proportion of time that the participant watch the display to TT
!! MT [sec]: Total time of the normal interaction mode




Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
Some findings and discussions

¡  Users would expect the next event and attempt to know when it
    will occur.
   ¡  Time to next event helps to create mental model in a user s mind and
       prepare for the event.

¡  Some events and indications seem to be unnecessary.
   ¡  The blinking pattern was comprehensible, but no indication seems to be
       needed while the user is walking on the right route.

¡  Since the user interface on the simple user interaction mode was
    not interesting, users started to look the scenery.




Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
Future work #1: Multiple device deployment

!! Advanced version of the prototype with multiple wearable devices.
   !! HMD: Nikon UP300x
      !! Visual/Audio modality
      !! Head gesture with 3D accelerometer
   !! Wrist watch: SunSpot based prototype
      !! Visual/Haptic modality
      !! Gesture with 3D accelerometer
      !! Environmental sensors
   !! Mobile: iPhone/iPod touch (or maemo platform)
      !! Visual/Audio modality
      !! Gesture with 3D accelerometer


!! Support gesture/context based adaptation
Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
Future work #2: System support development
                                                                                                              Event
¡  Develop a middleware for multi-                                                                           desc
    device interaction                                                  App                       App

   ¡  Device (resource) management
   ¡  Adaptation policy management                                                       Context       Adaptation
                                                                                           pool           policy
   ¡  I/O management
       ¡  Context sensing
                                                                        Event
      ¡  Gesture input                                              Dispatcher
      ¡  Simplified event notification
                                                                                                        Resource
                                                                                                         mgmr
¡  Develop a framework for multi-
    layered interaction design
                                                                        Dev                 Dev
   ¡  Multimodality
   ¡  Simplicity                                                                                       Dev

   ¡  Adaptability
                                                            sensor              display                         I/O
                                                                                                               desc
Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
Conclusion

¡  We have pointed out design issues in mobile interaction design, in
    order to improve usability of mobile services on the move.

¡  A pedestrian navigation service was developed and we evaluated
    its feasibility through field experiments.

¡  We have successfully decreased a user s cognitive load by adding
    a simple interaction mode.
   ¡  Also, we have proved that the service semantics was successfully kept
       even in the simple interaction mode.

¡  We will continue to develop the system based on the comments
    and discussions, in order to realize the complete a picture of the
    proposed design framework.



Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
APPENDIX




Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008,
Leuven, Belgium
1 of 26

Recommended

Poster Guide project poster-09-2011 by
Poster  Guide project poster-09-2011Poster  Guide project poster-09-2011
Poster Guide project poster-09-2011AEGIS-ACCESSIBLE Projects
72 views1 slide
GRAS by
GRASGRAS
GRASafd147
359 views10 slides
Soupal by
SoupalSoupal
SoupalTUESDAY Business Network
318 views14 slides
Ie spain main e2 by
Ie spain main e2Ie spain main e2
Ie spain main e2Vivekkapadia
210 views15 slides
SOFIA Pilots Brochure Final Set by
SOFIA Pilots Brochure Final SetSOFIA Pilots Brochure Final Set
SOFIA Pilots Brochure Final SetSofia Eu
456 views6 slides
SOFIA PILOTS BROCHURE 8th European ITS Congress, Lyon - France by
SOFIA PILOTS BROCHURE 8th European ITS Congress, Lyon - France SOFIA PILOTS BROCHURE 8th European ITS Congress, Lyon - France
SOFIA PILOTS BROCHURE 8th European ITS Congress, Lyon - France Sofia Eu
263 views2 slides

More Related Content

What's hot

Multi-modal_1st_Research_ETstudio by
Multi-modal_1st_Research_ETstudioMulti-modal_1st_Research_ETstudio
Multi-modal_1st_Research_ETstudioyeji1989
221 views26 slides
Sixth sense technolgy by
Sixth sense technolgySixth sense technolgy
Sixth sense technolgyAnvesh Ranga
2.4K views38 slides
2009 01 0521 Sae Paper Smart Touch by
2009 01 0521 Sae Paper Smart Touch2009 01 0521 Sae Paper Smart Touch
2009 01 0521 Sae Paper Smart Touchzztdn3
248 views3 slides
Hf3113931397 by
Hf3113931397Hf3113931397
Hf3113931397IJERA Editor
312 views5 slides
Building Task-Aware Mobile Applications by
Building Task-Aware Mobile ApplicationsBuilding Task-Aware Mobile Applications
Building Task-Aware Mobile ApplicationsDave Kellogg
655 views18 slides
IRJET- Hand Gesture Recognition for Deaf and Dumb by
IRJET- Hand Gesture Recognition for Deaf and DumbIRJET- Hand Gesture Recognition for Deaf and Dumb
IRJET- Hand Gesture Recognition for Deaf and DumbIRJET Journal
43 views4 slides

What's hot(12)

Multi-modal_1st_Research_ETstudio by yeji1989
Multi-modal_1st_Research_ETstudioMulti-modal_1st_Research_ETstudio
Multi-modal_1st_Research_ETstudio
yeji1989221 views
Sixth sense technolgy by Anvesh Ranga
Sixth sense technolgySixth sense technolgy
Sixth sense technolgy
Anvesh Ranga2.4K views
2009 01 0521 Sae Paper Smart Touch by zztdn3
2009 01 0521 Sae Paper Smart Touch2009 01 0521 Sae Paper Smart Touch
2009 01 0521 Sae Paper Smart Touch
zztdn3248 views
Building Task-Aware Mobile Applications by Dave Kellogg
Building Task-Aware Mobile ApplicationsBuilding Task-Aware Mobile Applications
Building Task-Aware Mobile Applications
Dave Kellogg655 views
IRJET- Hand Gesture Recognition for Deaf and Dumb by IRJET Journal
IRJET- Hand Gesture Recognition for Deaf and DumbIRJET- Hand Gesture Recognition for Deaf and Dumb
IRJET- Hand Gesture Recognition for Deaf and Dumb
IRJET Journal43 views
Model-Based Visual Software Specification by Thomas Memmel
Model-Based Visual Software SpecificationModel-Based Visual Software Specification
Model-Based Visual Software Specification
Thomas Memmel942 views
Maya by NASAPMC
MayaMaya
Maya
NASAPMC12K views
Haptic Technology- Interaction with Virtuality by vivatechijri
Haptic Technology- Interaction with VirtualityHaptic Technology- Interaction with Virtuality
Haptic Technology- Interaction with Virtuality
vivatechijri74 views
Saiful hidayar santri indigo telkom republika pondok pesantren keresek garut ... by Saiful Hidayat
Saiful hidayar santri indigo telkom republika pondok pesantren keresek garut ...Saiful hidayar santri indigo telkom republika pondok pesantren keresek garut ...
Saiful hidayar santri indigo telkom republika pondok pesantren keresek garut ...
Saiful Hidayat1.2K views
Digital technologies by jamberryxxx
Digital technologiesDigital technologies
Digital technologies
jamberryxxx174 views

Viewers also liked

Activity-Based Micro-pricing: Realizing Sustainable Behavior Changes through ... by
Activity-Based Micro-pricing: Realizing Sustainable Behavior Changes through ...Activity-Based Micro-pricing: Realizing Sustainable Behavior Changes through ...
Activity-Based Micro-pricing: Realizing Sustainable Behavior Changes through ...Tetsuo Yamabe
1.3K views33 slides
Prototyping Augmented Traditional Games: Concept, Design and Case Studies by
Prototyping Augmented Traditional Games: Concept, Design and Case StudiesPrototyping Augmented Traditional Games: Concept, Design and Case Studies
Prototyping Augmented Traditional Games: Concept, Design and Case StudiesTetsuo Yamabe
951 views25 slides
EmoPoker by
EmoPokerEmoPoker
EmoPokerTetsuo Yamabe
1.1K views9 slides
継続的デリバリーと読み解く Web 開発あるあるとその対策 by
継続的デリバリーと読み解く Web 開発あるあるとその対策継続的デリバリーと読み解く Web 開発あるあるとその対策
継続的デリバリーと読み解く Web 開発あるあるとその対策Tetsuo Yamabe
6.5K views91 slides
GMO プライベート DMP 開発で 取り組んできた DevOps と今後の展望 by
GMO プライベート DMP 開発で 取り組んできた DevOps と今後の展望GMO プライベート DMP 開発で 取り組んできた DevOps と今後の展望
GMO プライベート DMP 開発で 取り組んできた DevOps と今後の展望Tetsuo Yamabe
6.1K views65 slides
QS Tools for Emotions and Communication by
QS Tools for Emotions and CommunicationQS Tools for Emotions and Communication
QS Tools for Emotions and CommunicationHirotaka Niisato
695 views12 slides

Viewers also liked(20)

Activity-Based Micro-pricing: Realizing Sustainable Behavior Changes through ... by Tetsuo Yamabe
Activity-Based Micro-pricing: Realizing Sustainable Behavior Changes through ...Activity-Based Micro-pricing: Realizing Sustainable Behavior Changes through ...
Activity-Based Micro-pricing: Realizing Sustainable Behavior Changes through ...
Tetsuo Yamabe1.3K views
Prototyping Augmented Traditional Games: Concept, Design and Case Studies by Tetsuo Yamabe
Prototyping Augmented Traditional Games: Concept, Design and Case StudiesPrototyping Augmented Traditional Games: Concept, Design and Case Studies
Prototyping Augmented Traditional Games: Concept, Design and Case Studies
Tetsuo Yamabe951 views
継続的デリバリーと読み解く Web 開発あるあるとその対策 by Tetsuo Yamabe
継続的デリバリーと読み解く Web 開発あるあるとその対策継続的デリバリーと読み解く Web 開発あるあるとその対策
継続的デリバリーと読み解く Web 開発あるあるとその対策
Tetsuo Yamabe6.5K views
GMO プライベート DMP 開発で 取り組んできた DevOps と今後の展望 by Tetsuo Yamabe
GMO プライベート DMP 開発で 取り組んできた DevOps と今後の展望GMO プライベート DMP 開発で 取り組んできた DevOps と今後の展望
GMO プライベート DMP 開発で 取り組んできた DevOps と今後の展望
Tetsuo Yamabe6.1K views
QS Tools for Emotions and Communication by Hirotaka Niisato
QS Tools for Emotions and CommunicationQS Tools for Emotions and Communication
QS Tools for Emotions and Communication
Hirotaka Niisato695 views
Empowering End-users to Find Point-of-interests with a Public Display by Tetsuo Yamabe
Empowering End-users to Find Point-of-interests with a Public DisplayEmpowering End-users to Find Point-of-interests with a Public Display
Empowering End-users to Find Point-of-interests with a Public Display
Tetsuo Yamabe1.2K views
Apple Watch vs Android Wear by Tak Inamori
Apple Watch vs Android WearApple Watch vs Android Wear
Apple Watch vs Android Wear
Tak Inamori3.1K views
GTB2015Spring_Webサービスとインターネットの歴史 by Tak Inamori
GTB2015Spring_Webサービスとインターネットの歴史GTB2015Spring_Webサービスとインターネットの歴史
GTB2015Spring_Webサービスとインターネットの歴史
Tak Inamori3.9K views
今年は高田純次UXDが流行る -適当の美学- by Tak Inamori
今年は高田純次UXDが流行る -適当の美学-今年は高田純次UXDが流行る -適当の美学-
今年は高田純次UXDが流行る -適当の美学-
Tak Inamori6.4K views
A System Framework for Decision Support in Ambient Intelligence by Tetsuo Yamabe
A System Framework for Decision Support in Ambient IntelligenceA System Framework for Decision Support in Ambient Intelligence
A System Framework for Decision Support in Ambient Intelligence
Tetsuo Yamabe970 views
Augmented Reality Go: Extending Traditional Game Play with Interactive Self-L... by Tetsuo Yamabe
Augmented Reality Go: Extending Traditional Game Play with Interactive Self-L...Augmented Reality Go: Extending Traditional Game Play with Interactive Self-L...
Augmented Reality Go: Extending Traditional Game Play with Interactive Self-L...
Tetsuo Yamabe1.2K views
SXSWedu 2016 報告会 〜EdTech JAPAN 世界への挑戦 セッション紹介(山邉分) by Tetsuo Yamabe
SXSWedu 2016 報告会 〜EdTech JAPAN 世界への挑戦 セッション紹介(山邉分)SXSWedu 2016 報告会 〜EdTech JAPAN 世界への挑戦 セッション紹介(山邉分)
SXSWedu 2016 報告会 〜EdTech JAPAN 世界への挑戦 セッション紹介(山邉分)
Tetsuo Yamabe1.8K views
『GMOプライベートDMP』の開発にあたって取り組んできた DevOps、更にその反省点と現在進行中のカイゼン事例の紹介 by Tetsuo Yamabe
『GMOプライベートDMP』の開発にあたって取り組んできた DevOps、更にその反省点と現在進行中のカイゼン事例の紹介『GMOプライベートDMP』の開発にあたって取り組んできた DevOps、更にその反省点と現在進行中のカイゼン事例の紹介
『GMOプライベートDMP』の開発にあたって取り組んできた DevOps、更にその反省点と現在進行中のカイゼン事例の紹介
Tetsuo Yamabe3.9K views
StudySapuri Data Analytics Platform with Treasure Data by Tetsuo Yamabe
StudySapuri Data Analytics Platform with Treasure DataStudySapuri Data Analytics Platform with Treasure Data
StudySapuri Data Analytics Platform with Treasure Data
Tetsuo Yamabe2.2K views
GMO プライベート DMP で ビッグデータ解析をするために アプリクラウドで Apache Spark の検証をしてみた by Tetsuo Yamabe
GMO プライベート DMP で ビッグデータ解析をするために アプリクラウドで Apache Spark の検証をしてみたGMO プライベート DMP で ビッグデータ解析をするために アプリクラウドで Apache Spark の検証をしてみた
GMO プライベート DMP で ビッグデータ解析をするために アプリクラウドで Apache Spark の検証をしてみた
Tetsuo Yamabe4.4K views
ゲームニクス理論 by TANREN Inc.
ゲームニクス理論ゲームニクス理論
ゲームニクス理論
TANREN Inc.25.9K views
スタディサプリを支えるデータ分析基盤 ~設計の勘所と利活用事例~ by Tetsuo Yamabe
スタディサプリを支えるデータ分析基盤 ~設計の勘所と利活用事例~スタディサプリを支えるデータ分析基盤 ~設計の勘所と利活用事例~
スタディサプリを支えるデータ分析基盤 ~設計の勘所と利活用事例~
Tetsuo Yamabe19.4K views

Similar to Design Issues and Empirical Study in Mobility Oriented Service Developmentﰀ

Mobile health impetus of mobile communication 20121116 by
Mobile health impetus of mobile communication 20121116Mobile health impetus of mobile communication 20121116
Mobile health impetus of mobile communication 20121116Sandra Hoyer
354 views7 slides
UX archetypes secondary by
UX archetypes secondaryUX archetypes secondary
UX archetypes secondaryNicholas Evans
1.6K views20 slides
3 Use Cases towards All Inclusive Mainstream ICT by
3  Use Cases towards All Inclusive Mainstream ICT3  Use Cases towards All Inclusive Mainstream ICT
3 Use Cases towards All Inclusive Mainstream ICTAEGIS-ACCESSIBLE Projects
504 views24 slides
User-Centered Mobile Concept Development by
User-Centered Mobile Concept DevelopmentUser-Centered Mobile Concept Development
User-Centered Mobile Concept DevelopmentSøren Engelbrecht
795 views38 slides
HAND GESTURE VOCALIZER by
HAND GESTURE VOCALIZERHAND GESTURE VOCALIZER
HAND GESTURE VOCALIZERIRJET Journal
59 views5 slides
Mobile Software Engineering (at University of Cambridge Wednesday Seminars) by
Mobile Software Engineering (at University of Cambridge Wednesday Seminars)Mobile Software Engineering (at University of Cambridge Wednesday Seminars)
Mobile Software Engineering (at University of Cambridge Wednesday Seminars)3scale.net
7.3K views43 slides

Similar to Design Issues and Empirical Study in Mobility Oriented Service Developmentﰀ(20)

Mobile health impetus of mobile communication 20121116 by Sandra Hoyer
Mobile health impetus of mobile communication 20121116Mobile health impetus of mobile communication 20121116
Mobile health impetus of mobile communication 20121116
Sandra Hoyer354 views
Mobile Software Engineering (at University of Cambridge Wednesday Seminars) by 3scale.net
Mobile Software Engineering (at University of Cambridge Wednesday Seminars)Mobile Software Engineering (at University of Cambridge Wednesday Seminars)
Mobile Software Engineering (at University of Cambridge Wednesday Seminars)
3scale.net7.3K views
Strategic mobile user experience by Sushmita Dutt
Strategic mobile user experienceStrategic mobile user experience
Strategic mobile user experience
Sushmita Dutt1.5K views
Sixth sense technology 04 by akki_hearts
Sixth  sense technology 04Sixth  sense technology 04
Sixth sense technology 04
akki_hearts6.8K views
Tnooz-Amadeus Webinar: The impact of the always-connected traveler by Kevin May
Tnooz-Amadeus Webinar: The impact of the always-connected travelerTnooz-Amadeus Webinar: The impact of the always-connected traveler
Tnooz-Amadeus Webinar: The impact of the always-connected traveler
Kevin May1.1K views
Upcomming technologies by nabeelmalic7
Upcomming technologiesUpcomming technologies
Upcomming technologies
nabeelmalic72.2K views
3 g be technologized by Dev yusmananda by dev yusmananda
3 g   be technologized by Dev yusmananda3 g   be technologized by Dev yusmananda
3 g be technologized by Dev yusmananda
dev yusmananda261 views
droidcon 2012: What's the Hack is NFC .., Hauke Meyn, NXP by Droidcon Berlin
droidcon 2012: What's the Hack is NFC .., Hauke Meyn, NXPdroidcon 2012: What's the Hack is NFC .., Hauke Meyn, NXP
droidcon 2012: What's the Hack is NFC .., Hauke Meyn, NXP
Droidcon Berlin10.9K views
Mobile Strategy & Gamification - iMedia Online Retail Summit by Mark Neely
Mobile Strategy & Gamification - iMedia Online Retail Summit Mobile Strategy & Gamification - iMedia Online Retail Summit
Mobile Strategy & Gamification - iMedia Online Retail Summit
Mark Neely617 views
Accesibility challenges, tools and applications Spanish accessibility worksho... by AEGIS-ACCESSIBLE Projects
Accesibility challenges, tools and applications Spanish accessibility worksho...Accesibility challenges, tools and applications Spanish accessibility worksho...
Accesibility challenges, tools and applications Spanish accessibility worksho...
2012-11 MLOVE Mobile Trend Report Preview by MLOVE ConFestival
2012-11 MLOVE Mobile Trend Report Preview2012-11 MLOVE Mobile Trend Report Preview
2012-11 MLOVE Mobile Trend Report Preview
MLOVE ConFestival361 views
28704893 sixth-sense-final-ppt by ahani
28704893 sixth-sense-final-ppt28704893 sixth-sense-final-ppt
28704893 sixth-sense-final-ppt
ahani1.9K views

Recently uploaded

iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas... by
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...Bernd Ruecker
54 views69 slides
VNF Integration and Support in CloudStack - Wei Zhou - ShapeBlue by
VNF Integration and Support in CloudStack - Wei Zhou - ShapeBlueVNF Integration and Support in CloudStack - Wei Zhou - ShapeBlue
VNF Integration and Support in CloudStack - Wei Zhou - ShapeBlueShapeBlue
203 views54 slides
Live Demo Showcase: Unveiling Dell PowerFlex’s IaaS Capabilities with Apache ... by
Live Demo Showcase: Unveiling Dell PowerFlex’s IaaS Capabilities with Apache ...Live Demo Showcase: Unveiling Dell PowerFlex’s IaaS Capabilities with Apache ...
Live Demo Showcase: Unveiling Dell PowerFlex’s IaaS Capabilities with Apache ...ShapeBlue
126 views10 slides
Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ... by
Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ...Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ...
Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ...ShapeBlue
119 views17 slides
Declarative Kubernetes Cluster Deployment with Cloudstack and Cluster API - O... by
Declarative Kubernetes Cluster Deployment with Cloudstack and Cluster API - O...Declarative Kubernetes Cluster Deployment with Cloudstack and Cluster API - O...
Declarative Kubernetes Cluster Deployment with Cloudstack and Cluster API - O...ShapeBlue
132 views13 slides
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ... by
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...ShapeBlue
166 views28 slides

Recently uploaded(20)

iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas... by Bernd Ruecker
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...
iSAQB Software Architecture Gathering 2023: How Process Orchestration Increas...
Bernd Ruecker54 views
VNF Integration and Support in CloudStack - Wei Zhou - ShapeBlue by ShapeBlue
VNF Integration and Support in CloudStack - Wei Zhou - ShapeBlueVNF Integration and Support in CloudStack - Wei Zhou - ShapeBlue
VNF Integration and Support in CloudStack - Wei Zhou - ShapeBlue
ShapeBlue203 views
Live Demo Showcase: Unveiling Dell PowerFlex’s IaaS Capabilities with Apache ... by ShapeBlue
Live Demo Showcase: Unveiling Dell PowerFlex’s IaaS Capabilities with Apache ...Live Demo Showcase: Unveiling Dell PowerFlex’s IaaS Capabilities with Apache ...
Live Demo Showcase: Unveiling Dell PowerFlex’s IaaS Capabilities with Apache ...
ShapeBlue126 views
Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ... by ShapeBlue
Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ...Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ...
Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ...
ShapeBlue119 views
Declarative Kubernetes Cluster Deployment with Cloudstack and Cluster API - O... by ShapeBlue
Declarative Kubernetes Cluster Deployment with Cloudstack and Cluster API - O...Declarative Kubernetes Cluster Deployment with Cloudstack and Cluster API - O...
Declarative Kubernetes Cluster Deployment with Cloudstack and Cluster API - O...
ShapeBlue132 views
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ... by ShapeBlue
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...
ShapeBlue166 views
Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ... by ShapeBlue
Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ...Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ...
Backup and Disaster Recovery with CloudStack and StorPool - Workshop - Venko ...
ShapeBlue184 views
Confidence in CloudStack - Aron Wagner, Nathan Gleason - Americ by ShapeBlue
Confidence in CloudStack - Aron Wagner, Nathan Gleason - AmericConfidence in CloudStack - Aron Wagner, Nathan Gleason - Americ
Confidence in CloudStack - Aron Wagner, Nathan Gleason - Americ
ShapeBlue130 views
Initiating and Advancing Your Strategic GIS Governance Strategy by Safe Software
Initiating and Advancing Your Strategic GIS Governance StrategyInitiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance Strategy
Safe Software176 views
CloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlue by ShapeBlue
CloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlueCloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlue
CloudStack Object Storage - An Introduction - Vladimir Petrov - ShapeBlue
ShapeBlue138 views
Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha... by ShapeBlue
Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha...Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha...
Mitigating Common CloudStack Instance Deployment Failures - Jithin Raju - Sha...
ShapeBlue180 views
Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava... by ShapeBlue
Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava...Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava...
Centralized Logging Feature in CloudStack using ELK and Grafana - Kiran Chava...
ShapeBlue145 views
Why and How CloudStack at weSystems - Stephan Bienek - weSystems by ShapeBlue
Why and How CloudStack at weSystems - Stephan Bienek - weSystemsWhy and How CloudStack at weSystems - Stephan Bienek - weSystems
Why and How CloudStack at weSystems - Stephan Bienek - weSystems
ShapeBlue238 views
Digital Personal Data Protection (DPDP) Practical Approach For CISOs by Priyanka Aash
Digital Personal Data Protection (DPDP) Practical Approach For CISOsDigital Personal Data Protection (DPDP) Practical Approach For CISOs
Digital Personal Data Protection (DPDP) Practical Approach For CISOs
Priyanka Aash158 views
2FA and OAuth2 in CloudStack - Andrija Panić - ShapeBlue by ShapeBlue
2FA and OAuth2 in CloudStack - Andrija Panić - ShapeBlue2FA and OAuth2 in CloudStack - Andrija Panić - ShapeBlue
2FA and OAuth2 in CloudStack - Andrija Panić - ShapeBlue
ShapeBlue147 views
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N... by James Anderson
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...
James Anderson160 views
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f... by TrustArc
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...
TrustArc Webinar - Managing Online Tracking Technology Vendors_ A Checklist f...
TrustArc170 views
NTGapps NTG LowCode Platform by Mustafa Kuğu
NTGapps NTG LowCode Platform NTGapps NTG LowCode Platform
NTGapps NTG LowCode Platform
Mustafa Kuğu423 views
Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit... by ShapeBlue
Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...
Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...
ShapeBlue159 views

Design Issues and Empirical Study in Mobility Oriented Service Developmentﰀ

  • 1. Design Issues and Empirical Study in Mobility Oriented Service Development Tetsuo Yamabe Distributed Computing Laboratory Waseda University
  • 2. Preamble ¡  How we should design mobile/wearable service interaction, in order to improve its mobility for nomadic people? ¡  This work aims to explore the service design principles, with developing practical services. ¡  We are exploring approaches to decrease a user s cognitive load (i.e. attention to a mobile service). ¡  This work was initiated in Nokia Research Center Tokyo. Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium
  • 3. Outline ¡  Introduction & Motivation ¡  Design issues in mobile interaction & Our approach ¡  Prototyping & Experimental evaluation ¡  Discussion from findings and comments ¡  Future works ¡  Conclusion Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium
  • 4. Introduction !! Nowadays people are too addicted to mobile services. !! Using mobile phones while walking, on a bicycle, even driving a car… !! Current mobile service design is too attention-consuming. !! From cognitive psychology point of view, attention is a key factor to improve mobile usability in the wild. Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium
  • 5. Usability degradation on the move !! Usability of mobile service becomes degraded while moving. !! Environmental transition - Situational disabilities forces a user to pay more attention. !! Multitasking environment - Fragmentation of attention doesn t allow a user to concentrate on mobile interaction. !! Fine usability allows a user to perform tasks with less attention. !! Flexible and multimodal interaction is required. Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium
  • 6. Design issues in mobile interaction ¡  Multimodality ¡  Cognitive resource is limited, so mobile services should support multimodal interaction to approach available sense. ¡  Also wearable devices play important role to change the modality/presentation of feedback according to the level of its importance. ¡  Simplicity ¡  Direct feedback (stimulus) makes interaction style passive, so that a user doesn t have to interact with a mobile service proactively (i.e. event-driven interaction). ¡  However, the direct stimulus should be simple in order to decrease cognitive load. ¡  Adaptability ¡  System should change the modality of interaction, since available sense changes according to mobile context. ¡  Also combination of available device changes according to users. Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium
  • 7. Multi-layered, Multi-modal and Multi-presentation approach for mobile/wearable interaction Pedestrian navigation on a mobile device Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium
  • 8. Multi-layered, Multi-modal and Multi-presentation approach for mobile/wearable interaction Direct feedback: Pedestrian navigation on a mobile device symbolic presentation Simple format indication on a head-mounted display Detailed map on a ordinary mobile phone Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium
  • 9. Multi-layered, Multi-modal and Multi-presentation approach for mobile/wearable interaction Direct feedback: Pedestrian navigation on a mobile device symbolic presentation Simple format indication on a head-mounted display LED/LCD indication on a wrist watch type device Detailed map on a ordinary mobile phone Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium
  • 10. Multi-layered, Multi-modal and Multi-presentation approach for mobile/wearable interaction Direct feedback: Direct feedback: Pedestrian navigation on a mobile device ambient presentation symbolic presentation Simple format indication on a head-mounted display LED/LCD indication on a wrist watch type device Detailed map on a ordinary mobile phone Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium
  • 11. Multi-layered, Multi-modal and Multi-presentation approach for mobile/wearable interaction Direct feedback: Direct feedback: Pedestrian navigation on a mobile device ambient presentation symbolic presentation Simple format indication on a head-mounted display LED/LCD indication on a wrist watch type device Tactile indication on a Detailed map on a ordinary belt type wearable device mobile phone Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium
  • 12. Multi-layered, Multi-modal and Multi-presentation approach for mobile/wearable interaction Direct feedback: Direct feedback: Pedestrian navigation on a mobile device ambient presentation symbolic presentation Simple format indication on a head-mounted display Text LED/LCD indication on a wrist watch type device Tactile indication on a belt type wearable device A ticker tape style indication LED indication on an Audio based indication ordinary mobile phone Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium
  • 13. Empirical study on a pedestrian navigation ¡  A pedestrian navigation service on N800 Nokia internet tablet. ¡  Added some simplified user interfaces and route navigation feature to maemo-mapper. ¡  3 different presentation styles are supported: ¡  Simple text sentence ¡  Simple voice message ¡  Simple visual indication Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium
  • 14. ¡  The event types in the prototype, which makes direct feedback as an indication to a user. Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium
  • 15. 1. Determine a user s location with a GPS receiver 2. Identify event types Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium
  • 16. 3. Navigate the user according to detected event types Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium
  • 17. Preliminary experimentation ¡  As the first step, we mainly focused on the simplicity in this evaluation. ¡  How the simplified indication works and affects to a user s behavior? ¡  Compared normal interaction mode and simple interaction mode. ¡  Field experiments are performed with using the prototype. ¡  5 participants from NRC Tokyo joined. ¡  Two tasks are given to each participant. Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium
  • 18. Tasks ¡  Task A: Participants are instructed to walk Route A only with the normal interaction mode. The normal interaction mode shows the user's current location and route to the destination. The user can reach the destination by following the route, but the shown area on the display is small enough so that the user can not remember the entire route. ¡  Task B: Participants are instructed to walk Route B with a combination of the simple interaction mode (i.e. blink indication) and the normal interaction mode. In this case, the simple interaction mode has to be mainly used and the normal interaction mode is used auxiliary when the user has lost his/her way. Users can switch modes by manually pushing a hardware key. Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium
  • 19. ¡  Number of corners and total distance are almost same. Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium
  • 20. Examinee observation ¡  Two observers pursued the participant with video cameras to record a user s behavior and surrounding environment. Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium
  • 21. Experimental results !! TT [sec]: Total time spent to reach the destination !! ST [sec]: Total time of stationary state (i.e. just standing without walking) !! LT [sec]: Total (loss) time spent for walking incorrect route !! LD [m]: Total (loss) distance of incorrect route walking !! SP [km/h]: Average walking speed !! GR [%]: Proportion of time that the participant watch the display to TT !! MT [sec]: Total time of the normal interaction mode Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium
  • 22. Some findings and discussions ¡  Users would expect the next event and attempt to know when it will occur. ¡  Time to next event helps to create mental model in a user s mind and prepare for the event. ¡  Some events and indications seem to be unnecessary. ¡  The blinking pattern was comprehensible, but no indication seems to be needed while the user is walking on the right route. ¡  Since the user interface on the simple user interaction mode was not interesting, users started to look the scenery. Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium
  • 23. Future work #1: Multiple device deployment !! Advanced version of the prototype with multiple wearable devices. !! HMD: Nikon UP300x !! Visual/Audio modality !! Head gesture with 3D accelerometer !! Wrist watch: SunSpot based prototype !! Visual/Haptic modality !! Gesture with 3D accelerometer !! Environmental sensors !! Mobile: iPhone/iPod touch (or maemo platform) !! Visual/Audio modality !! Gesture with 3D accelerometer !! Support gesture/context based adaptation Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium
  • 24. Future work #2: System support development Event ¡  Develop a middleware for multi- desc device interaction App App ¡  Device (resource) management ¡  Adaptation policy management Context Adaptation pool policy ¡  I/O management ¡  Context sensing Event ¡  Gesture input Dispatcher ¡  Simplified event notification Resource mgmr ¡  Develop a framework for multi- layered interaction design Dev Dev ¡  Multimodality ¡  Simplicity Dev ¡  Adaptability sensor display I/O desc Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium
  • 25. Conclusion ¡  We have pointed out design issues in mobile interaction design, in order to improve usability of mobile services on the move. ¡  A pedestrian navigation service was developed and we evaluated its feasibility through field experiments. ¡  We have successfully decreased a user s cognitive load by adding a simple interaction mode. ¡  Also, we have proved that the service semantics was successfully kept even in the simple interaction mode. ¡  We will continue to develop the system based on the comments and discussions, in order to realize the complete a picture of the proposed design framework. Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium
  • 26. APPENDIX Mobile Middleware: Embracing the Personal Communication Device (MobMid'08) , December 2, 2008, Leuven, Belgium