Being Human
Human computer interaction in 2020




                            Adopted from Microsoft Research on HCI, 2008
Some problems of today

Why Facebook does not automatically wish our friends
during their birthday?
Why MMLS does not send us updates when a class is
cancelled?
Why can’t we play DOTA or Cityville or throw Angry
birds while driving?
How to solve this?
Four Computing Eras
                                                                                     1     1                                              2    2                                                                        3 3                                                4 4



                                                                                                                                                                                                   1 1                                                    2 2




          There have been various computer-driven revolutions in the                                                                          Photography, for example, has retained its familiarity despite
                                                                       activities – from buying food to paying our bills – and they
                                       1960s: Mainframe Era                                         1980s: Personal Computer Era              point of creation, people still ‘point and Mobility Era
                                                                                                                                                                                2000s: shoot’ in much the                               2020 and beyond: Ubiquity Era
                                       One computer per many users.                                 One computer per user.                                                   Several computers per user. is not just in terms of user experiences, suchof shopping,
                                                                                                                                                                                                       It                               Thousands as computers per user.
     14




                                            Solutions in 60s and 80s
                                             (see diagram below)




                                                                                     3     3                                              4    4     Solutions now and future
as
                                                            1      1                                                            2     2                                                            3 3                                                    4 4




            1960s: Mainframe Era                                        1980s: Personal Computer Era                                           2000s: Mobility Era                                             2020 and beyond: Ubiquity Era
            One computer per many users.                                One computer per user.                                                 Several computers per user.                                     Thousands of computers per user.
                                                                                                                                                                                                                                                                            15
hat are richer and less prone to the many


blet computers that use stylus-based interaction
 and even paper-based systems that digitally




                                                                                                                   The HotHand device:
                                                                                                                a ring worn by electric
                                                                                                                guitar players that uses
iple points of input also supports novel forms                                                                  motion sensors and a
                                                                                                                wireless transmitter to
g around it and interacting together (see the                                                                   create different kinds of



                                 Why can’t we play guitar
eft)                                               is beginning to be used to control digital movies, turn on   sound effects by various
                                                                                                                hand gestures.




                                 with this?
so been developed that enables the movement
                                                   and our movements can be captured using CCTV cameras,
interface’ or GUI (for this and other terms used throughout, see
                                  the Glossary)



      The Reactable: a multi-
touch interface for playing
       music. Performers can
      simultaneously interact
       with it by moving and
     rotating physical objects                                                                       shift t
     on its surface. Reactable
     was developed by Sergi                                                                          by ga
      Jordà and colleagues at                                                                        ‘React
     the Universitat Pompeu
 Fabra, Barcelona. Icelandic
 songstress Björk used one
         on her 2007 tour.




                                                                                                     input




16




                                 If GUI can become Gesture User interface
                                    from Graphical user interface, why not
                                                   guitar?
Electro-Mechanical Systems (MEMS), are also being made at an



                                                                                                                                                                                                                                                                                                          mobile phone




                                                                                                                                                                                                                        Simple Robots to Autonomous Machines




                                                 After all, things have changed
                                                                                                                                                                                                                        That Learn                                                vacuum cleaner has also become a com
                                                                                                                                                                                          Emotional kitty: a robot
                                                                                                                    and plastic electronics are enabling displays to be made
                                                                                                                                                                                         hardware platform called
                                                                                                                                                                                      sports, concerts of logical cultural events are presented and
                                                                                                                                                                                         iCAT uses a set and other
                                                                                                                                                                                        rules to convey emotional       of assembly lines, as remote investigators of hazardous
                                                                                                                                                                                       states as it makes decisions,
                                                                                                                                                                                                                                                                                                          provide a frus
                                                                                                                                                                                       with the goal of improving                                                                 of human companions, are also being co
                                                                                                                                                                                         human-robot interaction.
                                                                                                                                                                                         It looks confused if it’s in   have begun appearing in our homes as autonomous
                                                                                                                                                                                           trouble, smiles if it gets
                                                                                                                    materials to create very thin semi-conductive transistors that            something right…
                                                                                                                                                                                                                                                                                                          visualisation t
                                                                                                                                                                                                                                                                                  partially due to their therapeutic qualiti
                                                                                                                    can be embedded in all sorts of materials, from paper to cloth,


                                                                                          Animated Textiles                                                                                                                                                                       is beyond the 2020 horizon, recent adva
                                                                                      developed by Studio                                                                                                                                                                                                 Sensors of ma
                                                                                 subTela at the Hexagram                                                                                                                                                                                                  acceleromete
                                                                            Institute, Montreal, Canada.                                                                              music players and other mobile devices providing information                                robots to be programmed to respond an
                                                                                 These two jackets ‘synch
                                                                              up’ when the wearers hold
                                                                                 hands, and the message
                                                                                  scrolls from the back of
 to the World in our Hands                                                   one person to the other.                 Talk to the hand…                                               dynamic readouts, reporting and alerting us to the status of

                                                                                                                   phone ‘brick’ to the
                                                                                                                   latest Apple iPhone: as
                                                                                                                   the size reduces, the
es are rapidly becoming the most ubiquitous                                                                        potential expands.




                                                                                                                                                                                                                                                                                  or not to notify a person of an incoming m
                                                                            18                                                                                                                                                                                                    on the nature and content (and therefore




strating ‘genie-in-a-bottle’ experience – they             Brick to iPhone
                                                 devices can also monitor our medical condition, too, such                                   Smart fabric                                         Dumb toy to emo robots
techniques – such as automatic zooming – have




any types – from GPS location receivers and
rs to RFID tag scanners – and some actuators




                                                 device at a historic building and be offered up an audio or



                                                 the product came from, its associated air miles, and ecological


                                                 band’s poster and then sending it as a gift to a friend’s music
                                                 player can be as natural as a ‘cut and paste’ operation on a
ision of the
g musicians
reate music
s in remote
ollowing or
usical score
wraparound
deo images
displays the
al score.




               Won’t it be a fun desktop?
Some problems of today

Why Facebook does not automatically wish our friends
during their birthday?
Why MMLS does not send us updates when a class is
cancelled?
Why can’t we play DOTA or Cityville or throw Angry
birds while driving?
Why can’t we just think and the assignment gets done?
Find ONE problem that YOU
      want to solve.
Write the problem, and what solution you want and why it
                         matters?
        I don’t expect you to know how to solve it.



                                    15 minutes to think
Being Human : Human Values
Build




                                                                                                                                      Extended use
                                         Study                                                            Understand
                                                                                The conventional
                                                                             user-centred, four-stage
                                                                                                                                   model. The new
                    photographs and other materials to preserve and honour                                                         entails conceptu




                                                                                          ate
                                                                                                                                   or ‘understandin




                                                                                                                            S tu
                                                                                     Evalu
                     Evaluate




                                                              Design




                                                                                                                             dy
ory, cultural



ng the technology

                                                                                                ui
                                                                                                     ld               sig




                                                                                           B




                                                                                                                       n
                                       Build                                                                       De


                                  Previously                                             New Suggestion
                                                                                Extended user-centred,
                                      Understand

serve and honour    How do we solve the problems?                            model. The new stage
                                                                             entails conceptual analysis
                          ate




                                                                             or ‘understanding’
                                                              S tu
                     Evalu




                                                               dy
Understand

It is about what?
  Play and creativity?
  Social connectivity and togetherness?
  Preserve and honour family history?
  Reflect on personal past?
  Supporting collaborative task in domestic situation?
those mechanics of interaction help people achieve long-
                                                                   This stage usua



                                                                   on this, further

Study
                                                                   shopper and an




                                                                   Hence, Stage 2
design implications for existing infrastructures, the people that
technology is used or interpreted, or even contradict the


                                                            not just the individual user experience of playing music, sending




              Design
Build                                            Stage 4:




Prototyping
Programming
Electronics
Physical Computing

                                                 It might, as
                                                 everyday ob
                         Phidgets or ‘physical
                         widgets’ are building
                     blocks to help developers   example, m
                       construct physical user
m the design




then evaluation   considerations may also suggest to HCI researchers that



                   Evaluate
                  other experts from other disciplines need to participate in
monitoring or,




                                                                                   A new device being
                                                                                evaluated in a long-


                                                                                family kitchen.




ividual may




and more far-
and again this
                                                                                           Family 63
                                                                                                  Kitchen
Use UNDERSTANDING to solve

 It is about what?
   Play and creativity?
   Social connectivity and togetherness?
   Preserve and honour family history?
   Reflect on personal past?
   Supporting collaborative task in domestic situation?
Let’s solve some real
 HUMAN problem

Being human : Future of human computer interaction

  • 1.
    Being Human Human computerinteraction in 2020 Adopted from Microsoft Research on HCI, 2008
  • 2.
    Some problems oftoday Why Facebook does not automatically wish our friends during their birthday? Why MMLS does not send us updates when a class is cancelled? Why can’t we play DOTA or Cityville or throw Angry birds while driving?
  • 3.
  • 4.
    Four Computing Eras 1 1 2 2 3 3 4 4 1 1 2 2 There have been various computer-driven revolutions in the Photography, for example, has retained its familiarity despite activities – from buying food to paying our bills – and they 1960s: Mainframe Era 1980s: Personal Computer Era point of creation, people still ‘point and Mobility Era 2000s: shoot’ in much the 2020 and beyond: Ubiquity Era One computer per many users. One computer per user. Several computers per user. is not just in terms of user experiences, suchof shopping, It Thousands as computers per user. 14 Solutions in 60s and 80s (see diagram below) 3 3 4 4 Solutions now and future as 1 1 2 2 3 3 4 4 1960s: Mainframe Era 1980s: Personal Computer Era 2000s: Mobility Era 2020 and beyond: Ubiquity Era One computer per many users. One computer per user. Several computers per user. Thousands of computers per user. 15
  • 5.
    hat are richerand less prone to the many blet computers that use stylus-based interaction and even paper-based systems that digitally The HotHand device: a ring worn by electric guitar players that uses iple points of input also supports novel forms motion sensors and a wireless transmitter to g around it and interacting together (see the create different kinds of Why can’t we play guitar eft) is beginning to be used to control digital movies, turn on sound effects by various hand gestures. with this? so been developed that enables the movement and our movements can be captured using CCTV cameras,
  • 6.
    interface’ or GUI(for this and other terms used throughout, see the Glossary) The Reactable: a multi- touch interface for playing music. Performers can simultaneously interact with it by moving and rotating physical objects shift t on its surface. Reactable was developed by Sergi by ga Jordà and colleagues at ‘React the Universitat Pompeu Fabra, Barcelona. Icelandic songstress Björk used one on her 2007 tour. input 16 If GUI can become Gesture User interface from Graphical user interface, why not guitar?
  • 7.
    Electro-Mechanical Systems (MEMS),are also being made at an mobile phone Simple Robots to Autonomous Machines After all, things have changed That Learn vacuum cleaner has also become a com Emotional kitty: a robot and plastic electronics are enabling displays to be made hardware platform called sports, concerts of logical cultural events are presented and iCAT uses a set and other rules to convey emotional of assembly lines, as remote investigators of hazardous states as it makes decisions, provide a frus with the goal of improving of human companions, are also being co human-robot interaction. It looks confused if it’s in have begun appearing in our homes as autonomous trouble, smiles if it gets materials to create very thin semi-conductive transistors that something right… visualisation t partially due to their therapeutic qualiti can be embedded in all sorts of materials, from paper to cloth, Animated Textiles is beyond the 2020 horizon, recent adva developed by Studio Sensors of ma subTela at the Hexagram acceleromete Institute, Montreal, Canada. music players and other mobile devices providing information robots to be programmed to respond an These two jackets ‘synch up’ when the wearers hold hands, and the message scrolls from the back of to the World in our Hands one person to the other. Talk to the hand… dynamic readouts, reporting and alerting us to the status of phone ‘brick’ to the latest Apple iPhone: as the size reduces, the es are rapidly becoming the most ubiquitous potential expands. or not to notify a person of an incoming m 18 on the nature and content (and therefore strating ‘genie-in-a-bottle’ experience – they Brick to iPhone devices can also monitor our medical condition, too, such Smart fabric Dumb toy to emo robots techniques – such as automatic zooming – have any types – from GPS location receivers and rs to RFID tag scanners – and some actuators device at a historic building and be offered up an audio or the product came from, its associated air miles, and ecological band’s poster and then sending it as a gift to a friend’s music player can be as natural as a ‘cut and paste’ operation on a
  • 8.
    ision of the gmusicians reate music s in remote ollowing or usical score wraparound deo images displays the al score. Won’t it be a fun desktop?
  • 9.
    Some problems oftoday Why Facebook does not automatically wish our friends during their birthday? Why MMLS does not send us updates when a class is cancelled? Why can’t we play DOTA or Cityville or throw Angry birds while driving? Why can’t we just think and the assignment gets done?
  • 10.
    Find ONE problemthat YOU want to solve. Write the problem, and what solution you want and why it matters? I don’t expect you to know how to solve it. 15 minutes to think
  • 11.
    Being Human :Human Values
  • 12.
    Build Extended use Study Understand The conventional user-centred, four-stage model. The new photographs and other materials to preserve and honour entails conceptu ate or ‘understandin S tu Evalu Evaluate Design dy ory, cultural ng the technology ui ld sig B n Build De Previously New Suggestion Extended user-centred, Understand serve and honour How do we solve the problems? model. The new stage entails conceptual analysis ate or ‘understanding’ S tu Evalu dy
  • 13.
    Understand It is aboutwhat? Play and creativity? Social connectivity and togetherness? Preserve and honour family history? Reflect on personal past? Supporting collaborative task in domestic situation?
  • 14.
    those mechanics ofinteraction help people achieve long- This stage usua on this, further Study shopper and an Hence, Stage 2
  • 15.
    design implications forexisting infrastructures, the people that technology is used or interpreted, or even contradict the not just the individual user experience of playing music, sending Design
  • 16.
    Build Stage 4: Prototyping Programming Electronics Physical Computing It might, as everyday ob Phidgets or ‘physical widgets’ are building blocks to help developers example, m construct physical user
  • 17.
    m the design thenevaluation considerations may also suggest to HCI researchers that Evaluate other experts from other disciplines need to participate in monitoring or, A new device being evaluated in a long- family kitchen. ividual may and more far- and again this Family 63 Kitchen
  • 18.
    Use UNDERSTANDING tosolve It is about what? Play and creativity? Social connectivity and togetherness? Preserve and honour family history? Reflect on personal past? Supporting collaborative task in domestic situation?
  • 19.
    Let’s solve somereal HUMAN problem