0
The Future of
User Interfaces
!
19 June 2014
Future of Digital Marketing 2014
!
Jason Mesut
Head of User Experience, Plan
...
!
Let’s watch some videos
Microsoft video
Microsoft vision of the future
Corning — A day made of glass 2
!
How did the videos make you feel?
!
How would these future solutions
work as part of your life?
!
What does your home look like?
Original iPhone
??
2007
—Direct manipulation
—Dynamic display
—Rich graphics

Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Original iPhone
??
2007
—Direct manipulation
—Dynamic display
—Rich graphics

Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knob handles
??
Knobs
Buttons
Switches
Levers and handles
!
Who am I to talk about the
Future of User Interfaces?
5years
!
Industrial Design
years
!
Digital User Experience
15
3years
Local leader
Interaction Design
Association
L o n d o n
Subjects over 3 years
Internet of Things
Future of publishi...
I joined
A product strategy consultancy
!
We help companies
work out what to do next.
I joined
!
We help companies
work out what to do next.
Helping innovation
and design teams
raise their game
Bringing clari...
Bringing clarity to
the front end of
innovation
Helping innovation
and design teams
raise their game
Consumer
electronics
...
2026 2027 2028
We work across a range of horizons
2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025
FMCG
Consumer ele...
Across a variety
of challenge areas
Packaging
Digital
Services
Products
Interactions
Environments
So we think a lot
about the future
of user interfaces
Packaging
Digital
Services
Products
Interactions
Environments
And their relationships
to those other areas
What is a
User Interface?
!
User Interface
!
User Interface
A human that uses something:
customer, employee, citizen, parent, child
!
User Interface
A human that uses something
A way for a human to understand
and control a machine or technology
!
What about User Experience?
User Interface
!
A way for a human
to understand and
control a machine
or technology
User Interface
!
A way for a human
to understand and
control a machine
or technology
User Experience
!
Perceptions and
mem...
User Interface
we can
design this
User Interface User Experience
we can
design this
to affect
this
User Experience
Which we hope
will affect
Loyalty
Revenue
Brand
Efficiency
Graphical
User Interface
!
Allows users to
interact with
electronic systems
Visual Language
Motion Graphics
Information Design
Information Architecture
Interaction Design
Visual Language
Motion Graphics
Information Design
Information Architecture
Interaction Design
Visual language
Motion graphics
Information Design
Information Architecture
Interaction Design
Still relevant
But there’s more to
UI than just GUI
Physical
Telephone
Voice
Embedded
Distributed
I want to talk you through
The future present
The future possible
The future likely
How to focus better
What’s going on now?
The future present
!
We’re still getting to
grips with touchscreens
Original iPhone
2007
—Direct manipulation
—Dynamic display
—Rich graphics

Skeuomorphism
??
2007
—??
In defence of
skeuomorphism
2007
—??
Skeuomorphism has
always been in design
Zune
Radical failure
Windows 8
Radical failure
!
Designers obsessed with flat design.
But at what cost?
Flat design
Less obvious
Homogenous
Requires good typography
!
Screen size impacting
how we design
Responsive design
Mobile first
!
Gestural interaction is
growing and fading
Wii
Leap
!
Better isn’t always better
!
Tiring
Coarse control
Confusion with natural gestures
Nest Protect
We’re
attracted to
magic like
magpies
!
Screens dominating
Screens on
everything
Screens replacing
tactile controls
Screens in
front of babies
http://www.digitaltrends.com/wp-content/uploads/2013/12/fisher-price-ipad-apptivity-seat.jpg
!
Emerging hardware revival
The internet of
things is hitting
the mainstream
Niche Mass
In odd ways
http://www.beamtoothbrush.com/toothbrush/
http://www.beamtoothbrush.com/toothbrush/
Tech companies
buying hardware
companies + skills
Service
companies
selling hardware
Wearable
excitement
Something other than a
smartphone to design
Even if they make
us look ridiculous
What are the possible futures?
The future possible
!
Artificial Intelligence
!
!
!
!
How far can this go?
!
Her
!
!
!
!
How far can this go?
Beware the uncanny valley
Humanoid
robot
Corpse
Stuffed
animal
Bunraku
puppet
Uncanny valley
Industrial
robot
Familarity
H...
!
Smart platforms
As internet connected sensors
proliferate and sense a wider range
of phenomena, platforms are using
mach...
!
Natural UI
!
No such thing
as a natural UI
!
Invisible Computing
Hardware virtually disappears, as computing technology
unobtrusively integrates with everyday, natur...
!
Ban the word intuitive
!
No UI
!
No UI is the best UI
!
No UI is not
always better
Better for
Less visual clutter
Less learning (in theory)
Less conscious interaction
!
Displaced complexity
System rules
Mental models
!
Or we lose control
!
Wearables
!
!
How long are
our wrists?
Wearable Where?
Visible
Concealed
Pendant
Undergarment strap
Chest pin
BFC
Belt
Pocket
Inside pocket or undergarment
Earri...
Wearables need to consider
many different factors
Fashion, gender, context, size
Where should you focus?
The future likely
The future is already
here — it's just not very
evenly distributed.
William Gibson, 1993
!
Touch and gesture
will evolve
!
Screen form factors
will evolve
Round screens
Any shape screens
Curved screens
!
We will seek more
immersive interfaces
Occulus Rift
Sony projector
Microsoft illumiroom
Amazon Fire phone
!
Escapism or focus?
Gamers and experts?
!
More motion and emotion
!
We will get physical again
Blending paper products
and digital services


Evernote
+ Moleskin

+ Post-Its

+ Business cards

Integrated
automotive
interface
Texas Instruments

Immersive Automobile

Physical controls
designed in concert with
graphi...
Physical
peripherals with
digital interfaces
Roli
Seaboard
Roli 

Innovative expressive
piano. Keys you can bend.
!
Strokable surfaces
Physical
interaction design
Beo A9

Physical volume control

Physical interaction
design
Beo A9

Physical volume control

Beo A9

Physical volume control

!
AI driven relevance
Intelligence driven relevance
!
More distributed interfaces
Distributed controls and displays
!
There will still be
buttons, knobs, mice
and keyboards
Still loads of
buttons
Slick
knobs
Distributed
knobs
And keyboards will
still be important
Mice are precise
!
The future likely
!
It’s like today, with
some small differences
!
— Greater relevance
— Politer interactions
— Evolved ...
How can you better
focus for the future?
!
Triangulate to focus
Experts
Emergent
behaviour
Trends Brand
Business
Creative
technologists
Industrial
Designer
Interaction
designer
Visual
designer
Software
engineers
Researchers
De...
Monitor
trends
Perpetual
contact
Perpetual
contact
Culture
of fear
Culture of
emotions
Polarised
prosperity
Urban
rennaiss...
!
Keep aware of new technology
Innovation
trigger
Peak of inflated
expectations
Trough of
disillusionment
Slope of
enlightenment
Plateau of
productivity
A...
!
Understand human behaviours in context
The world
The products and
services that people will
use and the context of
that usage
The user
How they see the
world and...
The world
The products and
services that people will
use and the context of
that usage
The user
How they see the
world and...
Environment User
Situation Task
System
LearnabilityEcosystem
Intent
The world
The products and
services that people will
u...
Environment User
Situation Task
System
LearnabilityEcosystem
Intent
Usability
Product
Experience
Brand
The world
!
!
!
The...
Background vs. foreground
Consciousness
Polite interactions
Contextual
Respectful
Discrete
!
Understand your brand
position and permission
A recipe for integrated products?
+ +Physical
Product
Digital
Interface
Digital
Service
Integrated
product
=
+ +Physical
Product
Digital
Interface
Digital
Services
!
Aesthetic 

Visceral. Visual, sonic, feel.

Interactive
Behaviour...
Experts
Emergent
behaviour
Trends Brand
!
Escape the echo chamber
Mobile first
Responsive design
Big Data
Internet of Things
Native apps
Natural UI
…
The human centipede of digital rhetori...
Escape the echo chamber
Look around you.
Listen with your eyes.
Apply critical judgement.
!
Make the future real
Beware concept videos
Tell real stories and demonstrate
with working prototypes
2014 2015 2016 2017 2018 2019
The Internet of
Ubiquitous
Computing
Information
Appliance Things is
growing

Prototype out loud
!
Shun the shiny
Don’t be a magpie
to the magical
!
The Future of User Interfaces?
!
Knobs
Buttons
Switches
Levers and handles
Knobs
Buttons
Switches
Levers and handles
!
The Future of User Interfaces?
!
It’s like today, with
some small differences
!
— Greater relevance
— Politer interactio...
!
The Future of User Interfaces?
!
To make a better future
!
!
— Triangulate to focus
— Escape the echo chamber
— Make the...
Thank you jason@plan.bz
@jasonmesut
http://www.plan.bz
slideshare.net/jasonmesut
slideshare.net/planstrategic
The Future of User Interfaces
The Future of User Interfaces
The Future of User Interfaces
The Future of User Interfaces
The Future of User Interfaces
The Future of User Interfaces
The Future of User Interfaces
The Future of User Interfaces
The Future of User Interfaces
The Future of User Interfaces
The Future of User Interfaces
The Future of User Interfaces
The Future of User Interfaces
The Future of User Interfaces
The Future of User Interfaces
The Future of User Interfaces
The Future of User Interfaces
The Future of User Interfaces
The Future of User Interfaces
The Future of User Interfaces
The Future of User Interfaces
Upcoming SlideShare
Loading in...5
×

The Future of User Interfaces

15,218

Published on

A challenging review of the future of user interfaces, and a plea to better focus and shun the shiny:
– triangulate through experts
– observe emergent behaviour
– and track a range of trends.

Get out the echochamber and avoid the human centipede of digital rhetoric. Listen harder with your eyes and critique better with your mind.

Published in: Design, Technology
7 Comments
128 Likes
Statistics
Notes
No Downloads
Views
Total Views
15,218
On Slideshare
0
From Embeds
0
Number of Embeds
17
Actions
Shares
0
Downloads
348
Comments
7
Likes
128
Embeds 0
No embeds

No notes for slide

Transcript of "The Future of User Interfaces"

  1. 1. The Future of User Interfaces ! 19 June 2014 Future of Digital Marketing 2014 ! Jason Mesut Head of User Experience, Plan Local Leader, IxDA London ! ! @jasonmesut !
  2. 2. ! Let’s watch some videos
  3. 3. Microsoft video Microsoft vision of the future
  4. 4. Corning — A day made of glass 2
  5. 5. ! How did the videos make you feel?
  6. 6. ! How would these future solutions work as part of your life?
  7. 7. ! What does your home look like?
  8. 8. Original iPhone ?? 2007 —Direct manipulation —Dynamic display —Rich graphics

  9. 9. Knob handles ??
  10. 10. Knob handles ??
  11. 11. Knob handles ??
  12. 12. Knob handles ??
  13. 13. Knob handles ??
  14. 14. Knob handles ??
  15. 15. Knob handles ??
  16. 16. Knob handles ??
  17. 17. Knob handles ??
  18. 18. Knob handles ??
  19. 19. Original iPhone ?? 2007 —Direct manipulation —Dynamic display —Rich graphics

  20. 20. Knob handles ??
  21. 21. Knob handles ??
  22. 22. Knob handles ??
  23. 23. Knob handles ??
  24. 24. Knob handles ??
  25. 25. Knob handles ??
  26. 26. Knob handles ??
  27. 27. Knob handles ??
  28. 28. Knob handles ??
  29. 29. Knob handles ??
  30. 30. Knob handles ??
  31. 31. Knob handles ??
  32. 32. Knob handles ??
  33. 33. Knob handles ??
  34. 34. Knob handles ??
  35. 35. Knob handles ??
  36. 36. Knobs Buttons Switches Levers and handles
  37. 37. ! Who am I to talk about the Future of User Interfaces?
  38. 38. 5years ! Industrial Design years ! Digital User Experience 15
  39. 39. 3years Local leader Interaction Design Association L o n d o n Subjects over 3 years Internet of Things Future of publishing Urban environment Smart materials Mobility / Automotive Clinical applications ! Upcoming… Smart home Music interfaces Consumer healthcare
  40. 40. I joined A product strategy consultancy ! We help companies work out what to do next.
  41. 41. I joined ! We help companies work out what to do next. Helping innovation and design teams raise their game Bringing clarity to the front end of innovation
  42. 42. Bringing clarity to the front end of innovation Helping innovation and design teams raise their game Consumer electronics Automotive ! Materials What should we do for our next smart phone? ! How will we engage gen Z? ! ! How can we compete with the no.1 in our category?
  43. 43. 2026 2027 2028 We work across a range of horizons 2015 2016 2017 2018 2019 2020 2021 2022 2023 2024 2025 FMCG Consumer electronics Automotive Healthcare Aviation
  44. 44. Across a variety of challenge areas Packaging Digital Services Products Interactions Environments
  45. 45. So we think a lot about the future of user interfaces
  46. 46. Packaging Digital Services Products Interactions Environments And their relationships to those other areas
  47. 47. What is a User Interface?
  48. 48. ! User Interface
  49. 49. ! User Interface A human that uses something: customer, employee, citizen, parent, child
  50. 50. ! User Interface A human that uses something A way for a human to understand and control a machine or technology
  51. 51. ! What about User Experience?
  52. 52. User Interface ! A way for a human to understand and control a machine or technology
  53. 53. User Interface ! A way for a human to understand and control a machine or technology User Experience ! Perceptions and memories of interactions and events
  54. 54. User Interface we can design this
  55. 55. User Interface User Experience we can design this to affect this
  56. 56. User Experience Which we hope will affect Loyalty Revenue Brand Efficiency
  57. 57. Graphical User Interface ! Allows users to interact with electronic systems
  58. 58. Visual Language Motion Graphics Information Design Information Architecture Interaction Design
  59. 59. Visual Language Motion Graphics Information Design Information Architecture Interaction Design
  60. 60. Visual language Motion graphics Information Design Information Architecture Interaction Design Still relevant
  61. 61. But there’s more to UI than just GUI Physical Telephone Voice Embedded Distributed
  62. 62. I want to talk you through The future present The future possible The future likely How to focus better
  63. 63. What’s going on now? The future present
  64. 64. ! We’re still getting to grips with touchscreens
  65. 65. Original iPhone 2007 —Direct manipulation —Dynamic display —Rich graphics

  66. 66. Skeuomorphism ?? 2007 —??
  67. 67. In defence of skeuomorphism 2007 —??
  68. 68. Skeuomorphism has always been in design
  69. 69. Zune Radical failure
  70. 70. Windows 8 Radical failure
  71. 71. ! Designers obsessed with flat design. But at what cost?
  72. 72. Flat design Less obvious Homogenous Requires good typography
  73. 73. ! Screen size impacting how we design
  74. 74. Responsive design
  75. 75. Mobile first
  76. 76. ! Gestural interaction is growing and fading
  77. 77. Wii
  78. 78. Leap
  79. 79. ! Better isn’t always better
  80. 80. ! Tiring Coarse control Confusion with natural gestures
  81. 81. Nest Protect
  82. 82. We’re attracted to magic like magpies
  83. 83. ! Screens dominating
  84. 84. Screens on everything
  85. 85. Screens replacing tactile controls
  86. 86. Screens in front of babies http://www.digitaltrends.com/wp-content/uploads/2013/12/fisher-price-ipad-apptivity-seat.jpg
  87. 87. ! Emerging hardware revival
  88. 88. The internet of things is hitting the mainstream Niche Mass
  89. 89. In odd ways
  90. 90. http://www.beamtoothbrush.com/toothbrush/ http://www.beamtoothbrush.com/toothbrush/
  91. 91. Tech companies buying hardware companies + skills
  92. 92. Service companies selling hardware
  93. 93. Wearable excitement Something other than a smartphone to design
  94. 94. Even if they make us look ridiculous
  95. 95. What are the possible futures? The future possible
  96. 96. ! Artificial Intelligence
  97. 97. ! ! ! ! How far can this go?
  98. 98. ! Her ! ! ! ! How far can this go?
  99. 99. Beware the uncanny valley Humanoid robot Corpse Stuffed animal Bunraku puppet Uncanny valley Industrial robot Familarity Human likeness 50% 100% + - Healthy person Moving Still Prosthetic hand Zombie
  100. 100. ! Smart platforms As internet connected sensors proliferate and sense a wider range of phenomena, platforms are using machine intelligence to interpret and aggregate collected data to make useful interventions.
  101. 101. ! Natural UI
  102. 102. ! No such thing as a natural UI
  103. 103. ! Invisible Computing Hardware virtually disappears, as computing technology unobtrusively integrates with everyday, natural human function. ! Supportive Computing Computing technology that supports natural human function, rather than requires humans to adapt to computing functions. Adaptive Computing Intelligently recognize and interpret human patterns to produce output based on relative context. ! http://pivotallabs.com/the-future-of-uiux-the-natural-user-interface/
  104. 104. ! Ban the word intuitive
  105. 105. ! No UI
  106. 106. ! No UI is the best UI
  107. 107. ! No UI is not always better
  108. 108. Better for Less visual clutter Less learning (in theory) Less conscious interaction
  109. 109. ! Displaced complexity System rules Mental models
  110. 110. ! Or we lose control
  111. 111. ! Wearables
  112. 112. ! ! How long are our wrists?
  113. 113. Wearable Where? Visible Concealed Pendant Undergarment strap Chest pin BFC Belt Pocket Inside pocket or undergarment Earring or on ear Shirt collar Upper arm of Sleeve Tie or Shirt button Wrist Finger ring Calf or Sock On or in shoe Hair Gadi Amit, New Deal Design, PDI 2014
  114. 114. Wearables need to consider many different factors Fashion, gender, context, size
  115. 115. Where should you focus? The future likely
  116. 116. The future is already here — it's just not very evenly distributed. William Gibson, 1993
  117. 117. ! Touch and gesture will evolve
  118. 118. ! Screen form factors will evolve
  119. 119. Round screens
  120. 120. Any shape screens
  121. 121. Curved screens
  122. 122. ! We will seek more immersive interfaces
  123. 123. Occulus Rift
  124. 124. Sony projector
  125. 125. Microsoft illumiroom
  126. 126. Amazon Fire phone
  127. 127. ! Escapism or focus? Gamers and experts?
  128. 128. ! More motion and emotion
  129. 129. ! We will get physical again
  130. 130. Blending paper products and digital services 
 Evernote + Moleskin
 + Post-Its
 + Business cards

  131. 131. Integrated automotive interface Texas Instruments
 Immersive Automobile
 Physical controls designed in concert with graphical user interface

  132. 132. Physical peripherals with digital interfaces
  133. 133. Roli Seaboard Roli 
 Innovative expressive piano. Keys you can bend.
  134. 134. ! Strokable surfaces
  135. 135. Physical interaction design Beo A9
 Physical volume control

  136. 136. Physical interaction design Beo A9
 Physical volume control
 Beo A9
 Physical volume control

  137. 137. ! AI driven relevance
  138. 138. Intelligence driven relevance
  139. 139. ! More distributed interfaces
  140. 140. Distributed controls and displays
  141. 141. ! There will still be buttons, knobs, mice and keyboards
  142. 142. Still loads of buttons
  143. 143. Slick knobs
  144. 144. Distributed knobs
  145. 145. And keyboards will still be important
  146. 146. Mice are precise
  147. 147. ! The future likely ! It’s like today, with some small differences ! — Greater relevance — Politer interactions — Evolved touch, gesture, voice — New screen form factors — Return to physical !
  148. 148. How can you better focus for the future?
  149. 149. ! Triangulate to focus
  150. 150. Experts Emergent behaviour Trends Brand
  151. 151. Business Creative technologists Industrial Designer Interaction designer Visual designer Software engineers Researchers Design strategists Work with experts
  152. 152. Monitor trends Perpetual contact Perpetual contact Culture of fear Culture of emotions Polarised prosperity Urban rennaissance Sustainability tensions Behaviour change Retail revolution Consumerisation of healthcare Learning diversity Austerity culture Labour imbalances Innovation imperative Resource volatility New conventions Ageing societies Search for authenticity Trust crisis Internet of things Networks of connected objects that sense and share information Hardware revival Smart systems Social Econom ic Technological
  153. 153. ! Keep aware of new technology
  154. 154. Innovation trigger Peak of inflated expectations Trough of disillusionment Slope of enlightenment Plateau of productivity As of July 2013 Time Content analytics Augmented reality Mobile health monitoring Cloud computing Virtual reality Gesture control Biometric authentication Location intelligence Predictive analytics Speech recognition Wearable user interfaces Gamification Big data Natural language processing Internet of Things Autonomous vehicles Holographic displays Expectations
  155. 155. ! Understand human behaviours in context
  156. 156. The world The products and services that people will use and the context of that usage The user How they see the world and how they need to manipulate it
  157. 157. The world The products and services that people will use and the context of that usage The user How they see the world and how they need to manipulate it Environment User Situation Task System LearnabilityEcosystem Intent
  158. 158. Environment User Situation Task System LearnabilityEcosystem Intent The world The products and services that people will use and the context of that usage The user How they see the world and how they need to manipulate it
  159. 159. Environment User Situation Task System LearnabilityEcosystem Intent Usability Product Experience Brand The world ! ! ! The user
  160. 160. Background vs. foreground Consciousness
  161. 161. Polite interactions Contextual Respectful Discrete
  162. 162. ! Understand your brand position and permission
  163. 163. A recipe for integrated products? + +Physical Product Digital Interface Digital Service Integrated product =
  164. 164. + +Physical Product Digital Interface Digital Services ! Aesthetic 
 Visceral. Visual, sonic, feel.
 Interactive Behavioural. Distribution of inputs and controls. ! Experiential Reflective. Fit with person’s context and ecosystems. ! ! Key levels of harmony Components of integrated experience
  165. 165. Experts Emergent behaviour Trends Brand
  166. 166. ! Escape the echo chamber
  167. 167. Mobile first Responsive design Big Data Internet of Things Native apps Natural UI … The human centipede of digital rhetoric Twitter LinkedIn Conferences Campaign …
  168. 168. Escape the echo chamber Look around you. Listen with your eyes. Apply critical judgement.
  169. 169. ! Make the future real
  170. 170. Beware concept videos Tell real stories and demonstrate with working prototypes
  171. 171. 2014 2015 2016 2017 2018 2019
  172. 172. The Internet of Ubiquitous Computing Information Appliance Things is growing
 Prototype out loud
  173. 173. ! Shun the shiny Don’t be a magpie to the magical
  174. 174. ! The Future of User Interfaces? !
  175. 175. Knobs Buttons Switches Levers and handles
  176. 176. Knobs Buttons Switches Levers and handles
  177. 177. ! The Future of User Interfaces? ! It’s like today, with some small differences ! — Greater relevance — Politer interactions — Evolved touch, gesture, voice — New screen form factors — Return to physical !
  178. 178. ! The Future of User Interfaces? ! To make a better future ! ! — Triangulate to focus — Escape the echo chamber — Make the future real — Don’t be a magpie
  179. 179. Thank you jason@plan.bz @jasonmesut http://www.plan.bz slideshare.net/jasonmesut slideshare.net/planstrategic
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×