UX Design for the IoT and the Rise of Natural Interaction

www.ICS.comwww.BostonUX.com
UX DESIGN FOR THE IoT &
THE RISE OF NATURAL INTERACTION
DOROTHY SHAMONSKY UXPA INTERNATIONAL 2019

www.ICS.comwww.BostonUX.com www.BostonUX.com
Part 1: Introduction

Is the Internet of Things an inevitable evolution in
digital technology?

“
https://www.business2community.com/business-innovation/internet-things-ecosystem-value-greater-sum-things-0829370
Research firm, IDC, expects a globally installed base of IoT will
reach around 212 billion things by the end of 2020, including 30.1
billion installed connected autonomous things. Intel predicts there
will be 31 billion connected devices. Cisco, a notable leader in IoT
research and awareness, predicts 50 billion objects will be
connected to the Internet. Gartner predicts these billions of
connected “things” added economic value will be $1.9 trillion
dollars in 2020.

Technology Cynic

In my vision of future tech, aesthetics plays a big role

Weirdly devoid of emotion

Good Reasons to Computer-enable Things
· Convenience – Easy Pass
· Safety – Self-driving cars
· Security – Smart doorbell
· Health monitoring – Wearable EKG monitor
· Energy conservation – Smart washer
· Empowerment – Smart prosthesis

Part 1: Introduction
Part 2: Understanding the IoT
Part 3: Sample Project
Part 4: Natural Interaction

Part 2: Understanding the IoT

Two Main
Characteristics of
the IoT
1. Embed computation
into things
1. Communicate with
computer-enabled
things and enable
them to communicate
with each other.

Definition: Internet of Things (IoT) - 1
The internet of things, or IoT, is a system of interrelated computing devices,
mechanical and digital machines, objects, animals or people that are provided
with unique identifiers and the ability to transfer data over a network without
requiring human-to-human or human-to-computer interaction.
A thing in the internet of things can be a person with a heart monitor
implant, a farm animal with a biochip transponder, an automobile that
has built-in sensors to alert the driver when tire pressure is low or any other
natural or man-made object that can be assigned an IP address and is able to
transfer data over a network.

Definition: Internet of Things (IoT) - 2
… An IoT ecosystem consists of web-enabled smart devices that use
embedded processors, sensors and communication hardware to collect,
send and act on data they acquire from their environments. …The devices do
most of the work without human intervention, although people can interact
with the devices -- for instance, to set them up, give them instructions or
access the data.
https://internetofthingsagenda.techtarget.com/definition/Internet-of-Things-IoT

Ubiquitous Computing (UBICOMP) b. 1988
Mark Weiser, Chief Technology
Officer, Xerox PARC
Computation everywhere, embedded
in things and/or used as an
information infrastructure
“Machines that fit the human
environment, instead of forcing humans
to enter theirs, will make using a
computer as refreshing as taking a walk
in the woods.”

Ubiquitous Computing (UBICOMP) b. 1988
The purpose of a computer is to help you do something else.
The best computer is a quiet, invisible servant.
The more you can do by intuition the smarter you are; the computer
should extend your unconscious.
Technology should create calm.

A world saturated
with computer
-enabled things
badly needs good
UX design

What Are the Main UX Challenges of IoT Design?
IoT Apps
Not restricted to an operating system that
has pre-solved interaction patterns
Standard operating system with prebuilt
components and patterns for interaction
Context of use can be unique to every
application in a system
Standard context of use
No one standard modality of interaction,
although touch and voice are primary
Standard modalities for interacting such as mouse,
touch and voice
Placement and size of any one device or
system of devices can vary
Standard device size and resolutions
Across device experience is more diverse
because of uniqueness of devices
Across device usually means desktop and mobile
Interface needs to be intuitive or more natural
to use
OK for interface to be very complex since you own
the device and can take time to learn

Prius IVI

UX Skills
UX Strategy
Research
Personas
User Stories
Journey Mapping
Across Device Multi-
user
Interaction Design
Visual Design
Designing for
Modalities: Touch,
Voice, Gesture
Designing Interaction
Patterns/Components
Context of Use
Ergonomics
ID
Natural Interaction:
More intuitive,
Seamlessly integrated
with our
environments,
Calm, Aesthetic
Known Shallow Knowledge Specialties Need to Learn

Part 3:
Sample
Project

ViewPoint
www.ViewPointTouch.com

1. We try to make our kiosks
blend into the environment,
but people don’t always know
that they are interactive

2. Touch is always a solid solution; voice and gesture are problematic

3. Ergonomic factors matter hugely3. Ergonomics matters a lot

4. A kiosk interface always needs to be totally intuitive to use

Part 4: Natural Interaction

Are our current UX design paradigms and
principles good enough for the near future - for
ubiquitous computing, and even robotics, AR/VR?

Graphical User
Interface (GUI) -
persistent, primary
design paradigm

Mashup of Machine Controls & Graphic
Design

IoT and the GUI - not a fit
The GUI paradigm

IoT and the GUI - not a fit
IOT
The GUI paradigm

It just needs additional
paradigms added to it: GUI +
TUI + VUI + ergonomics + ID
Needs a fresh overriding
paradigm that encompasses all
digital tech including IoT +
robotics + AR/VR
TWO FUTURES: Two Ways to Look at the GUI Paradigm

The NUI -2011

Interact with content

NUI Principles
1. Choose an input and output modality that is appropriate to the context of use.
2. Content is the interface.
3. Leverage instinct or innate skills such as motor memory and sense of 2 and 3-D space.
4. Leverage already learned non-computer behavior.
5. Discoverable and easy with progressive complexity.
6. Inviting and highly responsive. Calm when appropriate.
7. Pleasurable and enjoyable.
8. Personalized.
9. Intelligent.
10. Simple and Elegant.

ViewPoint as a NUI (movie of changing color on car)

Content is the Interface

Medium @dshamonsky
THANK YOU!

UX Design for the IoT and the Rise of Natural Interaction

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to UX Design for the IoT and the Rise of Natural Interaction

Similar to UX Design for the IoT and the Rise of Natural Interaction (20)

More from UXPA International

More from UXPA International (20)

Recently uploaded

Recently uploaded (20)

UX Design for the IoT and the Rise of Natural Interaction