This document summarizes a presentation about using low-fidelity prototyping tools to stimulate the design process. It discusses using physical models, projections, sensors and tracking to prototype physical and immersive environments for user experience design. Specific prototyping tools that were covered include 3D models, projections, sensors like iBeacons, microcontrollers like Arduino, and avatars to evaluate designs. The presentation provided examples of how these tools could be applied to prototype concepts involving the Internet of Things, augmented reality, virtual reality and physical spaces.

1. Prototyping
Physical & Immersive Environments
for UX Designers
Tools for Making Lo-Fi Prototypes to Stimulate the Design Process
Seattle Prototyping for Designers Meetup | 10.19.2015 | Susan Oldham

2. 1. About me
2. Why lo-fi for 3D?
3. Physical & Immersive environments
a. Descriptions
b. Design challenges
4. Prototyping Tools
a. Models
b. Projections
c. Sensors
d. Tracking engagement
5. Virtual Worlds
a. Second Life demo with Valerie Hill
6. Questions & contributions
agenda

3. about me
UX & Visual Designer

4. University of Washington
MS Human Centered Design & Engineering, 2015
Capstone : UX in Public Spaces
BS Informatics, Human Computer Interaction, 2012
Certificate of Virtual Worlds, 2009
University of Cincinnati
DAAP, Graphic/Industrial Design, 1980s
education

5. Apparel Designer
Sportswear : Heet, Unionbay Sportswear
Activewear : Jantzen, Burton Snowboard, NK Sport
Handknits : Vogue Knitting, Knitter’s, Creative KnitsG
Visual Designer
Retail & Merchandising : T-Mobile, Starbucks, Macys
Packaging : Starbucks, Costco, Econobox, Girvin
Architectural : J. Miller & Associates; KR Studios, T-Mobile
UX, Web & Information Design : Costco, Engine Interactive,
City of Redmond, WIN Home Inspection, UW. + others
experience

6. Prototype
A representation that
can be tested in some
way
proto- : combining form meaning “first,”
“foremost,” “earliest form of,” used in
the formation of compound words
(protomartyr; protoplasm).
mockup
A model for
presentation &
communication
mock : to mimic, imitate, or
counterfeit; an imitation; counterfeit;
fake; feigned; not real.
my definitions
“Prototype is an action—something we do in
order to solve a particular business, design,
or technical problem.”—Anthony Franco

7. mocktype?
Proto-up?

8. 1. External memory reduces cognitive load [Simon & Newell, 1972]
2. Sketching/doodling aids concentration & recall [Andrade, 2009]
3. Sketching improves ability to restructure ideas [Verstijnen, 1998]
4. Serendipity and happy accidents [Fish & Stephen, 1990]
5. Sketching facilitates team collaboration [van der Lugt, 2004]
6. Better design outcomes [Yang, 2009]
7. Better communication with clients, stakeholders & users
[Buxton, 2007]
“Sketchesaresocialthings”—Bill Buxton
making, sketching & the design brain
From Smashing Magazine article by Laura Busche

9. SmartWheels
Communication Kit
SmartWheels Kit
installed on chair Includes Sensors,
Microcontroller and
Wi-Fi
SmartWheels
App
OpenStreet
Maps
Secure User
Database
Bluetooth
Headset
User
physical design patterns
Physical technology that users can interact with in an interior or
exterior physical space, either in an overt or ubiquitous manner
• Engagement is key to interaction in public or private spaces
• Climate & traffic patterns are factors in designing physical
interfaces
• How people move within
the space will inform design
solutions
• Conditions can vary inside
or outside: consider heat, cold,
wind, rain, light & sound

10. IoT patterns
The Internet of Things is a network of physical objects embedded
with electronics, software, sensors and network connectivity,
which enables these objects to collect and exchange data
• Look and feel is of utmost importance, product must fit into
environment and give pleasure to user because of the intimacy of
everyday devices
• Small size of components requires :
• Power efficiency
• Heat dispersal
• Elegant interface

11. immersive design patterns | AR, MR
Augmented reality is the overlay of
information onto a physical environment
Mixed reality allows generated
information to merge with physical
• Immersion is moderate, sense of the
physical must be strong
• Distraction is a concern :
• Minimal information for job at hand
• Effortless way to turn on/off
• Light source is critical
• Safety protocols
Carrier 12:34 AM 100%
Rate the entertainmentRate the entertainment
Make your Mark on
a Seattle Park
Put your name on the wall
Donate to a Busker or a Park
You’re in Westlake Park, Downtown Seattle
watching band Blue Trees Wailiers
on April 19, 2015
Give Voice to your idea
Carrier 12:34 AM 100%
Do you want to see
this band in the
park again?
You’re in Westlake Park, Downtown Seattle
watching band Blue Trees Wailiers
on April 19, 2015
Nope
not again
Yes,
loved it
SubmitRate!
Carrier 12:34 AM 100%
Sign your name and
hometown.
You’re in Westlake Park, Downtown Seattle
on April 19, 2015
Name
Place
Submit
Manuel
Salt Lake City
Carrier 12:34 AM 100%
How would you change
the world? Please
record your thoughts
for Seattle.
You’re in Westlake Park, Downtown Seattle
60 sec
SubmitListen
Carrier 12:34 AM 100%
Sunday,
Today Tomorrow all
Seattle Parks & Rec Calendar
Pac NW Skateboard Tournament
Setup Main Stage
Buskers Play Noon to 2pm
10
Noon
Pac NW Skateboard Tournament
Events begin
Sonic Kittens Concert
Pac NW Skateboard Tournament
1
5
Carrier 12:34 AM 100%
June 30th
Westlake Park
Augmented Event calendar
for Westlake Park with projected
info. Real-time data from Seattle
Park & Recreation online calendar.
Rate the Park
1. scale 1 question
2. Rate It
Sign the Park
1. TyPe/speak Name
2. Choose Place
Mark the Park
1. Choose A way to
impact the park
Learn the park Share your vision
1. speak
2. Share

12. immersive design patterns | VR
Virtual reality is a total immersion into another environment
• Freedom to break from physical norms, defy conventions
• Psychology of being immersed in unfamiliar situation :
• Physical cues to combat dizziness
• Empathy for user’s experience

13. 3d models | Physical, IoT, AR, MR
• 3d representations of products that can be tested
• Design exploration—test for shape, size, weight, viability, etc
• Team communication & collaboration
• Work with stakeholders to refine before time-consuming user tests
• User testing can be amazing with a well-executed 3D model
• Triangulation of methods = deeper understanding
Play-doh Illustrator Extrusion
Second Life
Paper

14. models
Sketching user ExperiencesQueensland University Library
International User Experience course, UW

15. projections | AR, MR, IoT
• Combine an old-fashioned transparency overhead projector with
a regular projector to emulate augmented & mixed reality apps
• Layer transparencies of sketches, diagrams, info overlays into room
• Add objects for shadows, outlines
• Team can make notes & sketch on projected prototypes
• Conduct usability testing, users can add sketches and comments
on transparencies
• Multiple projectors can emulate room immersion
• Standard projectors mounted on ceiling can be angled
down on surfaces
• Used overheads are inexpensive, $20-50 each on craigslist

16. projections

17. projections | Physical, AR, MR, IoT
• Wizard of Oz interactivity for users by projecting onto wall
• Similar to paper prototype, but projected on wall or screen while
researcher controls action from computer
• Project concept onto body for wearable and mobile concepts
• Projector can be angled toward body area
• Can be combined with light activated stickers or glow-in-dark paint
• Reverse images on smartphone to reflect on glass or clear plastic
simulate augmented reality information overlay
Sketching user Experiences

18. projections

19. tracking engagement | Physical, AR, MR, IoT
• Glow sticks and bracelets body for wearable and mobile concepts
• Track users more easily, differentiate between users on camera
• UV beads and UV flashlight are physical breadcrumbs
• Light, heat or touch sensitive paper that changes state, i.e. color
Findthesesciencetoolsandmoreatwww.teachersource.com.
Teachersource.com

20. sensors | AR, MR, IoT, Physical
• iBeacons
• Pros : Easy to install and use, about $100 for 3; waterproof
• Cons : Smartphones need to be bluetooth enabled to track
• Dash button
• Pros : Can track users button push with script; inexpensive, $5 each
• Cons : Users have to press button, can disrupt flow
• Script created by Edward Benson, medium.com/@edwardbenson
• TILE squares, or other trackers with mobile apps
Amazon Dash button Estimotes iBeacon Dev Kit TILE

21. microcontrollers | AR, MR, IoT, Physical
• Arduino
• Pros : customizable and scriptable
• Cons : learning curve; bulky appearance; one script
• Raspberry Pi
• Pros : High-level computing possible
• Cons : learning curve, bulky
• Sensors for prototyping physical spaces
• Proximity : track user patterns in local area
• Accelerometer or GPS : track broad user patterns

22. ev
aluate & ref
ine
learn&a
nalyze envisio
n&design
PER
SONAS SCENA
RIOSSKETC
H
ING
REQUIR
EM
ENTS
The roof that protects a home is
one of the most expensive house
systems. Customer avatars can
safely learn how the inspector looks
for potential issues.
The thorough home inspector is
aware that the crawl space under
the porch or house may have clues
to the home’s condition. Customers
can join him in this tight space.
It’s important that an inspector
not harm the seller’s home in any
way, so a careful inspector comes
prepared with coveralls and shoe
protection, and parks offsite.
The home inspector looks at the
entire site as a system. Water is the
biggest enemy to a home and a
good inspector starts by assessing
all possible exterior entry points.
Jenna & Josh | Avatars
• First time homebuyers
• Nurse & Marketing Manager
• Newlyweds, no children
• Avid gamers
Joanna | Avatar
• Real Estate Agent, 5 yrs
• Married with one child
• Creates virtual home tours
• Learning Photoshop
Jim | Avatar
• Moving from apt to condo
• High School teacher
• Divorced, 2 grown sons
• Enjoys games, motorcycles
Jason | Avatar
• Real Estate Agent, 10 yrs
• Single, owns condo
• Looking for new social
marketing techniques
A WIN Home Inspection inspector’s
main role is to communicate with
homebuyers about their new home,
and how its systems work. Accurate
information is an important factor in
the success of the inspection.
Client Problem
Prospective homebuyers are often confused
about the home inspection process, and problems
found in the home can seem overwhelming. The
client, WIN Home Inspection, wanted to educate
and reassure homebuyers about the process.
User Centered Design
•Conducted qualitative interviews with stakeholders
•Defined user personas to understand user needs
•Designed scenarios based on use case analysis
•Generated sketches & prototype
•Refined business & design requirements
Solution = Experience
Interactive information system in Second Life®:
Second Life® is an immersive virtual world that’s free
and accessible. WIN can effectively educate & talk to
homebuyers in a simulated environment. Customers
can learn about home systems and experience
inspections from the inspector’s point-of-view.
Feature goals
•Interactive views of home systems including roof,
crawlspace, plumbing, furnace, windows, etc.
•Educational displays and videos
•Metric-gathering scripts to learn about the virtual
home visitors and prospective customers
•Games and prizes to encourage repeat visits
Social networking goals
•3D Twitter feed to permit external communication
•Staging in-world events to engage visitors
•Real-time open house to network with agents
•Annual WIN Conference conducted virtually
Evaluation
•User testing and surveys
•Virtual world heuristic guidelines
•Analysis of data gathered on site with scripts
THE SEE MORE VIRTUAL HOUSE
Home Inspection as Immersive User Experience
The PersonasThe Design Process
Inspector Identity
The personas exercise was particularly
important for a virtual world project
where trust can be an issue. It’s critical
to gain the trust of potential users via
good design, and to help the client
assess how Second Life users translate
to real customers.
Second Life demo
Second Life is a social virtual world, free to users
unless they want to purchase space for building
or services and goods.

23. Second Life | AR, MR, VR, IoT, Physical
Virtual world features of Second life
• Multi-modal : many ways to collaborate with others.
• Own it : keep what you create, sell or barter services.
• Free : unless users want to purchase space for building
or services and events.
• Unique : design and create elaborate worlds & individual identities.
• Linden currency : users can sell licenses to what they create.
• Changes in terms of service : has made selling in SL less attractive.
• Similar to World of Warcraft : but without the gaming aspect.

24. prototyping in SL | AR, MR, VR, IoT, Physicalprototyping in SL | AR, MR, VR, IoT, Physical
SL is a valuable rapid prototyping area for 3d tech.
• Upload images and textures to emulate your environment..
• You can buy assets very cheaply, no need to build everything.
• Test scenarios and use cases.
• Users & stakeholders are aware that it’s a rough prototype.
• Create scripts (similar to ActionScript) to :
• Run parts of simulation
• Greet your users
• Emulate interactions
• Easy to create different personas

25. Valerie Hill, MLS, PhD
Information Literacy Consultant & Machinimator
Valerie Hill is a professional librarian, adjunct instructor of library science,
and information literacy consultant. Dr. Hill received her MLS in Library and
Information Science from Texas Woman’s University in 2007 and a PhD in Library
and Information Science in 2012.
She is currently an information literacy consultant and machinimator with a
research focus on the intersection of information literacy and libraries with
virtual worlds and digital culture.
As president of Community Virtual Library, Val invites you to visit this virtual
space to learn more about how to get started in Second Life.
http://maps.secondlife.com/secondlife/Bradley%20University/57/114/27
@valibrarian blog: vhill.edublogs.org

26. pros & cons
CONS
1. Cartoony appearance
2. Learning curve for new users who
need time to learn how to navigate
and communicate
3. Substantial cost for personal space
4. Public access allows “griefers” to
harass users
5. Lag time for many users with slower
computers or connections
6. Limited exchange of prims and
property
7. Users can no longer make a lot of
money in SL, so many vendors and
users have moved on
PROS
1. Free entry, can invite friends
2. Collaboration among remote
team members is easy because of
multiple modes of communication
3. Excellent for large group events
like graduations & conferences
4. Users can emulate many different
real world and virtual reality
scenarios
5. Users can sell and share what they
create
6. Practice for Project Sansar, the new
VR platform from Linden Labs
7. Linden Labs is a reputable company

27. alternative worlds
OpenSim
• Open source and compatible with Second Life,
can exchange some items among worlds
• Users have more control
• Users have to create more infrastructure
http://opensimulator.org
InWorldz
http://inworldz.com
Kitely
• Built in OpenSim
http://www.kitely.com

28. free spaces to build in SL
Edtech Island Sandbox & Campus
http://maps.secondlife.com/secondlife/EdTech/148/88/24
TechLab Oldest and Largest Sandbox
http://maps.secondlife.com/secondlife/TechInvestLab/125/193/26
College of North West London Sandbox
http://maps.secondlife.com/secondlife/CNWL/48/175/26
Check out new sandbox locations at
http://secondlife.com/destinations/howto/sandbox

29. books
Creating Your World: The Official Guide to Advanced Content Creation for
Second Life byAimeeWeber,KimberlyRufer-Bach&RichardPlatel
Prototyping and Modelmaking for Product Design byBjarkiHallgrimsson
Scripting Your World: The Official Guide to Second Life Scripting Paperback
byDanaMoore,MichaelThome&Dr.KarenHaigh
Sketching for User Experiences byBillBuxton
Sketching for User Experiences Workbook bySaulGreenberg&BillBuxton
links
Science project supplies: www.teachersource.com
Dash button sniffer hack: https://medium.com/@edwardbenson/how-i-hacked-
amazon-s-5-wifi-button-to-track-baby-data-794214b0bdd8
Dash button: www.amazon.com/dash
TILE finder: www.thetileapp.com
references & links

30. Please share your own
tips for prototyping
emerging technologies.
Thanks!
question & contribution time