Tony Aubé
Designer
Disclaimer:
Inventing Osmo
Lesson Learned
Design Process
Redefining AR
1
2
3
4
1
Mirror
Computer Vision
• Started 5 years ago
• Selling in 55+ countries
• Used in 35,000 schools
• Acquired by Byjus for $120M
How it began…
JéromePramod
Computer Vision
What if we gave
computer vision
to iPads?
What is the
purpose of
Osmo?
Hands-on
Kids (3-12)Hands-on
Screen
Addiction
“Healthy”
Educational
Fun
For kids
Hands-on
Start with why
A new UI
Mouse Touch screen Keyboard
mental
model
Focus on design
key design decisions
5
No vision markers
1
AR is a
magic trick
No whiteboard
2
?
No electronics
3
Keep the interaction
in the real world
4
Hands-on
5
Sell the hardware,
give the software
free$
forever!
Healthy
Dark
patterns
Micro
payments
Business model should
provides the correct incentives
for your product
No vision markers
No whiteboard
No electronics
Keep interaction in the real world
Sell the hardware
2
The combination of digital &
physical must be better than
the sum of its part
Most
important!
The combination of digital &
physical must be better than
the sum of its part
Tangram
Intuitive, clear
relationship between
screen & table
Combined UX is
better than the
sum of its parts
Better than the
sum of its parts
Could I
create a better
experience?
physical-only
Could I
create a better
experience?
screen-only
3
Pen & paper
1
Photo & video
2
Create a drawing game
using our characters ”“
Web & mobile prototyping tools
Augmented Reality
Photos & videos are your best friends
Wizard of Oz
3
Duet Photoshop
SideCar
Find low cost ways to explore,
communicate and validate
your ideas
Without requiring engineering
Wizard of Oz
Fake it till you
make it
QR codes
4
Build the infrastructure upfront
to help you iterate quickly
Test, test, test
5
Test every Thursdays
Logistics are exhausting
Coordinator
Testing
Testing should be “casual”
not an “event”
Remove the burden of logistics
from the creative team
Everybody tests
Record everything
Pen & paper
Photos & videos
Wizard of Oz
QR codes
Test, test, test
1
2
3
4
5
4
What 3D software
do you use?
???
AR:
3d models
Camera feed
AR in 2019:
Our definition of AR
is too constrained
+
Osmo’s big
innovation
We need to redefine AR
3d models
Camera feed
is the most important
ingredient of AR
AI
Smart speakers
Read Along with Disney
The future of AR will be
BORING
video platform
AR is the next
video platform
AR is the next
computing platform
this is a toy“ ”
Thank you!
Follow me:
@aubetony
medium.com/@tonyaub
hello@tonyaube.com

Design Beyond the Screen - Tony Aube at AmuseConf 2019