SlideShare a Scribd company logo
1 of 122
Space, the Final Frontier
Designing Interactions Beyond the Screen
John Ryan & Eric Mika, Local Projects
How do we create seamless
‘interfaces’ between the digital
and the physical?
LOCAL PROJECTS 3
A JOURNEY INTO SPACE
A JOURNEY INTO SPACE
Local Projects
💡📖5 Chapters Takeaways
🤔The Future
$%
&'
$%
&'
LOCAL PROJECTS 6
LOCAL PROJECTS 7
LOCAL PROJECTS 8
Technology in service
of human stories and emotion.
Our tools are trapped
inside tiny rectangles.
— Brett Victor
Why space?
LOCAL PROJECTS 19
LOCAL PROJECTS 20
LOCAL PROJECTS 22
Why space? Custom interactions at scale
LOCAL PROJECTS 24
LOCAL PROJECTS 25
LOCAL PROJECTS 26
LOCAL PROJECTS 27
LOCAL PROJECTS 28
LOCAL PROJECTS 29
Why space? Custom interactions at scale
Shared experiences
LOCAL PROJECTS 31Dragan Ilic
The environment is part
of our cognitive system
People lean slightly forward while
thinking about the future.
People lean slightly back

when thinking about the past.
Why space? Custom interactions at scale
Shared experiences
Embodied cognition
A JOURNEY INTO SPACE
I. ADDING CONTEXT
II. INTERACTION BEYOND SCREENS
III. TANGIBLE INTERACTIONS
IV. IMMERSIVE ENVIRONMENTS
V. PROTOTYPE & POSSIBILITIES
📖
CHAPTER I
ADDING
CONTEXT
🤖👩
🤖
👩
🌍
🤖
👩
🌍
LOCAL PROJECTS 41
LOCAL PROJECTS 43
Tech Museum:
Body Metrics
CHAPTER I — ADDING CONTEXT
💡
Spatialize data flow across devices
CHAPTER II
INTERACTION

BEYOND SCREENS
🤖👩
🤖👩
🤖👩 👈
INTERACTION
SCREEN
USERINTERFACE
✋
🤖👩
👈INTERACTION
SCREEN
USERINTERFACE
✋
Cleveland Museum of Art
CHAPTER II — INTERACTION BEYOND SCREENS
💡
Leverage how we already interact
ARoS Aarhus Art Museum
CHAPTER II — INTERACTION BEYOND SCREENS
LOCAL PROJECTS 58
💡
Reveal the perceptual process
One World Observatory
CHAPTER II — INTERACTION BEYOND SCREENS
LOCAL PROJECTS 63
💡
Align feedback with locus of interaction
CHAPTER III
TANGIBLE
INTERACTIONS
🤖👩
👈
SCREEN
USERINTERFACE
✋INTERACTION
🤖👩
👈INTERACTION
USER INTERFACE
✋
SCREEN
🎲
Cooper Hewitt
National Design Museum
CHAPTER III — TANGIBLE INTERACTIONS
💡
Atoms are cheaper than ever
Tech Museum:
Synthetic Biology
CHAPTER III — TANGIBLE INTERACTIONS
LOCAL PROJECTS 77
LOCAL PROJECTS 78
LOCAL PROJECTS 80
LOCAL PROJECTS 82
💡
Synchronicity and mirroring between
tangible objects and digital world
💡
Balance complexity with forgiveness
Skeuomorphic Cycle
☎ 📱
LOCAL PROJECTS 87Gabriele Meldaikyte
LOCAL PROJECTS 88
CHAPTER IV
INTERACTIVE
ENVIRONMENTS
🤖👩
👈INTERACTION
USER INTERFACE
✋ SCREEN
🎲
🎲
🎲
🤖👩
✋
🎲
Cooper Hewitt
Immersion Room
CHAPTER IV — INTERACTIVE ENVIRONMENTS
💡
Leverage small gestures
for big payoff
Target Open House
CHAPTER IV — INTERACTIVE ENVIRONMENTS
💡
Stories help us understand
complex systems
REAL SPACE
DIGITAL SPACE
CHAPTER V
PROTOTYPES &
POSSIBILITIES
COLLAPSING REAL SPACE & DIGITAL SPACE
Technologies Spatial Tracking
LOCAL PROJECTS 101
Pozyx Indoor Positioning
LOCAL PROJECTS 102
FAITH & LIBERTY DISCOVERY CENTER | LOCAL PROJECTS
103
Change
🤔
• Reimplement & reinterpret physics
• Spatially-relative interactions
Technologies Spatial Tracking
Augmented Reality
LOCAL PROJECTS 106
LOCAL PROJECTS 107
🤔
• Gaze-reactive environments
• Google Maps down to the millimeter
• Personalized real-world layer
Technologies Spatial Tracking
Augmented Reality
Artificial Intelligence
LOCAL PROJECTS 110
Bodymetrics
EEG Headset
Wide-area RFID Readers
Brain Activity
Location
Muscle Activity
Motion
Images
Sounds
Heartrate
Sensors Raw Data Semantic Extractions
iPod Touch & RFID Tag
Exhibit Interactive
RFID Reader
EXG Sensor
Heart Rate Sensor
Inferences
Skin Resistance
Interest
Congeniality
Buzz
Energy Level
Posture
Mood
Engagement
Learning
Focus
Excitement
Drowsiness
Metabolism
Gregariousness
Popularity
Attraction
Anxiety
Bustle
Tonality
Pace
Restlessness
Agitation
Utterances
Nearby Face Emotions
Anger, Contempt, Disgust, Joy, Fear,
Negative, Neutral, Positive, Sadness,
Surprise, Confusion, Frustration
Average Color
Volume Level
Step Counts
Average Brightness
Nearby Faces Seen
Pitch Level
Brainwave Levels
"Attention", "Meditation",
Alpha, theta, etc.
Orientation
Blinks
Caloric Burn
Latest interaction
Location in Museum
Tension
Stress
Exertion
Distance from others
Acceleration
LOCAL PROJECTS 112
LOCAL PROJECTS 113
LOCAL PROJECTS 115
🤔
• Dynamically learned spaces
• Metadata of the mundane
• Intuitively blending inputs
I. ADDING CONTEXT
II. INTERACTION BEYOND SCREENS
III. TANGIBLE INTERACTIONS
IV. IMMERSIVE ENVIRONMENTS
V. PROTOTYPE & POSSIBILITIES
Boldly Go
Thank You
John Ryan — @johndryan
Eric Mika — @kitschpatrol
www.localprojects.com
0🙋0🙋
QUESTIONS?
COMMENTS?

More Related Content

Similar to Space, the Final Frontier: Designing Interactions Beyond the Screen (@ Interaction17)

Search Patterns KMWorld 2010
Search Patterns KMWorld 2010Search Patterns KMWorld 2010
Search Patterns KMWorld 2010
Peter Morville
 

Similar to Space, the Final Frontier: Designing Interactions Beyond the Screen (@ Interaction17) (20)

Creativity and things
Creativity and thingsCreativity and things
Creativity and things
 
Portfolio 2015 2016
Portfolio 2015 2016Portfolio 2015 2016
Portfolio 2015 2016
 
Emerging Technologies for Museums
Emerging Technologies for MuseumsEmerging Technologies for Museums
Emerging Technologies for Museums
 
Enabling co-­creation of e-services through virtual worlds
Enabling co-­creation of e-services through virtual worldsEnabling co-­creation of e-services through virtual worlds
Enabling co-­creation of e-services through virtual worlds
 
Enabling co-­creaton of e­‐services through virtual worlds
Enabling co-­creaton of e­‐services through virtual worldsEnabling co-­creaton of e­‐services through virtual worlds
Enabling co-­creaton of e­‐services through virtual worlds
 
DRIVE 2016 | 26 October: Smart Industry T2T
DRIVE 2016 | 26 October: Smart Industry T2TDRIVE 2016 | 26 October: Smart Industry T2T
DRIVE 2016 | 26 October: Smart Industry T2T
 
KAIST UVR Lab 2013
KAIST UVR Lab 2013KAIST UVR Lab 2013
KAIST UVR Lab 2013
 
MCN 2012 Horizon Report Preview
MCN 2012 Horizon Report PreviewMCN 2012 Horizon Report Preview
MCN 2012 Horizon Report Preview
 
COMP 4010 - Lecture 1: Introduction to Virtual Reality
COMP 4010 - Lecture 1: Introduction to Virtual RealityCOMP 4010 - Lecture 1: Introduction to Virtual Reality
COMP 4010 - Lecture 1: Introduction to Virtual Reality
 
2012 design futures cindy oxford short
2012 design futures cindy oxford short2012 design futures cindy oxford short
2012 design futures cindy oxford short
 
From concept mapping to digital media publishing: An overview for researchers II
From concept mapping to digital media publishing: An overview for researchers IIFrom concept mapping to digital media publishing: An overview for researchers II
From concept mapping to digital media publishing: An overview for researchers II
 
Infrastructures
InfrastructuresInfrastructures
Infrastructures
 
Search Patterns
Search PatternsSearch Patterns
Search Patterns
 
Search Patterns KMWorld 2010
Search Patterns KMWorld 2010Search Patterns KMWorld 2010
Search Patterns KMWorld 2010
 
Datanauts: Open Innovation & Earth Observation (Proposal)
Datanauts: Open Innovation & Earth Observation (Proposal)Datanauts: Open Innovation & Earth Observation (Proposal)
Datanauts: Open Innovation & Earth Observation (Proposal)
 
AHRC Digital Transformations
AHRC Digital TransformationsAHRC Digital Transformations
AHRC Digital Transformations
 
Nmc 2007 Publish
Nmc 2007 PublishNmc 2007 Publish
Nmc 2007 Publish
 
ACS Summer Institute - Emerging Roles of Librarians - 14_0731
ACS Summer Institute - Emerging Roles of Librarians - 14_0731ACS Summer Institute - Emerging Roles of Librarians - 14_0731
ACS Summer Institute - Emerging Roles of Librarians - 14_0731
 
Does My Project Look Big in This?
Does My Project Look Big in This?Does My Project Look Big in This?
Does My Project Look Big in This?
 
Enterprise Search: An Information Architect's Perspective
Enterprise Search: An Information Architect's PerspectiveEnterprise Search: An Information Architect's Perspective
Enterprise Search: An Information Architect's Perspective
 

Recently uploaded

如何办理(UAL毕业证书)伦敦艺术大学毕业证成绩单本科硕士学位证留信学历认证
如何办理(UAL毕业证书)伦敦艺术大学毕业证成绩单本科硕士学位证留信学历认证如何办理(UAL毕业证书)伦敦艺术大学毕业证成绩单本科硕士学位证留信学历认证
如何办理(UAL毕业证书)伦敦艺术大学毕业证成绩单本科硕士学位证留信学历认证
ugzga
 
NO1 Best Vashikaran Specialist in Uk Black Magic Specialist in Uk Black Magic...
NO1 Best Vashikaran Specialist in Uk Black Magic Specialist in Uk Black Magic...NO1 Best Vashikaran Specialist in Uk Black Magic Specialist in Uk Black Magic...
NO1 Best Vashikaran Specialist in Uk Black Magic Specialist in Uk Black Magic...
Amil baba
 
一模一样英国德比大学毕业证(derby毕业证书)本科学历-国外大学文凭办理
一模一样英国德比大学毕业证(derby毕业证书)本科学历-国外大学文凭办理一模一样英国德比大学毕业证(derby毕业证书)本科学历-国外大学文凭办理
一模一样英国德比大学毕业证(derby毕业证书)本科学历-国外大学文凭办理
thubko
 
如何办理(UCL毕业证书)伦敦大学学院毕业证成绩单本科硕士学位证留信学历认证
如何办理(UCL毕业证书)伦敦大学学院毕业证成绩单本科硕士学位证留信学历认证如何办理(UCL毕业证书)伦敦大学学院毕业证成绩单本科硕士学位证留信学历认证
如何办理(UCL毕业证书)伦敦大学学院毕业证成绩单本科硕士学位证留信学历认证
ugzga
 
如何办理(UW毕业证书)华盛顿大学毕业证成绩单本科硕士学位证留信学历认证
如何办理(UW毕业证书)华盛顿大学毕业证成绩单本科硕士学位证留信学历认证如何办理(UW毕业证书)华盛顿大学毕业证成绩单本科硕士学位证留信学历认证
如何办理(UW毕业证书)华盛顿大学毕业证成绩单本科硕士学位证留信学历认证
ugzga
 
如何办理(Bath毕业证书)巴斯大学毕业证成绩单本科硕士学位证留信学历认证
如何办理(Bath毕业证书)巴斯大学毕业证成绩单本科硕士学位证留信学历认证如何办理(Bath毕业证书)巴斯大学毕业证成绩单本科硕士学位证留信学历认证
如何办理(Bath毕业证书)巴斯大学毕业证成绩单本科硕士学位证留信学历认证
ugzga
 
如何办理(UCI毕业证书)加利福尼亚大学尔湾分校毕业证成绩单本科硕士学位证留信学历认证
如何办理(UCI毕业证书)加利福尼亚大学尔湾分校毕业证成绩单本科硕士学位证留信学历认证如何办理(UCI毕业证书)加利福尼亚大学尔湾分校毕业证成绩单本科硕士学位证留信学历认证
如何办理(UCI毕业证书)加利福尼亚大学尔湾分校毕业证成绩单本科硕士学位证留信学历认证
ugzga
 
ECHOES OF GENIUS - A Tribute to Nari Gandhi's Architectural Legacy. .pdf
ECHOES OF GENIUS - A Tribute to Nari Gandhi's Architectural Legacy. .pdfECHOES OF GENIUS - A Tribute to Nari Gandhi's Architectural Legacy. .pdf
ECHOES OF GENIUS - A Tribute to Nari Gandhi's Architectural Legacy. .pdf
Sarbjit Bahga
 
Abortion Clinic in Springs +27791653574 Springs WhatsApp Abortion Clinic Serv...
Abortion Clinic in Springs +27791653574 Springs WhatsApp Abortion Clinic Serv...Abortion Clinic in Springs +27791653574 Springs WhatsApp Abortion Clinic Serv...
Abortion Clinic in Springs +27791653574 Springs WhatsApp Abortion Clinic Serv...
mikehavy0
 
如何办理(Columbia College毕业证书)纽约市哥伦比亚大学毕业证成绩单本科硕士学位证留信学历认证
如何办理(Columbia College毕业证书)纽约市哥伦比亚大学毕业证成绩单本科硕士学位证留信学历认证如何办理(Columbia College毕业证书)纽约市哥伦比亚大学毕业证成绩单本科硕士学位证留信学历认证
如何办理(Columbia College毕业证书)纽约市哥伦比亚大学毕业证成绩单本科硕士学位证留信学历认证
ugzga
 

Recently uploaded (20)

如何办理(UAL毕业证书)伦敦艺术大学毕业证成绩单本科硕士学位证留信学历认证
如何办理(UAL毕业证书)伦敦艺术大学毕业证成绩单本科硕士学位证留信学历认证如何办理(UAL毕业证书)伦敦艺术大学毕业证成绩单本科硕士学位证留信学历认证
如何办理(UAL毕业证书)伦敦艺术大学毕业证成绩单本科硕士学位证留信学历认证
 
GBU INDOOR STADIUM CASE STUDY DESCRIBING ITS STRUCTURE
GBU INDOOR STADIUM CASE STUDY DESCRIBING ITS STRUCTUREGBU INDOOR STADIUM CASE STUDY DESCRIBING ITS STRUCTURE
GBU INDOOR STADIUM CASE STUDY DESCRIBING ITS STRUCTURE
 
Webhost NVME Cloud VPS Hosting1234455678
Webhost NVME Cloud VPS Hosting1234455678Webhost NVME Cloud VPS Hosting1234455678
Webhost NVME Cloud VPS Hosting1234455678
 
CADD 141 - BIRD Scooter - Cup Holder Photos.pdf
CADD 141 - BIRD Scooter - Cup Holder Photos.pdfCADD 141 - BIRD Scooter - Cup Holder Photos.pdf
CADD 141 - BIRD Scooter - Cup Holder Photos.pdf
 
NO1 Best Vashikaran Specialist in Uk Black Magic Specialist in Uk Black Magic...
NO1 Best Vashikaran Specialist in Uk Black Magic Specialist in Uk Black Magic...NO1 Best Vashikaran Specialist in Uk Black Magic Specialist in Uk Black Magic...
NO1 Best Vashikaran Specialist in Uk Black Magic Specialist in Uk Black Magic...
 
一模一样英国德比大学毕业证(derby毕业证书)本科学历-国外大学文凭办理
一模一样英国德比大学毕业证(derby毕业证书)本科学历-国外大学文凭办理一模一样英国德比大学毕业证(derby毕业证书)本科学历-国外大学文凭办理
一模一样英国德比大学毕业证(derby毕业证书)本科学历-国外大学文凭办理
 
Spring Summer 26 Colors Trend Book Peclers Paris
Spring Summer 26 Colors Trend Book Peclers ParisSpring Summer 26 Colors Trend Book Peclers Paris
Spring Summer 26 Colors Trend Book Peclers Paris
 
如何办理(UCL毕业证书)伦敦大学学院毕业证成绩单本科硕士学位证留信学历认证
如何办理(UCL毕业证书)伦敦大学学院毕业证成绩单本科硕士学位证留信学历认证如何办理(UCL毕业证书)伦敦大学学院毕业证成绩单本科硕士学位证留信学历认证
如何办理(UCL毕业证书)伦敦大学学院毕业证成绩单本科硕士学位证留信学历认证
 
如何办理(UW毕业证书)华盛顿大学毕业证成绩单本科硕士学位证留信学历认证
如何办理(UW毕业证书)华盛顿大学毕业证成绩单本科硕士学位证留信学历认证如何办理(UW毕业证书)华盛顿大学毕业证成绩单本科硕士学位证留信学历认证
如何办理(UW毕业证书)华盛顿大学毕业证成绩单本科硕士学位证留信学历认证
 
如何办理(Bath毕业证书)巴斯大学毕业证成绩单本科硕士学位证留信学历认证
如何办理(Bath毕业证书)巴斯大学毕业证成绩单本科硕士学位证留信学历认证如何办理(Bath毕业证书)巴斯大学毕业证成绩单本科硕士学位证留信学历认证
如何办理(Bath毕业证书)巴斯大学毕业证成绩单本科硕士学位证留信学历认证
 
Branding in the Psychedelic Landscape Report.pdf
Branding in the Psychedelic Landscape Report.pdfBranding in the Psychedelic Landscape Report.pdf
Branding in the Psychedelic Landscape Report.pdf
 
如何办理(UCI毕业证书)加利福尼亚大学尔湾分校毕业证成绩单本科硕士学位证留信学历认证
如何办理(UCI毕业证书)加利福尼亚大学尔湾分校毕业证成绩单本科硕士学位证留信学历认证如何办理(UCI毕业证书)加利福尼亚大学尔湾分校毕业证成绩单本科硕士学位证留信学历认证
如何办理(UCI毕业证书)加利福尼亚大学尔湾分校毕业证成绩单本科硕士学位证留信学历认证
 
Levi's Advertisement and camapign design
Levi's Advertisement and camapign designLevi's Advertisement and camapign design
Levi's Advertisement and camapign design
 
ECHOES OF GENIUS - A Tribute to Nari Gandhi's Architectural Legacy. .pdf
ECHOES OF GENIUS - A Tribute to Nari Gandhi's Architectural Legacy. .pdfECHOES OF GENIUS - A Tribute to Nari Gandhi's Architectural Legacy. .pdf
ECHOES OF GENIUS - A Tribute to Nari Gandhi's Architectural Legacy. .pdf
 
BIT Khushi gandhi project.pdf graphic design
BIT Khushi gandhi project.pdf graphic designBIT Khushi gandhi project.pdf graphic design
BIT Khushi gandhi project.pdf graphic design
 
Abortion Clinic in Springs +27791653574 Springs WhatsApp Abortion Clinic Serv...
Abortion Clinic in Springs +27791653574 Springs WhatsApp Abortion Clinic Serv...Abortion Clinic in Springs +27791653574 Springs WhatsApp Abortion Clinic Serv...
Abortion Clinic in Springs +27791653574 Springs WhatsApp Abortion Clinic Serv...
 
Spring Summer 2026 Inspirations trend book Peclers Paris
Spring Summer 2026 Inspirations trend book Peclers ParisSpring Summer 2026 Inspirations trend book Peclers Paris
Spring Summer 2026 Inspirations trend book Peclers Paris
 
iF_Design_Trend_Report_twentytwenrythree
iF_Design_Trend_Report_twentytwenrythreeiF_Design_Trend_Report_twentytwenrythree
iF_Design_Trend_Report_twentytwenrythree
 
如何办理(Columbia College毕业证书)纽约市哥伦比亚大学毕业证成绩单本科硕士学位证留信学历认证
如何办理(Columbia College毕业证书)纽约市哥伦比亚大学毕业证成绩单本科硕士学位证留信学历认证如何办理(Columbia College毕业证书)纽约市哥伦比亚大学毕业证成绩单本科硕士学位证留信学历认证
如何办理(Columbia College毕业证书)纽约市哥伦比亚大学毕业证成绩单本科硕士学位证留信学历认证
 
Latest Trends in Home and Building Design
Latest Trends in Home and Building DesignLatest Trends in Home and Building Design
Latest Trends in Home and Building Design
 

Space, the Final Frontier: Designing Interactions Beyond the Screen (@ Interaction17)