Space Invading:
An approch to sensing ...
Hornsby Adrian
Tampere University of Technology
IEEE CE Games Innovation Conference
London 25-28th August 2009

About the speaker

Mission statement
Research on systems, services and
applications for advanced digital media
integration and convergence in
heterogeneous environment.

From data to knowledge
→ Data are often viewed as a
lowest level of abstraction from
which information and knowledge
are derived.
→ Data comes from sensors

The notion of sensing

Raw sensing ...

Sensors and small devices in the
future
Internet of Things = 1012
Fringe Internet = 109
Core Internet
= 106

Accessing this mine of information
Information
Thought-like
world
Available Developers
Web-like Service world
Middle-ware Platform World
Low-Level
Device world

eXtensible Message and Presence
Protocol - XMPP
open technologies for instant messaging, presence, multi-party chat, voice and video
calls, collaboration, lightweight middleware, content syndication, and generalized routing
of XML data and much more ...
XMPP offers several key advantages over such services:
* Open
* Standard
* Proven
* Decentralized Jabber Jabber
Server Server
* Secure Domain Internet Domain
(tut.jabber.a) (nokia.jabber.com)
* Extensible
* Flexible
* Diverse
Client Client
A B
Adrian@tut.jabber.fi Rod@nokia.jabber.com

XMPP <stream>
<stream>
<presence>
<show/> sensors available
</presence>
<message to='tom'>
→ information
Stanza <body/>
....Push
</message> mechanism
<iq to='tom'>
<query/> → ← whats the temperature ?
</iq>
[ ... ]
</stream>

XMPP' secret weapon
•
Presence
•
PubSub
•
Discovery

The case of XMPP

µXMPP for low power devices

µXMPP for low power sensors

Are the toilets free ?
Internet
The closest free toilet
uXMPP sensors

Application area

But also … Real-time augmented
reality

What about games ??
• Games of tag using wireless sensors?
• Interactive role-playing games with sensors?
• Game Design and Real-Time User satisfaction
Help this kid brush
his teeth !!!
mybrush.sensor.com

Some thoughts related to content,
experience and games ...

Learn from people
Kolb (1984) model inspired by the work of Kurt Lewin.
Concrete Reflective
Experience Observation
Learning = Fun
Active Abstract
Experimentation Conceptualisation

The notion of sensing

Multimedia sensing
• Audio and visual features extraction (TUT-Muvis)

Even more than that ...

SMS

Emails

Call logging Life Logging + Raw Sensing

Phonebook
Pattern

Blogs Extraction

Forums

Social Website Behavior, Social and Context knowledge

Galleries --EXPERIENCE--

Games

...
New INPUT to my system

You were In ISCE 2009 in Tokyo
The system noticed you enjoyed Karaoke with CE members
You are now in ICE-Game 2009 conference
Do you want the list of karaoke places next to Imperial ??

Cycle of experience ...

Reflective interaction ...

The future ...
• Low Power Multimedia streaming “Jingle”
• The real and the virtual tightly connected
– By sensor networks, location, wireless networks, ...
• Connecting users and giving more control over:
– The choices
– The path
– The content
– The social
• Natural navigational paths to information,
experiences, relationships and communication

The current barriers ...
REAL-TIME

Make it happen !!
“Alone we can do so little; together we can do so
much.”
Helen Keller
1880-1968
Helen Adams Keller was an American author, activist and lecturer. She was the first deaf-blind person to
graduate from college.

“And that's just the beginning ...”