The web in the world
Timo Arnall elasticspace.com
nearfield.org
I do design and research, based at the Oslo School of Architecture & Design, where I run a design
research project that looks at emerging technologies.
We work in interaction and industrial design mainly,
so we are in a good position to be thinking about the current shift in technology,
from screen-based interaction towards physical interaction with the world around us.

So what do I mean by The web in the world?
When we think of the mobile web many of us think about small screen rendering of web pages.
And this is clearly happening, the web is moving towards an enormous number of tiny screens.

And it’s leaking out into a lot of other devices.
This is the result of having Twitter sending out SMSes for a few days.
There are of course a lot of subtler ways that the web is filtering out into the world.

The iPhone is also clearly making a platform for the mobile web, with it’s assumed always-on network
connectivity.
Applications are starting to take advantage of this always-on-ness and to make use of some of it’s
sensing abilities.

But we are working towards a ‘ubiquitous web’ has greater implications than everyone constantly
engaged in tiny-screen interaction.
In fact I think we should set out to NOT create an overload of this interaction.
The ‘internet of things’ may instead increase awareness of the physical and social environment, and to
do more, with less screen-time.

Marc Smith of Microsoft Research said last week at the Social Computing Symposium that:
“Most digital interaction takes place in another interaction order – in another space – not in the
physical interaction order of co-presence.”
“This is about to change...”
So digital interaction takes place, mentally and physically, somewhere else. We go onto the internet...
And what is enabling this to happen?
Spimes (Bruce Sterling)
Data shadows (Mike Kuniavsky)
The Internet of things...

Things & links
So I’ve put together a number of ‘patterns’ that show some issues and directions for the future web in
the world.
Then a few design directions that are needed to make these happen.
What is the basic building block of an internet of things?

Well according to many, it is the humble link.
If we go right back to basics, we can see that URLs have been inhabiting the physical world for a few
years.
From gra!ti artists to large companies, the url has become a standard part of public marketing and
branding.

And an ever increasing number of objects are used to attempt to link people back into the web.
http://ba.com

But the interaction experience for this is not yet well defined.
Shortcodes for instance are quite successful, short text input yields richer information sent back,
usually via a URL.

So many projects and platforms are setting out to find other ways of linking the physical to the digital.
Yellow arrow used a kind of shortcode, or unique ID for places, and encouraged storytelling (didn’t
really work on a wide scale)
http://www.yellowarrow.net

Thinglink attempts to create unique identifiers for physical products. They have a lovely idea about
creating greater visibility for the long tail.
http://thinglink.org

So there are many incompatible barcode systems that have emerged, some like QR coding are
designed for linking, particularly on the mobile phone.

But experiences of barcoding stu\" beyond grocery goods haven’t gone very well.
This is the Cuecat, the massive fail project that partnered with Wired.

This is one ‘unique identifier’ project that I really like, made by Maya Lotan at Ivrea.
It has unique and decorative patterns that can be converted through image recognition into a unique
ID. She designed a range of products, from clothes, to accessories to paper material that contained the
codes.
I really like the integration with fashion.
Urban Seeder.
http://www.urbanseeder.com

This is another way of linking, a box that asks you to turn on bluetooth and lets you download
content.
The weirdness with this is that it’s di!cult to tell where the bluetooth begins and ends.
It’s not ‘direct manipulation’.

Near Field Communication is perhaps the most advanced kind of object linking. It uses battery-less
RFID chips that store and transfer data.
The idea is that we’ll use phones for ticketing, payment, and for discovering ‘services’ in the physical
world.

• index_us.html
Rafi probably showed Mir:ror yesterday.
It uses the same RFID technology
http://www.violet.net

And Tikitag.com
But what is required is a more nuanced vision of the physical link. I think the hyperlink is a flawed
model for physical interaction.
Yes it allows for objects to communicate, for things to be tracked as part of logistics systems.
But does it really make sense from the user perspective?
What is the user-experience? What is the context? What is useful or playful in this interaction?

We have also created products that use physical objects to trigger interactions with media.
These wooden objects have embedded RFID chips, that create reactions when they are placed inside
the bowl.
We really tried to concentrate on objects and interfaces that would fit in the home environment (on the
co\"ee table!)
and would allow for subtle and tangible interactions with media (particularly with kids)
Which leads us to...
www.nearfield.org/2007/12/bowl-token-based-media-for-children

Tangible in
What I think we need to be thinking about from a user-perspective is tangible interaction.
This is the use of physical objects and gestures to control interactions.
The aim is to use more senses and more of the body in our interactions.

Nintendo Wii controller.

Nokia 5500 and iphone have accelerometers.

Eyetoy or sixaxis controller.
Sixaxis playstation

GPS in, in lots of things, cars, mobiles.
I really hate GPS, as someone who lives most of their lives walking in dense cities, it doesn’t work
well...

But lets not overlook the humble microphone...
The games produced that include sound and breath input for the DS are astounding.
Nintendo DS

And of course, tangible interaction with objects is perfect for games and toys, this is where it is
starting to emerge.
Brio Network
http://brio.hosting.mrfriday.com/network/

Ambient out
I use the word ambient loosely (there is a whole research e\"ort on ‘ambient computing’) but I think the
concept is interesting.
Instead of the focused, attention grabbing interaction with the web, what if we could use more of our
senses to get information:
Peripheral, background, sound, haptic

Perhaps the quintessential ambient displays are made by “Ambient Devices”
This is their orb, that can be set up to display a few variables of data, through brightness and colour.

Their HomeJoule device also o\"ers background information in specific places.
To do this they have set up their own network in the US.

Their ‘dashboard’ o\"ers lovely analogue pointers that display information.
This is the kind of display that can be glanced, or is easily understood without direct attention.

One really lovely thing about this dashboard is the custom plates that allow customisation of the
displays. Not only does this change the functionality, it changes the scale or the data that is presented.

There are a lot more products on the horizon that o\"er some sense of ambient output. The chumby is
e\"ectively ‘widgets for physical space’.
Photo CC by dalager:
http://flickr.com/photos/dalager/2587380983/

Sound objects
Sound is a critical aspect of interfaces that inhabit the world with us
Don’t bleep!!

And finally, haptics.
The use of vibration to indicate interaction output.
This is a lovely use of haptic feedback, Chris Woebken at the RCA made a simple digital compass that
vibrated whenever it pointed north. People who wore this apparatus gained a new sense of direction.
Part of the animal superpowers project by Chris Woebken
http://www.flickr.com/photos/sutje/493456056/

In our Touch project one of my students created ‘Sni\" the dog’ that sni\"s RFID tags and gives sound
and vibration feedback.
This is a lovely explorative toy where the sound and vibration adds up to create emotional responses
to the environment.
http://www.nearfield.org/2007/06/sni\"-wins-prize-for-design-for-all

Context
I use the word context rather than location. It’s more general, and has more interesting connotations.
Context is hard. We also have a whole research domain called ‘context aware computing’ that has been
for decades looking for ways of making devices respond smarter to their surroundings.
Also, contextual design practices will have to be brought to the forefront.

But one definition of context that is useful right now is:
Devices that are aware of other devices...
Plazes turns the proximity to wifi routers into one way of determining simple context
*The use of fields to determine context*
Founder says that it was important for Plazes location lookups to be implicit in the use of mobile
devices and laptops, not explicitly chosen by the user (but with user control over privacy)

Simply mapping devices creates a lot of rich data.
This is the ‘Mapping Graz’ project by MIT
http://web.mit.edu/newso!ce/2005/cellphones.html

And this data can be turned back into interface
Here is ‘Citysense’ allowing people to visualise the number of people (cellphones) around them

The other thing that is clearly happening is visualising the geo-located data from the web, in place.
I’m skeptical about Augmented Reality, particularly the goggles/glasses variety but this is quite a
compelling demo
Sekai phone
http://www.tonchidot.com

Here is one piece of evidence, ‘The future of internet search’ by Mac Funamizu
He has successfully visualised ideas about using data in the physical world
An interface that adds to physical experience rather than making us withdraw to small screens.
http://petitinvention.wordpress.com/2008/02/10/future-of-internet-search-mobile-version/

Visibility
Visibility is one of the biggest issues for ‘ubiquitous computing’.

And Donald Norman is taking those ideas further.
There is an e\"ort towards embedding computing in everything, and making it ‘disappear’.
But the consequences of that from a user-perspective have not been fully thought through.

Every modern electronic device we carry has some sort of invisible interaciton with the world around it,
through various ‘bubbles of radio’ of varying sizes.

RFID in particular has been a short-fuse of controversy around ubiquitous computing.
This is both because it can be invisible (Embedded)
And because it has features that are not visible (Radio)

These radio bubbles surround us most of the time.
Wifi
Bluetooth
GSM
3G
DMB
GPS
RFID
Zigbee

3G coverage in Stavanger, Norway
This stu\" is starting to have an impact on our everyday lives.
It’s experienced as dropped connections, as unreliability, as slowdowns.
The mapping of this stu\" is important.

Skyhook wireless is mapping out these fields, and turning them into material we can use in
interactions...
Their coverage can be visualised on their website
http://www.skyhookwireless.com/howitworks/

Very practically:
How will you explain to users that their location lookups depend on a number of bubbles of radio
waves?
Or how will they know that they are in a GPS shadow?
This is my student’s work on visualising radio fields, she imagined fictional ‘species’ of radio waves
that she turned into an encyclopaedia.
http://www.nearfield.org/2007/12/fictional-radio-spaces

This is some work I did with Adam Greenfield towards making a set of symbols for his book
“Everyware”
We attempted to explain various elements of ubiquitous experience through simple symbols.
Work in progress.

Tracking &
tracing
A lot of these technologies lend themselves to tracking and tracing.
So something has emerged in what Matt Jones and Tom Coates are calling “Personal Informatics”, “the
ability to leverage data about yourself and your friends to your advantage”

The Nike+ is a fascinating example of new forms of entertainment
It is designed, a physical object, using high technology.
But the connection to the web is a critical part of the experience.

The sharing and reflection on data is a large part of the experience

Nokia Sports Tracker:
http://sportstracker.nokia.com

It’s the same with the Wattson from DIYKyoto.
Plugging this thing in for the first time is something that gets Flickr’ed over and over.
http://www.diykyoto.com/

And the resulting data visualisations are then excellent ‘social objects’ with which to compare and
reflect.

http://flickr.com/photos/antimega/2371642867/

Scarcity &
distance
If the mobile phone and internet is compressing time and space,
any move back towards the interaction with the physical world re-introduces scarcity and distance.

This is what I got when I loaded Geode for the first time.
A total lack of content.
Not having an active community near you means that many services will only work in certain
geographical contexts.
http://labs.mozilla.com/2008/10/introducing-geode/

If we have ‘smart’ posters o\"ering content, is this the only place that it is available, can I take the
content with me and access it again?
These are questions that need to be answered.

Poken is a physical (rfid based) object that lets you connect your social networks in physical space, by
touching them together you create a connection. It is open-API based.
underestimating the di!culty of achieving critical mass
or: overestimating their ability to a\"ect culture
There is an enormous e\"ort to reach the critical point at which cluster e\"ects can take place, and many
users will feel the full brunt of the ‘first fax machine’ problem.
http://www.doyoupoken.com/

Adaptability
Which also leads to adaptability.
The mouse, keyboard and screen is a wonderfully adaptable interface, so much so that it has stuck with
us for over 20 years.
And the web is a fantastically adaptive environment, built out of layers of generalised code (material).
But physical and tangible interfaces tend to be much more specialised.
In particular the economics of adaptability.

Single use-interfaces
This is a toy called Swinxs, it connects to the web and allows lots of games to be played, but the
interactions are limited to touching this console.
Suitable for toys and museums, and that is exactly where we are seeing the first of these kinds of
interfaces.
http://www.swinxs.com

So there are modular approaches to hardware, which should provide some means of getting some of
the adaptable features of the web onto into the physical world.
http://www.buglabs.net

This is the Olinda radio from Schulze & Webb.
It goes some of the way towards creating an adaptive, social piece of hardware, that mirrors the web.
They even made a hardware API.
Matt Webb says that “Some things are di!cult to do in social software: \"But these things I get for free
by having them in a physical object\" eg \"Storing my identity in an object, and gifting it to someone\".”
http://schulzeandwebb.com/2008/olinda/

Designerly
directions
So what does this mean for design practice?

The good news is that this stu\" is already emerging from the web. Web practices are very applicable,
dealing with networks, connections, social media, etc.
Schulze & Webb for example are actively encouraging web-practices in physical product design...
But this stu\" is di!cult, it needs to be platformed out so that practices, methods and data can be
shared.
http://www.pachube.com o\"ers a wide platform for starting some of these linkages.

This stu\" is di!cult, even compared with the web.
Arduino and other hardware prototyping platforms make it easier.
This is something that Mike Kuniavsky talks about: Sketching in hardware, the ability to use relatively
simple hardware tools to make and revise quick prototypes.
We could also call it rapid prototyping.

Both this and the last image are the iterations towards a finished “Sni\"”.
The challenges come in making physical objects which are robust, which have the qualities of good
products, and work interactively.
This requires lots of skills, from interaction design to software and industrial design.

Some of this is made easier through visualisation.
Visualisation skills become important in actually uncovering the materials that we are working with.

This is a series of sketches that work towards understanding how RFID works.
We wanted to sketch out the a\"ordances of RFID:
\"the perceived and actual properties of the thing, primarily those fundamental properties that
determine just how the thing could...”
“A quality of an object, or an environment, that allows an individual to perform an action.”

And we ended up with a diagram that explains the important aspects of RFID for designers.

We can also start to explain some of the invisible aspects of RFID, here we are looking at the fields that
surround an RFID object.

Evidence: create the stu\" that we will all talk about, and can either agree or disagree about.
This is from Urban Seeder by Maya Lotan.

Fiction is really important, especially when the

Emerging themes Design approaches
Things linked Sketching
Tangible in and out Visualisation
Ambient and haptics Fiction
Context
(In)visibility
Adaptability
Scarcity
In summary

Thank you
elasticspace.com
nearfield.org
aho.no