Your SlideShare is downloading. ×

Tish Shute - the next wave of AR


Published on

See for the video of this presentation.

See for the video of this presentation.

Published in: Business, Technology
  • Be the first to comment

No Downloads
Total Views
On Slideshare
From Embeds
Number of Embeds
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

No notes for slide


  • 1. The Next Wave of AR: Mobile Social Interaction, Right Here, Right Now! Tish Shute Presentation for MoMo #13 Amsterdam, Nov 16th, 2009
  • 2. In January 2009, I wrote a post that asked the question: Is it “OMG Finally” for Augmented Reality? The answer was yes! (with some caveats) I love being part of thinking about how a new industry will turn out! (If you aren't excited try watching Denno Coil)
  • 3. But it is not just the new industry of augmented reality I am excited by! Something even bigger is afoot! I began by asking the question: Can we create an open framework for distributed augmented reality using "off the shelf" standards, e.g., the Google Wave Federation Protocol? But the implications of this proposal go well beyond augmented reality and towards an open framework for in context mobile social communication.
  • 4. The Internet is Coming Alive!
  • 5. Pranav Mistry Open Sources SixthSense
  • 6. What really excites me is the new forms of mobile social interaction that the combination of ubiquitous computing and augmented reality enables. We are entering the era of the outernet
  • 7. The "Outernet" AR and "ubiquitous computing & augmented reality are a DNA Base Pair. adenine and thymine
  • 8. What is an architecture of participation for the "Outernet"? The structure of the key protein that enables quorum-sensing bacteria to communicate and spread infection.
  • 9. Social Mobility and the 3rd Cloud David P. Reed (development of TCP/IP, designer of UDP, one of architects of Croquet
  • 10. Designing a Mobile Social Interaction Utility for the Outernet. What are the qualities of the 3rd cloud and context based mobile and social communications?
  • 11. "Mobility of People not Devices" - David P. Reed (thank you Marc Fonteijn for reminding me to think about traffic lights!)
  • 12. 3rd Cloud Signs Serve People (through a mobile social interaction utility focused on the mobility of people not devices) Windows With No Curtains - the sign will communicate with your wife's phone and let her know you'll be late and will sync with your friend's calendar and remind you of the dinner party tonight....
  • 13. Social Augmented Experiences - Built on Layers and Channels The layers of augmented reality, linked to location/place/time and arrayed in full 3 dimensional space, are a powerful way for people to to get to the contextually relevant and interesting bits, and to orchestrate social, collaborative experiences of the world. Location is not a set of co-ordinates it is a culture of place.
  • 14. drawing by Thomas Wrobel
  • 15. Channels and Filters for Social Augmented Experiences Dystopian Future? - Jamais Cascio "Will filtering threaten civility?"
  • 16. Augmented Reality Social Publishing "You see small transparent white dots glowing on people and objects indicating that they contain accessible cloud content." Chris Arkenberg, URBEINGRECORDED Glam Dots from Solomon Chase and David Toro
  • 17. Social Publishing/Remix culture collaboratively annotating, retrieving, sharing and remixing multimedia content. (diagram from Chris Anderson ) MSMDX (Media Streams Metadata Exchange) project at UC Berkeley,
  • 18. AR Browsers Today "Experiences built around resources originating from else-where within the ubiquitous digital experience ecosystem." Joe Lamantia
  • 19. Pulling the Web to the World AR browsers Layar, AcrossAir, Wikitude, Bionic Eye, Robot Vision
  • 20. "Smart" AR Browsers Cooperating cloud data services + mobile = apps that learn by "context accumulation" (Tim O'Reilly) but still built around resources orig-i-nat-ing from else-where. Two way communication done right!
  • 21. Years in the making, Siri is born out of SRI's CALO Project, the largest Artificial Intelligence project in U.S. history. (CALO stands for Cognitive Assistant that Learns and Organizes). Made possible by a $150 million DARPA investment, the CALO Project included 25 research organizations and institutions and spanned 5 years.
  • 22. We have $150 million Darpa investment in CALO. But for mobile social interaction and social augmented experiences we are still stuck with this!
  • 23. Mobile Social Interaction & AR Layar BuildAR,, Junaio: proto-collaborative/UG social augmented experiences beyond coordinate tagged text data.
  • 24. But while users can submit data, they can only been seen by one application or another. Hugh MacLeod
  • 25. Lowering the Barriers for AR Content Creation and Sharing Currently AR content creators need to create their content specifically for each AR application/browser "Its a bit like having to use a different web browser for each website you want to visit. Its as if all the content on the internet is only going over a handful of approved channels." Thomas Wrobel
  • 26. Social Augmented Reality experiences require interoperability and open participation. "Clouds grow via standardization of interfaces and evolving protocols" David P. Reed.
  • 27. The Internet has been evolving towards real-time communications Attention streams - twitter tweets, flickr uploads, sensors, data streams everywhere, and cross pollination between streams
  • 28. Wave Federation Protocol Brings the Internet Alive! At the core Wave is a new technology that enables live concurrent modifications of shared data streams. After 26 years the hypertext based internet is transforming into a network of real time data sources combined with powerful on demand cloud based computing.
  • 29. How can we use social augmented experiences to explore transactional realities between the “Asynchronous City” - the lived city, and “Synchronous Internet of Things” - the real-time data based city? Di-Ann Eisnor, Platial, describes as, “transactional cartography” – “the movement from map providing entertainment/information to map as enabling action” (see Human as Sensors) The Copenhagen Wheel
  • 30. Wave has many qualities very important to creating an open distributed framework for augmented reality. - including the advantages of both real-time communication, & the advantages of persistent hosting of data. Wave combines asynchronous & synchronous data. - Federation anyone can create their own client and server
  • 31. Wave Federation Protocol - A Cooperative Architecture of Loosely Connected small parts
  • 32. Is Wave an "Off the Shelf " "mobile social interaction utility" for augmented reality? Clearly we’re not going to have one TCP/IP style global “Outernet.” Not in the near term, at least. It’s going to be fascinating to see how this stuff niches-up, fragments and then mashes back together. Bruce Sterling, Beyond the Beyond
  • 33. Coming Alive! No-one likes to talk about plumbing. It isn't sexy. But re/creation and plumbing are intimately linked.
  • 34. Wave provides a very new and interesting set of open pipes for the Layers and Channels of Social Augmented Experiences
  • 35. And the new plumbing potentially comes with a very big house. Google's giant industrial park in The Dalles what may be the world's largest server farm. Photo by Melanie Conner.
  • 36. And Can Augmented Reality Enable Wave? "More than AR needing Wave, I think Wave needs AR. Just to simplify the UI/UX" Are the multiple, collaborative attention streams of Wave better served by layers and channels of augmented reality?
  • 37. Big Question? Does using Google Wave protocol give Google disproportionate influence?
  • 38. Wave Client Server Protocol a Moving Target Currently there is no standard for client/server communication in Wave. Google's using protocol buffers and taking "community" input on standards. We are waiting for additional support for existing standards, e.g. XMPP/JSON
  • 39. Search and the Next Wave of AR OH: "one thing that prevents Google from implementing a standard for c/s communication is the search function which is used in GWave and which is definitely the same engine which Google uses for everything. The second problem is their proprietary database system ("BigTable").
  • 40. "The Big Table" A.K.A "The Google's Kraken" proprietary data base.
  • 41. So AR Blips are riding the PygoWave ARDev Camp, Dec 5th, Mountain View, NYC and Wave. Time: December 5th, 2009. 10:00AM-9:00PM Venue: The Open Planning Project office in Manhattan Come and learn about PygoWave and "Writing an AR Blip to Pygowave" with Thomas Wrobel, and Patrick.P2K.Schneider of PygoWave, and be part of building a new - Social Mobile Interaction Utility for Augmented Reality
  • 42. PygoWave "code is directly derived from Google's published Wave API and protocol specification and, well, my imagination" Patrick.P2K.Schneider PyGoWave source code is now at GitHub
  • 43. And if you are not gear heady - come and contribute use cases for social augmented reality experiences that inspire and delight, do stuff that matters, or get us to "come out and play!"
  • 44. Are we ready to move beyond augmented reality experiences like this?
  • 45. See you at ARDev Camp, Dec 5th, Mountain View, NYC and Wave. I will be at NYC Dev camp. Time: December 5th, 2009. 10:00AM-9:00PM Venue: The Open Planning Project office in Manhattan Contact me at tish.shute at @tishshute twitter