The document discusses the potential of augmented reality (AR) and ubiquitous computing to revolutionize mobile social interactions, proposing an open framework for distributed AR using commonly accepted standards. It highlights the importance of interoperability and collaboration in creating social augmented experiences while addressing the need for improved communication protocols. The author emphasizes the transformational shift towards real-time data and social engagement facilitated by technologies like the Google Wave federation protocol.

1. The Next Wave of AR: Mobile Social Interaction, Right Here, Right Now! Tish Shute http:// ugotrade.com Presentation for MoMo #13 Amsterdam, Nov 16 th , 2009

2. In January 2009, I wrote a post that asked the question: Is it “OMG Finally” for Augmented Reality? The answer was yes! (with some caveats) I love being part of thinking about how a new industry will turn out! (If you aren't excited try watching Denno Coil)

3. But it is not just the new industry of augmented reality I am excited by! Something even bigger is afoot! I began by asking the question: Can we create an open framework for distributed augmented reality using "off the shelf" standards, e.g., the Google Wave Federation Protocol? But the implications of this proposal go well beyond augmented reality and towards an open framework for in context mobile social communication.

4. The Internet is Coming Alive!

5. Pranav Mistry Open Sources SixthSense

6. What really excites me is the new forms of mobile social interaction that the combination of ubiquitous computing and augmented reality enables. We are entering the era of the outernet

7. The "Outernet" AR and "ubiquitous computing & augmented reality are a DNA Base Pair. adenine and thymine

8. The structure of the key protein that enables quorum-sensing bacteria to communicate and spread infection. What is an architecture of participation for the "Outernet"?

9. Social Mobility and the 3rd Cloud David P. Reed (development of TCP/IP, designer of UDP, one of architects of Croquet

10. Designing a Mobile Social Interaction Utility for the Outernet. What are the qualities of the 3rd cloud and context based mobile and social communications?

11. "Mobility of People not Devices" - David P. Reed (thank you Marc Fonteijn for reminding me to think about traffic lights!)

12. 3rd Cloud Signs Serve People (through a mobile social interaction utility focused on the mobility of people not devices) Windows With No Curtains - the sign will communicate with your wife's phone and let her know you'll be late and will sync with your friend's calendar and remind you of the dinner party tonight....

13. The layers of augmented reality, linked to location/place/time and arrayed in full 3 dimensional space, are a powerful way for people to to get to the contextually relevant and interesting bits, and to orchestrate social, collaborative experiences of the world. Location is not a set of co-ordinates it is a culture of place. Social Augmented Experiences - Built on Layers and Channels

14. drawing by Thomas Wrobel

15. Dystopian Future? - Jamais Cascio "Will filtering threaten civility?" http://www.theatlantic.com/doc/200911/augmented-reality Channels and Filters for Social Augmented Experiences

16. "You see small transparent white dots glowing on people and objects indicating that they contain accessible cloud content." Chris Arkenberg, URBEINGRECORDED Augmented Reality Social Publishing Glam Dots from Solomon Chase and David Toro

17. Social Publishing/Remix culture collaboratively annotating, retrieving, sharing and remixing multimedia content. (diagram from Chris Anderson ) MSMDX (Media Streams Metadata Exchange) project at UC Berkeley,

18. AR Browsers Today "Experiences built around resources originating from else­where within the ubiquitous digital experience ecosystem." Joe Lamantia

19. Pulling the Web to the World AR browsers Layar, AcrossAir, Wikitude, Bionic Eye, Robot Vision

20. Two way communication done right! "Smart" AR Browsers Cooperating cloud data services + mobile = apps that learn by "context accumulation" (Tim O'Reilly) but still built around resources orig­i­nat­ing from else­where.

21. Years in the making, Siri is born out of SRI's CALO Project , the largest Artificial Intelligence project in U.S. history. (CALO stands for Cognitive Assistant that Learns and Organizes ). Made possible by a $150 million DARPA investment, the CALO Project included 25 research organizations and institutions and spanned 5 years.

22. We have $150 million Darpa investment in CALO. But for mobile social interaction and social augmented experiences we are still stuck with this!

23. Layar BuildAR, Wikitude.me, Junaio: proto-collaborative/UG social augmented experiences beyond coordinate tagged text data. Mobile Social Interaction & AR

24. But while users can submit data, they can only been seen by one application or another. Hugh MacLeod http://gapingvoid.com/

25. Lowering the Barriers for AR Content Creation and Sharing Currently AR content creators need to create their content specifically for each AR application/browser "Its a bit like having to use a different web browser for each website you want to visit. Its as if all the content on the internet is only going over a handful of approved channels." Thomas Wrobel

26. Social Augmented Reality experiences require interoperability and open participation. "Clouds grow via standardization of interfaces and evolving protocols" David P. Reed.

27. Attention streams - twitter tweets, flickr uploads, sensors, data streams everywhere, and cross pollination between streams The Internet has been evolving towards real-time communications

28. Wave Federation Protocol Brings the Internet Alive! At the core Wave is a new technology that enables live concurrent modifications of shared data streams. After 26 years the hypertext based internet is transforming into a network of real time data sources combined with powerful on demand cloud based computing.

29. How can we use social augmented experiences to explore transactional realities between the “Asynchronous City” - the lived city, and “Synchronous Internet of Things” - the real-time data based city? Di-Ann Eisnor, Platial , describes as, “transactional cartography” – “the movement from map providing entertainment/information to map as enabling action” (see Human as Sensors ) The Copenhagen Wheel

30. - including the advantages of both real-time communication, & the advantages of persistent hosting of data. Wave combines asynchronous & synchronous data. - Federation anyone can create their own client and server Wave has many qualities very important to creating an open distributed framework for augmented reality.

31. Wave Federation Protocol - A Cooperative Architecture of Loosely Connected small parts

32. Is Wave an "Off the Shelf " "mobile social interaction utility" for augmented reality? Clearly we’re not going to have one TCP/IP style global “Outernet.” Not in the near term, at least. It’s going to be fascinating to see how this stuff niches-up, fragments and then mashes back together. Bruce Sterling, Beyond the Beyond

33. Coming Alive! No-one likes to talk about plumbing. It isn't sexy. But re/creation and plumbing are intimately linked.

34. Wave provides a very new and interesting set of open pipes for the Layers and Channels of Social Augmented Experiences

35. And the new plumbing potentially comes with a very big house. Google's giant industrial park in The Dalles what may be the world's largest server farm. Photo by Melanie Conner.

36. And Can Augmented Reality Enable Wave? "More than AR needing Wave, I think Wave needs AR. Just to simplify the UI/UX" [email_address] Are the multiple, collaborative attention streams of Wave better served by layers and channels of augmented reality?

37. Big Question? Does using Google Wave protocol give Google disproportionate influence?

38. Currently there is no standard for client/server communication in Wave. Google's using protocol buffers and taking "community" input on standards. We are waiting for additional support for existing standards, e.g. XMPP/JSON Wave Client Server Protocol a Moving Target

39. OH: "one thing that prevents Google from implementing a standard for c/s communication is the search function which is used in GWave and which is definitely the same engine which Google uses for everything. The second problem is their proprietary database system ("BigTable"). Search and the Next Wave of AR

40. "The Big Table" Google's proprietary data base. A.K.A "The Kraken"

41. So AR Blips are riding the PygoWave ARDev Camp , Dec 5th, Mountain View, NYC and Wave. Time: December 5th, 2009. 10:00AM-9:00PM Venue: The Open Planning Project office in Manhattan Come and learn about PygoWave and "Writing an AR Blip to Pygowave" with Thomas Wrobel, ar@lostagain.nl and Patrick.P2K.Schneider of PygoWave, and be part of building a new - Social Mobile Interaction Utility for Augmented Reality

42. PygoWave http:// pygowave.net / "code is directly derived from Google's published Wave API and protocol specification and, well, my imagination" Patrick.P2K.Schneider PyGoWave source code is now at GitHub

43. And if you are not gear heady - come and contribute use cases for social augmented reality experiences that inspire and delight, do stuff that matters, or get us to "come out and play!"

44. Are we ready to move beyond augmented reality experiences like this?

45. See you at ARDev Camp , Dec 5th, Mountain View, NYC and Wave. I will be at NYC Dev camp. Time: December 5th, 2009. 10:00AM-9:00PM Venue: The Open Planning Project office in Manhattan Contact me at tish.shute at gmail.com [email_address] @tishshute twitter