Lecture 5 from a course on Mobile Based Augmented Reality Development taught by Mark Billinghurst and Zi Siang See on November 29th and 30th 2015 at Johor Bahru in Malaysia. This lecture provides an overview of location based mobile Augmented Reality. Look for the other 9 lectures in the course.

1. LECTURE 5:
LOCATION-BASED AR
Mark Billinghurst
mark.billinghurst@unisa.edu.au
Zi Siang See
zisiang@reina.com.my
November 29th-30th 2015
Mobile-Based Augmented Reality Development

2. AR Point of Interest

3. AR Point of Interest
Video: Layar, Impactful Augmented Reality in Your Everyday Life

4. AR Point of Interest
Video: Microsoft future

5. Challenges
• Design and Development
• Content creation, authoring
• Display platforms or systems
• Tracking approaches

6. Sensors

7. Wikitude World: location-based AR

8. Wikitude World: location-based AR
• KML
• Keyhole Markup Language is a standardized format
used in Google Earth. It can provide basic information
for POIs and easily uploaded (or using hyperlink) into
Wikitude.
• KML files can be created with the Google Earth user
interface (in Google Map)
• Alternatively, it can be created using XML or simple text
editor to work on raw KML scripts from scratch.
https://developers.google.com/kml/documentation/?hl=en

9. Wikitude World: location-based AR
• ARML
• Augmented Reality Markup Language is an open
exchange format based on KML but extends the format
for useful data around AR data sets.
• ARML 2.0 is used in the live versions of the 3 leading
Augmented Reality Browsers (Junaio, Layar and
Wikitude), where it is used to make the AR Browsers
interoperable.
• ARML 1.0 file format is currently used in the Wikitude
World Browser.
http://openarml.org/wikitude4.html

10. Steps for Using Wikitude
1. Register for Wikitude account
• http://www.wikitude.com
2. Register for web hosting account
• http://www.000webhost.com
• Own domain and server hosting
3. Content authoring
• https://www.google.com/mymaps/
• http://studio.wikitude.com
• Scripting and customization

11. Publish in Wikitude
• KML
• [put stuff here]
• ARML
• [put stuff here]

12. Free Web Hosting
• KML
• [put stuff here]
• ARML
• [put stuff here]

13. Part 1: KML

14. https://www.google.com/mymaps/
• KML
• [put stuff here]
• ARML
• [put stuff here]

15. KML (Google Map)
• KML
• [put stuff here]
• ARML
• [put stuff here]

16. KML (Google Map)
• KML
• [put stuff here]
• ARML
• [put stuff here]

17. KML (Google Map)
• KML
• [put stuff here]
• ARML
• [put stuff here]

18. KML (Google Map)
• KML
• [put stuff here]
• ARML
• [put stuff here]

19. KML (Google Map)
• KML
• [put stuff here]
• ARML
• [put stuff here]

20. KML: XML Scripting
• KML
• [put stuff here]
• ARML
• [put stuff here]

21. KML
• Benefits
• Generated from Google Earth
• Allows basic editing
• Current limitation
• Limited scripting option for Wikitude World
• Lack of options for POI details in Wikitude World
• Range is confined to ~20km radius

22. Publish in Wikitude: KML
• KML
• [put stuff here]
• ARML
• [put stuff here]

23. Publish in Wikitude: KML
• KML
• [put stuff here]
• ARML
• [put stuff here]

24. Publish in Wikitude: KML
• KML
• [put stuff here]
• ARML
• [put stuff here]
provide URL, host the *.kml file
from your own server

25. Wikitude Mobile App

26. Part 2: ARML

27. Publish in Wikitude
• KML
• [put stuff here]
• ARML
• [put stuff here]

28. ARML: XML Scripting
• KML
• [put stuff here]
• ARML
• [put stuff here]
http://openarml.org/wikitude4.html

29. wikitude-arml_workshop.xml
<?xml version="1.0" encoding="UTF-8"?>
<kml xmlns="http://www.opengis.net/kml/2.2"
xmlns:ar="http://www.openarml.org/arml/1.0"
xmlns:wikitude="http://www.openarml.org/wikitude/1.0">
<Document>
<ar:provider id="utm-workshop-arml">
<ar:name>UTM AR Workshop (ARML)</ar:name>
<ar:description>Creating POI location-based AR</ar:description>
<wikitude:providerUrl>http://www.hitlabnz.org</wikitude:providerUrl>
<wikitude:logo>http://www.zisiangsee.com/wikitude/hitlabnz/hitlab_512x512.png</wikitude:logo>
</ar:provider>
<Placemark id="123">
<ar:provider>utm-workshop-arml</ar:provider>
<name>LEGOLAND</name>
<description>A fantastic place to visit in Iskandar Johor. Open 10:00AM-7:00PM.</description>
<wikitude:info>
<wikitude:thumbnail>
http://www.zisiangsee.com/wikitude/hitlabnz/hitlab_512x512.png
</wikitude:thumbnail>
<wikitude:phone>+6075978888</wikitude:phone>
<wikitude:url>http://www.legoland.com.my</wikitude:url>
<wikitude:email>info@legoland.com.my</wikitude:email>
<wikitude:address>7, Jalan Legoland, Bandar Medini,, 79250 Nusajaya, Johor, Malaysia</wikitude:address>
</wikitude:info>
<Point>
<coordinates>103.63179030000003,1.426637,0.0</coordinates>
</Point>
</Placemark>
</Document>
</kml>

30. wikitude-arml_workshop.xml
<?xml version="1.0" encoding="UTF-8"?>
<kml xmlns="http://www.opengis.net/kml/2.2"
xmlns:ar="http://www.openarml.org/arml/1.0"
xmlns:wikitude="http://www.openarml.org/wikitude/1.0">
<Document>
<ar:provider id="utm-workshop-arml">
<ar:name>UTM AR Workshop (ARML)</ar:name>
<ar:description>Creating POI location-based AR</ar:description>
<wikitude:providerUrl>http://www.hitlabnz.org</wikitude:providerUrl>
<wikitude:logo>http://www.zisiangsee.com/wikitude/hitlabnz/hitlab_512x512.png</wikitude:logo>
</ar:provider>
<Placemark id="123">
<ar:provider>utm-workshop-arml</ar:provider>
<name>LEGOLAND</name>
<description>A fantastic place to visit in Iskandar Johor. Open 10:00AM-7:00PM.</description>
<wikitude:info>
<wikitude:thumbnail>
http://www.zisiangsee.com/wikitude/hitlabnz/hitlab_512x512.png
</wikitude:thumbnail>
<wikitude:phone>+6075978888</wikitude:phone>
<wikitude:url>http://www.legoland.com.my</wikitude:url>
<wikitude:email>info@legoland.com.my</wikitude:email>
<wikitude:address>7, Jalan Legoland, Bandar Medini,, 79250 Nusajaya, Johor, Malaysia</wikitude:address>
</wikitude:info>
<Point>
<coordinates>103.63179030000003,1.426637,0.0</coordinates>
</Point>
</Placemark>
</Document>
</kml>
Keep consistent

31. wikitude-arml_workshop.xml
<?xml version="1.0" encoding="UTF-8"?>
<kml xmlns="http://www.opengis.net/kml/2.2"
xmlns:ar="http://www.openarml.org/arml/1.0"
xmlns:wikitude="http://www.openarml.org/wikitude/1.0">
<Document>
<ar:provider id="utm-workshop-arml">
<ar:name>UTM AR Workshop (ARML)</ar:name>
<ar:description>Creating POI location-based AR</ar:description>
<wikitude:providerUrl>http://www.hitlabnz.org</wikitude:providerUrl>
<wikitude:logo>http://www.zisiangsee.com/wikitude/hitlabnz/hitlab_512x512.png</wikitude:logo>
</ar:provider>
<Placemark id="123">
<ar:provider>utm-workshop-arml</ar:provider>
<name>LEGOLAND</name>
<description>A fantastic place to visit in Iskandar Johor. Open 10:00AM-7:00PM.</description>
<wikitude:info>
<wikitude:thumbnail>
http://www.zisiangsee.com/wikitude/hitlabnz/hitlab_512x512.png
</wikitude:thumbnail>
<wikitude:phone>+6075978888</wikitude:phone>
<wikitude:url>http://www.legoland.com.my</wikitude:url>
<wikitude:email>info@legoland.com.my</wikitude:email>
<wikitude:address>7, Jalan Legoland, Bandar Medini,, 79250 Nusajaya, Johor, Malaysia</wikitude:address>
</wikitude:info>
<Point>
<coordinates>103.63179030000003,1.426637,0.0</coordinates>
</Point>
</Placemark>
</Document>
</kml>
Allows replication
(use unique numeric id)
For example
<Placemark id=“124”>
or
<Placemark id=“125”>

32. wikitude-arml_workshop.xml
<?xml version="1.0" encoding="UTF-8"?>
<kml xmlns="http://www.opengis.net/kml/2.2"
xmlns:ar="http://www.openarml.org/arml/1.0"
xmlns:wikitude="http://www.openarml.org/wikitude/1.0">
<Document>
<ar:provider id="utm-workshop-arml">
<ar:name>UTM AR Workshop (ARML)</ar:name>
<ar:description>Creating POI location-based AR</ar:description>
<wikitude:providerUrl>http://www.hitlabnz.org</wikitude:providerUrl>
<wikitude:logo>http://www.zisiangsee.com/wikitude/hitlabnz/hitlab_512x512.png</wikitude:logo>
</ar:provider>
<Placemark id="123">
<ar:provider>utm-workshop-arml</ar:provider>
<name>LEGOLAND</name>
<description>A fantastic place to visit in Iskandar Johor. Open 10:00AM-7:00PM.</description>
<wikitude:info>
<wikitude:thumbnail>
http://www.zisiangsee.com/wikitude/hitlabnz/hitlab_512x512.png
</wikitude:thumbnail>
<wikitude:phone>+6075978888</wikitude:phone>
<wikitude:url>http://www.legoland.com.my</wikitude:url>
<wikitude:email>info@legoland.com.my</wikitude:email>
<wikitude:address>7, Jalan Legoland, Bandar Medini,, 79250 Nusajaya, Johor, Malaysia</wikitude:address>
</wikitude:info>
<Point>
<coordinates>103.63179030000003,1.426637,0.0</coordinates>
</Point>
</Placemark>
</Document>
</kml> Longlitude, Latitude, Altitude (altitude is optional)

33. ARML: Tags
http://openarml.org/wikitude4.html

34. ARML: Tags
http://openarml.org/wikitude4.html

35. Publish in Wikitude: ARML
• KML
• [put stuff here]
• ARML
• [put stuff here]

36. Publish in Wikitude: ARML
• KML
• [put stuff here]
• ARML
• [put stuff here]

37. Publish in Wikitude: ARML
• KML
• [put stuff here]
• ARML
• [put stuff here]
provide URL, host the *.xml file
from your own server

38. Wikitude Mobile App

39. ARML
• Benefits
• Extended scripting option for Wikitude World
• Additional POI details in Wikitude World
• Current limitation
• Propagation: Wikitude World may take time to be
visible.
• Range is confined to ~20km radius
• Future possibilities
• AR link may be interoperated with other AR browser.

40. Discussion
• Potentials
• Location-based AR experience may extend beyond
vision (Nurminen, 2015) – multisensory augmentation.
• Sensor such as GPS can be unstable.
Nurminen, A. (2015) Mobile multisensory augmentations with the CultAR platform. SIGGRAPH Asia 2015 Mobile Graphics and Interactive Applications.

41. Discussion
• Potentials
• User interface that provides rich audio-visual AR/VR
experience, multiple devices (Matomura et al., 2015).
Matomura, W., Yamanaka, M. and Yamamoto, T. (2015) Mobile-based Streaming System of Spatial Audiovisual Contents and Web-based Design System. SIGGRAPH
Asia 2015 Mobile Graphics and Interactive Applications.

42. Implication
• Possibilities
• Explore other solutions suitable for hybrid approaches
that combine vision-based tracking and sensor input.
• Design industry - user interface, content development.
• Mixed-reality experience (taste, scent, haptic, touch,
audio, motion).

43. Explore
• Design and Development
• Content creation
• Display platforms or systems
• Tracking approaches