The document discusses various advancements in augmented reality (AR) technology, including methods for enhancing user interaction through thermal touch interfaces and non-photorealistic rendering. It outlines different applications and devices, such as smartphones capable of real-time visual odometry and projection-based AR systems like Microsoft's RoomAlive. Additionally, it mentions Apple's patent for an iPhone-based AR navigation system, highlighting the evolution and potential of AR in real-world environments.

1. Augmented Reality – showcase, development and
discussions
8th October 2014
Manly Emporium

2. What is Augmented Reality?
a technology that superimposes digital content
on a user's view of the real world.
• Combines the real & virtual
• Is interactive in real time
• Is registered in 3D
Ronald Azuma, 1997
MIT Ph.D

3. So how does AR work?
Local matching
Cloud matching
GPS
Accelerometer
Gyroscope
GPS
NFC/Beacons
Input Matching Sensory Data
Non 3D
AR Content
Local tracking
Cloud tracking
Tracking AR Output
Microphone,
light,
temperature

4. Thermal Touch: Thermography-Enabled Everywhere Touch
Interfaces for Mobile Augmented Reality Applications
Author: Daniel Kurz
• Traditionally, visible light energy hits something and
bounces off it, a detector then receives it and turns it
into an image.
• Thermal cameras detect more than just heat
though; they detect tiny differences in heat – as
small as 0.01°C
• The hotter something is the more thermal energy
it emits. This emitted thermal energy is called a
“heat signature.”

5. Thermal Touch: Thermography-Enabled Everywhere Touch
Interfaces for Mobile Augmented Reality Applications
Author: Daniel Kurz
• Detects residual heat resulting from a warm fingertip
touching the colder surface of an object
• Detects is a surface has actually been touched, or if a
finger only approached it without any physical contact
• determine the corresponding 3D position on the
touched object based on visual object tracking using a
visible light camera
• 3D position of the touch is used by human machine
interfaces for Augmented Reality providing natural
means to interact with real and virtual objects.

6. Thermal Touch: Thermography-Enabled Everywhere Touch
Interfaces for Mobile Augmented Reality Applications
Author: Daniel Kurz

7. Thermal Touch: Thermography-Enabled Everywhere Touch
Interfaces for Mobile Augmented Reality Applications
Author: Daniel Kurz
https://www.youtube.com/watch?v=t1HmYNqp8NM

8. FLIR ONE: Thermal imaging device for your iPhone 5/5s

9. FLIR ONE: Thermal imaging device for your iPhone 5/5s
https://www.youtube.com/watch?v=3i94L0B-Y-U
https://www.kickstarter.com/projects/ebeall/hemaimag
er-accessible-thermal-imaging-for-smart-de

10. Presence and Discernability in Conventional and Non-
Photorealistic Immersive Augmented Reality
Authors: William Steptoe, Simon Julier, Anthony Steed
• Non-photorealistic rendering (NPR) has been shown as
a powerful way to enhance both visual coherence and
immersion in augmented reality (AR).
• Investigates the use of NPR in an immersive,
stereoscopic, wide field-of-view head-mounted
video see-through AR display.
• Introduces many real-world effects including
latency, tracking failures, optical artefacts and
mismatches in lighting.
• recover the most plausible real-world lighting
conditions depending on incident light angle using
Spherical Harmonics.

11. Presence and Discernability in Conventional and Non-
Photorealistic Immersive Augmented Reality
Authors: William Steptoe, Simon Julier, Anthony Steed
https://www.youtube.com/watch?v=gb79GliV370

12. Presence and Discernability in Conventional and Non-
Photorealistic Immersive Augmented Reality
Authors: William Steptoe, Simon Julier, Anthony Steed
https://www.youtube.com/watch?v=Bc_TCLoH2CA

13. Semi-Dense Visual Odometry for AR on a Smartphone
Authors: Thomas Schöps, Jakob Engel, Daniel Cremers
• direct monocular visual odometry system which runs in
real-time on a smartphone.
• tracks and maps on the images themselves
instead of extracted features such as keypoints.
• New images are tracked using direct image
alignment, while geometry is represented in the
form of a semi-dense depth map
• AR applications can be derived from semi-dense
depth maps, and demonstrate the practical
applicability in the context of an AR application in
which simulated objects can collide with real
geometry.

14. Semi-Dense Visual Odometry for AR on a Smartphone
Authors: Thomas Schöps, Jakob Engel, Daniel Cremers
https://www.youtube.com/watch?v=X0hx2vxxTMg

15. New '3D Haptics Touchable 3D Technology' Enables you to
Touch 3D images, Boosts Virtual-Reality Gaming
AFP, Japan
"It works by fooling the brain, blending the images the eye
is seeing with different patterns of vibration created by a
small device on the fingertip," adds Mr Nakamura.

16. The Daqri Smart Helmet

17. The Daqri Smart Helmet
https://www.youtube.com/watch?v=qIU456jtkmw

18. FlexSense: A Transparent Self-Sensing Deformable Surface
• FlexSense, a new thin-film, transparent sensing surface
• based on printed piezoelectric sensors
• reconstruct complex deformations without the need for
any external sensing
• improves mobility and is not affected from occlusions
• FlexSense can be used for a variety of 2.5D interactions

19. FlexSense: A Transparent Self-Sensing Deformable Surface
https://www.youtube.com/watch?v=3Jo9ww9cLzg

20. Dyadic Projected Spatial Augmented Reality
• augmented reality system that combines dynamic
projection mapping, multiple perspective views and
device-less interaction.
• face to face, or dyadic, interaction with 3D virtual
objects
• interact with 3D virtual objects and each other
without cumbersome devices

21. Dyadic Projected Spatial Augmented Reality
https://www.youtube.com/watch?v=Df7fZAYVAIE

22. Microsoft RoomAlive: turns your room into a Holodeck
• The evolution of the Microsoft Research research project
IllumiRoom
• projection-mapping animated environments onto the walls
• a unified, scalable approach for interactive projection
mapping that dynamically adapts content to any room
• With six procam units, every square inch of a room can be
projection mapped.

23. Microsoft RoomAlive: turns your room into a Holodeck
https://www.youtube.com/watch?v=ILb5ExBzHqw

24. Apple's iPhone-based augmented reality navigation concept
Patents filed September 4, 2014
• "Federated mobile device positioning”
• "Registration between actual mobile
device position and environmental
model"
Apple's augmented reality patent filings
were first applied for in March 2013 and
credit Christopher G. Nicholas, Lukas M.
Marti, Rudolph van der Merwe and John
Kassebaum as inventors.
Source: http://appleinsider.com/articles/14/09/04/apple-invents-iphone-based-augmented-reality-navigation-with-x-ray-vision-features

25. Apple's iPhone-based augmented reality navigation concept
Patents filed September 4, 2014
Current iOS 7 Maps Flyover of New York City.

26. Apple's iPhone-based augmented reality navigation concept
Patents filed September 4, 2014

27. LinkedIn: au.linkedin.com/in/hugoortega
Twitter: @OnlyAugmented
http://www.insidear2014.com/munich/speakers/
sales@onlyaugmented.com
1800 615 617