The document discusses the evolution of human-computer interfaces (HCI) from low-tech control panels in the late 20th century to advanced augmented reality (AR) systems in the 21st century. It highlights the strengths and limitations of various interface technologies and provides examples of AR software development kits. Additionally, it emphasizes the need for artificial intelligence to enhance AR interactions and suggests that the field must learn from the virtual reality experience to avoid being seen as a recurring fad.

1. augmented reality and the
human computer interface
•an overview and case study
John Reid Perkins-Buzo
Southern Illinois University
rperkinsbuzo@siu.edu

2. late 20th century
UI hardware
• control panels (buttons)
• switches, slots and levers
• lightpens
• keyboard + mouse
• joystick & controller

3. 3
20th Century Model HCI
Diagram adapted from Otto Traian

4. strengths and limitations
• Strengths
– Low bandwidth
– Inexpensive
– Movement constrained
• Limitations
– Tech-training required motions
– Movement constrained
– Less integrated for human sensory
response

5. 21st century ui basics
• touch screens
• voice recognition
• facial expression recognition

6. strengths and limitations
• Strengths
– Less tech-training required
– Relatively Inexpensive
– Movement constrained
• Limitations
– High bandwidth
– Movement constrained
– Less integrated for human sensory
response

7. augmented reality
• virtual controls
– Any virtual reality control can also be
incorporated into AR
– Procedural controls are also possible, and
more natural
• real controls
– Control surfaces in the real world can be
mapped as controllers in AR
– Previous hardware controllers can also be
used

8. strengths and limitations
• Strengths
– Few motion constraints
– Integration for human sensory response
– Less tech-training required
• Limitations
– Relatively expensive
– High bandwidth
– Few motion constraints

9. examples
• Vuphoria (https://developer.vuforia.com)
– QualComm’s AR Software Developers Kit
(SDK) free in beta, now with a licensing
fee (but still with a free version).
• Metaio (http://www.metaio.com/sdk/)
– Leading AR developers. SDK licensing fee
(but with a free feature-limited version).
• Augment (http://augmentedev.com)
– Oriented toward presentation of products.
SDK licensing fee (but with a free
educational version).

10. my research
• Moverio BT-200

11. 11
click the image to view the video in a browser window

12. 12
Directions
 Artificial Intelligence needed to provide
the necessary responses motivated by
the reality of the augmented interface.
 Lessons to learn from the VR track
record. Always on the cusp of becoming
big, but never actually making it
beyond a recurring fad.
 Devices need to be revisited. For
instance, how should AR app interact
with a smart watch?

13. 13
Questions?

14. references
• Gotow, J. K. Zienkiewicz, J. White and D. Schmidt.
Addressing Challenges in Delivering Augmented
Reality Applications to Smartphones. Proceedings
of the Third International ICST Conference on
MOBILe Wireless MiddleWARE, Operating
Systems, and Applications. Mobilware 2010,
Chicago, IL, USA.
• Grudin, Jonathan. History in a Time of Rapid
Obsolence. Human Computer Interaction
Handbook ed. Julie A. Jacko. (CRC Press, May 4, 2012).
xxvii-lxi.
• Papagiannakis, G, G. Singh, and N. Magnenat-Thalman. A
Survey of Mobile and Wireless Technologies for
Augmented Reality Systems. Computer
Animation Virtual Worlds 2008. 19(1): 3-22.
• Wagner, D. and D. Schmalstieg. Making Augmented