Multimodal Engagements with Cultural Heritage. Presentation to introduce Masterclass students to Tangible Interaction and novel interaction methods

1. INTERACTION AND
INTERFACES
From Physical Objects to Data
Javier Pereda // Web Science DTC
@TrinkerMedia
Masterclass Multimodal Engagements with Cultural Heritage

2. INTERACTIVITY AND
INTERFACES
• What is an interface
• The evolution of interfaces
• Natural and new interfaces
• Interfaces and the Web
• Exploration and the use of data
• Internet ofThings (IoT)

3. WHAT IS AN INTERFACE?
øWikimedia Commons

4. CLOAKED COMPLEXITY

5. CLOAKED COMPLEXITY
ø Rube Goldberg

6. THE INTERFACE
• A way of interacting with a system
• How do we get things into the system and how
do we manipulate them
• How do we get other people to do what is
needed?
• Technologic issues?

7. ANALOGUE INTERFACE
øWikimedia Commons

8. DIGITAL INTERFACESCOMPUTING
øWikimedia Commons

9. COMMAND-LINE INTERFACE
ø CodeProject
commandLineVideo

10. TEXT-MENU INTERFACE
ø CodeProject
TextMenuVideo

11. GRAPHIC USER INTERFACE
ø CodeProject
(GUI)

12. THE USE OF METAPHORS
ø CSSauthor

13. NATURAL USER INTERFACE
ø Microsoft
NUIvideo

14. NATURAL USER INTERFACE
øWikimediaCommons
Multi-sensory InterfaceHuman Like Interaction
Biometric Interaction Invisible Computing

15. MULTI-SENSORY
ø Apple
GesturesVideo

16. BIOMETRIC
ø GoCollective.com

17. HUMAN-LIKE
ø inc.ucds.edu

18. INVISIBLE COMPUTING
øTurbosquid

19. INTERACTION METHODS
øTurbosquid
GRAPHIC USER
INTERFACES
(GUI)
TANGIBLE USER
INTERFACES
(TUI)

20. TANGIBLE USER INTERFACES
FRAMEWORK
TANGIBLE
MANIPULATION
SPATIAL
INTERACTION
EMBODIED
FACILITATION
EXPRESSIVE
REPRESENTATION
TOUCH
HAPTIC
DIRECT MANIPULATION
SPATIAL
BODY
BEHAVIOUR
SOCIAL
PLACE SPECIFIC
SPATIAL CONFIGURATION
EXPRESSIVE
MEANING
REPRESENTATIONS
SIGNIFICANCE
CAUSE-EFFECT
ø Xiangyu ø SyllaøWebMediaMIT.eduø Oriboo // MIT

21. TANGIBLE USER INTERFACES
ø Reactivision//Reactable
(TUI)
COMPUTER VISION

22. INTERACTING WITH DATA
ø DIKW ModelWikimedia//Wikipedia
Ackoff, DIKW Model

23. INTERACTING WITH DATA

24. INTERACTING WITH DATA
CULTURAL HERITAGE EXAMPLE

25. INTERACTING WITH DATA
DATA & METADATA

26. INTERACTING WITH DATA
øWordHoard Project

27. INTERACTING WITH DATA
ø MandalaBrowser

28. INTERACTING WITH DATA
ø DeityCollector @Trinkermedia
The Deity Collector

29. INTERACTING WITH DATA
ø DeityCollector @Trinkermedia
The Deity Collector
Interaction methods

30. THE INTERNET OFTHINGS
(IOT)
ø SilliconLabs

31. EVERYTHING INTERACTS!
ø pngImg.com

32. @TrinkerMedia
Thank you.