The State of Touch Technologies: Educational       Opportunities and Challenges     Touch, Motion Gesture National Confere...
Touch, motion and gesture (TMG) technologieswill engage more of the sensorium for learning Sight Hearing Touch
Convergence of TMG with Other Trends         Impacting Learning                                                    Multimo...
TMG and Embodied Cognition
Embodied CognitionEmbodied cognitiondoes not isolate brainfrom body andenvironment.Our bodies shape howwe sense and proces...
Touch offers more intuitive way to    interact with digital tools    Sourece: http://www.youtube.com/watch?v=pT4EbM7dCMs
Multitouch offers new ways tosupport collaborative learning
Touch feedback on screens  Source: Senseg
Gesture-Based Computing• Gestural systems offer a path for a more  holistic, human interaction of people with  technology•...
Gestural Computing Challenges• Need for standards (Different systems may  use different conventions)• gestures are ephemer...
Importance of interaction design principles   in creating new gestural interfaces• Visibility (also called perceived affor...
Recognizing the              power of gestures for learningSource: Power Posing – Carney et al, 2010
Mixed Reality             Using TMG to fuse video game              with real world interactionSource: Marta Ferraz, Docto...
Moving into a multimodal world  Source: Nokia Research Center Future Technologies
A Day Made of GlassSource: A Day Made of Glass Corning
Wearable Technology                                       ViconRevue – Life Logs Sony razor thin display that bends like p...
TMG provides new ways to     support Multimodal Learning• Multiple means of  representation• Multiple means of  action and...
Questions for Multimodal Learning Design• Scaffolding needed to prepare students to  effectively use multimedia visual  re...
Now able to capture and analyze astudent’s interactions on touch devices
Will require new ways to analyze and visualize             the new massive data setsSource: Taylor Martin :Analysis of stu...
Education Visualization LabUniversity of Texas at Austin Learning Technology Center and              Texas Advanced Comput...
Implications of Touch and Gesture             Technologies• The future trajectory of touch and gesture  technologies have ...
The Future of Touch and Gesture        Technologies for Learning• To achieve this goal, we need to:  – break out of discip...
The new TMG technologies offer excitingopportunities to move toward a new vision of  learning built upon embodied cognition.
Resta tmg conference presentation
Resta tmg conference presentation
Resta tmg conference presentation
Upcoming SlideShare
Loading in...5
×

Resta tmg conference presentation

205

Published on

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
205
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
1
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Resta tmg conference presentation

  1. 1. The State of Touch Technologies: Educational Opportunities and Challenges Touch, Motion Gesture National Conference Opening Address December 7, 2011 Paul Resta The University of Texas at Austin
  2. 2. Touch, motion and gesture (TMG) technologieswill engage more of the sensorium for learning Sight Hearing Touch
  3. 3. Convergence of TMG with Other Trends Impacting Learning Multimodal learning Touch, motion, Visualization gesture technologies Learning Analytics Cloud computing
  4. 4. TMG and Embodied Cognition
  5. 5. Embodied CognitionEmbodied cognitiondoes not isolate brainfrom body andenvironment.Our bodies shape howwe sense and processinformation in ourinteractions with theworld.
  6. 6. Touch offers more intuitive way to interact with digital tools Sourece: http://www.youtube.com/watch?v=pT4EbM7dCMs
  7. 7. Multitouch offers new ways tosupport collaborative learning
  8. 8. Touch feedback on screens Source: Senseg
  9. 9. Gesture-Based Computing• Gestural systems offer a path for a more holistic, human interaction of people with technology• Gesture-based computing is potentially transformative technology, because it changes not only the physical and mechanical aspects of interaction with computers, but also our perception of collaborating with computers.
  10. 10. Gestural Computing Challenges• Need for standards (Different systems may use different conventions)• gestures are ephemeral, they do not leave behind any record of their path• Gestures also vary in meaning and use by culture
  11. 11. Importance of interaction design principles in creating new gestural interfaces• Visibility (also called perceived affordances or signifiers)• Feedback• Consistency (also known as standards)• Non-destructive operations (hence the importance of undo)• Discoverability: All operations can be discovered by systematic exploration of menus.• Scalability: The operation should work on all screen sizes, small and large.• Reliability: Operations should work. Norman (2010)
  12. 12. Recognizing the power of gestures for learningSource: Power Posing – Carney et al, 2010
  13. 13. Mixed Reality Using TMG to fuse video game with real world interactionSource: Marta Ferraz, Doctoral research University of Texas at Austin
  14. 14. Moving into a multimodal world Source: Nokia Research Center Future Technologies
  15. 15. A Day Made of GlassSource: A Day Made of Glass Corning
  16. 16. Wearable Technology ViconRevue – Life Logs Sony razor thin display that bends like paper LED display you can wear as contact lens
  17. 17. TMG provides new ways to support Multimodal Learning• Multiple means of representation• Multiple means of action and expression• Multiple means of engagement
  18. 18. Questions for Multimodal Learning Design• Scaffolding needed to prepare students to effectively use multimedia visual representations and touch, motion and gesture technologies for learning• How to minimize cognitive overload for students in interacting in a multimodal environment
  19. 19. Now able to capture and analyze astudent’s interactions on touch devices
  20. 20. Will require new ways to analyze and visualize the new massive data setsSource: Taylor Martin :Analysis of student actions with virtual manipulativeson interactive whiteboard
  21. 21. Education Visualization LabUniversity of Texas at Austin Learning Technology Center and Texas Advanced Computing Center
  22. 22. Implications of Touch and Gesture Technologies• The future trajectory of touch and gesture technologies have profound implications for: – the creation of new ways of interacting with computers and with each other – the design of new learning environments that engage more of the sensorium and are more authentic and engaging for students
  23. 23. The Future of Touch and Gesture Technologies for Learning• To achieve this goal, we need to: – break out of disciplinary silos – Form new interdisciplinary teams of kinesiology experts. learning scientists, neuroscientists, software designers, engineers, computer scientists and artists working together
  24. 24. The new TMG technologies offer excitingopportunities to move toward a new vision of learning built upon embodied cognition.
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×