Resta tmg conference presentation
Upcoming SlideShare
Loading in...5

Like this? Share it with your network


Resta tmg conference presentation






Total Views
Views on SlideShare
Embed Views



0 Embeds 0

No embeds



Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
Post Comment
Edit your comment

Resta tmg conference presentation Presentation Transcript

  • 1. The State of Touch Technologies: Educational Opportunities and Challenges Touch, Motion Gesture National Conference Opening Address December 7, 2011 Paul Resta The University of Texas at Austin
  • 2. Touch, motion and gesture (TMG) technologieswill engage more of the sensorium for learning Sight Hearing Touch
  • 3. Convergence of TMG with Other Trends Impacting Learning Multimodal learning Touch, motion, Visualization gesture technologies Learning Analytics Cloud computing
  • 4. TMG and Embodied Cognition
  • 5. Embodied CognitionEmbodied cognitiondoes not isolate brainfrom body andenvironment.Our bodies shape howwe sense and processinformation in ourinteractions with theworld.
  • 6. Touch offers more intuitive way to interact with digital tools Sourece:
  • 7. Multitouch offers new ways tosupport collaborative learning
  • 8. Touch feedback on screens Source: Senseg
  • 9. Gesture-Based Computing• Gestural systems offer a path for a more holistic, human interaction of people with technology• Gesture-based computing is potentially transformative technology, because it changes not only the physical and mechanical aspects of interaction with computers, but also our perception of collaborating with computers.
  • 10. Gestural Computing Challenges• Need for standards (Different systems may use different conventions)• gestures are ephemeral, they do not leave behind any record of their path• Gestures also vary in meaning and use by culture
  • 11. Importance of interaction design principles in creating new gestural interfaces• Visibility (also called perceived affordances or signifiers)• Feedback• Consistency (also known as standards)• Non-destructive operations (hence the importance of undo)• Discoverability: All operations can be discovered by systematic exploration of menus.• Scalability: The operation should work on all screen sizes, small and large.• Reliability: Operations should work. Norman (2010)
  • 12. Recognizing the power of gestures for learningSource: Power Posing – Carney et al, 2010
  • 13. Mixed Reality Using TMG to fuse video game with real world interactionSource: Marta Ferraz, Doctoral research University of Texas at Austin
  • 14. Moving into a multimodal world Source: Nokia Research Center Future Technologies
  • 15. A Day Made of GlassSource: A Day Made of Glass Corning
  • 16. Wearable Technology ViconRevue – Life Logs Sony razor thin display that bends like paper LED display you can wear as contact lens
  • 17. TMG provides new ways to support Multimodal Learning• Multiple means of representation• Multiple means of action and expression• Multiple means of engagement
  • 18. Questions for Multimodal Learning Design• Scaffolding needed to prepare students to effectively use multimedia visual representations and touch, motion and gesture technologies for learning• How to minimize cognitive overload for students in interacting in a multimodal environment
  • 19. Now able to capture and analyze astudent’s interactions on touch devices
  • 20. Will require new ways to analyze and visualize the new massive data setsSource: Taylor Martin :Analysis of student actions with virtual manipulativeson interactive whiteboard
  • 21. Education Visualization LabUniversity of Texas at Austin Learning Technology Center and Texas Advanced Computing Center
  • 22. Implications of Touch and Gesture Technologies• The future trajectory of touch and gesture technologies have profound implications for: – the creation of new ways of interacting with computers and with each other – the design of new learning environments that engage more of the sensorium and are more authentic and engaging for students
  • 23. The Future of Touch and Gesture Technologies for Learning• To achieve this goal, we need to: – break out of disciplinary silos – Form new interdisciplinary teams of kinesiology experts. learning scientists, neuroscientists, software designers, engineers, computer scientists and artists working together
  • 24. The new TMG technologies offer excitingopportunities to move toward a new vision of learning built upon embodied cognition.