Tangible Objects for  E-Learning Abdulmotaleb El Saddik FIEEE, FCAE, FEIC
 
At a glance Creation  of Advanced Multimedia LO Protection  of LO Navigation  of LOR by VR metaphors Adaptation  of LO acc...
Introduction <ul><li>Haptics </li></ul><ul><ul><li>Derived from the Greek verb “haptesthai” </li></ul></ul><ul><ul><li>Ref...
Multimedia and Authoring <ul><li>Multimedia contents  </li></ul><ul><ul><li>Graphic images  </li></ul></ul><ul><ul><li>3D ...
Multimedia Authoring Tools <ul><li>A major challenges in multimedia authoring is to make authoring complex multimedia titl...
HAMLAT <ul><li>Blender: </li></ul><ul><ul><li>Open source </li></ul></ul><ul><ul><li>Full-fledged 3D graphical renderer </...
HAMLAT Implementation  (demo)
A Multimedia Handwriting Learning and Evaluation Tool <ul><li>Learning sensorimotor skills is difficult with graphical or ...
Multimedia Learning Tool  <ul><li>Distinguished features </li></ul><ul><ul><ul><li>Language choice: Arabic, French, Englis...
Multimedia Learning Tool
Learning Mode -1- <ul><li>Language Repository </li></ul><ul><ul><li>Including symbols images, pronunciation files, and the...
Learning Mode -2- <ul><li>Haptic player: Three modes of operation: </li></ul><ul><ul><li>No guidance  </li></ul></ul><ul><...
Evaluation Mode -1-  <ul><li>Test GUI </li></ul>
Evaluation Mode -2- <ul><li>Dynamic Time Warping </li></ul><ul><ul><li>Measure the similarity between test and reference h...
Performance Evaluation -1-  <ul><li>Experimental Setup </li></ul><ul><ul><li>The Phantom Omni Device </li></ul></ul><ul><u...
Performance Evaluation -2- <ul><li>The DTW distance for the “Tha” Arabic character </li></ul>
Performance Evaluation -3- <ul><li>The DTW distance for the “i” Japanese character  </li></ul>
Performance Evaluation -4- (Demo) The DTW distances for five Japanese characters  Character Threshold Distance (x10 3  mm)...
At a glance Creation  of Advanced Multimedia LO Protection  of LO Navigation  of LOR by VR metaphors Adaptation  of LO acc...
Haptic signal prediction, compression, and watermarking Watermark haptic signals to protect copyright and authenticate con...
Case Study: Identifying Human Pattern with Haptics The Experiment Methodology Dynamic Time Warping : + Nelder-Mead non-lin...
Verifying such feasibility ( demo ) Virtual Check Virtual Mobile Phone Performance Ambient Intelligent Engine
At a glance Creation  of Advanced Multimedia LO Protection  of LO by Digital Watermarking Navigation  of LOR by VR metapho...
Navigation  <ul><ul><li>Tangible Objects:  Demo1 </li></ul></ul><ul><ul><li>Haptics:  Demo  2 </li></ul></ul><ul><ul><li>M...
At a glance Creation  of Advanced Multimedia LO Protection  of LO by Digital Watermarking Navigation  of LOR by VR metapho...
<ul><li>E-Learning courses </li></ul><ul><li>Toddler Interfaces </li></ul>
Toddler Interfaces <ul><li>Main idea </li></ul><ul><ul><li>Whenever a child utters an object’s name or taps on an object, ...
Alphabet Learning Evaluation <ul><li>12 children, ages 4-5, evaluated the system </li></ul><ul><li>We Observed the followi...
At a glance Creation  of Advanced Multimedia LO Protection  of LO by Digital Watermarking Navigation  of LOR by VR metapho...
Clustering and 3D Mapping Semantic keyword metrics MST tree Overall clustering process design
Searching/Sharing Learning Objects
Sample Interface: Dynamic Traffic Layout
Multimodal Interaction ( demo )
At a glance Creation  of Advanced Multimedia LO Protection  of LO by Digital Watermarking Navigation  of LOR by VR metapho...
Last thoughts
Acknowledgment
October 4, 2005 Dankie WAD MAHAD SAN TAHAY GADDA GUEY Ευχαριστώ Urakoze Asante متشکرم DMnvwd go raibh maith agaibh
Upcoming SlideShare
Loading in …5
×

2011 06 01 (uned) emadrid aelsaddik uottawa tangible objects for e learning

803 views
716 views

Published on

2011 06 01
(uned)
emadrid
aelsaddik
uottawa
tangible objects for e learning

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
803
On SlideShare
0
From Embeds
0
Number of Embeds
5
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Pinching is also a form of posture, whereas sign language is a good example of a gesture
  • 2011 06 01 (uned) emadrid aelsaddik uottawa tangible objects for e learning

    1. 1. Tangible Objects for E-Learning Abdulmotaleb El Saddik FIEEE, FCAE, FEIC
    2. 3. At a glance Creation of Advanced Multimedia LO Protection of LO Navigation of LOR by VR metaphors Adaptation of LO according to user context/profile & network QoS LO Delivery to user
    3. 4. Introduction <ul><li>Haptics </li></ul><ul><ul><li>Derived from the Greek verb “haptesthai” </li></ul></ul><ul><ul><li>Refers to sensing and manipulation through touch </li></ul></ul><ul><ul><li>Comprises both “Tactile” and “Kinesthetic” senses </li></ul></ul><ul><li>Applications </li></ul><ul><ul><li>Education and Training </li></ul></ul><ul><ul><li>Medicine: Tele-surgery, rehabilitation, etc. </li></ul></ul><ul><ul><li>Entertainment </li></ul></ul><ul><ul><li>Arts and Design </li></ul></ul><ul><ul><li>… </li></ul></ul>
    4. 5. Multimedia and Authoring <ul><li>Multimedia contents </li></ul><ul><ul><li>Graphic images </li></ul></ul><ul><ul><li>3D models </li></ul></ul><ul><ul><li>Audio and video files </li></ul></ul><ul><ul><li>And recently haptic stimuli </li></ul></ul><ul><li>Multimedia authoring tools </li></ul><ul><ul><li>Integrate the disparate media elements into a cohesive multimedia application </li></ul></ul>
    5. 6. Multimedia Authoring Tools <ul><li>A major challenges in multimedia authoring is to make authoring complex multimedia titles as easy as using a word processor or drawing program </li></ul><ul><li>We propose a multimedia authoring tool for hapto-visual applications to make the development process a non-programming experience </li></ul>
    6. 7. HAMLAT <ul><li>Blender: </li></ul><ul><ul><li>Open source </li></ul></ul><ul><ul><li>Full-fledged 3D graphical renderer </li></ul></ul><ul><ul><li>Physics and game engine </li></ul></ul><ul><ul><li>Adaptive user-interface </li></ul></ul><ul><li>Plug-ins incorporated in Blender source code </li></ul><ul><ul><li>Haptic panel in Blender GUI </li></ul></ul><ul><ul><li>Haptic rendering extension </li></ul></ul><ul><ul><li>Implemented in C++ using OpenHaptics and OpenGL </li></ul></ul>
    7. 8. HAMLAT Implementation (demo)
    8. 9. A Multimedia Handwriting Learning and Evaluation Tool <ul><li>Learning sensorimotor skills is difficult with graphical or auditory feedback </li></ul><ul><li>Sense of touch will be a must for physical guidance </li></ul><ul><li>Examples of physical guidance learning: </li></ul><ul><ul><li>Handwriting for visually impaired people </li></ul></ul><ul><ul><li>Medical procedures and rehabilitation training </li></ul></ul><ul><ul><li>Painting/sculpting techniques </li></ul></ul>
    9. 10. Multimedia Learning Tool <ul><li>Distinguished features </li></ul><ul><ul><ul><li>Language choice: Arabic, French, English, Japanese and Spanish </li></ul></ul></ul><ul><ul><ul><li>Multimodal: haptic, visual, and audio information for each letter </li></ul></ul></ul><ul><ul><ul><li>Learning mode choice: full or partial guidance, or test mode. </li></ul></ul></ul><ul><ul><ul><li>Evaluation Mode: quantitative evaluation using dynamic time warping </li></ul></ul></ul>
    10. 11. Multimedia Learning Tool
    11. 12. Learning Mode -1- <ul><li>Language Repository </li></ul><ul><ul><li>Including symbols images, pronunciation files, and the haptic stimuli of each letter (using XML-based schema) </li></ul></ul>
    12. 13. Learning Mode -2- <ul><li>Haptic player: Three modes of operation: </li></ul><ul><ul><li>No guidance </li></ul></ul><ul><ul><li>Partial guidance </li></ul></ul><ul><ul><li>Full guidance </li></ul></ul>
    13. 14. Evaluation Mode -1- <ul><li>Test GUI </li></ul>
    14. 15. Evaluation Mode -2- <ul><li>Dynamic Time Warping </li></ul><ul><ul><li>Measure the similarity between test and reference handwritings </li></ul></ul><ul><ul><li>Tolerate both global and local shifts in the time domain </li></ul></ul><ul><ul><li>Startup position of the test pattern is shifted to that of the reference pattern </li></ul></ul>Given two time series // x i is a point in the test trajectory X = x 0 , x 1 , …, x N-1 // y i is a point in the ref. trajectory Y = y 0 , y 1 , …, y T-1 D(x i ,y i ) = sqrt((abs(x i )-abs(y i ))^2 + (ord(x i )-ord(y i ))^2) DTW[0,0] = D(x 0 ,y 0 ) For i=1 to T-1 DTW[0,i] = D(x 0 ,y i ) + DTW[0,i-1] For i=1 to N-1 DTW[i,0] = D(x i ,y 0 ) + DTW[i-1,0] For i=1 to N-1 For j=1 to T-1 DTW[i,j]=D(x i ,y j )+min{DTW[i,j-1],DTW[i-1,j],DTW[i-1,j-1]} Return (DTW[N-1,T-1])
    15. 16. Performance Evaluation -1- <ul><li>Experimental Setup </li></ul><ul><ul><li>The Phantom Omni Device </li></ul></ul><ul><ul><li>Application is developed with .NET 2.0 Framework and programmed using C#. </li></ul></ul><ul><ul><li>Bipolar grading scheme (Pass/fail) </li></ul></ul><ul><ul><li>Threshold distance is computed based on subjective analysis </li></ul></ul><ul><ul><li>Three threshold values were estimated: </li></ul></ul><ul><ul><ul><li>Difficult </li></ul></ul></ul><ul><ul><ul><li>Medium </li></ul></ul></ul><ul><ul><ul><li>Easy </li></ul></ul></ul>
    16. 17. Performance Evaluation -2- <ul><li>The DTW distance for the “Tha” Arabic character </li></ul>
    17. 18. Performance Evaluation -3- <ul><li>The DTW distance for the “i” Japanese character </li></ul>
    18. 19. Performance Evaluation -4- (Demo) The DTW distances for five Japanese characters Character Threshold Distance (x10 3 mm) Easy Medium Difficult Sa 5.5 2.5 1 Shi 4 1 0.5 Chi 5 2.5 1 Tsu 4 1.5 1 Na 10 6 1
    19. 20. At a glance Creation of Advanced Multimedia LO Protection of LO Navigation of LOR by VR metaphors Adaptation of LO according to user context/profile & network QoS LO Delivery to user
    20. 21. Haptic signal prediction, compression, and watermarking Watermark haptic signals to protect copyright and authenticate content.
    21. 22. Case Study: Identifying Human Pattern with Haptics The Experiment Methodology Dynamic Time Warping : + Nelder-Mead non-linear minimization Spectral analysis: Fast Fourier Transform Unsupervised Method: K-Means Graphic Representation Data Trial Timestamp Position X Position Y … Force X ( N) 1 0 0.23344 0.56768 0.00456 1 … .. … … 1 0.0123090 0.37676 0.98976 0,03767
    22. 23. Verifying such feasibility ( demo ) Virtual Check Virtual Mobile Phone Performance Ambient Intelligent Engine
    23. 24. At a glance Creation of Advanced Multimedia LO Protection of LO by Digital Watermarking Navigation of LOR by VR metaphors Adaptation of LO according to user context/profile & network QoS LO Delivery to user
    24. 25. Navigation <ul><ul><li>Tangible Objects: Demo1 </li></ul></ul><ul><ul><li>Haptics: Demo 2 </li></ul></ul><ul><ul><li>Mobile Phone: Demo 3 </li></ul></ul>
    25. 26. At a glance Creation of Advanced Multimedia LO Protection of LO by Digital Watermarking Navigation of LOR by VR metaphors Adaptation of LO according to user context/profile & network QoS LO Delivery to user
    26. 27. <ul><li>E-Learning courses </li></ul><ul><li>Toddler Interfaces </li></ul>
    27. 28. Toddler Interfaces <ul><li>Main idea </li></ul><ul><ul><li>Whenever a child utters an object’s name or taps on an object, a set of appropriate multimedia representations is displayed (i.e. images, Multi-lingual texts, audio…) </li></ul></ul><ul><li>Techniques investigated </li></ul><ul><ul><li>Voice-based technique (Speech detection) </li></ul></ul><ul><ul><li>Magic Stick technique (RFID and Bluetooth technologies) </li></ul></ul><ul><li>Evaluation </li></ul><ul><ul><li>Several games were developed: i.e., Book game, Alphabet Learning, and Object Identification </li></ul></ul>
    28. 29. Alphabet Learning Evaluation <ul><li>12 children, ages 4-5, evaluated the system </li></ul><ul><li>We Observed the following: </li></ul><ul><ul><li>Children’s discussions </li></ul></ul><ul><ul><li>Their Writings </li></ul></ul><ul><ul><li>Their Questions </li></ul></ul><ul><ul><li>Simplicity of using the Magic Stick. </li></ul></ul>Demo 1 Demo 2
    29. 30. At a glance Creation of Advanced Multimedia LO Protection of LO by Digital Watermarking Navigation of LOR by VR metaphors Adaptation of LO according to user context/profile & network QoS LO Delivery to user
    30. 31. Clustering and 3D Mapping Semantic keyword metrics MST tree Overall clustering process design
    31. 32. Searching/Sharing Learning Objects
    32. 33. Sample Interface: Dynamic Traffic Layout
    33. 34. Multimodal Interaction ( demo )
    34. 35. At a glance Creation of Advanced Multimedia LO Protection of LO by Digital Watermarking Navigation of LOR by VR metaphors Adaptation of LO according to user context/profile & network QoS LO Delivery to user
    35. 36. Last thoughts
    36. 37. Acknowledgment
    37. 38. October 4, 2005 Dankie WAD MAHAD SAN TAHAY GADDA GUEY Ευχαριστώ Urakoze Asante متشکرم DMnvwd go raibh maith agaibh

    ×