Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Sweet Home Project


Published on

Presentation of the "Sweet Home" Project

Published in: Health & Medicine, Technology
  • Be the first to comment

  • Be the first to like this

Sweet Home Project

  1. 3. Sweet Home Meeting Nice - November 9 – 2010 CHU de Nice
  2. 4. Sweet Home Meeting Nice - November 9 – 2010 CHU de Nice Participants: Pau-Choo Chung: [email_address] Francois Bremond : [email_address] Rim Romdhane: [email_address] Juliette Mallez: [email_address] Emmanuel Mulin: [email_address] Alexandre Derreumaux: [email_address] Julie Piano: [email_address]   Jihyun Lee: [email_address] Robert Philippe: [email_address]
  3. 5. SWEET-Home project <ul><li>Research protocol I was designed by the Nice CMRR and approved by the Nice Ethical committee </li></ul><ul><li>Aims to build an innovative framework for modeling behavior and activities of daily living of patient presenting AD and whether they are involved in goal directed behaviors. </li></ul>
  4. 6. A place for Behavioral assessment <ul><li>Set up the 2 video cameras according to the activities planed during the video tape recording; </li></ul><ul><li>Give global explanations of the session and have the participant sign the informed consent (Cf. information review, informed consent) </li></ul><ul><li>Fix on the actigraphs (MotionPod®, Actiwatch®, Motionlogger®) and explain the participant the video tape recording script including the activities list and their achievement order; </li></ul><ul><li>For the equipment calibration, the participant will be asked to stand still for 10 seconds. </li></ul>
  5. 7. Scenario 1 <ul><li>  </li></ul><ul><li>Total length: 1 hour </li></ul><ul><li>Step A (directed activities): 10 minutes </li></ul><ul><li>Step B (semi directed activities): 20 minutes </li></ul><ul><li>Step C (free activities): 30 minutes </li></ul>
  6. 8. Step A: directed activities <ul><ul><li>(timed and systematically demonstrated to the participant) </li></ul></ul><ul><ul><li>based on the short physical performance battery (the examiner stays in the room for scoring) </li></ul></ul><ul><li>  </li></ul><ul><li>Balance testing </li></ul><ul><ul><li>Side by side stand, one ’ s feet together </li></ul></ul><ul><ul><li>Semi tandem stand, stand with the side of the heel of one foot touching the big toe of the other foot </li></ul></ul><ul><ul><li>Tandem stand, with the heel of one foot in front of and touching the toes of the other foot </li></ul></ul>
  7. 9. <ul><li>  </li></ul><ul><li>Speed of walk testing </li></ul><ul><ul><li>The examiner asks the participant to walk through the room, from the opposite side of the video camera for 4 meters and then to go back. </li></ul></ul><ul><li>First attempt: Time to walk 4 meters: sec </li></ul><ul><li>Second attempt: Time to walk 4 meters: sec </li></ul><ul><li>  </li></ul><ul><li>Repeated chair stands testing </li></ul><ul><ul><li>The examiner asks the participant to make the first chair stand, from sat to stand position without using his arms. The examiner will then ask the participant to do the same action 5 times in a row. </li></ul></ul>Step A: directed activities
  8. 10. <ul><li>The participant is asked to achieve some activities according to an order. </li></ul><ul><li>Before beginning, a physician or an examiner describes each of the steps, location and the way to use the objects. </li></ul><ul><li>Once the participant says he understands each steps, he ’ s told that he can keep the instructions and use them any time he needs. </li></ul><ul><li>Then the examiner gets out of the room). </li></ul>Step B: semi directed activities
  9. 11. Step B: semi directed activities <ul><li>1.Walk to the coffee table, sit down and read something for 2 mn </li></ul><ul><li>2. Walk to the desk where the kettle is and make warm some water. </li></ul><ul><li>3.Walk to the phone and compose this number: xxxxxx.  </li></ul><ul><li>4.Take the watering can and water the plant. </li></ul><ul><li>5. Walk to the television and turn it on with the remote control. </li></ul><ul><li>6. Walk to the coffee table, take the playing cards and classify them by color (reds with reds, blacks with blacks). </li></ul><ul><li>7. Take the green “ ABCD ” folder on the desk with the A, B, C, D sheets in it. </li></ul><ul><li>8. Match the A, B, C, D sheets from the folder to one ’ s dispersed all over the room; A with A, etc… </li></ul><ul><li>9. Put the “ ABCD ” folder back on the desk. </li></ul><ul><li>10. Get out of the room. </li></ul>
  10. 12. Step C: Free activities <ul><li>There are several things in the room which allow various activities. To promote moving there are dispersed in different places: </li></ul><ul><li>Magazines, news papers, book of photos </li></ul><ul><li>Drinks (coffee, tea, fruit juice) </li></ul><ul><li>Dominos, playing cards </li></ul><ul><li>Phone </li></ul><ul><li>Television </li></ul><ul><li>Plant which once can water </li></ul><ul><li>  </li></ul><ul><li>NB: The participant is asked to answer if the phone rings during this step (the phone rings 30 minutes after the examiner gets out of the room). </li></ul><ul><li>  </li></ul><ul><li>The participant is verbally informed of what he can do and where things are in the room. Activities are suggested but there are no instructions or task to do. </li></ul><ul><li>Before living the participant alone, he is told that an examiner is at his disposal just behind the door to answer his possible questions and that he can leave the room or interrupt this step before its end if he wants to. </li></ul>
  11. 13. Step A: directed activities <ul><li>Indicators: Speed of execution, cadence, </li></ul><ul><li>length of walk </li></ul>Indicators: Speed of execution (m/s), number of error (standard unity) and omission (standard unity). Step B: semi directed activities Step C: Free activities Indicators: Speed of execution (m/s), number of activities (standard unity), percentage of working time (%), number of transfer (standard unity),
  12. 14. Video captors recognition methods Overview Automatic process
  13. 15. Event recognition Component A priori knowledge <ul><li>Different types of contextual objects : </li></ul><ul><ul><li>- Walls, </li></ul></ul><ul><ul><li>- 3D Equipment, </li></ul></ul><ul><ul><li>- 2D Zones of interest </li></ul></ul><ul><ul><li>Green : Walls, Pink : 3D Equipment, Red : 2D Zones of interest. </li></ul></ul>
  14. 16. Vision component Vision component (detection, classification, tracking): detect the person in the scene and to track his different movements over time.
  15. 17. R David E Mulin J Piano J Lee A Derreumeaux P Mallea F Bremont R Romdhane N Zouba V Joumier M Thonnat
  16. 18. 11/09/2010 Reporter: Pau-Choo Chung IEEE Fellow
  17. 19. <ul><li>Experiment Process </li></ul><ul><li>Indoor Experiment Setting </li></ul><ul><li>Outdoor Experiment Setting </li></ul><ul><li>Outdoor Experiment Results </li></ul><ul><li>Conclusion </li></ul>Outline
  18. 20. <ul><li>Total length: 100 mins </li></ul><ul><li>Indoor Experiments </li></ul><ul><ul><li>Step A: Completely supervised activities (10 mins) </li></ul></ul><ul><ul><li>Step B: Half supervised activities </li></ul></ul><ul><ul><li>(30 mins) </li></ul></ul><ul><ul><li>Step C: Free activities (30 mins) </li></ul></ul><ul><li>Outdoor Experiments (30 mins) </li></ul>Experiment Process
  19. 21. <ul><li>Balance testing </li></ul><ul><li>Speed of walking testing </li></ul><ul><li>Repeated chair stands testing </li></ul>Indoor Experiment Setting Step A: Completely Supervised Activities
  20. 22. Indoor Experiment Setting Step B: Half supervised activities
  21. 23. Indoor Experiment Setting Step B: Half supervised activities (Prospective memory )
  22. 24. Indoor Experiment Setting Step C: Free activities Entrance 1 Restaurant 2 Kitchen 3 Bedroom 4 Study 6 Parlor 7 Mirror 5
  23. 25. Outdoor Experiment Setting Participants are asked to walk around the ring region in the NCKU campus. Examiner will walk with them and ask them the direction of the starting point in five fixed point on the way. During a straight path of forty meters, participants will wear non-invasive sensors to measure the gait information.
  24. 26. Outdoor Experiment Setting <ul><li>Specification of Accelerometer: </li></ul><ul><ul><li>Triaxial accelerometer (LIS3L02AQ3):  2g to +2g </li></ul></ul><ul><ul><li>Uniaxial angular rate gyroscope (ADXRS300): ±300 °/s </li></ul></ul><ul><ul><li>Biaxial angular rate gyroscope (IDG-300): ±500 °/s </li></ul></ul>X-axis Y-axis Z-axis
  25. 27. Outdoor Experiment Results <ul><li>Subjects </li></ul><ul><ul><ul><li>Very mild AD patients (3) </li></ul></ul></ul><ul><ul><ul><li>Health controls (2) </li></ul></ul></ul>
  26. 28. Outdoor Experiment Results <ul><li>Gait Parameters </li></ul><ul><ul><li>Stride detection </li></ul></ul><ul><ul><li>Gait cycle </li></ul></ul><ul><ul><li>Stride length </li></ul></ul><ul><ul><li>Stride frequency </li></ul></ul><ul><ul><li>Stride speed </li></ul></ul><ul><ul><li>Stride regularity </li></ul></ul>
  27. 29. Outdoor Experiment Results Stride Detection
  28. 30. Outdoor Experiment Results Stride Detection Distance (m) Time (s) Number of Stride Mild AD (1) 40 42.53 34 Mild AD (2) 40 32.89 28 Mild AD (3) 40 43.26 34 Health Control (1) 40 36.47 32 Health Control (2) 40 36.25 31
  29. 31. Outdoor Experiment Results Gait Cycle <ul><li>Red: X-axis </li></ul><ul><li>Green: Y-axis </li></ul><ul><li>Blue: Z-axis </li></ul>Push-Off Swing Phase Heel Strike 18.5% 32.6% 19.3% Swing Phase Stance Phase 71.4% 29.6%
  30. 32. Outdoor Experiment Results Gait Cycle <ul><li>Red: X-axis </li></ul><ul><li>Green: Y-axis </li></ul><ul><li>Blue: Z-axis </li></ul>Push-Off Swing Phase Heel Strike 18.5% 32.6% 19.3% Swing Phase Stance Phase 71.4% 29.6%
  31. 33. Outdoor Experiment Results Gait Cycle <ul><li>SW/ST: time of swing phase/ time of stance phase </li></ul>Stance Phase (%) Swing Phase (%) SW/ST Mild AD (1) 35 65 1.88 (0.18) Mild AD (2) 30 70 2.35(0.23) Mild AD (3) 43 57 1.31(0.11) Health Control (1) 36 64 1.79 (0.21) Health Control (2) 37 63 1.70 (0.11)
  32. 34. Outdoor Experiment Results Stride Length <ul><li>Stride length: 40m/number of Stride </li></ul>Distance (m) No. of Stride Stride Length (m) Mild AD (1) 40 34 1.176 Mild AD (2) 40 28 1.428 Mild AD (3) 40 34 1.176 Health Control (1) 40 32 1.25 Health Control (2) 40 31 1.29
  33. 35. Outdoor Experiment Results Stride Frequency <ul><li>Fourier transform of accelerometer signal </li></ul><ul><li>Stride frequency for normal: 1.5~2.2 Hz </li></ul><ul><li>Stride frequency = 0.7904 * 2 = 1.5808 (Hz) </li></ul>X : 0.7904
  34. 36. Outdoor Experiment Results Stride Frequency Single Stride Frequency (Hz) Walking Stride Frequency (Hz) Mild AD (1) 0.79 1.58 Mild AD (2) 0.84 1.68 Mild AD (3) 0.78 1.56 Health Control (1) 0.88 1.76 Health Control (2) 0.84 1.68
  35. 37. Outdoor Experiment Results Stride Speed <ul><li>Stride speed = Stride length * Stride frequency </li></ul>Stride Length (m) Stride Frequency (Hz) Stride Speed (m/s) Mild AD (1) 1.176 0.79 0.929 Mild AD (2) 142.8 0.84 1.20 Mild AD (3) 117.6 0.78 0.917 Health Control (1) 1.25 0.88 1.10 Health Control (2) 1.29 0.84 1.075
  36. 38. Outdoor Experiment Results Stride Regularity <ul><li>Entropy: The entropy value of accelerometer signal. </li></ul>Entropy Mild AD (1) 3.24 Mild AD (2) 0.28 Mild AD (3) 1.04 Health Control (1) 0.83 Health Control (2) 0.56
  37. 40. Conclusion <ul><li>Mild AD presents </li></ul><ul><ul><li>Higher SW/ST ratio </li></ul></ul><ul><ul><li>Lower stride length </li></ul></ul><ul><ul><li>Lower stride frequency </li></ul></ul><ul><ul><li>Lower stride speed </li></ul></ul><ul><ul><li>Greater cycle-to-cycle gait variability </li></ul></ul>