Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Auckland ux meetup Sept 13 augmented reality in healthcare


Published on

Ian Power from Healthy Digital presents an update of some cool AR stuff happening in healthcare, and an intro to an idea to improve patient adherence with long term medicines.
Presented to the Auckland UX meet up, September 2013

Published in: Business, Technology
  • Be the first to comment

Auckland ux meetup Sept 13 augmented reality in healthcare

  1. 1. Augmented Reality in Healthcare Auckland UX Meet up September 2013 Ian Power
  2. 2. healthy
  3. 3. We create intuitive, satisfying user- experiences and then help you organize, train, track, measure and improve.
  5. 5. Cookie vs Laundry (Thanks to John Maeda, designer and champion of simplicity)
  6. 6. MORE JOY AND LESS WORK Our aim is to design experiences with
  7. 7. HUB
  10. 10. augmented reality is computer generated content visualized in the real world
  11. 11. •  AR apps can be tricky. •  Hardware: sensors, cameras, and network connections that work. •  Software: strong image recognition algorithms to identify objects from a variety of angles.
  12. 12. Experiencing AR
  13. 13. Typical mobile handset view
  14. 14. Tablet view (showing underground cables and pipes)
  15. 15. EyeTap – which projects images directly onto the retina
  16. 16. Google Glass – here modelled by co-owner Sergey Brin
  17. 17. The Google Glass experience
  18. 18. AR Triggers •  Printed images •  Real 3D objects or faces •  SLAM (Simultaneous localization and mapping) •  NFC •  User commands
  19. 19. HEALTHCARE Examples of great AR work going on in
  20. 20. 72% physicians now use smart phones or tablets in their everyday routines
  21. 21. AR on the ward might look something like this…
  22. 22. Developed by German company Fraunhofer MEVIS, this AR app helps surgeons locate critical structures such as tumors and blood vessels (using data from CT scans).
  23. 23. This is liver surgery. Your liver has many blood vessels, which the app helps the surgeon avoid or be prepared for when he/ she cuts.
  24. 24. Endoscopic surgery often means the surgeon has a very disjointed view of proceedings, limited to the keyhole camera via a monitor, medical imaging data on a second display, and the outside of the patient. The surgeon has to assemble the data in their head, and this really complicates the intuitive use of surgical tools. Here we’re seeing an AR view of minimally invasive intervention vertebroplasty (on a model), via a HMD, developed by a team at Technische Universität München (TUM). Vertebroplasty is the insertion of cement into weak and brittle vertebrae through a trocar (metal tube) for stabilization
  25. 25. …and here’s what the kit looks like
  26. 26. Nursing and midwifery students at Sheffield Hallam University will benefit from a new iPad based augmented reality (AR) tool to improve their communication skills. They used to hire actors to be patients for students, but now, it’s all on an iPad!
  27. 27. My current favourite
  28. 28. CPRGLASS Developed by cardiologist Christian Assad, M.D. University of Arkansas for Medical Sciences (UAMS)
  29. 29. CPR GLASS •  Someone in the street collapses •  Glass wearer says “OK GLASS, CPRGLASS” •  App opens. Instructions appear - ABC (Assess Airway, Breathing and Circulation). App measures pulse. •  Eulerian video magnification – are the compressions adequate? and has patient regained pulse if we stop compressions…
  30. 30. Eulerian video magnification amplifies changes over time, can detect pulse from skin colour changes. MIT-developed software, open source, uses standard video camera footage.
  31. 31. Eulerian video magnification can use motion amplification to detect baby breathing
  32. 32. Anyway – back to CPRGlass – “OK GLASS, No Pulse!” Triggers the following: •  Staying Alive music starts which will guide you to do the compressions at a rate of 100/min. •  Gyroscope in Glass tells you if compressions are adequate •  App tracks TIME of CPR initiation and number of compressions •  Calls emergency services with your GPS-based location •  Via GPS will try to find nearest AED via AED4US •  Sends Txt Msg to nearest hospital with information regarding ongoing CPR for them to get prepared
  33. 33. Acute vs Ongoing •  Acute – new and exciting •  Interventions •  Technology •  Ongoing •  Supporting people •  Motivation
  34. 34. MEDICINE = WORK For some people with chronic illness
  35. 35. In Health, often the last thing users want is an ‘experience’. They want to find it, use it and forget it. The best experience is invisible. Peter Morville
  36. 36. Over my career in marketing and healthcare advertising 95% SELL, 5% support
  37. 37. BIG PROBLEM Poor compliance/ adherence/ concordance
  38. 38. •  Between 30% and 50% of patients with long-term diseases in developed countries follow treatment recommendations. - asthma - diabetes - CVD - osteoporosis
  39. 39. WHY? •  Low level engagement •  Poor understanding of treatment benefits •  Side effects management •  Poor communication
  40. 40. Lady collapses in the street
  41. 41. Luckily guy with CPRGlass is walking by…
  42. 42. She makes it to hospital, is treated and discharged
  43. 43. •  LD aspirin •  Antiplatelet •  Beta-blocker •  ACE inhibitor •  Statin …with 5 medications to manage: LD aspirin – prevents clots Antiplatelet – works with aspirin to prevent clots Beta-blocker – reduce heart’s workload, slows it down ACE inhiibitor – widens vessels and lowers BP Statin – lower cholesterol
  44. 44. Suddenly, breakfast comes with these!
  45. 45. You do get some explanatory brochures…
  47. 47. Jesse James Garrett’s flow diagram Elements of User Experience I really wanted to use this – this being a UX meet up and everything… But I couldn’t. Sorry…
  48. 48. Goal: Help users feel more connected to their HCP, to better understand their treatment and to take their medicine correctly +
  49. 49. Strategy: Bring the HCP to the user Simple to DO As and when required +
  50. 50. Healthy Reminder Mobile AR app
  51. 51. The patient can open the app and point it at the trigger, and it will play video content of the practice nurse or doctor explaining what the treatments are for, why they are important, and the agreed goals that the patient and the HCPs are working towards.
  52. 52. MedTech 32 interface – what most of the Drs and Nurses in primary care are using
  53. 53. + Add a digital camera to her desk or her laptop
  54. 54. Practice nurse runs through: Agreed treatment goals Current medication Managing SEs Other
  55. 55. •  Multiple overlays per trigger possible •  Can update overlays without needing to update app •  Cross platform
  56. 56. QUESTIONS? Thanks for listening