THROUGH THE LOOKING GLASS:
RETHINKING MOBILE IN THE AGE OF WEARABLES AND AUGMENTATION
Michele Perras, Vice President Strat...
SHAPING THE FUTURE OF DIGITAL HEALTH

35 WEEKS: THE MORNING ROUTINE

The advent of mobile and wearable technologies
promis...
SHAPING THE FUTURE OF DIGITAL HEALTH

THE EARLY MORNING WAKE UP CALL

Let’s observe how such devices and systems
might aug...
SHAPING THE FUTURE OF DIGITAL HEALTH

THE MORNING
ROUTINE:
DIAGNOSTICS

Using her Scanadu she records her body temp,
heart...
THE MORNING ROUTINE:
WEIGH-IN

SHAPING THE FUTURE OF DIGITAL HEALTH

Michele weighs herself on her smart scale which has
t...
SHAPING THE FUTURE OF DIGITAL HEALTH

At her last appointment, Michele complained of
heart palpitations. Her doctor prescr...
SHAPING THE FUTURE OF DIGITAL HEALTH

THE MORNING ROUTINE:
GLUCOSE MONITORING

She was diagnosed with Gestational Diabetes...
SHAPING THE FUTURE OF DIGITAL HEALTH

A FRIENDLY REMINDER

Michele’s smartwatch vibrates to let her know that she
needs to...
SHAPING THE FUTURE OF DIGITAL HEALTH

THE CONSULTATION
SHAPING THE FUTURE OF DIGITAL HEALTH

A NEW DAY

Wearable technologies are also augmenting
the healthcare practitioner's r...
SHAPING THE FUTURE OF DIGITAL HEALTH

Dr. Jay walks to the teaching hospital
for his day of appointments
SHAPING THE FUTURE OF DIGITAL HEALTH

Great job Dr. Goldman.
You’ve reached your daily
NikeFuel goal.
FUEL 2150
CALS 4750
...
SHAPING THE FUTURE OF DIGITAL HEALTH

Wearing Glass, he reviews his first patient’s
EHR prior to their consultation

9:25
...
SHAPING THE FUTURE OF DIGITAL HEALTH

THE INTERACTIVE
CONSULTATION
SHAPING THE FUTURE OF DIGITAL HEALTH

Michele and Dr Jay review her data and discuss her
progress through a transparent fl...
SHAPING THE FUTURE OF DIGITAL HEALTH

CO-CONSULTATION WITH DR. GREG

Dr Jay seeks the opinion of his cardiac specialist
co...
SHAPING THE FUTURE OF DIGITAL HEALTH

RECEIVING DATA

Dr. Greg receives and reviews the data
via his IMEC smart contact le...
SHAPING THE FUTURE OF DIGITAL HEALTH

PROJECTING DATA
AND RELAYING ANALYSIS

Dr. Greg confirms that there are no issues ba...
SHAPING THE FUTURE OF DIGITAL HEALTH

CONSULTATION
AND WRAPUP

Having received Dr. Greg’s response, Dr. Jay
immediately sh...
SHAPING THE FUTURE OF DIGITAL HEALTH

CONSIDER
THIS FUTURE
Image: http://avatar.wikia.com/wiki/File:Future_city_final_high...
THIS IS TODAY!
(OR VERY CLOSE TO IT)
SHAPING THE FUTURE OF DIGITAL HEALTH

ALL TECHNOLOGY AUGMENTS OUR EXPERIENCES

If you have a smartphone, you are already a...
Augmented reality (AR) was once envisioned as obtrusive
and isolating. Today AR is focused
on being intermediated by small...
Smartphones have enabled the proliferation of AR though
apps that layer geolocation, search, social
and other contextual d...
Glass merges the literal in-your-face approach of traditional
AR with the data and network capabilities we now expect
from...
These are quickly becoming normal experiences.
Your daily reality augmented through technology
Beyond the handset, data interfaces layered on various
surfaces will be the norm. Even today,
many 3 yr olds use tablets t...
Embodied Computing is here with ‘tattooed electronics’ that
may usher in a new type of augmented experience tied
directly ...
STATE OF THE AUGMENTED NATION
PERIPHERALS
Wearables revolutionize the frequency of
data collection: snapshots vs. continuous

FREQUENCY
HEADS-UP
Head mounted devices revolutionize our
interactions with data: Touch, Talk, Tilt & Target

INTERACTION
ADHESIVES, INGESTABLES, INJECTABLES
Biotech and nanotech revolutionize the
fidelity of data collection: we can measure at site
FIDELITY
SHAPING THE FUTURE OF DIGITAL HEALTH

CONSIDERATIONS

What are the common themes to be
considered with these technologies?
SHAPING THE FUTURE OF DIGITAL HEALTH

DATA
TRANSMISSION
POWER SOURCE
NETWORKING
CONTEXT OF USE
PURPOSE
We are still at the Innovator / Early Adopter stage
SHAPING THE FUTURE OF DIGITAL HEALTH

BEHAVIORAL SPECTRUM OF AUGMENTED TECH
PASSIVE TRACKING

INTERACTIVITY

SEMI-AUTONOMO...
SHAPING THE FUTURE OF DIGITAL HEALTH

PURSUING THE PLATFORM

69%

46%

of US adults are currently
tracking health indicato...
SHAPING THE FUTURE OF DIGITAL HEALTH

BIG CHOICES:
TO AUGMENT OR NOT?

What will be deemed a necessity,
http://bit.ly/dbs-...
SHAPING THE FUTURE OF DIGITAL HEALTH

PRIVACY

Business and culture will continue to test the boundaries
SHAPING THE FUTURE OF DIGITAL HEALTH

WHAT’S BIG DATA IN A WEARABLE, AUGMENTED
WORLD?

Who gets access to each person’s ‘d...
SHAPING THE FUTURE OF DIGITAL HEALTH

WHAT’S MRL IN A WEARABLE, AUGMENTED WORLD?

Regulatory bodies are slowly adapting
SHAPING THE FUTURE OF DIGITAL HEALTH

SO WHAT?

What are the opportunities to deliver healthcare
innovations in the next 2...
SHAPING THE FUTURE OF DIGITAL HEALTH

EHR

OPPORTUNITY: HCP ENGAGEMENT
SHAPING THE FUTURE OF DIGITAL HEALTH

OPPORTUNITY: CO-DIAGNOSIS

Patient driven tracking and real time HCP collaboration
SHAPING THE FUTURE OF DIGITAL HEALTH

OPPORTUNITY: SURGICAL SUPPORT AND TEACHING
SHAPING THE FUTURE OF DIGITAL HEALTH

OPPORTUNITY: EARLY DIAGNOSIS
SHAPING THE FUTURE OF DIGITAL HEALTH

OPPORTUNITY: ADHERENCE AND SUPPORT
SHAPING THE FUTURE OF DIGITAL HEALTH

CHALLENGE: VALUE BEYOND THE PILL

Support tools and services which augment / enhance...
SHAPING THE FUTURE OF DIGITAL HEALTH

CHALLENGE: COMPLIANCE AND REGULATORY

How will regulatory bodies which are purposefu...
SHAPING THE FUTURE OF DIGITAL HEALTH

WHEN?
NOW — SOME THINGS ARE ALREADY HERE
WELCOME TO
THE FUTURE!
Upcoming SlideShare
Loading in …5
×

Digital Pharma East: Through the looking glass

985 views
870 views

Published on

What is the near future of quantified self technologies migrating into mainstream healthcare?

Published in: Health & Medicine, Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
985
On SlideShare
0
From Embeds
0
Number of Embeds
219
Actions
Shares
0
Downloads
31
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide
  • Michele wakes up the morning of her third trimester OB appt.
  • As with every morning, the first thing she does is place her Scanadu to her forehead to measure her body temp, heart stats and blood pressure, and sends this info to her EHR, shared with her OB. (shoot with overlay of scanadu)
  • As with every morning, the first thing she does is place her Scanadu to her forehead to measure her body temp, heart stats and blood pressure, and sends this info to her EHR, shared with her OB. (shoot with overlay of scanadu)
  • Michele also weighs herself on her Withings, her weight at 32 weeks pregnant is also tracked and added to her EHR to ensure her baby’s health. (stock of feet on withings)
  • At her last appointment, Michele complained of heart palpitations, and has been wearing Nuvant to track any arrhythmia.
    Measures - FLUID in interstitial cells, ECG, Temperature, Heartrate, Respitory Rate
  • Because she was diagnosed with Gestational Diabetes at 27 weeks, she also measures her glucose and takes her daily oral medication. Her treatment is also transmitted - her glucose is measured with her iPhone and her oral meds are digitized, submitting data on time of consumption to her EHR. (shoot [reading iphone] and stock [glucose strip, proteus if available])
  • Her Pebble watch vibrates and lets her know that she needs to leave to get to her Drs appt. (shoot - me reading pebble)
  • They are pleased to see her diabetes is being managed well, but there is some concern with the heart palpitations and arrhythmia. Using Glass, he sends the charts to Dr Greg (shot of Glass with sending message).
  • Dr Jay walks to the teaching hospital for his day of OB appointments.
  • On the way, his Nike+ FuelBand lets him know that he’s achieved his weekly activity goal by displaying a notification on Glass. (shoot jay with nike Outside, and stock of Glass with FuelBand notification)
  • Wearing Glass, he reviews his first patient’s EHR prior to their consultation. (stock of glass reviewing EHR mock)
  • In the consultation, Michele and Dr Jay discuss her health over the last two weeks and review her data together. (shoot - discussion over holographic display of 3D ultrasound)
  • In the consultation, Michele and Dr Jay discuss her health over the last two weeks and review her data together. (shoot - discussion over holographic display of 3D ultrasound)
  • They are pleased to see her diabetes is being managed well, but there is some concern with the heart palpitations and arrhythmia. Using Glass, he sends the charts to Dr Greg (shot of Glass with sending message).
  • He reviews the data via his IMEC lens, noting no unusual symptoms. (Shoot of greg with overlay of IMEC lens projecting ECG)
  • He reviews the data via his IMEC lens, noting no unusual symptoms. (Shoot of greg with overlay of IMEC lens projecting ECG)
  • Having received Dr Greg’s recommendation immediately, Dr Jay discusses options for reducing stress with Michele. They wrap up the appt. (Shoot of happy people)
  • IF YOU HAVE A SMARTPHONE, YOU ARE ALREADY AUGMENTED, A COMPUTER, ETC.
  • Most augmented reality work has historically focused on heads-up displays - funny hat AR that is obtrusive and focused on micro-interactions. The rising trend over the last decade has brought a new focus - AR intermediated by small screens.
  • The explosion of smartphones has encouraged a proliferation of augmented reality supported by hand held devices - apps that bring a user geolocation, search, social, content, services, etc - literally in the palm of their hands.
    Last month Nokia launched ‘Internships Lens’ which leverages AR and social networks to point students to nearby opportunities.
  • Which in turn have led to recent innovations like Glass. Glass merges the literally in-your-face approach of traditional AR (although slightly sexier looking) with the capabilities of networked computing, data and services.
  • The point being is that these are quickly becoming normal experiences - to have your daily reality augmented through technology
  • EMBODIED COMPUTING
    - INCORPORATING BIOLOGY, PHARMACOLOGY, NANOTECHNOLOGY, ELECTRONICS AND OTHER DOMAINS
    - TYING THEM TOGETHER WITH HUMAN-COMPUTER INTERACTION AND CREATING NEW TYPES OF AUGMENTED EXPERIENCES THAT DIRECTLY INTEGRATE WITH THE BODY
    - Harvard researchers are investigating how to harness body's own energy (motion - piezoelectric, heat, inner ear) to power medical devices. 5 years out from a human trial.
    MIT and Harvard researchers have demonstrated in guinea pigs that they can use the energy produced by the inner ear to power tiny sensors.
    The ear converts a mechanical force — the vibration of the eardrum — into an electrochemical signal that can be processed by the brain; the biological battery is the source of that signal’s current. Located in the part of the ear called the cochlea, the battery chamber is divided by a membrane, some of whose cells are specialized to pump ions. An imbalance of potassium and sodium ions on opposite sides of the membrane, together with the particular arrangement of the pumps, creates an electrical voltage.
  • Revolutionizes data frequency: snapshots vs. continuous
  • Revolutionizes data interactions: TOUCH, TALK, TILT & TARGET
  • Revolutionizes data fidelity
  • CONSIDERING THE COMMON THEMES OF THESE TECHNOLOGIES
  • CONSIDERING THE COMMON THEMES OF THESE TECHNOLOGIES
  • WHAT’S NORMAL NOW AND HOW WILL IT BE NORMALIZED IN THE NEXT 5 YEARS?
    PASSIVE TRACKING: IT TRACKS BASIC DATA SUCH AS A SWIPE IN/OUT. NOT SEEING TOO MUCH HERE/
    INTERACTIVITY: TRACKING + CAPABILITY TO EXCHANGE DATA/INFORMATION
    SEMI-AUTONOMOUS: CAN PROCESS DATA, TAKE APPROPRIATE ACTION
    FULL AUTONOMY: MAKE DECISIONS BASED ON DATA INPUTS AND CONTEXT.
    crossing the chasm>> early adopter to majority.
    what becomes the new normal. rate of crossing the chasm.
  • LOOKING AT THE SOCIAL AND TECHNOLOGICAL NORMS: FISH WHERE THE FISH ARE, WHAT ARE THE FISH DOING? HOW TO ENABLE THEIR BEHAVIORS?
  • despite your initial reaction, this will very quickly become the new normal. see smartphone adoption.
    more ppl have access to cell phones than toilets - consider a cellphone as form of augmentation.
    smartphone comment, aimee mullins, andrew johnson
  • FACIAL RECOGNITION: GOOGLE IS NO, MICROSOFT IS YES.
  • what kind of data stream does that put around you?
    user name / reputation / level, etc.
    eBay reputation for the real world - complete picture of them. Want a model with access with
  • MRL AND COMPLIANCE: WE ARE CURRENTLY GOING THROUGH A RENAISSANCE IN TECHNOLOGY AND WE ARE SLOWLY SEEING REGULATORY BODIES ADAPT.
    AS USERS FREELY GIVE UP MORE DATA IN EXCHANGE FOR BETTER SERVICES IN THE CONSUMER WORLD, WHAT ARE THE IMPLICATIONS IN HEALTH AND MEDICINE?
  • SO WHAT DOES ALL OF THIS MEAN TO US AND OUR CLIENTS?
    - CALL TO ARMS IN DRIVING THE DELIVERY OF NEW INNOVATIONS
    - WHAT ARE THE OPPORTUNITIES IN THE NEXT 2 YEARS, THE NEXT 5?
  • LEVERAGING PATIENT-DRIVEN TRACKING/SEARCH, REAL TIME HCP COLLABORATION.
  • DR GROSSMAN: GLASS SURGEON (Eastern Maine Medical Center)
    INSTITUTE FOR COMPUTER GRAPHICS AND VISION: LIVER SURGERY PLANNING SYSTEM
  • ABILITY TO TAKE ADVANTAGE OF TECH TO AID IN EARLY DIAGNOSIS
    LGT MEDICAL’S PHONE OXIMETER
  • Digital Pharma East: Through the looking glass

    1. 1. THROUGH THE LOOKING GLASS: RETHINKING MOBILE IN THE AGE OF WEARABLES AND AUGMENTATION Michele Perras, Vice President Strategy / Klick Health Jay Goldman, Managing Director / Klick Health Keith Liu, Vice President Labs / Klick Health
    2. 2. SHAPING THE FUTURE OF DIGITAL HEALTH 35 WEEKS: THE MORNING ROUTINE The advent of mobile and wearable technologies promises to change the healthcare experience
    3. 3. SHAPING THE FUTURE OF DIGITAL HEALTH THE EARLY MORNING WAKE UP CALL Let’s observe how such devices and systems might augment the morning routine of our expectant mother Michele…
    4. 4. SHAPING THE FUTURE OF DIGITAL HEALTH THE MORNING ROUTINE: DIAGNOSTICS Using her Scanadu she records her body temp, heart rate and blood pressure then sends this data to the EHR shared with her OB
    5. 5. THE MORNING ROUTINE: WEIGH-IN SHAPING THE FUTURE OF DIGITAL HEALTH Michele weighs herself on her smart scale which has tracked her progress over the last 35 weeks and has sent this data to her mobile and her EHR
    6. 6. SHAPING THE FUTURE OF DIGITAL HEALTH At her last appointment, Michele complained of heart palpitations. Her doctor prescribed the Nuvant PiiX to track any arrhythmia THE MORNING ROUTINE: ARRHYTHMIA AND ECG
    7. 7. SHAPING THE FUTURE OF DIGITAL HEALTH THE MORNING ROUTINE: GLUCOSE MONITORING She was diagnosed with Gestational Diabetes at 27 wks. She measures her glucose using an app and smartphone accessory. This data along with her medication log is uploaded to her EHR
    8. 8. SHAPING THE FUTURE OF DIGITAL HEALTH A FRIENDLY REMINDER Michele’s smartwatch vibrates to let her know that she needs to leave to get to her doctor’s appointment
    9. 9. SHAPING THE FUTURE OF DIGITAL HEALTH THE CONSULTATION
    10. 10. SHAPING THE FUTURE OF DIGITAL HEALTH A NEW DAY Wearable technologies are also augmenting the healthcare practitioner's routine
    11. 11. SHAPING THE FUTURE OF DIGITAL HEALTH Dr. Jay walks to the teaching hospital for his day of appointments
    12. 12. SHAPING THE FUTURE OF DIGITAL HEALTH Great job Dr. Goldman. You’ve reached your daily NikeFuel goal. FUEL 2150 CALS 4750 STEPS 4750 TIME 9:30 am His Nike+ FuelBand alerts him to reaching his activity goal by displaying a notification on his Glass
    13. 13. SHAPING THE FUTURE OF DIGITAL HEALTH Wearing Glass, he reviews his first patient’s EHR prior to their consultation 9:25 “ok glass” PATIENT EHR REVIEW
    14. 14. SHAPING THE FUTURE OF DIGITAL HEALTH THE INTERACTIVE CONSULTATION
    15. 15. SHAPING THE FUTURE OF DIGITAL HEALTH Michele and Dr Jay review her data and discuss her progress through a transparent flexible display THE INTERACTIVE CONSULTATION
    16. 16. SHAPING THE FUTURE OF DIGITAL HEALTH CO-CONSULTATION WITH DR. GREG Dr Jay seeks the opinion of his cardiac specialist colleague Dr. Greg, who is currently located in another part of the clinic
    17. 17. SHAPING THE FUTURE OF DIGITAL HEALTH RECEIVING DATA Dr. Greg receives and reviews the data via his IMEC smart contact lens
    18. 18. SHAPING THE FUTURE OF DIGITAL HEALTH PROJECTING DATA AND RELAYING ANALYSIS Dr. Greg confirms that there are no issues based on the ECG and relays the good news
    19. 19. SHAPING THE FUTURE OF DIGITAL HEALTH CONSULTATION AND WRAPUP Having received Dr. Greg’s response, Dr. Jay immediately shares this with Michele and they wrap up
    20. 20. SHAPING THE FUTURE OF DIGITAL HEALTH CONSIDER THIS FUTURE Image: http://avatar.wikia.com/wiki/File:Future_city_final_high_resolution_desktop_2048x1103_hd-wallpaper-571096.jpg
    21. 21. THIS IS TODAY! (OR VERY CLOSE TO IT)
    22. 22. SHAPING THE FUTURE OF DIGITAL HEALTH ALL TECHNOLOGY AUGMENTS OUR EXPERIENCES If you have a smartphone, you are already augmented
    23. 23. Augmented reality (AR) was once envisioned as obtrusive and isolating. Today AR is focused on being intermediated by small screens…
    24. 24. Smartphones have enabled the proliferation of AR though apps that layer geolocation, search, social and other contextual data onto the handset
    25. 25. Glass merges the literal in-your-face approach of traditional AR with the data and network capabilities we now expect from phones and mobiles devices
    26. 26. These are quickly becoming normal experiences. Your daily reality augmented through technology
    27. 27. Beyond the handset, data interfaces layered on various surfaces will be the norm. Even today, many 3 yr olds use tablets through guestures A Day Made of Glass http://bit.ly/corning-future
    28. 28. Embodied Computing is here with ‘tattooed electronics’ that may usher in a new type of augmented experience tied directly to our bodies EPIDERMAL ELECTRONICS
    29. 29. STATE OF THE AUGMENTED NATION
    30. 30. PERIPHERALS
    31. 31. Wearables revolutionize the frequency of data collection: snapshots vs. continuous FREQUENCY
    32. 32. HEADS-UP
    33. 33. Head mounted devices revolutionize our interactions with data: Touch, Talk, Tilt & Target INTERACTION
    34. 34. ADHESIVES, INGESTABLES, INJECTABLES
    35. 35. Biotech and nanotech revolutionize the fidelity of data collection: we can measure at site FIDELITY
    36. 36. SHAPING THE FUTURE OF DIGITAL HEALTH CONSIDERATIONS What are the common themes to be considered with these technologies?
    37. 37. SHAPING THE FUTURE OF DIGITAL HEALTH DATA TRANSMISSION POWER SOURCE NETWORKING CONTEXT OF USE PURPOSE
    38. 38. We are still at the Innovator / Early Adopter stage
    39. 39. SHAPING THE FUTURE OF DIGITAL HEALTH BEHAVIORAL SPECTRUM OF AUGMENTED TECH PASSIVE TRACKING INTERACTIVITY SEMI-AUTONOMOUS INTEGRATION FULL AUTONOMY THE NEW NORMAL What is normal now and what will it be normalized in the next 5 years?
    40. 40. SHAPING THE FUTURE OF DIGITAL HEALTH PURSUING THE PLATFORM 69% 46% of US adults are currently tracking health indicators say this activity has changed their overall approach to managing their health
    41. 41. SHAPING THE FUTURE OF DIGITAL HEALTH BIG CHOICES: TO AUGMENT OR NOT? What will be deemed a necessity, http://bit.ly/dbs-parkinson a luxury, or a competitive (unfair?) advantage?
    42. 42. SHAPING THE FUTURE OF DIGITAL HEALTH PRIVACY Business and culture will continue to test the boundaries
    43. 43. SHAPING THE FUTURE OF DIGITAL HEALTH WHAT’S BIG DATA IN A WEARABLE, AUGMENTED WORLD? Who gets access to each person’s ‘data bubble’ as these bubbles grow exponentially? PROPRIETARY + CONFIDENTIAL
    44. 44. SHAPING THE FUTURE OF DIGITAL HEALTH WHAT’S MRL IN A WEARABLE, AUGMENTED WORLD? Regulatory bodies are slowly adapting
    45. 45. SHAPING THE FUTURE OF DIGITAL HEALTH SO WHAT? What are the opportunities to deliver healthcare innovations in the next 2 years? The next 5 year?
    46. 46. SHAPING THE FUTURE OF DIGITAL HEALTH EHR OPPORTUNITY: HCP ENGAGEMENT
    47. 47. SHAPING THE FUTURE OF DIGITAL HEALTH OPPORTUNITY: CO-DIAGNOSIS Patient driven tracking and real time HCP collaboration
    48. 48. SHAPING THE FUTURE OF DIGITAL HEALTH OPPORTUNITY: SURGICAL SUPPORT AND TEACHING
    49. 49. SHAPING THE FUTURE OF DIGITAL HEALTH OPPORTUNITY: EARLY DIAGNOSIS
    50. 50. SHAPING THE FUTURE OF DIGITAL HEALTH OPPORTUNITY: ADHERENCE AND SUPPORT
    51. 51. SHAPING THE FUTURE OF DIGITAL HEALTH CHALLENGE: VALUE BEYOND THE PILL Support tools and services which augment / enhance a treatment are becoming competitive differentiators but this will eventually become the norm
    52. 52. SHAPING THE FUTURE OF DIGITAL HEALTH CHALLENGE: COMPLIANCE AND REGULATORY How will regulatory bodies which are purposefully measured in their pace to adopt new trends going handle this?
    53. 53. SHAPING THE FUTURE OF DIGITAL HEALTH WHEN? NOW — SOME THINGS ARE ALREADY HERE
    54. 54. WELCOME TO THE FUTURE!

    ×