KEYNOTE AT HxD 2021.
Overall Message:
A. Effectiveness is the most important differentiator between digital health offerings
B. Everyone in digital health should be evaluating their offerings
3 Key Takeaways:
1. We are rapidly moving towards effectiveness as the key differentiator in digital health
2. Apps need to be evaluated throughout the design process
3. There are things you can and should do now to make your life easier and Your apps better
Find out more inside!
11. Larsen, M.E., Huckvale, K., Nicholas, J. et al. Using science to sell apps: Evaluation of mental health app store quality claims. npj Digit. Med. 2, 18 (2019).
DIGITAL
MENTAL
HEALTH
64%
CLAIMED EFFECTIVENESS AT
DIAGNOSING MENTAL
HEALTH CONDITION OR
IMPROVING SYMPTOMS
12. Larsen, M.E., Huckvale, K., Nicholas, J. et al. Using science to sell apps: Evaluation of mental health app store quality claims. npj Digit. Med. 2, 18 (2019).
DIGITAL
MENTAL
HEALTH
3%
COULD BACK IT UP WITH
EVIDENCE
25. DIGITAL HEALTH
DIGITAL MEDICINE
DIGITAL THERAPEUTICS
Digital therapeutic (DTx) products
deliver clinically evaluated,
evidence-based therapeutic
interventions to treat, manage, or
precent a broad spectrum of
diseases and disorders.
Digital medicine includes
evidence-based software
and/or hardware products
that measure and/or
intervene in the service of
human health.
Digital health technologies,
platforms and systems that
engage consumers for
lifestyle, wellness, and
health-related purposes;
capture store or transmit
health data; and/or
support life science and
clinical operations.
Clinical evidence is
required for all digital
medicine products
Clinical evidence and real-world
outcomes are required for all
digital medicine products.
Clinical evidence is
not required.
27. STANDARDS, FRAMEWORKS, & REGULATIONS
TO BE INCLUDED IN A HEALTHCARE SYSTEM FORMULARY OR PRESCRIBED BY AN MD,
YOUR APP MUST:
• DEMONSTRATE CLINICAL EFFICACY (OR PATIENT-RELATED IMPROVEMENTS) AND SAFETY;
• BE USABLE, ACCESSIBLE, AND INTEROPERABLE WITH HEALTH SYSTEM INFRASTRUCTURE;
• HOLD A HIGH STANDARD FOR DATA SECURITY AND PRIVACY.
28. STANDARDS, FRAMEWORKS, & REGULATIONS
• A NUMBER OF APP RATING FRAMEWORKS HAVE EMERGED
• PAYORS/PROVIDERS CREATING FORMULARIES OF EFFECTIVE,
SAVE, AND TRUSTWORTHY DIGITAL HEALTH APPS AND SERVICES
29. WHAT COULD WE
BE DOING?
CONSIDERING EVALUATION
AN INTEGRAL, DE FACTO
PART OF YOUR DESIGN
PROCESS
INCLUDE EVALUATION
ACTIVITIES THROUGHOUT THE
ENTIRE DEVELOPMENT CYCLE
FROM THE EARLIEST
CONCEPTING ONWARDS
START BY:
30. QUALITATIVE EVALUATIONS:
MORE THAN RCTS
TO UNDERSTAND HOW PEOPLE EXPERIENCE OR FEEL ABOUT YOUR PRODUCT OR SERVICE.
GATHERING RICH DATA THROUGH SMALL SAMPLES. *YOU ARE PROBABLY ALREADY DOING THIS.
[ACCEPTABILITY, USABILITY]
DESCRIPTIVE EVALUATIONS:
TO UNDERSTAND WHAT’S GOING ON. HOW MANY PEOPLE ARE USING YOUR SERVICE, HOW OFTEN DO
THEY USE IT? HOW LONG DO THEY STAY ENGAGED, WHAT DO THEY USE? [PROCESS, ENGAGEMENT]
ECONOMIC EVALUATIONS:
TO ASSESS COST-BENEFIT ANALYSIS FOR YOUR PRODUCT COMPARED TO AVAILABLE ALTERNATIVES. OR
LIKELY COST-IMPLICATIONS OF ROLLING OUT/ADOPTING YOUR PRODUCT. [ECONOMIC EVALUATIONS]
COMPARATIVE EVALUATIONS:
BUT ALSO RCTS
TO UNDERSTAND WHETHER OR NOT YOUR PRODUCT IS WORKING AS INTENDED.
[EFFICACY, EFFECTIVENESS]
32. HOW MIGHT WE
GET STARTED?
START BY CREATING A MODEL OF YOUR PRODUCT OR SERVICE
OUTCOMES
BEHAVIORS
BEHAVIORAL
DETERMINANTS
BEHAVIOR
CHANGE
TECHNIQUES
PRODUCT /
SERVICE
FEATURE
(CONTENT)
33. REDUCED HIV
VIRAL LOAD
REDUCE
ALCOHOL
USE
ART / PREP
ADHERENCE
INTENTIONS
(TO REDUCE)
INTENTIONS
(TO MAINTAIN)
HEALTH BELIEFS
MODELING THE
BEHAVIOR
SOCIAL
SUPPORT
MENTAL HEALTH
STATUS
BEHAVIORAL
SKILLS
COMPONENT 1
MOTIVATIONAL
INTERVIEWING
COMPONENT 2
PEER
MENTORNING
COMPONENT 3
TEXT MSSGING
COMPONENT 4
MINDFUL
MEDITATION
COMPONENT 5
BEHAVIORAL
SKILLS
TRAINING
OUTCOME
BEHAVIOR
BEHAVIORAL DETERMINANT
PRODUCT COMPONENT
34. IN SUMMARY
1. WE ARE RAPIDLY MOVING TOWARDS EFFECTIVENESS AS THE KEY
DIFFERENTIATOR IN DIGITAL HEALTH.
2. DIGITAL HEALTH PRODUCTS AND SERVICES NEED TO BE EVALUATED
THROUGHOUT THE DESIGN PROCESS (FOR A HOST OF REASONS).
3. THERE ARE A NUMBER OF EVALUATION OPTIONS FOR GATHERING
EVIDENCE ABOUT IF, HOW, AND WHY YOUR PRODUCT WORKS.
4. THERE ARE THINGS YOU CAN AND SHOULD DO NOW LIKE CREATING A
MODEL THAT WILL HELP YOU BE MORE EFFECTIVE IN YOUR ABILITIES TO BE
MORE EFFECTIVE.