SlideShare a Scribd company logo
Motivation
Facilitation
Co-
Calibration
PhD Defence
Vlad Manea
Quality of Life
Technologies Lab
University of Copenhagen
From Participation Factors to Co-Calibration of Patient- and Wearable-Reported
Outcomes in Behavioural, Health, and Quality of Life Studies
PhD Thesis Defence • April 14th
, 2021 • University of Copenhagen
Candidate
Vlad Manea
Københavns Universitet, Copenhagen, Denmark
Committee
Professor Nancy E. Mayo
McGill University, Montreal, Canada
Professor Bert Arnrich
Universität Potsdam, Potsdam, Germany
Professor Thomas T. Hildebrandt
Københavns Universitet, Copenhagen, Denmark
Quality of Life Technologies Lab
Human-Centered Computing / Computer Science / Science
University of Copenhagen | Københavns Universitet
Supervisor
Professor Katarzyna Wac
Université de Genève, Geneva, Switzerland
Københavns Universitet, Copenhagen, Denmark
12:45-13:05: Preparation
13:05-13:50: Presentation
13:50-14:00: Break
14:00-15:30: Discussion
15:30-15:45: Votation
15:45-16:00: Reception
Agenda for the Day
Agenda for the Presentation
Part 1
Motivation and Facilitation of
Human Subject Study
Participation
Part 2
Co-Calibration of Behavioural,
Health, and Quality of Life
Outcomes
Introduction
Conclusions
Introduction
Primary Causes of Mortality: Chronic Diseases
Introduction
Chronic diseases
Common examples:
- Cardiovascular
- Respiratory
- Metabolic
- Digestive
- Mental
Roth, G.A., et al., 2018. Global, regional, and national age-sex-specific mortality for 282
causes of death in 195 countries and territories, 1980–2017: a systematic analysis for
the Global Burden of Disease Study 2017. The Lancet, 392(10159).
Risk Factors for Chronic Diseases: Behaviours
Introduction
Behavioural pattern Risk
Smoking habits 18.1%
Poor diet
Physical inactivity
16.6%
Alcohol consumption 3.5%
Inadequate sleep ...
{
Mokdad, A.H., Marks, J.S., Stroup, D.F. and Gerberding, J.L., 2004. Actual causes of
death in the United States, 2000. Jama, 291(10).
Roth, G.A., et al., 2018. Global, regional, and national age-sex-specific mortality for 282
causes of death in 195 countries and territories, 1980–2017: a systematic analysis for
the Global Burden of Disease Study 2017. The Lancet, 392(10159).
Introduction
From Behaviours to Reported Outcomes
Mayo, N.E., Figueiredo, S., Ahmed, S. and Bartlett, S.J., 2017. Montréal Accord on
Patient-Reported Outcomes (PROs) use series–Paper 2: Terminology proposed to
measure what matters in health. Journal of clinical epidemiology, 89.
Introduction
Patient-Reported Outcome (PRO) Example
During the past month,
how often have you had
trouble sleeping because
you wake up in the middle
of the night or early
morning?
Buysse, D.J., Reynolds III, C.F., Monk, T.H., Berman, S.R. and Kupfer,
D.J., 1989. The Pittsburgh Sleep Quality Index: a new instrument for
psychiatric practice and research. Psychiatry research, 28(2).
Challenges with Patient-Reported Outcomes
Introduction
infrequent
subjective
memory-
based
socially
acceptable
qualitative
? What happens between the visits at the doctor?
often
1-dimensional
out of
context
Measure behaviours
from daily life
Over 430 wearables
available (2018)
Mobiles & Wearables
Introduction
Wac, K., 2018. From quantified self to quality of life. In
Digital Health. Springer, Cham.
Dey, A.K., Wac, K., et al. 2011. Getting closer: an
empirical investigation of the proximity of user to their
smart phones. In Proceedings of the 13th UbiComp.
Grossman, L. and Vella, M. 2014. Never Offline. TIME,
September 22.
Mobiles in our
proximity 88% time
Technology-Reported Outcome (TechRO) Examples
Introduction
Physical Activity
steps, elevation, distance, calories
Heart Rate
normal, moderate, fast, too fast
Sleep
total, in bed, score, interruptions, heart rate
Heart Activity
electrocardiogram
Behavioural Markers
What happens between the visits at the doctor?
Behaviours can be reported during daily life.
Opportunities with Technology-Reported Outcomes
Introduction
quantitative
?
objective continuous
sensor-based
in context
longitudinal
non-judgemental
frequent
multi-dimensional
✓
Mayo, N.E., Figueiredo, S., Ahmed, S. and Bartlett, S.J., 2017. Montréal Accord on
Patient-Reported Outcomes (PROs) use series–Paper 2: Terminology proposed to
measure what matters in health. Journal of clinical epidemiology, 89.
Introduction
Co-Calibrating Reported Outcomes
PROs TechROs
Emerging
?
?
Co-Calibration
Gold Standard
Introduction
A Quick Reality Check
PROs TechROs
? Why participate in studies in the first place?
Introduction
Understanding Participation
Motivation Facilitation
? Why participate in studies in the first place?
✓Need more research to understand participation.
Part 1
Motivation and Facilitation of
Human Subject Study Participation
Part 1
Motivation and
Facilitation of Human
Subject Study
Participation
Background
Methods
Results
Reflections
Contributions
Community
Absent models to assess
study participation
Studies
Limited data quality
from / to participants
Participants
Different reasons to
participate in research
Challenges
Motivation and Facilitation of Human Studies / Background
Objectives
Motivation and Facilitation of Human Studies / Background
Review literature on
participation
1
Propose model and
framework designs
2
Extend mQoL-Lab
platform
3
Part 1
Motivation and
Facilitation of Human
Subject Study
Participation
Background
Methods
Results
Reflections
Contributions
Activities
Motivation and Facilitation of Human Studies / Methods
Literature review on
the motivation to
participate in studies
Information exchange
with researchers who
conduct studies
Model and framework
designs for study
participation
Software tools that
facilitate participation
in studies
Human Subject Studies
Longitudinal Studies
Health Studies
Literature Review on Participation
Motivation and Facilitation of Human Studies / Methods
Willingness factors to share
health data
Motivation factors to
participate
Human factors
Technical factors
Requirements Architectural design
Manea, V., Schnoor Hansen, M., Elbeyi, S.E. and Wac,
K., 2019. Towards personalizing participation in health
studies. In Workshop on Multimedia for Personal
Health & Health Care.
1
Manea, V. and Wac, K., 2018. mQoL: mobile quality of
life lab: from behavior change to QoL. Workshop on
Mobile Human Contributions.
2
Manea, V., Berrocal, A., De Masi, A., Møller, N.H.,
Wac, K., Bayer, H., Lehmann, S. and Ashley, E., 2019.
International workshop on longitudinal data collection
in human subject studies. In UbiComp Adjunct 2019.
3
Berrocal, A., Manea, V., De Masi, A. and Wac, K.,
2020. mQoL Lab: Step-by-Step Creation of a Flexible
Platform to Conduct Studies Using Interactive, Mobile,
Wearable and Ubiquitous Devices. MobiSPC 2020.
4
1
2
3
4
Challenges
Opportunities
Challenges
Opportunities
Electronic health records
Wearable data
Healthy participants
Diseased participants
Participants
Researchers
Data
Participants
System
Researchers
Layers
Features
Components
Part 1
Motivation and
Facilitation of Human
Subject Study
Participation
Background
Methods
Results
Reflections
Contributions
Factors Influencing the Motivation to Participate
Motivation and Facilitation of Human Studies / Results
Manea, V., Schnoor Hansen, M., Elbeyi, S.E. and Wac, K., 2019. Towards personalizing participation in health studies. In Workshop on Multimedia for Personal Health & Health Care.
May share electronic
health records
67% May share wearable
data from daily life
78% Altruism over health
and financial gains?
♡/$ No model to assess
motivation
?
1 2 3 4
Factors Influencing the Motivation to Participate
Motivation and Facilitation of Human Studies / Results
Manea, V., Schnoor Hansen, M., Elbeyi, S.E. and Wac, K., 2019. Towards personalizing participation in health studies. In Workshop on Multimedia for Personal Health & Health Care.
Helping others
Family
Friends
Acquaintances
Society
Personal benefits
Health
Information
Reward
Social
Topic of study
Organ
Process
Behavior
Quality of Life
Method of study
Delivery
Effort
Artefact
Data use
1 2 3 4
Information Exchange Workshop with Domain Experts
Motivation and Facilitation of Human Studies / Results
Manea, V., Berrocal, A., De Masi, A., Møller, N.H., Wac, K., Bayer, H., Lehmann, S. and Ashley, E., 2019, September. LDC'19: international workshop on longitudinal data
collection in human subject studies. In Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the
2019 ACM International Symposium on Wearable Computers.
Workshop on Longitudinal Data Collection
● Contributions and discussions
● Methods, tools, and frameworks
● Collection, analysis, and interpretation
● Mobile, wearable, and ubiquitous data
● Exclusive focus on longitudinal data
● Keynote by a domain expert (UCL)
● Affiliations: KU, DTU, UniGe, NYU, SU
● ldc2019ubicomp.wordpress.com
1 2 3 4
Chatbot Stories Facilitating Participation
Motivation and Facilitation of Human Studies / Results
Manea, V., Schnoor Hansen, M., Elbeyi, S.E. and Wac,
K., 2019, October. Towards personalizing participation
in health studies. In Proceedings of the 4th
International Workshop on Multimedia for Personal
Health & Health Care.
Personalized Stories
Personalization with stories and
moments relevant for the
participant
1 2 3 4
mQoL Mobile App Facilitating Participation
Motivation and Facilitation of Human Studies / Results
Manea, V. and Wac, K., 2018, October. mQoL: mobile quality of life lab: from behavior change to QoL. In Proceedings of the 2018 ACM International Joint Conference and 2018
International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers.
1 2 3 4
mQoL Mobile App Facilitating Participation
Motivation and Facilitation of Human Studies / Results
Manea, V. and Wac, K., 2018, October. mQoL: mobile quality of life lab: from behavior change to QoL. In Proceedings of the 2018 ACM International Joint Conference and 2018
International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers.
1 2 3 4
mQoL-Lab Platform Facilitating Participation
Motivation and Facilitation of Human Studies / Results
Berrocal, A., Manea, V., De Masi, A. and Wac, K., 2020. mQoL Lab: Step-by-Step Creation of a Flexible Platform to Conduct Studies Using Interactive, Mobile, Wearable and
Ubiquitous Devices. MobiSPC 2020.
1 2 3 4
Part 1
Motivation and
Facilitation of Human
Subject Study
Participation
Background
Methods
Results
Reflections
Contributions
Summary
Motivation and Facilitation of Human Studies / Reflections
Feasibility
Personalised studies may
help participation
Challenges
Challenges beyond
humans and technology
Factors
Families of factors without
relative importance
Part 1
Motivation and
Facilitation of Human
Subject Study
Participation
Background
Methods
Results
Reflections
Contributions
Objectives × Scientific Contributions
Motivation and Facilitation of Human Studies / Contributions
Thoroughly explored a research area
● Motivation and facilitation of participation in studies
Produced a presentational model
● Personalized stories model to motivate participation
Provided a unifying framework
● Mobile app design for longitudinal studies
● Chatbot design for health studies
Designed and developed a tool
● mQoL-Lab platform for human subject studies
Review literature on
participation
1
Propose model and
framework designs
2
Extend mQoL-Lab
platform
3
Part 2
Co-Calibration of Behavioural,
Health, and Quality of Life
Outcomes
Part 2
Co-Calibration of
Behavioural, Health, and
Quality of Life Outcomes
Background
Methods
Results
Reflections
Contributions
Project Goals
● Relieve caregiver pressure
● Increase participant wellbeing and autonomy
● Decrease participant risk of dementia
Context
Co-Calibration of Reported Outcomes / Background
Research Project
● AAL “Caregiver and ME” (CoME, No. 14-7)
○ 2015-2019
● For people of older age with mild impairment and their caregivers
○ Spain or Hungary, use a mobile phone
Livingston, G. et al. Dementia prevention, intervention, and care. Lancet 390.10113 (2017): 2673-2734.
Objectives
Co-Calibration of Reported Outcomes / Background
TechROs
Emerging
Gold Standard
PROs
?
Review the literature on
co-calibration
1
Review the literature on a
related QoL facet
2
Collect behavioural, health,
and Quality of Life PROs from
validated scales
3
Collect behavioural marker
TechROs using wearables
4
Assess quality properties of
the collected data
5
Observe PRO-TechRO
statistical relations
6
Derive a computational model
for co-calibration
7
Demonstrate the model's
feasibility in the study
8
Inform designs of future
longitudinal in situ studies
9
Part 2
Co-Calibration of
Behavioural, Health, and
Quality of Life Outcomes
Background
Methods
Results
Reflections
Contributions
Measures
● Age, gender, ethnicity, profession, education,
cohabitants, height, weight, blood pressure,
cholesterol, smoking status, alcohol status,
medication, mild disease status, etc.
Profiles of Participants
Co-Calibration of Reported Outcomes / Methods
Profile
● Filled during the first visit at the study site
● Updated along the duration of the project
Measures (Validated Scales)
● Physical Activity (IPAQ)
● Social Support (MSPSS)
● Anxiety/Depression (GADS)
● Nutrition (PREDIMED, SelfMNA)
● Memory (MFE)
● Sleep Quality (PSQI)
● Health-Related Quality of Life (EQ-5D-3L)
Measured Patient-Reported Outcomes
Co-Calibration of Reported Outcomes / Methods
Patient-Reported Measures (PROs)
● Filled during subsequent group visits
Measures (Daily Aggregates)
● Energy expenditure
● Steps
● Distance
● Sedentary duration
● Physical activity durations (light, fair, vigorous)
● Sleep duration
● Heart rate
Measured Technology-Reported Outcomes
Co-Calibration of Reported Outcomes / Methods
Devices (TechROs)
● Fitbit Charge 2 consumer wearable for ownership
Interval durations
7, 14, 21, 28, 60, 120 days
1.1
Step 3A
Select PRO variables
- item
- sub-score
- score
7
Step 3B
Select TechRO variables
absolute: median
relative: geometric mean of composition
(centered log ratio)
For each interval duration
Use a leeway between:
- PRO administration date, and
- TechRO interval end date
Allow maximum 1 alignment per wave
Obtain max. 1 alignment / duration / participant / wave / leeway
Step 2 Align in time
PRO-TechRO Alignment
Using a leeway of 0, 7, 14, 21, 28, 60, 90, 120 days
•
• • • • •
• • • •
6 4 ... 2 7
Health outcomes (scale) PRO
Behavioural markers (Fitbit) TechRO
Statistical Correlations
e.g., Spearman rS
0.75
7 1.1
2.1
...
6.2
...
4
...
5
...
Set of Pairs
PRO-TechRO Pair
7
1.1
Patterns of Correlations
TechRO j TechRO k
PRO i 0.75
0.55
Participants
Construct
PRO-TechRO
bivariate sets
Step 1A Compute
PRO scores
Step 1B Select
TechRO aggregations
Step 4 Inference
statistical hypothesis testing
Step 5 Patterns
from correlations to patterns
4
2 1 ... 1 3
5 6 3 1
Sub-score Numeric
score
Categorical
score
Sub-score Sub-score
Metrics for patterns
1. Count significant correlations 0.5+
- For all PROs and TechROs
2. Contours of significant correlations 0.8+
- For all PROs but only ordered TechROs
coQoL Computational Model for Co-Calibration
Co-Calibration of Reported Outcomes / Methods
Examples of Contour Correlations Metric |rS| ≥ 0.8
Co-Calibration of Reported Outcomes / Methods
Part 2
Co-Calibration of
Behavioural, Health, and
Quality of Life Outcomes
Background
Methods
Results
Reflections
Contributions
Participants (PRO)
Co-Calibration of Reported Outcomes / Results
Qualified
● N = 39 (age 70.0 ± 7.2)
○ At least one PRO or TechRO
○ 28 healthy, 11 with mild disease
Signed Up
● N = 42 (age 69.8 ± 7.4)
Co-Calibration of Reported Outcomes / Results
Waves of Answers
● Wave 1
○ Mid 2018
● Wave 2
○ End 2018
○ Start 2019
● Wave 3
○ Mid 2019
Data Quality: Waves of Answers
Physical Activity (IPAQ - Fitbit): Contours
Co-Calibration of Reported Outcomes / Results
Contours of PRO-TechRO correlations (0.8+)
● All participants
○ Domestic moderate
● Participants with mild disease
○ Work walking
○ Work moderate
○ Work vigorous
○ Garden vigorous
○ Leisure vigorous
○ Leisure total
Social Support (MSPSS - Fitbit): Contours
Co-Calibration of Reported Outcomes / Results
Contours of PRO-TechRO correlations (0.8+)
● All participants
○ Significant other social support
○ Family social support
● Healthy participants
○ Significant other social support
○ Family social support
○ Friends social support
Anxiety-Depression (GADS - Fitbit): Contours
Co-Calibration of Reported Outcomes / Results
Contours of PRO-TechRO correlations (0.8+)
● All participants
○ Q5A Sleeping poorly
● Healthy participants
○ Q7A Trembling
Mediterranean Diet (PREDIMED - Fitbit): Contours
Co-Calibration of Reported Outcomes / Results
Contours of PRO-TechRO correlations (0.8+)
● All participants
○ Q12 Nuts consumption
● Healthy participants
○ Q3 Vegetables consumption
Nutrition (SelfMNA - Fitbit): Contours
Co-Calibration of Reported Outcomes / Results
Contours of PRO-TechRO correlations (0.8+)
● Participants with mild disease
○ Q1 Food intake declined
○ Q2 Weight loss
○ Q4 Stressed or severely ill
Memory (MFE - Fitbit): Contours
Co-Calibration of Reported Outcomes / Results
Contours of PRO-TechRO correlations (0.8+)
● All participants
○ Q24 Forgetting where things are kept
● Healthy participants
○ Q14 Forgetting to do planned things
● Participants with mild disease
○ Q18 Forgetting to tell somebody
something important
Sleep Quality (PSQI - Fitbit): Contours
Co-Calibration of Reported Outcomes / Results
Contours of PRO-TechRO correlations (0.8+)
● All participants
○ Q5F trouble due to feeling cold
● Healthy participants
○ Q5C trouble due to use of the bathroom
● Participants with mild disease
○ Q4 duration of actual sleep
Quality of Life (EQ-5D-3L - Fitbit): Contours
Co-Calibration of Reported Outcomes / Results
Contours of PRO-TechRO correlations (0.8+)
● Participants with mild disease
○ Q5 Anxiety and depression
Part 2
Co-Calibration of
Behavioural, Health, and
Quality of Life Outcomes
Background
Methods
Results
Reflections
Contributions
Effects of Longitudinal Measurement
Co-Calibration of Reported Outcomes / Reflections
Example: MSPSS Q3 vs Relative Fair Activity
● A strong PRO-TechRO correlation (0.9)
○ “More family help ~ more fair activity”
○ PRO: MSPSS Q3 family trying to help
○ TechRO: relative fair physical activity
● Effect of interval and leeway on corrs.
○ correlates the highest at 28 days
○ increasing leeway, decreasing corrs.
Durations of Monitoring
● We reported strong correlations across
○ many TechRO durations (7-120 days)
○ many leeway durations (0-120 days)
Towards Personalized and Holistic Assessment
Co-Calibration of Reported Outcomes / Reflections
PROs TechROs
PROs TechROs
Wave 1
Worse
Mid
Better
Worse
Mid
Better
Worse
Mid
Better
Wave 2 Wave 3
Wave 1
Worse
Mid
Better
Worse
Mid
Better
Worse
Mid
Better
Wave 2 Wave 3
PROs
Wave 1
Worse
Mid
Better
Wave 2
Worse
Mid
Better
Wave 3
Worse
Mid
Better
TechROs
coQoL as a Methodological Approach
Co-Calibration of Reported Outcomes / Reflections
Advantages
Potential for personalized
and holistic assessment
Limitations
Small sample size led to
simple methods
Identified groups of
PRO-TechRO relations
Feasibility
Part 2
Co-Calibration of
Behavioural, Health, and
Quality of Life Outcomes
Background
Methods
Results
Reflections
Contributions
Objectives × Scientific Contributions
Co-Calibration of Reported Outcomes / Contributions
Thoroughly explored a research area
● Prior work on assessing PROs and TechROs
● Energy and fatigue facet (see publications)
Provided empirical data
● Physical and psychological PROs (raw)
● Behavioural marker TechROs (aggregate)
● Patterns of PRO-TechRO statistical correlations
Produced a reusable computational model
● coQoL co-calibration model for PROs and TechROs
Designed and developed a tool
● Tools for validated scale data collection PRO
● Tools for consumer wearable data collection TechRO
Review the literature on
co-calibration
1
Review the literature on
a related QoL facet
2
Collect behavioural, health,
and Quality of Life PROs
from validated scales
3
Collect behavioural marker
TechROs using wearables
4
Assess quality properties
of the collected data
5
Observe PRO-TechRO
statistical relations
6
Derive a computational
model for co-calibration
7
Demonstrate the model's
feasibility in the study
8
Inform designs of future
longitudinal in situ studies
9
Conclusions
Challenges and Opportunities
Conclusions
Motivation and Facilitation
● Self-reported motivation to participate
○ Validate models that assess
motivation
● Motivation not perceived as central when
designing studies
○ Implement tools that facilitate and
measure participation
Co-calibration of Reported Outcomes
● Small sample size and simple methods
○ Powered studies specialized on
subsets of PROs and TechROs
○ More advanced methods, e.g.,
predict PROs based on TechRO
● coQoL for observational settings
○ Gold standard updates with
consumer wearables when valid
● coQoL for interventional settings
○ Proactive investigation of inflections
Vision Observational Study with coQoL
Conclusions
Behaviour change techniques
High-quality TechROs
approx. 1 month
Relevant PRO administration
at the end of the 1 month
coQoL PRO-TechRO subsets
Trigger
helps obtain
informs
Further co-calibration
facilitates *
longitudinal
study, 2+ years,
avoid initial 3
weeks
3 months of data
needed for the
less compliant
PRO repeated in
the same season
PRO repeated in
different seasons
Vision Interventional Study with coQoL
Conclusions
*
longitudinal
study, avoid
initial 3 weeks
Gradual change in behaviour
Inflection criteria in TechRO
prior from co-calibrations
Relevant PRO administration
at the end of the 1 month
coQoL PRO-TechRO subsets
Trigger
helps trigger
informs
Participant known "state"
updates
Future Work
Conclusions
Motivation and Facilitation
● Data collected in a study (N = 100) on
motivation and facilitation of human
subject studies.
Co-calibration of Reported Outcomes
● Analysis complete in a study (N = 27) on
cardiac patients with Vital Beats.
● Additional studies in the lab leveraging
coQoL and its PRO-TechRO results.
Dissemination: Motivation and Facilitation
Conclusions
Workshop paper Vlad Manea, Mads Schnoor Hansen, Semahat Ece
Elbeyi, Katarzyna Wac. Towards Personalizing Participation in Health
Studies. Workshop on Multimedia for Personal Health and Health Care
(HealthMedia 2019), Conference on Multimedia (MM 2019). 8p. DOI:
https://doi.org/10.1145/3347444.3356241.2
Conference paper Allan Berrocal, Vlad Manea, Alexandre De Masi,
Katarzyna Wac. mQoL-Lab: Step-by-Step Creation of a Flexible Platform
to Conduct Studies Using Interactive, Mobile, Wearable and Ubiquitous
Devices. Conference on Mobile Systems and Pervasive Computing
(MobiSPC 2020). 9p. DOI: https://doi.org/10.1016/j.procs.2020.07.033.
Workshop paper Vlad Manea, Katarzyna Wac. mQoL: Mobile Quality of
Life lab: from Behavior Change to Quality of Life. Workshop on Mobile
Human Contributions (MHC 2018), Conference on Pervasive and
Ubiquitous Computing (UbiComp 2018). 6p. DOI:
https://doi.org/10.1145/3267305.3267549.3
Workshop call for papers Vlad Manea, Allan Berrocal, Alexandre De
Masi, Naja Holten Møller, Katarzyna Wac, Hannah Bayer, Sune Lehmann,
Euan Ashley. Call for Papers: LDC ’19: Workshop on Longitudinal Data
Collection in Human Subject Studies. Call for Papers for the Workshop
on Longitudinal Data Collection in Human Subject Studies (LDC 2019),
Conference on Pervasive and Ubiquitous Computing (UbiComp 2019). 4p.
DOI: https://doi.org/10.1145/3341162.3347758.4
Poster Vlad Manea, Vero Estrada-Galiñanes, Katarzyna Wac. mQoL:
Mobile Quality of Life lab. Poster and demo at the Digital Health
Conference (DH 2018).
Advised master thesis Alba Kejser Perez, Cecilie Rosentoft, Elisabeth
Brinth Refstrup. Designing for Participation in Longitudinal Health and
Well-being Studies. MSc thesis (2020, September). Department of Media,
Cognition, and Communication, University of Copenhagen.
Co-supervised master thesis Mads Schnoor Hansen. Engaging
Participants in the Recruitment Phase of Human Subject Health Studies –
mQoL-chat: a Chatbot Approach. MSc thesis (2019, September).
Department of Computer Science, University of Copenhagen.
Dissemination: Co-Calibration of Reported Outcomes
Conclusions
Journal paper Vlad Manea, Katarzyna Wac. Co-calibrating Physical and
Psychological Outcomes and Consumer Wearable Activity Outcomes in
Older Adults: An Evaluation of the coQoL Method. Journal of
Personalized Medicine, 10(4), MDPI, 2020. Special Issue: PROomics:
Patient Reported Outcome (PRO) and Self-Tracking for Personalized
Medicine. Impact factor 4.433, rank 10/102 (Q1) in Health Care Sciences
and Services. 41p. DOI: https://doi.org/10.3390/jpm10040203
Poster Vlad Manea, Katarzyna Wac. Using Consumer-Friendly Wearables
to Associate Patient-Reported Quality of Life and Tech-Reported
Physical Activity and Sleep in Healthy Seniors. Poster at the Conference
of the International Society for Quality of Life Research (ISOQOL 2020).
DOI: https://doi.org/10.1007/s11136-020-02626-y
Conference paper Vlad Manea, Allan Berrocal, Katarzyna Wac. Using
Consumer-Friendly Wearables to Associate Patient- and
Technology-Reported Physical Activity in Healthy Seniors. Conference
on Mobile Systems and Pervasive Computing (MobiSPC2020). 8p. DOI:
https://doi.org/10.1016/j.procs.2020.07.036
Book chapter Natalie Solomon, Vlad Manea. Energy and Fatigue:
Classification and Assessment of Energy and Fatigue using Subjective,
Objective, and Mixed Methods towards Health and Quality of Life
(accepted). Book chapter in: Katarzyna Wac, Sharon Wulfovich (eds.),
Quantifying Quality of Life: Incorporating Daily Life into Medicine, Health
Informatics, Springer, Cham. 30p.
Advised master thesis Kirke Kjellberg. ConsistencyQoL: A Framework for
Modelling Consistency in Behavioural Data Collected with Wearables. MSc
thesis (2020, August). Department of Computer Science, University of
Copenhagen.
Thank You

More Related Content

Similar to PhD Thesis Defence: From Participation Factors to Co-Calibration of Patient- and Wearable-Reported Outcomes in Behavioural, Health, and Quality of Life Studies

DOCTORAL STUDY ORAL DEFENSE - MEDICAL IDENTITY THEFT AND PALM VEIN AUTHENTICA...
DOCTORAL STUDY ORAL DEFENSE - MEDICAL IDENTITY THEFT AND PALM VEIN AUTHENTICA...DOCTORAL STUDY ORAL DEFENSE - MEDICAL IDENTITY THEFT AND PALM VEIN AUTHENTICA...
DOCTORAL STUDY ORAL DEFENSE - MEDICAL IDENTITY THEFT AND PALM VEIN AUTHENTICA...
CRUZ CERDA
 
Remote quality of life assessment: ‘What is always speaking silently is the b...
Remote quality of life assessment: ‘What is always speaking silently is the b...Remote quality of life assessment: ‘What is always speaking silently is the b...
Remote quality of life assessment: ‘What is always speaking silently is the b...
Katarzyna Wac & The QoL Lab
 
Nursing Shortageby Monica CastelaoSubmission dat e 01-.docx
Nursing Shortageby Monica CastelaoSubmission dat e  01-.docxNursing Shortageby Monica CastelaoSubmission dat e  01-.docx
Nursing Shortageby Monica CastelaoSubmission dat e 01-.docx
cherishwinsland
 
The use of mobile devices to support learning in practice settings
The use of mobile devices to support learning in practice settingsThe use of mobile devices to support learning in practice settings
The use of mobile devices to support learning in practice settings
Art + Design: elearning lab design for social change
 
Scope and significance of evidence based research in nursing practice27 5-20
Scope and significance of evidence based research in nursing practice27 5-20Scope and significance of evidence based research in nursing practice27 5-20
Scope and significance of evidence based research in nursing practice27 5-20
Mallika Vhora
 
'Demystifying Knowledge Transfer- an introduction to Implementation Science M...
'Demystifying Knowledge Transfer- an introduction to Implementation Science M...'Demystifying Knowledge Transfer- an introduction to Implementation Science M...
'Demystifying Knowledge Transfer- an introduction to Implementation Science M...
NEQOS
 
Literature Evaluation TableStudent Name Vanessa NoaChange.docx
Literature Evaluation TableStudent Name Vanessa NoaChange.docxLiterature Evaluation TableStudent Name Vanessa NoaChange.docx
Literature Evaluation TableStudent Name Vanessa NoaChange.docx
manningchassidy
 
Course Project Part 3—Translating Evidence Into PracticeIn Part.docx
Course Project Part 3—Translating Evidence Into PracticeIn Part.docxCourse Project Part 3—Translating Evidence Into PracticeIn Part.docx
Course Project Part 3—Translating Evidence Into PracticeIn Part.docx
buffydtesurina
 
Informatics and nursing 2015 2016.odette richards
Informatics and nursing 2015 2016.odette richardsInformatics and nursing 2015 2016.odette richards
Informatics and nursing 2015 2016.odette richards
Odette Richards
 
MedInfo 2010 Report
MedInfo 2010 ReportMedInfo 2010 Report
MedInfo 2010 Report
Health Informatics New Zealand
 
Medinfo2015 workshop-adherence mangement-patient_driven-publicized
Medinfo2015 workshop-adherence mangement-patient_driven-publicizedMedinfo2015 workshop-adherence mangement-patient_driven-publicized
Medinfo2015 workshop-adherence mangement-patient_driven-publicized
Pei-Yun Sabrina Hsueh
 
مثال 2.pdf
مثال 2.pdfمثال 2.pdf
مثال 2.pdf
ssuser50a5ec
 
Accessing and Sharing Electronic Personal Health Data.
Accessing and Sharing Electronic Personal Health Data.Accessing and Sharing Electronic Personal Health Data.
Accessing and Sharing Electronic Personal Health Data.
Maria Karampela
 
Accessing and Sharing Electronic Personal Health Data
Accessing and Sharing Electronic Personal Health DataAccessing and Sharing Electronic Personal Health Data
Accessing and Sharing Electronic Personal Health Data
Sofia Ouhbi
 
Key Topics in Health Care Technology EvaluationThe amount of new i.docx
Key Topics in Health Care Technology EvaluationThe amount of new i.docxKey Topics in Health Care Technology EvaluationThe amount of new i.docx
Key Topics in Health Care Technology EvaluationThe amount of new i.docx
sleeperfindley
 
How to write a research proposal
How to write a research proposalHow to write a research proposal
How to write a research proposal
Thanavathi C
 
Research Essay Conclusion
Research Essay ConclusionResearch Essay Conclusion
Research Essay Conclusion
Paper Writing Service Cheap
 
Interactive recommender systems: opening up the “black box”
Interactive recommender systems: opening up the “black box”Interactive recommender systems: opening up the “black box”
Interactive recommender systems: opening up the “black box”
Katrien Verbert
 
Course Project Part 3—Translating Evidence Into PracticeIn Pa.docx
Course Project Part 3—Translating Evidence Into PracticeIn Pa.docxCourse Project Part 3—Translating Evidence Into PracticeIn Pa.docx
Course Project Part 3—Translating Evidence Into PracticeIn Pa.docx
buffydtesurina
 
Nursing Midwifes
Nursing MidwifesNursing Midwifes
Nursing Midwifes
Samantha Caldwell
 

Similar to PhD Thesis Defence: From Participation Factors to Co-Calibration of Patient- and Wearable-Reported Outcomes in Behavioural, Health, and Quality of Life Studies (20)

DOCTORAL STUDY ORAL DEFENSE - MEDICAL IDENTITY THEFT AND PALM VEIN AUTHENTICA...
DOCTORAL STUDY ORAL DEFENSE - MEDICAL IDENTITY THEFT AND PALM VEIN AUTHENTICA...DOCTORAL STUDY ORAL DEFENSE - MEDICAL IDENTITY THEFT AND PALM VEIN AUTHENTICA...
DOCTORAL STUDY ORAL DEFENSE - MEDICAL IDENTITY THEFT AND PALM VEIN AUTHENTICA...
 
Remote quality of life assessment: ‘What is always speaking silently is the b...
Remote quality of life assessment: ‘What is always speaking silently is the b...Remote quality of life assessment: ‘What is always speaking silently is the b...
Remote quality of life assessment: ‘What is always speaking silently is the b...
 
Nursing Shortageby Monica CastelaoSubmission dat e 01-.docx
Nursing Shortageby Monica CastelaoSubmission dat e  01-.docxNursing Shortageby Monica CastelaoSubmission dat e  01-.docx
Nursing Shortageby Monica CastelaoSubmission dat e 01-.docx
 
The use of mobile devices to support learning in practice settings
The use of mobile devices to support learning in practice settingsThe use of mobile devices to support learning in practice settings
The use of mobile devices to support learning in practice settings
 
Scope and significance of evidence based research in nursing practice27 5-20
Scope and significance of evidence based research in nursing practice27 5-20Scope and significance of evidence based research in nursing practice27 5-20
Scope and significance of evidence based research in nursing practice27 5-20
 
'Demystifying Knowledge Transfer- an introduction to Implementation Science M...
'Demystifying Knowledge Transfer- an introduction to Implementation Science M...'Demystifying Knowledge Transfer- an introduction to Implementation Science M...
'Demystifying Knowledge Transfer- an introduction to Implementation Science M...
 
Literature Evaluation TableStudent Name Vanessa NoaChange.docx
Literature Evaluation TableStudent Name Vanessa NoaChange.docxLiterature Evaluation TableStudent Name Vanessa NoaChange.docx
Literature Evaluation TableStudent Name Vanessa NoaChange.docx
 
Course Project Part 3—Translating Evidence Into PracticeIn Part.docx
Course Project Part 3—Translating Evidence Into PracticeIn Part.docxCourse Project Part 3—Translating Evidence Into PracticeIn Part.docx
Course Project Part 3—Translating Evidence Into PracticeIn Part.docx
 
Informatics and nursing 2015 2016.odette richards
Informatics and nursing 2015 2016.odette richardsInformatics and nursing 2015 2016.odette richards
Informatics and nursing 2015 2016.odette richards
 
MedInfo 2010 Report
MedInfo 2010 ReportMedInfo 2010 Report
MedInfo 2010 Report
 
Medinfo2015 workshop-adherence mangement-patient_driven-publicized
Medinfo2015 workshop-adherence mangement-patient_driven-publicizedMedinfo2015 workshop-adherence mangement-patient_driven-publicized
Medinfo2015 workshop-adherence mangement-patient_driven-publicized
 
مثال 2.pdf
مثال 2.pdfمثال 2.pdf
مثال 2.pdf
 
Accessing and Sharing Electronic Personal Health Data.
Accessing and Sharing Electronic Personal Health Data.Accessing and Sharing Electronic Personal Health Data.
Accessing and Sharing Electronic Personal Health Data.
 
Accessing and Sharing Electronic Personal Health Data
Accessing and Sharing Electronic Personal Health DataAccessing and Sharing Electronic Personal Health Data
Accessing and Sharing Electronic Personal Health Data
 
Key Topics in Health Care Technology EvaluationThe amount of new i.docx
Key Topics in Health Care Technology EvaluationThe amount of new i.docxKey Topics in Health Care Technology EvaluationThe amount of new i.docx
Key Topics in Health Care Technology EvaluationThe amount of new i.docx
 
How to write a research proposal
How to write a research proposalHow to write a research proposal
How to write a research proposal
 
Research Essay Conclusion
Research Essay ConclusionResearch Essay Conclusion
Research Essay Conclusion
 
Interactive recommender systems: opening up the “black box”
Interactive recommender systems: opening up the “black box”Interactive recommender systems: opening up the “black box”
Interactive recommender systems: opening up the “black box”
 
Course Project Part 3—Translating Evidence Into PracticeIn Pa.docx
Course Project Part 3—Translating Evidence Into PracticeIn Pa.docxCourse Project Part 3—Translating Evidence Into PracticeIn Pa.docx
Course Project Part 3—Translating Evidence Into PracticeIn Pa.docx
 
Nursing Midwifes
Nursing MidwifesNursing Midwifes
Nursing Midwifes
 

More from Vlad Manea

Calitatea Vieții la un Click Distanță
Calitatea Vieții la un Click DistanțăCalitatea Vieții la un Click Distanță
Calitatea Vieții la un Click Distanță
Vlad Manea
 
coQoL: co-calibrating physical and psychological outcomes and consumer wearab...
coQoL: co-calibrating physical and psychological outcomes and consumer wearab...coQoL: co-calibrating physical and psychological outcomes and consumer wearab...
coQoL: co-calibrating physical and psychological outcomes and consumer wearab...
Vlad Manea
 
Towards personalizing participation in health studies
Towards personalizing participation in health studiesTowards personalizing participation in health studies
Towards personalizing participation in health studies
Vlad Manea
 
Livskvalitet lige ved hånden
Livskvalitet lige ved håndenLivskvalitet lige ved hånden
Livskvalitet lige ved hånden
Vlad Manea
 
Quality of Life at your fingertips
Quality of Life at your fingertipsQuality of Life at your fingertips
Quality of Life at your fingertips
Vlad Manea
 
Calidad de Vida a su alcance
Calidad de Vida a su alcanceCalidad de Vida a su alcance
Calidad de Vida a su alcance
Vlad Manea
 
How engaging is your lecture?
How engaging is your lecture?How engaging is your lecture?
How engaging is your lecture?
Vlad Manea
 
Prototyping for knowledge based entrepreneurship
Prototyping for knowledge based entrepreneurshipPrototyping for knowledge based entrepreneurship
Prototyping for knowledge based entrepreneurship
Vlad Manea
 
Balancing priorities: a field study of coordination in distributed elder care
Balancing priorities: a field study of coordination in distributed elder careBalancing priorities: a field study of coordination in distributed elder care
Balancing priorities: a field study of coordination in distributed elder care
Vlad Manea
 
F11 Final
F11 FinalF11 Final
F11 Final
Vlad Manea
 
Cultural Exchange
Cultural ExchangeCultural Exchange
Cultural Exchange
Vlad Manea
 
F11 press
F11 pressF11 press
F11 press
Vlad Manea
 
Regroop Platform presentation
Regroop Platform presentationRegroop Platform presentation
Regroop Platform presentation
Vlad Manea
 
Graph Algorithms for FII Gamedev
Graph Algorithms for FII GamedevGraph Algorithms for FII Gamedev
Graph Algorithms for FII GamedevVlad Manea
 
Programare Obiect
Programare ObiectProgramare Obiect
Programare Obiect
Vlad Manea
 
Slideshare
SlideshareSlideshare
Slideshare
Vlad Manea
 
Online Educa Berlin Cme
Online Educa Berlin CmeOnline Educa Berlin Cme
Online Educa Berlin Cme
Vlad Manea
 
Destination Success Animal Shelter
Destination Success Animal ShelterDestination Success Animal Shelter
Destination Success Animal Shelter
Vlad Manea
 
Worldbase
WorldbaseWorldbase
Worldbase
Vlad Manea
 
Inteligenta
InteligentaInteligenta
Inteligenta
Vlad Manea
 

More from Vlad Manea (20)

Calitatea Vieții la un Click Distanță
Calitatea Vieții la un Click DistanțăCalitatea Vieții la un Click Distanță
Calitatea Vieții la un Click Distanță
 
coQoL: co-calibrating physical and psychological outcomes and consumer wearab...
coQoL: co-calibrating physical and psychological outcomes and consumer wearab...coQoL: co-calibrating physical and psychological outcomes and consumer wearab...
coQoL: co-calibrating physical and psychological outcomes and consumer wearab...
 
Towards personalizing participation in health studies
Towards personalizing participation in health studiesTowards personalizing participation in health studies
Towards personalizing participation in health studies
 
Livskvalitet lige ved hånden
Livskvalitet lige ved håndenLivskvalitet lige ved hånden
Livskvalitet lige ved hånden
 
Quality of Life at your fingertips
Quality of Life at your fingertipsQuality of Life at your fingertips
Quality of Life at your fingertips
 
Calidad de Vida a su alcance
Calidad de Vida a su alcanceCalidad de Vida a su alcance
Calidad de Vida a su alcance
 
How engaging is your lecture?
How engaging is your lecture?How engaging is your lecture?
How engaging is your lecture?
 
Prototyping for knowledge based entrepreneurship
Prototyping for knowledge based entrepreneurshipPrototyping for knowledge based entrepreneurship
Prototyping for knowledge based entrepreneurship
 
Balancing priorities: a field study of coordination in distributed elder care
Balancing priorities: a field study of coordination in distributed elder careBalancing priorities: a field study of coordination in distributed elder care
Balancing priorities: a field study of coordination in distributed elder care
 
F11 Final
F11 FinalF11 Final
F11 Final
 
Cultural Exchange
Cultural ExchangeCultural Exchange
Cultural Exchange
 
F11 press
F11 pressF11 press
F11 press
 
Regroop Platform presentation
Regroop Platform presentationRegroop Platform presentation
Regroop Platform presentation
 
Graph Algorithms for FII Gamedev
Graph Algorithms for FII GamedevGraph Algorithms for FII Gamedev
Graph Algorithms for FII Gamedev
 
Programare Obiect
Programare ObiectProgramare Obiect
Programare Obiect
 
Slideshare
SlideshareSlideshare
Slideshare
 
Online Educa Berlin Cme
Online Educa Berlin CmeOnline Educa Berlin Cme
Online Educa Berlin Cme
 
Destination Success Animal Shelter
Destination Success Animal ShelterDestination Success Animal Shelter
Destination Success Animal Shelter
 
Worldbase
WorldbaseWorldbase
Worldbase
 
Inteligenta
InteligentaInteligenta
Inteligenta
 

Recently uploaded

Phenomics assisted breeding in crop improvement
Phenomics assisted breeding in crop improvementPhenomics assisted breeding in crop improvement
Phenomics assisted breeding in crop improvement
IshaGoswami9
 
bordetella pertussis.................................ppt
bordetella pertussis.................................pptbordetella pertussis.................................ppt
bordetella pertussis.................................ppt
kejapriya1
 
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốtmô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
HongcNguyn6
 
Red blood cells- genesis-maturation.pptx
Red blood cells- genesis-maturation.pptxRed blood cells- genesis-maturation.pptx
Red blood cells- genesis-maturation.pptx
muralinath2
 
Mudde & Rovira Kaltwasser. - Populism in Europe and the Americas - Threat Or...
Mudde &  Rovira Kaltwasser. - Populism in Europe and the Americas - Threat Or...Mudde &  Rovira Kaltwasser. - Populism in Europe and the Americas - Threat Or...
Mudde & Rovira Kaltwasser. - Populism in Europe and the Americas - Threat Or...
frank0071
 
ESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptxESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptx
PRIYANKA PATEL
 
Lateral Ventricles.pdf very easy good diagrams comprehensive
Lateral Ventricles.pdf very easy good diagrams comprehensiveLateral Ventricles.pdf very easy good diagrams comprehensive
Lateral Ventricles.pdf very easy good diagrams comprehensive
silvermistyshot
 
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdfMudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
frank0071
 
NuGOweek 2024 Ghent programme overview flyer
NuGOweek 2024 Ghent programme overview flyerNuGOweek 2024 Ghent programme overview flyer
NuGOweek 2024 Ghent programme overview flyer
pablovgd
 
platelets_clotting_biogenesis.clot retractionpptx
platelets_clotting_biogenesis.clot retractionpptxplatelets_clotting_biogenesis.clot retractionpptx
platelets_clotting_biogenesis.clot retractionpptx
muralinath2
 
DMARDs Pharmacolgy Pharm D 5th Semester.pdf
DMARDs Pharmacolgy Pharm D 5th Semester.pdfDMARDs Pharmacolgy Pharm D 5th Semester.pdf
DMARDs Pharmacolgy Pharm D 5th Semester.pdf
fafyfskhan251kmf
 
Anemia_ types_clinical significance.pptx
Anemia_ types_clinical significance.pptxAnemia_ types_clinical significance.pptx
Anemia_ types_clinical significance.pptx
muralinath2
 
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills MN
 
Topic: SICKLE CELL DISEASE IN CHILDREN-3.pdf
Topic: SICKLE CELL DISEASE IN CHILDREN-3.pdfTopic: SICKLE CELL DISEASE IN CHILDREN-3.pdf
Topic: SICKLE CELL DISEASE IN CHILDREN-3.pdf
TinyAnderson
 
Introduction to Mean Field Theory(MFT).pptx
Introduction to Mean Field Theory(MFT).pptxIntroduction to Mean Field Theory(MFT).pptx
Introduction to Mean Field Theory(MFT).pptx
zeex60
 
Nucleic Acid-its structural and functional complexity.
Nucleic Acid-its structural and functional complexity.Nucleic Acid-its structural and functional complexity.
Nucleic Acid-its structural and functional complexity.
Nistarini College, Purulia (W.B) India
 
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
University of Maribor
 
Orion Air Quality Monitoring Systems - CWS
Orion Air Quality Monitoring Systems - CWSOrion Air Quality Monitoring Systems - CWS
Orion Air Quality Monitoring Systems - CWS
Columbia Weather Systems
 
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
yqqaatn0
 
Nucleophilic Addition of carbonyl compounds.pptx
Nucleophilic Addition of carbonyl  compounds.pptxNucleophilic Addition of carbonyl  compounds.pptx
Nucleophilic Addition of carbonyl compounds.pptx
SSR02
 

Recently uploaded (20)

Phenomics assisted breeding in crop improvement
Phenomics assisted breeding in crop improvementPhenomics assisted breeding in crop improvement
Phenomics assisted breeding in crop improvement
 
bordetella pertussis.................................ppt
bordetella pertussis.................................pptbordetella pertussis.................................ppt
bordetella pertussis.................................ppt
 
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốtmô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
mô tả các thí nghiệm về đánh giá tác động dòng khí hóa sau đốt
 
Red blood cells- genesis-maturation.pptx
Red blood cells- genesis-maturation.pptxRed blood cells- genesis-maturation.pptx
Red blood cells- genesis-maturation.pptx
 
Mudde & Rovira Kaltwasser. - Populism in Europe and the Americas - Threat Or...
Mudde &  Rovira Kaltwasser. - Populism in Europe and the Americas - Threat Or...Mudde &  Rovira Kaltwasser. - Populism in Europe and the Americas - Threat Or...
Mudde & Rovira Kaltwasser. - Populism in Europe and the Americas - Threat Or...
 
ESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptxESR spectroscopy in liquid food and beverages.pptx
ESR spectroscopy in liquid food and beverages.pptx
 
Lateral Ventricles.pdf very easy good diagrams comprehensive
Lateral Ventricles.pdf very easy good diagrams comprehensiveLateral Ventricles.pdf very easy good diagrams comprehensive
Lateral Ventricles.pdf very easy good diagrams comprehensive
 
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdfMudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
Mudde & Rovira Kaltwasser. - Populism - a very short introduction [2017].pdf
 
NuGOweek 2024 Ghent programme overview flyer
NuGOweek 2024 Ghent programme overview flyerNuGOweek 2024 Ghent programme overview flyer
NuGOweek 2024 Ghent programme overview flyer
 
platelets_clotting_biogenesis.clot retractionpptx
platelets_clotting_biogenesis.clot retractionpptxplatelets_clotting_biogenesis.clot retractionpptx
platelets_clotting_biogenesis.clot retractionpptx
 
DMARDs Pharmacolgy Pharm D 5th Semester.pdf
DMARDs Pharmacolgy Pharm D 5th Semester.pdfDMARDs Pharmacolgy Pharm D 5th Semester.pdf
DMARDs Pharmacolgy Pharm D 5th Semester.pdf
 
Anemia_ types_clinical significance.pptx
Anemia_ types_clinical significance.pptxAnemia_ types_clinical significance.pptx
Anemia_ types_clinical significance.pptx
 
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...
 
Topic: SICKLE CELL DISEASE IN CHILDREN-3.pdf
Topic: SICKLE CELL DISEASE IN CHILDREN-3.pdfTopic: SICKLE CELL DISEASE IN CHILDREN-3.pdf
Topic: SICKLE CELL DISEASE IN CHILDREN-3.pdf
 
Introduction to Mean Field Theory(MFT).pptx
Introduction to Mean Field Theory(MFT).pptxIntroduction to Mean Field Theory(MFT).pptx
Introduction to Mean Field Theory(MFT).pptx
 
Nucleic Acid-its structural and functional complexity.
Nucleic Acid-its structural and functional complexity.Nucleic Acid-its structural and functional complexity.
Nucleic Acid-its structural and functional complexity.
 
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...
 
Orion Air Quality Monitoring Systems - CWS
Orion Air Quality Monitoring Systems - CWSOrion Air Quality Monitoring Systems - CWS
Orion Air Quality Monitoring Systems - CWS
 
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
如何办理(uvic毕业证书)维多利亚大学毕业证本科学位证书原版一模一样
 
Nucleophilic Addition of carbonyl compounds.pptx
Nucleophilic Addition of carbonyl  compounds.pptxNucleophilic Addition of carbonyl  compounds.pptx
Nucleophilic Addition of carbonyl compounds.pptx
 

PhD Thesis Defence: From Participation Factors to Co-Calibration of Patient- and Wearable-Reported Outcomes in Behavioural, Health, and Quality of Life Studies

  • 1. Motivation Facilitation Co- Calibration PhD Defence Vlad Manea Quality of Life Technologies Lab University of Copenhagen
  • 2. From Participation Factors to Co-Calibration of Patient- and Wearable-Reported Outcomes in Behavioural, Health, and Quality of Life Studies PhD Thesis Defence • April 14th , 2021 • University of Copenhagen Candidate Vlad Manea Københavns Universitet, Copenhagen, Denmark Committee Professor Nancy E. Mayo McGill University, Montreal, Canada Professor Bert Arnrich Universität Potsdam, Potsdam, Germany Professor Thomas T. Hildebrandt Københavns Universitet, Copenhagen, Denmark Quality of Life Technologies Lab Human-Centered Computing / Computer Science / Science University of Copenhagen | Københavns Universitet Supervisor Professor Katarzyna Wac Université de Genève, Geneva, Switzerland Københavns Universitet, Copenhagen, Denmark
  • 3. 12:45-13:05: Preparation 13:05-13:50: Presentation 13:50-14:00: Break 14:00-15:30: Discussion 15:30-15:45: Votation 15:45-16:00: Reception Agenda for the Day
  • 4. Agenda for the Presentation Part 1 Motivation and Facilitation of Human Subject Study Participation Part 2 Co-Calibration of Behavioural, Health, and Quality of Life Outcomes Introduction Conclusions
  • 6. Primary Causes of Mortality: Chronic Diseases Introduction Chronic diseases Common examples: - Cardiovascular - Respiratory - Metabolic - Digestive - Mental Roth, G.A., et al., 2018. Global, regional, and national age-sex-specific mortality for 282 causes of death in 195 countries and territories, 1980–2017: a systematic analysis for the Global Burden of Disease Study 2017. The Lancet, 392(10159).
  • 7. Risk Factors for Chronic Diseases: Behaviours Introduction Behavioural pattern Risk Smoking habits 18.1% Poor diet Physical inactivity 16.6% Alcohol consumption 3.5% Inadequate sleep ... { Mokdad, A.H., Marks, J.S., Stroup, D.F. and Gerberding, J.L., 2004. Actual causes of death in the United States, 2000. Jama, 291(10). Roth, G.A., et al., 2018. Global, regional, and national age-sex-specific mortality for 282 causes of death in 195 countries and territories, 1980–2017: a systematic analysis for the Global Burden of Disease Study 2017. The Lancet, 392(10159).
  • 8. Introduction From Behaviours to Reported Outcomes Mayo, N.E., Figueiredo, S., Ahmed, S. and Bartlett, S.J., 2017. Montréal Accord on Patient-Reported Outcomes (PROs) use series–Paper 2: Terminology proposed to measure what matters in health. Journal of clinical epidemiology, 89.
  • 9. Introduction Patient-Reported Outcome (PRO) Example During the past month, how often have you had trouble sleeping because you wake up in the middle of the night or early morning? Buysse, D.J., Reynolds III, C.F., Monk, T.H., Berman, S.R. and Kupfer, D.J., 1989. The Pittsburgh Sleep Quality Index: a new instrument for psychiatric practice and research. Psychiatry research, 28(2).
  • 10. Challenges with Patient-Reported Outcomes Introduction infrequent subjective memory- based socially acceptable qualitative ? What happens between the visits at the doctor? often 1-dimensional out of context
  • 11. Measure behaviours from daily life Over 430 wearables available (2018) Mobiles & Wearables Introduction Wac, K., 2018. From quantified self to quality of life. In Digital Health. Springer, Cham. Dey, A.K., Wac, K., et al. 2011. Getting closer: an empirical investigation of the proximity of user to their smart phones. In Proceedings of the 13th UbiComp. Grossman, L. and Vella, M. 2014. Never Offline. TIME, September 22. Mobiles in our proximity 88% time
  • 12. Technology-Reported Outcome (TechRO) Examples Introduction Physical Activity steps, elevation, distance, calories Heart Rate normal, moderate, fast, too fast Sleep total, in bed, score, interruptions, heart rate Heart Activity electrocardiogram Behavioural Markers
  • 13. What happens between the visits at the doctor? Behaviours can be reported during daily life. Opportunities with Technology-Reported Outcomes Introduction quantitative ? objective continuous sensor-based in context longitudinal non-judgemental frequent multi-dimensional ✓
  • 14. Mayo, N.E., Figueiredo, S., Ahmed, S. and Bartlett, S.J., 2017. Montréal Accord on Patient-Reported Outcomes (PROs) use series–Paper 2: Terminology proposed to measure what matters in health. Journal of clinical epidemiology, 89. Introduction Co-Calibrating Reported Outcomes PROs TechROs Emerging ? ? Co-Calibration Gold Standard
  • 15. Introduction A Quick Reality Check PROs TechROs ? Why participate in studies in the first place?
  • 16. Introduction Understanding Participation Motivation Facilitation ? Why participate in studies in the first place? ✓Need more research to understand participation.
  • 17. Part 1 Motivation and Facilitation of Human Subject Study Participation
  • 18. Part 1 Motivation and Facilitation of Human Subject Study Participation Background Methods Results Reflections Contributions
  • 19. Community Absent models to assess study participation Studies Limited data quality from / to participants Participants Different reasons to participate in research Challenges Motivation and Facilitation of Human Studies / Background
  • 20. Objectives Motivation and Facilitation of Human Studies / Background Review literature on participation 1 Propose model and framework designs 2 Extend mQoL-Lab platform 3
  • 21. Part 1 Motivation and Facilitation of Human Subject Study Participation Background Methods Results Reflections Contributions
  • 22. Activities Motivation and Facilitation of Human Studies / Methods Literature review on the motivation to participate in studies Information exchange with researchers who conduct studies Model and framework designs for study participation Software tools that facilitate participation in studies
  • 23. Human Subject Studies Longitudinal Studies Health Studies Literature Review on Participation Motivation and Facilitation of Human Studies / Methods Willingness factors to share health data Motivation factors to participate Human factors Technical factors Requirements Architectural design Manea, V., Schnoor Hansen, M., Elbeyi, S.E. and Wac, K., 2019. Towards personalizing participation in health studies. In Workshop on Multimedia for Personal Health & Health Care. 1 Manea, V. and Wac, K., 2018. mQoL: mobile quality of life lab: from behavior change to QoL. Workshop on Mobile Human Contributions. 2 Manea, V., Berrocal, A., De Masi, A., Møller, N.H., Wac, K., Bayer, H., Lehmann, S. and Ashley, E., 2019. International workshop on longitudinal data collection in human subject studies. In UbiComp Adjunct 2019. 3 Berrocal, A., Manea, V., De Masi, A. and Wac, K., 2020. mQoL Lab: Step-by-Step Creation of a Flexible Platform to Conduct Studies Using Interactive, Mobile, Wearable and Ubiquitous Devices. MobiSPC 2020. 4 1 2 3 4 Challenges Opportunities Challenges Opportunities Electronic health records Wearable data Healthy participants Diseased participants Participants Researchers Data Participants System Researchers Layers Features Components
  • 24. Part 1 Motivation and Facilitation of Human Subject Study Participation Background Methods Results Reflections Contributions
  • 25. Factors Influencing the Motivation to Participate Motivation and Facilitation of Human Studies / Results Manea, V., Schnoor Hansen, M., Elbeyi, S.E. and Wac, K., 2019. Towards personalizing participation in health studies. In Workshop on Multimedia for Personal Health & Health Care. May share electronic health records 67% May share wearable data from daily life 78% Altruism over health and financial gains? ♡/$ No model to assess motivation ? 1 2 3 4
  • 26. Factors Influencing the Motivation to Participate Motivation and Facilitation of Human Studies / Results Manea, V., Schnoor Hansen, M., Elbeyi, S.E. and Wac, K., 2019. Towards personalizing participation in health studies. In Workshop on Multimedia for Personal Health & Health Care. Helping others Family Friends Acquaintances Society Personal benefits Health Information Reward Social Topic of study Organ Process Behavior Quality of Life Method of study Delivery Effort Artefact Data use 1 2 3 4
  • 27. Information Exchange Workshop with Domain Experts Motivation and Facilitation of Human Studies / Results Manea, V., Berrocal, A., De Masi, A., Møller, N.H., Wac, K., Bayer, H., Lehmann, S. and Ashley, E., 2019, September. LDC'19: international workshop on longitudinal data collection in human subject studies. In Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers. Workshop on Longitudinal Data Collection ● Contributions and discussions ● Methods, tools, and frameworks ● Collection, analysis, and interpretation ● Mobile, wearable, and ubiquitous data ● Exclusive focus on longitudinal data ● Keynote by a domain expert (UCL) ● Affiliations: KU, DTU, UniGe, NYU, SU ● ldc2019ubicomp.wordpress.com 1 2 3 4
  • 28. Chatbot Stories Facilitating Participation Motivation and Facilitation of Human Studies / Results Manea, V., Schnoor Hansen, M., Elbeyi, S.E. and Wac, K., 2019, October. Towards personalizing participation in health studies. In Proceedings of the 4th International Workshop on Multimedia for Personal Health & Health Care. Personalized Stories Personalization with stories and moments relevant for the participant 1 2 3 4
  • 29. mQoL Mobile App Facilitating Participation Motivation and Facilitation of Human Studies / Results Manea, V. and Wac, K., 2018, October. mQoL: mobile quality of life lab: from behavior change to QoL. In Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers. 1 2 3 4
  • 30. mQoL Mobile App Facilitating Participation Motivation and Facilitation of Human Studies / Results Manea, V. and Wac, K., 2018, October. mQoL: mobile quality of life lab: from behavior change to QoL. In Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers. 1 2 3 4
  • 31. mQoL-Lab Platform Facilitating Participation Motivation and Facilitation of Human Studies / Results Berrocal, A., Manea, V., De Masi, A. and Wac, K., 2020. mQoL Lab: Step-by-Step Creation of a Flexible Platform to Conduct Studies Using Interactive, Mobile, Wearable and Ubiquitous Devices. MobiSPC 2020. 1 2 3 4
  • 32. Part 1 Motivation and Facilitation of Human Subject Study Participation Background Methods Results Reflections Contributions
  • 33. Summary Motivation and Facilitation of Human Studies / Reflections Feasibility Personalised studies may help participation Challenges Challenges beyond humans and technology Factors Families of factors without relative importance
  • 34. Part 1 Motivation and Facilitation of Human Subject Study Participation Background Methods Results Reflections Contributions
  • 35. Objectives × Scientific Contributions Motivation and Facilitation of Human Studies / Contributions Thoroughly explored a research area ● Motivation and facilitation of participation in studies Produced a presentational model ● Personalized stories model to motivate participation Provided a unifying framework ● Mobile app design for longitudinal studies ● Chatbot design for health studies Designed and developed a tool ● mQoL-Lab platform for human subject studies Review literature on participation 1 Propose model and framework designs 2 Extend mQoL-Lab platform 3
  • 36. Part 2 Co-Calibration of Behavioural, Health, and Quality of Life Outcomes
  • 37. Part 2 Co-Calibration of Behavioural, Health, and Quality of Life Outcomes Background Methods Results Reflections Contributions
  • 38. Project Goals ● Relieve caregiver pressure ● Increase participant wellbeing and autonomy ● Decrease participant risk of dementia Context Co-Calibration of Reported Outcomes / Background Research Project ● AAL “Caregiver and ME” (CoME, No. 14-7) ○ 2015-2019 ● For people of older age with mild impairment and their caregivers ○ Spain or Hungary, use a mobile phone Livingston, G. et al. Dementia prevention, intervention, and care. Lancet 390.10113 (2017): 2673-2734.
  • 39. Objectives Co-Calibration of Reported Outcomes / Background TechROs Emerging Gold Standard PROs ? Review the literature on co-calibration 1 Review the literature on a related QoL facet 2 Collect behavioural, health, and Quality of Life PROs from validated scales 3 Collect behavioural marker TechROs using wearables 4 Assess quality properties of the collected data 5 Observe PRO-TechRO statistical relations 6 Derive a computational model for co-calibration 7 Demonstrate the model's feasibility in the study 8 Inform designs of future longitudinal in situ studies 9
  • 40. Part 2 Co-Calibration of Behavioural, Health, and Quality of Life Outcomes Background Methods Results Reflections Contributions
  • 41. Measures ● Age, gender, ethnicity, profession, education, cohabitants, height, weight, blood pressure, cholesterol, smoking status, alcohol status, medication, mild disease status, etc. Profiles of Participants Co-Calibration of Reported Outcomes / Methods Profile ● Filled during the first visit at the study site ● Updated along the duration of the project
  • 42. Measures (Validated Scales) ● Physical Activity (IPAQ) ● Social Support (MSPSS) ● Anxiety/Depression (GADS) ● Nutrition (PREDIMED, SelfMNA) ● Memory (MFE) ● Sleep Quality (PSQI) ● Health-Related Quality of Life (EQ-5D-3L) Measured Patient-Reported Outcomes Co-Calibration of Reported Outcomes / Methods Patient-Reported Measures (PROs) ● Filled during subsequent group visits
  • 43. Measures (Daily Aggregates) ● Energy expenditure ● Steps ● Distance ● Sedentary duration ● Physical activity durations (light, fair, vigorous) ● Sleep duration ● Heart rate Measured Technology-Reported Outcomes Co-Calibration of Reported Outcomes / Methods Devices (TechROs) ● Fitbit Charge 2 consumer wearable for ownership
  • 44. Interval durations 7, 14, 21, 28, 60, 120 days 1.1 Step 3A Select PRO variables - item - sub-score - score 7 Step 3B Select TechRO variables absolute: median relative: geometric mean of composition (centered log ratio) For each interval duration Use a leeway between: - PRO administration date, and - TechRO interval end date Allow maximum 1 alignment per wave Obtain max. 1 alignment / duration / participant / wave / leeway Step 2 Align in time PRO-TechRO Alignment Using a leeway of 0, 7, 14, 21, 28, 60, 90, 120 days • • • • • • • • • • 6 4 ... 2 7 Health outcomes (scale) PRO Behavioural markers (Fitbit) TechRO Statistical Correlations e.g., Spearman rS 0.75 7 1.1 2.1 ... 6.2 ... 4 ... 5 ... Set of Pairs PRO-TechRO Pair 7 1.1 Patterns of Correlations TechRO j TechRO k PRO i 0.75 0.55 Participants Construct PRO-TechRO bivariate sets Step 1A Compute PRO scores Step 1B Select TechRO aggregations Step 4 Inference statistical hypothesis testing Step 5 Patterns from correlations to patterns 4 2 1 ... 1 3 5 6 3 1 Sub-score Numeric score Categorical score Sub-score Sub-score Metrics for patterns 1. Count significant correlations 0.5+ - For all PROs and TechROs 2. Contours of significant correlations 0.8+ - For all PROs but only ordered TechROs coQoL Computational Model for Co-Calibration Co-Calibration of Reported Outcomes / Methods
  • 45. Examples of Contour Correlations Metric |rS| ≥ 0.8 Co-Calibration of Reported Outcomes / Methods
  • 46. Part 2 Co-Calibration of Behavioural, Health, and Quality of Life Outcomes Background Methods Results Reflections Contributions
  • 47. Participants (PRO) Co-Calibration of Reported Outcomes / Results Qualified ● N = 39 (age 70.0 ± 7.2) ○ At least one PRO or TechRO ○ 28 healthy, 11 with mild disease Signed Up ● N = 42 (age 69.8 ± 7.4)
  • 48. Co-Calibration of Reported Outcomes / Results Waves of Answers ● Wave 1 ○ Mid 2018 ● Wave 2 ○ End 2018 ○ Start 2019 ● Wave 3 ○ Mid 2019 Data Quality: Waves of Answers
  • 49. Physical Activity (IPAQ - Fitbit): Contours Co-Calibration of Reported Outcomes / Results Contours of PRO-TechRO correlations (0.8+) ● All participants ○ Domestic moderate ● Participants with mild disease ○ Work walking ○ Work moderate ○ Work vigorous ○ Garden vigorous ○ Leisure vigorous ○ Leisure total
  • 50. Social Support (MSPSS - Fitbit): Contours Co-Calibration of Reported Outcomes / Results Contours of PRO-TechRO correlations (0.8+) ● All participants ○ Significant other social support ○ Family social support ● Healthy participants ○ Significant other social support ○ Family social support ○ Friends social support
  • 51. Anxiety-Depression (GADS - Fitbit): Contours Co-Calibration of Reported Outcomes / Results Contours of PRO-TechRO correlations (0.8+) ● All participants ○ Q5A Sleeping poorly ● Healthy participants ○ Q7A Trembling
  • 52. Mediterranean Diet (PREDIMED - Fitbit): Contours Co-Calibration of Reported Outcomes / Results Contours of PRO-TechRO correlations (0.8+) ● All participants ○ Q12 Nuts consumption ● Healthy participants ○ Q3 Vegetables consumption
  • 53. Nutrition (SelfMNA - Fitbit): Contours Co-Calibration of Reported Outcomes / Results Contours of PRO-TechRO correlations (0.8+) ● Participants with mild disease ○ Q1 Food intake declined ○ Q2 Weight loss ○ Q4 Stressed or severely ill
  • 54. Memory (MFE - Fitbit): Contours Co-Calibration of Reported Outcomes / Results Contours of PRO-TechRO correlations (0.8+) ● All participants ○ Q24 Forgetting where things are kept ● Healthy participants ○ Q14 Forgetting to do planned things ● Participants with mild disease ○ Q18 Forgetting to tell somebody something important
  • 55. Sleep Quality (PSQI - Fitbit): Contours Co-Calibration of Reported Outcomes / Results Contours of PRO-TechRO correlations (0.8+) ● All participants ○ Q5F trouble due to feeling cold ● Healthy participants ○ Q5C trouble due to use of the bathroom ● Participants with mild disease ○ Q4 duration of actual sleep
  • 56. Quality of Life (EQ-5D-3L - Fitbit): Contours Co-Calibration of Reported Outcomes / Results Contours of PRO-TechRO correlations (0.8+) ● Participants with mild disease ○ Q5 Anxiety and depression
  • 57. Part 2 Co-Calibration of Behavioural, Health, and Quality of Life Outcomes Background Methods Results Reflections Contributions
  • 58. Effects of Longitudinal Measurement Co-Calibration of Reported Outcomes / Reflections Example: MSPSS Q3 vs Relative Fair Activity ● A strong PRO-TechRO correlation (0.9) ○ “More family help ~ more fair activity” ○ PRO: MSPSS Q3 family trying to help ○ TechRO: relative fair physical activity ● Effect of interval and leeway on corrs. ○ correlates the highest at 28 days ○ increasing leeway, decreasing corrs. Durations of Monitoring ● We reported strong correlations across ○ many TechRO durations (7-120 days) ○ many leeway durations (0-120 days)
  • 59. Towards Personalized and Holistic Assessment Co-Calibration of Reported Outcomes / Reflections PROs TechROs PROs TechROs Wave 1 Worse Mid Better Worse Mid Better Worse Mid Better Wave 2 Wave 3 Wave 1 Worse Mid Better Worse Mid Better Worse Mid Better Wave 2 Wave 3 PROs Wave 1 Worse Mid Better Wave 2 Worse Mid Better Wave 3 Worse Mid Better TechROs
  • 60. coQoL as a Methodological Approach Co-Calibration of Reported Outcomes / Reflections Advantages Potential for personalized and holistic assessment Limitations Small sample size led to simple methods Identified groups of PRO-TechRO relations Feasibility
  • 61. Part 2 Co-Calibration of Behavioural, Health, and Quality of Life Outcomes Background Methods Results Reflections Contributions
  • 62. Objectives × Scientific Contributions Co-Calibration of Reported Outcomes / Contributions Thoroughly explored a research area ● Prior work on assessing PROs and TechROs ● Energy and fatigue facet (see publications) Provided empirical data ● Physical and psychological PROs (raw) ● Behavioural marker TechROs (aggregate) ● Patterns of PRO-TechRO statistical correlations Produced a reusable computational model ● coQoL co-calibration model for PROs and TechROs Designed and developed a tool ● Tools for validated scale data collection PRO ● Tools for consumer wearable data collection TechRO Review the literature on co-calibration 1 Review the literature on a related QoL facet 2 Collect behavioural, health, and Quality of Life PROs from validated scales 3 Collect behavioural marker TechROs using wearables 4 Assess quality properties of the collected data 5 Observe PRO-TechRO statistical relations 6 Derive a computational model for co-calibration 7 Demonstrate the model's feasibility in the study 8 Inform designs of future longitudinal in situ studies 9
  • 64. Challenges and Opportunities Conclusions Motivation and Facilitation ● Self-reported motivation to participate ○ Validate models that assess motivation ● Motivation not perceived as central when designing studies ○ Implement tools that facilitate and measure participation Co-calibration of Reported Outcomes ● Small sample size and simple methods ○ Powered studies specialized on subsets of PROs and TechROs ○ More advanced methods, e.g., predict PROs based on TechRO ● coQoL for observational settings ○ Gold standard updates with consumer wearables when valid ● coQoL for interventional settings ○ Proactive investigation of inflections
  • 65. Vision Observational Study with coQoL Conclusions Behaviour change techniques High-quality TechROs approx. 1 month Relevant PRO administration at the end of the 1 month coQoL PRO-TechRO subsets Trigger helps obtain informs Further co-calibration facilitates * longitudinal study, 2+ years, avoid initial 3 weeks 3 months of data needed for the less compliant PRO repeated in the same season PRO repeated in different seasons
  • 66. Vision Interventional Study with coQoL Conclusions * longitudinal study, avoid initial 3 weeks Gradual change in behaviour Inflection criteria in TechRO prior from co-calibrations Relevant PRO administration at the end of the 1 month coQoL PRO-TechRO subsets Trigger helps trigger informs Participant known "state" updates
  • 67. Future Work Conclusions Motivation and Facilitation ● Data collected in a study (N = 100) on motivation and facilitation of human subject studies. Co-calibration of Reported Outcomes ● Analysis complete in a study (N = 27) on cardiac patients with Vital Beats. ● Additional studies in the lab leveraging coQoL and its PRO-TechRO results.
  • 68. Dissemination: Motivation and Facilitation Conclusions Workshop paper Vlad Manea, Mads Schnoor Hansen, Semahat Ece Elbeyi, Katarzyna Wac. Towards Personalizing Participation in Health Studies. Workshop on Multimedia for Personal Health and Health Care (HealthMedia 2019), Conference on Multimedia (MM 2019). 8p. DOI: https://doi.org/10.1145/3347444.3356241.2 Conference paper Allan Berrocal, Vlad Manea, Alexandre De Masi, Katarzyna Wac. mQoL-Lab: Step-by-Step Creation of a Flexible Platform to Conduct Studies Using Interactive, Mobile, Wearable and Ubiquitous Devices. Conference on Mobile Systems and Pervasive Computing (MobiSPC 2020). 9p. DOI: https://doi.org/10.1016/j.procs.2020.07.033. Workshop paper Vlad Manea, Katarzyna Wac. mQoL: Mobile Quality of Life lab: from Behavior Change to Quality of Life. Workshop on Mobile Human Contributions (MHC 2018), Conference on Pervasive and Ubiquitous Computing (UbiComp 2018). 6p. DOI: https://doi.org/10.1145/3267305.3267549.3 Workshop call for papers Vlad Manea, Allan Berrocal, Alexandre De Masi, Naja Holten Møller, Katarzyna Wac, Hannah Bayer, Sune Lehmann, Euan Ashley. Call for Papers: LDC ’19: Workshop on Longitudinal Data Collection in Human Subject Studies. Call for Papers for the Workshop on Longitudinal Data Collection in Human Subject Studies (LDC 2019), Conference on Pervasive and Ubiquitous Computing (UbiComp 2019). 4p. DOI: https://doi.org/10.1145/3341162.3347758.4 Poster Vlad Manea, Vero Estrada-Galiñanes, Katarzyna Wac. mQoL: Mobile Quality of Life lab. Poster and demo at the Digital Health Conference (DH 2018). Advised master thesis Alba Kejser Perez, Cecilie Rosentoft, Elisabeth Brinth Refstrup. Designing for Participation in Longitudinal Health and Well-being Studies. MSc thesis (2020, September). Department of Media, Cognition, and Communication, University of Copenhagen. Co-supervised master thesis Mads Schnoor Hansen. Engaging Participants in the Recruitment Phase of Human Subject Health Studies – mQoL-chat: a Chatbot Approach. MSc thesis (2019, September). Department of Computer Science, University of Copenhagen.
  • 69. Dissemination: Co-Calibration of Reported Outcomes Conclusions Journal paper Vlad Manea, Katarzyna Wac. Co-calibrating Physical and Psychological Outcomes and Consumer Wearable Activity Outcomes in Older Adults: An Evaluation of the coQoL Method. Journal of Personalized Medicine, 10(4), MDPI, 2020. Special Issue: PROomics: Patient Reported Outcome (PRO) and Self-Tracking for Personalized Medicine. Impact factor 4.433, rank 10/102 (Q1) in Health Care Sciences and Services. 41p. DOI: https://doi.org/10.3390/jpm10040203 Poster Vlad Manea, Katarzyna Wac. Using Consumer-Friendly Wearables to Associate Patient-Reported Quality of Life and Tech-Reported Physical Activity and Sleep in Healthy Seniors. Poster at the Conference of the International Society for Quality of Life Research (ISOQOL 2020). DOI: https://doi.org/10.1007/s11136-020-02626-y Conference paper Vlad Manea, Allan Berrocal, Katarzyna Wac. Using Consumer-Friendly Wearables to Associate Patient- and Technology-Reported Physical Activity in Healthy Seniors. Conference on Mobile Systems and Pervasive Computing (MobiSPC2020). 8p. DOI: https://doi.org/10.1016/j.procs.2020.07.036 Book chapter Natalie Solomon, Vlad Manea. Energy and Fatigue: Classification and Assessment of Energy and Fatigue using Subjective, Objective, and Mixed Methods towards Health and Quality of Life (accepted). Book chapter in: Katarzyna Wac, Sharon Wulfovich (eds.), Quantifying Quality of Life: Incorporating Daily Life into Medicine, Health Informatics, Springer, Cham. 30p. Advised master thesis Kirke Kjellberg. ConsistencyQoL: A Framework for Modelling Consistency in Behavioural Data Collected with Wearables. MSc thesis (2020, August). Department of Computer Science, University of Copenhagen.