Lifestreams is a modular data processing pipeline that analyzes diverse mHealth data to identify important patterns and behaviors. It extracts features from raw GPS, Wi-Fi, and other passive data streams. Location traces are clustered to identify meaningful places like home and work. Relevant features are selected and modules infer health-related insights, like identifying behavior changes and patterns. The pipeline was applied to a study of 44 young mothers, extracting over 140 features from their 14GB of passive and self-report data over 6 months.
Logging in 3 communities ECIL conference 2021Pamela McKinney
Presentation developed with Andrew Cox and Laura Sbaffi to summarise our quantitative research into Food and activity tracking in 3 communities of participants - people who run for leisure with Parkrun, people with type 2 diabetes who are members of the Diabetes.co.uk online community, and members of the IBS Network charity.
Presentation on how past medical records can be used to provide appropriate and timely treatment for patients using Genetic Algorithm and Feature Selection
Enhancing Precision Wellness with Knowledge Graphs and Semantic Analytics: O...James Hendler
Talk presented at Bio-IT 2018 (machine learning track) - explores some approaches to overcoming challenges of using machine learning systems in healthcare applications.
Logging in 3 communities ECIL conference 2021Pamela McKinney
Presentation developed with Andrew Cox and Laura Sbaffi to summarise our quantitative research into Food and activity tracking in 3 communities of participants - people who run for leisure with Parkrun, people with type 2 diabetes who are members of the Diabetes.co.uk online community, and members of the IBS Network charity.
Presentation on how past medical records can be used to provide appropriate and timely treatment for patients using Genetic Algorithm and Feature Selection
Enhancing Precision Wellness with Knowledge Graphs and Semantic Analytics: O...James Hendler
Talk presented at Bio-IT 2018 (machine learning track) - explores some approaches to overcoming challenges of using machine learning systems in healthcare applications.
Homeostasis is nature’s engineering behind the most complex autonomic system that exists: the human body. Homeostasis is a self-regulating process by which biological systems tend to maintain stability while adjusting to conditions that are optimal for survival. Disruption in homeostasis results in malfunctioning of natural autonomic system causing chronic diseases. Chronic diseases have been the leading cause of death and human suffering in the last 50 years. They also have resulted in highest financial burden for individuals and countries. This can be corrected using external augmentation of the homeostasis loop. Recent progress in artificial pancreas for Type 1 Diabetes is a compelling example for such augmentation. In this paper we discuss emerging multimodal approaches for such augmentation in the context of chronical diseases. We show that multimodal sensing and fundamental technology developed by multimedia computing community may offer powerful augmentation of natural homeostasis to assist in management of chronic diseases.
The data and Information Literacy of runners: quantifying diet and activityPamela McKinney
Presentation for the European Conference on Information Literacy, 24-27th September 2018, Oulu Finland. Reports on a quantitative study that investigated the health, diet and fitness tracking behaviours of members of the Parkrun organisation in the UK
Project Careable - Contextual Experience Design Aparna Das
What is all the fuss about Internet of things? How we create interactive experiences that integrate screens, objects, and locations for a real-time personal contextual experience? Project Careable is an attempt at Contextual Experience Design (CED) and narrative storytelling. The project team comprised on Britt Olsen, Varsha Bhagel, Jahnavi Mirashi and myself.
“My Doctor is Keeping an Eye on Me!”: Exploring the Clinical Applicability of...Myuserable
By enabling people to track their lifestyles, including activity level, sleeping, and diet, technology helps clinicians to treat patients suffering from "lifestyle diseases." However, despite its importance compared to other lifestyle factors, it is not easy to record food intake consistently. Although researchers have attempted to solve this problem, most have not considered its applicability in the clinical context. In this paper, we aim to (1) understand food-journaling practices and (2) explore the applicability of lifestyle data in the clinical context. By observing 20 patients who recorded data including food logs, steps, and sleeping time, we found that patients recorded their food logs diligently, as they were conscious of clinicians. Clinicians were surprised by the high adherence rate of journaling and tried to overlap food data with other data, such as steps, sleeping time, etc. This paper contributes by providing qualitative insights for designing applicable strategies utilizing lifestyle data in the clinical context.
Data Analytics Contest organised by ideatory.co
Stage 1: Survey rating for various events by users to be predicted
Stage 2 : Recommend predictive modeling idea based on daily routine life issues
Exercise programs for people with dementia: What's the evidence?Health Evidence™
Health Evidence hosted a 90 minute webinar examining the effectiveness of exercise programs for people with dementia. Click here for access to the audio recording: https://youtu.be/jC8HhC2XFrE
Dorothy Forbes, Professor, Faculty of Nursing, University of Alberta, Edmonton led the session and presented findings from her latest Cochrane review:
Forbes, D., Forbes, S. C., Blake, C. M., Thiessen, E. J., & Forbes, S. (2015). Exercise programs for people with dementia. Cochrane Database of Systematic Reviews, 2015(4), CD006489.
As the population ages, the number of people suffering with dementia will also rise. Not only will this affect quality of life of people with dementia but will also increase the burden of family caregivers, community care, and residential care services. Exercise interventions have been identified as a potential way of reducing or delaying the progression of dementia and its symptoms. This review examines two questions: do exercise programs for older people with dementia improve cognition, activities of daily living (ADLs), challenging behaviour, depression, and mortality in older people with dementia? and; do exercise programs for older people with dementia have an indirect impact on family caregivers' burden, quality of life, and mortality?
In developing countries like India, the plan of subsidising basic domestic commodities for poor families is an important part of meeting people’s basic needs. When a self-contained system for ration distribution is available, it benefits cardholders in a variety of ways. The E-Ration is the most convenient way to purchase ration items. Its goal is to offer ration products on the internet. E-Ration Shop is an automated system that distributes the exact amount of ration to cardholders based on the type of ration card and the number of family members, as well as keeping track of transactions in a database. As a result, this approach will reduce dealer communication, manual calculations, and time spent in stores. The cardholder can access the rationing system at any time during the month, with no need for human participation in the ration shop. Each transaction is automatically logged into the database by this system. Customers who purchase ration items online will have their information saved in an internet database, which will be viewable to higher-ranking officers as well as the shop owner. A fair price store (FPS) or ration shop is another name for a public distribution shop. It is a part of the Government of India's public distribution system, which provides subsidised rations to the needy in India. The Civil Supplies Corporation is a key government agency that oversees and distributes basic supplies to all inhabitants. Various products like as rice, sugar, and kerosene are supplied utilising a traditional ration store method in that system. Some of the drawbacks of the traditional ration shop system include: The user is unable to obtain an accurate quantity of material due to laborious measurements in the traditional technique. Because it is a direct process done by online ration shop keeper, this application uploads the data immediately to the server, confirming the data. Because it is a direct process done by online ration shop keeper, they cannot do anything in these transactions as they do in paper work.
Utilizing Social Health Websites for Cognitive Computing and Clinical Decisio...CrowdTruth
Crowdsourced annotations data offers cognitive computing systems insights in lay semantics. This is especially important in health care, where medical terminology is often not aligned with patients `lay' language. However, the general crowd often has limited medical knowledge. Therefore this research investigated the opportunities of social health websites for obtaining ground truth annotations data for cognitive computing systems including clinical decision support systems. By identifying these websites and analyzing their data, it offers a starting point for the future utilization of user-generated health content for cognitive systems. However, the opportunities of social health data are currently limited by various legal regulations. Therefore this paper also dwells on the legal aspects of implementing social health data for cognitive computing systems.
Presentation of Hexoskin Validation for KHealth's Dementia Project
The paper is available at: http://www.knoesis.org/library/resource.php?id=2155
Citation for the paper: T. Banerjee, P. Anantharam, W. L. Romine, L. Lawhorne, A. Sheth, 'Evaluating a Potential Commercial Tool for Healthcare Application for People with Dementia' in Proc. of the Intl Conf on Health Informatics and Medical Systems (HIMS), Las Vegas, July 27-30, 2015.
Data drives company outcomes - employers agree analytics are a key factor in strategic planning. Customizing wellness solutions that has turned science fiction into science. Employees biometrics and genomics - sequencing the genome - drives choosing individualized wellness coaching. Health solutions - providing a path of sustainability and adherence - scientific, engaging, redefining individualized - And we make it affordable. Employee health programs - what a wonderful way to build healthier communities - establish lifestyle habits creating a healthier future for our children. We can manage & prevent chronic illnesses - saving lives and money - investing the money for happier, bigger, better futures.
In the literature on sensing and monitoring, missing data is often treated as a nuisance. Statisticians have investigated many ways of filling gaps in a data set, depending on whether the data is missing completely randomly, whether the patterns of missing data can be predicted from other variables in the data set, or whether the patterns of missing data are regular, but hard to predict from existing data.
In this talk, I argue that missing data is evidence for how people engage with sensors and devices. I outline the processes that result in the absence of data, and discuss how this contextual understanding can be used to improve interpretation and analytics.
This talk is based on joint work with the Help4Mood team (http://help4mood.info) and Henry Potts, UCL, and Katarzyna Stawarz, Bristol, during an Alan Turing Institute Summer Programme Small Group.
A novel deep-learning enabled, metric learning based recommendation model that significantly improves the state-of-the-art recommendation accuracy for a large number of recommendation tasks (news, books, photography, music, etc.)
Homeostasis is nature’s engineering behind the most complex autonomic system that exists: the human body. Homeostasis is a self-regulating process by which biological systems tend to maintain stability while adjusting to conditions that are optimal for survival. Disruption in homeostasis results in malfunctioning of natural autonomic system causing chronic diseases. Chronic diseases have been the leading cause of death and human suffering in the last 50 years. They also have resulted in highest financial burden for individuals and countries. This can be corrected using external augmentation of the homeostasis loop. Recent progress in artificial pancreas for Type 1 Diabetes is a compelling example for such augmentation. In this paper we discuss emerging multimodal approaches for such augmentation in the context of chronical diseases. We show that multimodal sensing and fundamental technology developed by multimedia computing community may offer powerful augmentation of natural homeostasis to assist in management of chronic diseases.
The data and Information Literacy of runners: quantifying diet and activityPamela McKinney
Presentation for the European Conference on Information Literacy, 24-27th September 2018, Oulu Finland. Reports on a quantitative study that investigated the health, diet and fitness tracking behaviours of members of the Parkrun organisation in the UK
Project Careable - Contextual Experience Design Aparna Das
What is all the fuss about Internet of things? How we create interactive experiences that integrate screens, objects, and locations for a real-time personal contextual experience? Project Careable is an attempt at Contextual Experience Design (CED) and narrative storytelling. The project team comprised on Britt Olsen, Varsha Bhagel, Jahnavi Mirashi and myself.
“My Doctor is Keeping an Eye on Me!”: Exploring the Clinical Applicability of...Myuserable
By enabling people to track their lifestyles, including activity level, sleeping, and diet, technology helps clinicians to treat patients suffering from "lifestyle diseases." However, despite its importance compared to other lifestyle factors, it is not easy to record food intake consistently. Although researchers have attempted to solve this problem, most have not considered its applicability in the clinical context. In this paper, we aim to (1) understand food-journaling practices and (2) explore the applicability of lifestyle data in the clinical context. By observing 20 patients who recorded data including food logs, steps, and sleeping time, we found that patients recorded their food logs diligently, as they were conscious of clinicians. Clinicians were surprised by the high adherence rate of journaling and tried to overlap food data with other data, such as steps, sleeping time, etc. This paper contributes by providing qualitative insights for designing applicable strategies utilizing lifestyle data in the clinical context.
Data Analytics Contest organised by ideatory.co
Stage 1: Survey rating for various events by users to be predicted
Stage 2 : Recommend predictive modeling idea based on daily routine life issues
Exercise programs for people with dementia: What's the evidence?Health Evidence™
Health Evidence hosted a 90 minute webinar examining the effectiveness of exercise programs for people with dementia. Click here for access to the audio recording: https://youtu.be/jC8HhC2XFrE
Dorothy Forbes, Professor, Faculty of Nursing, University of Alberta, Edmonton led the session and presented findings from her latest Cochrane review:
Forbes, D., Forbes, S. C., Blake, C. M., Thiessen, E. J., & Forbes, S. (2015). Exercise programs for people with dementia. Cochrane Database of Systematic Reviews, 2015(4), CD006489.
As the population ages, the number of people suffering with dementia will also rise. Not only will this affect quality of life of people with dementia but will also increase the burden of family caregivers, community care, and residential care services. Exercise interventions have been identified as a potential way of reducing or delaying the progression of dementia and its symptoms. This review examines two questions: do exercise programs for older people with dementia improve cognition, activities of daily living (ADLs), challenging behaviour, depression, and mortality in older people with dementia? and; do exercise programs for older people with dementia have an indirect impact on family caregivers' burden, quality of life, and mortality?
In developing countries like India, the plan of subsidising basic domestic commodities for poor families is an important part of meeting people’s basic needs. When a self-contained system for ration distribution is available, it benefits cardholders in a variety of ways. The E-Ration is the most convenient way to purchase ration items. Its goal is to offer ration products on the internet. E-Ration Shop is an automated system that distributes the exact amount of ration to cardholders based on the type of ration card and the number of family members, as well as keeping track of transactions in a database. As a result, this approach will reduce dealer communication, manual calculations, and time spent in stores. The cardholder can access the rationing system at any time during the month, with no need for human participation in the ration shop. Each transaction is automatically logged into the database by this system. Customers who purchase ration items online will have their information saved in an internet database, which will be viewable to higher-ranking officers as well as the shop owner. A fair price store (FPS) or ration shop is another name for a public distribution shop. It is a part of the Government of India's public distribution system, which provides subsidised rations to the needy in India. The Civil Supplies Corporation is a key government agency that oversees and distributes basic supplies to all inhabitants. Various products like as rice, sugar, and kerosene are supplied utilising a traditional ration store method in that system. Some of the drawbacks of the traditional ration shop system include: The user is unable to obtain an accurate quantity of material due to laborious measurements in the traditional technique. Because it is a direct process done by online ration shop keeper, this application uploads the data immediately to the server, confirming the data. Because it is a direct process done by online ration shop keeper, they cannot do anything in these transactions as they do in paper work.
Utilizing Social Health Websites for Cognitive Computing and Clinical Decisio...CrowdTruth
Crowdsourced annotations data offers cognitive computing systems insights in lay semantics. This is especially important in health care, where medical terminology is often not aligned with patients `lay' language. However, the general crowd often has limited medical knowledge. Therefore this research investigated the opportunities of social health websites for obtaining ground truth annotations data for cognitive computing systems including clinical decision support systems. By identifying these websites and analyzing their data, it offers a starting point for the future utilization of user-generated health content for cognitive systems. However, the opportunities of social health data are currently limited by various legal regulations. Therefore this paper also dwells on the legal aspects of implementing social health data for cognitive computing systems.
Presentation of Hexoskin Validation for KHealth's Dementia Project
The paper is available at: http://www.knoesis.org/library/resource.php?id=2155
Citation for the paper: T. Banerjee, P. Anantharam, W. L. Romine, L. Lawhorne, A. Sheth, 'Evaluating a Potential Commercial Tool for Healthcare Application for People with Dementia' in Proc. of the Intl Conf on Health Informatics and Medical Systems (HIMS), Las Vegas, July 27-30, 2015.
Data drives company outcomes - employers agree analytics are a key factor in strategic planning. Customizing wellness solutions that has turned science fiction into science. Employees biometrics and genomics - sequencing the genome - drives choosing individualized wellness coaching. Health solutions - providing a path of sustainability and adherence - scientific, engaging, redefining individualized - And we make it affordable. Employee health programs - what a wonderful way to build healthier communities - establish lifestyle habits creating a healthier future for our children. We can manage & prevent chronic illnesses - saving lives and money - investing the money for happier, bigger, better futures.
In the literature on sensing and monitoring, missing data is often treated as a nuisance. Statisticians have investigated many ways of filling gaps in a data set, depending on whether the data is missing completely randomly, whether the patterns of missing data can be predicted from other variables in the data set, or whether the patterns of missing data are regular, but hard to predict from existing data.
In this talk, I argue that missing data is evidence for how people engage with sensors and devices. I outline the processes that result in the absence of data, and discuss how this contextual understanding can be used to improve interpretation and analytics.
This talk is based on joint work with the Help4Mood team (http://help4mood.info) and Henry Potts, UCL, and Katarzyna Stawarz, Bristol, during an Alan Turing Institute Summer Programme Small Group.
Similar to Lifestreams Presentation (Sensys 14) (20)
A novel deep-learning enabled, metric learning based recommendation model that significantly improves the state-of-the-art recommendation accuracy for a large number of recommendation tasks (news, books, photography, music, etc.)
Immersive Recommendation incorporates cross-platform and diverse personal digital traces into recommendations. Our context-aware topic modeling algorithm systematically profiles users' interests based on their traces from different contexts, and our hybrid recommendation algorithm makes high-quality recommendations by fusing users' personal profiles, item profiles, and existing ratings. The proposed model showed significant improvement over the state-of-the-art algorithms, suggesting the value of using this new user-centric recommendation model to improve recommendation quality, including in cold-start situations.
Final project report on grocery store management system..pdfKamal Acharya
In today’s fast-changing business environment, it’s extremely important to be able to respond to client needs in the most effective and timely manner. If your customers wish to see your business online and have instant access to your products or services.
Online Grocery Store is an e-commerce website, which retails various grocery products. This project allows viewing various products available enables registered users to purchase desired products instantly using Paytm, UPI payment processor (Instant Pay) and also can place order by using Cash on Delivery (Pay Later) option. This project provides an easy access to Administrators and Managers to view orders placed using Pay Later and Instant Pay options.
In order to develop an e-commerce website, a number of Technologies must be studied and understood. These include multi-tiered architecture, server and client-side scripting techniques, implementation technologies, programming language (such as PHP, HTML, CSS, JavaScript) and MySQL relational databases. This is a project with the objective to develop a basic website where a consumer is provided with a shopping cart website and also to know about the technologies used to develop such a website.
This document will discuss each of the underlying technologies to create and implement an e- commerce website.
Student information management system project report ii.pdfKamal Acharya
Our project explains about the student management. This project mainly explains the various actions related to student details. This project shows some ease in adding, editing and deleting the student details. It also provides a less time consuming process for viewing, adding, editing and deleting the marks of the students.
About
Indigenized remote control interface card suitable for MAFI system CCR equipment. Compatible for IDM8000 CCR. Backplane mounted serial and TCP/Ethernet communication module for CCR remote access. IDM 8000 CCR remote control on serial and TCP protocol.
• Remote control: Parallel or serial interface.
• Compatible with MAFI CCR system.
• Compatible with IDM8000 CCR.
• Compatible with Backplane mount serial communication.
• Compatible with commercial and Defence aviation CCR system.
• Remote control system for accessing CCR and allied system over serial or TCP.
• Indigenized local Support/presence in India.
• Easy in configuration using DIP switches.
Technical Specifications
Indigenized remote control interface card suitable for MAFI system CCR equipment. Compatible for IDM8000 CCR. Backplane mounted serial and TCP/Ethernet communication module for CCR remote access. IDM 8000 CCR remote control on serial and TCP protocol.
Key Features
Indigenized remote control interface card suitable for MAFI system CCR equipment. Compatible for IDM8000 CCR. Backplane mounted serial and TCP/Ethernet communication module for CCR remote access. IDM 8000 CCR remote control on serial and TCP protocol.
• Remote control: Parallel or serial interface
• Compatible with MAFI CCR system
• Copatiable with IDM8000 CCR
• Compatible with Backplane mount serial communication.
• Compatible with commercial and Defence aviation CCR system.
• Remote control system for accessing CCR and allied system over serial or TCP.
• Indigenized local Support/presence in India.
Application
• Remote control: Parallel or serial interface.
• Compatible with MAFI CCR system.
• Compatible with IDM8000 CCR.
• Compatible with Backplane mount serial communication.
• Compatible with commercial and Defence aviation CCR system.
• Remote control system for accessing CCR and allied system over serial or TCP.
• Indigenized local Support/presence in India.
• Easy in configuration using DIP switches.
Explore the innovative world of trenchless pipe repair with our comprehensive guide, "The Benefits and Techniques of Trenchless Pipe Repair." This document delves into the modern methods of repairing underground pipes without the need for extensive excavation, highlighting the numerous advantages and the latest techniques used in the industry.
Learn about the cost savings, reduced environmental impact, and minimal disruption associated with trenchless technology. Discover detailed explanations of popular techniques such as pipe bursting, cured-in-place pipe (CIPP) lining, and directional drilling. Understand how these methods can be applied to various types of infrastructure, from residential plumbing to large-scale municipal systems.
Ideal for homeowners, contractors, engineers, and anyone interested in modern plumbing solutions, this guide provides valuable insights into why trenchless pipe repair is becoming the preferred choice for pipe rehabilitation. Stay informed about the latest advancements and best practices in the field.
Immunizing Image Classifiers Against Localized Adversary Attacksgerogepatton
This paper addresses the vulnerability of deep learning models, particularly convolutional neural networks
(CNN)s, to adversarial attacks and presents a proactive training technique designed to counter them. We
introduce a novel volumization algorithm, which transforms 2D images into 3D volumetric representations.
When combined with 3D convolution and deep curriculum learning optimization (CLO), itsignificantly improves
the immunity of models against localized universal attacks by up to 40%. We evaluate our proposed approach
using contemporary CNN architectures and the modified Canadian Institute for Advanced Research (CIFAR-10
and CIFAR-100) and ImageNet Large Scale Visual Recognition Challenge (ILSVRC12) datasets, showcasing
accuracy improvements over previous techniques. The results indicate that the combination of the volumetric
input and curriculum learning holds significant promise for mitigating adversarial attacks without necessitating
adversary training.
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdffxintegritypublishin
Advancements in technology unveil a myriad of electrical and electronic breakthroughs geared towards efficiently harnessing limited resources to meet human energy demands. The optimization of hybrid solar PV panels and pumped hydro energy supply systems plays a pivotal role in utilizing natural resources effectively. This initiative not only benefits humanity but also fosters environmental sustainability. The study investigated the design optimization of these hybrid systems, focusing on understanding solar radiation patterns, identifying geographical influences on solar radiation, formulating a mathematical model for system optimization, and determining the optimal configuration of PV panels and pumped hydro storage. Through a comparative analysis approach and eight weeks of data collection, the study addressed key research questions related to solar radiation patterns and optimal system design. The findings highlighted regions with heightened solar radiation levels, showcasing substantial potential for power generation and emphasizing the system's efficiency. Optimizing system design significantly boosted power generation, promoted renewable energy utilization, and enhanced energy storage capacity. The study underscored the benefits of optimizing hybrid solar PV panels and pumped hydro energy supply systems for sustainable energy usage. Optimizing the design of solar PV panels and pumped hydro energy supply systems as examined across diverse climatic conditions in a developing country, not only enhances power generation but also improves the integration of renewable energy sources and boosts energy storage capacities, particularly beneficial for less economically prosperous regions. Additionally, the study provides valuable insights for advancing energy research in economically viable areas. Recommendations included conducting site-specific assessments, utilizing advanced modeling tools, implementing regular maintenance protocols, and enhancing communication among system components.
Water scarcity is the lack of fresh water resources to meet the standard water demand. There are two type of water scarcity. One is physical. The other is economic water scarcity.
1. Lifestreams
A modular sense-making toolset for identifying
important patterns from everyday life
Cheng-Kang (Andy) Hsieh
Hongsuda Tangmunarunkit
Faisal Alquaddoomi
John Jenkins
Jinha Kang
Cameron Ketcham
Brent Longstaff
Joshua Selsky
Betta Dawson
Dallas Swendeman
Deborah Estrin
Nithya Ramanathan
2. Health Concerns of After-
Pregnancy Moms
• Obesity
• Diabetes
• Depression
• Cardiovascular Diseases
• Suggested Strategy: Make
behavior changes when
children are young.
* Sattar, Naveed, and Ian A. Greer. "Pregnancy complications and maternal cardiovascular risk: opportunities for intervention and
screening?." British Medical Journal 2002.
* Gunderson, Erica P., and Barbara Abrams. "Epidemiology of gestational weight changes after pregnancy." Epidemiologic reviews, 2002.
* Nielsen, D., et al. "Postpartum depression: identification of women at risk."BJOG: An International Journal of Obstetrics &
Gynaecology 107.10, 2000.
3. Use mobile Health (mHealth) data to
provide personalized intervention
Photo: Marshall Astor, WWW
Personalized Intervention
Data Processing
(transform, cluster, infer, viz)
(smart apps, coaches)
4. Main Contributions
• Developed Lifestreams pipeline and an initial
set of modules that identified health-related
trends and patterns.
• Applied Lifestreams to a real-world mHealth
study.
• Validated the analysis results through the
interviews with the study participants.
• Evaluated the extensibility of Lifestreams by
applying it to two additional studies.
5. Pilot Field Study: Mom’s Study
• 44 young mothers monitor diet,
stress, and exercise for 6 months.
Dataset:
•Self-Reports
•On average, 2 self-reports per mom
per day.
•Passive Data Streams
•GPS data
•Ambient Wi-Fi signals
•Phone’s accelerometry
•Totaling 14GB of data. ohmage: a mobile data
collection tool
6. Use Lifestreams to analyze Moms’
data.
• How are moms progressing in their weight control?
• What is the cause of an undesirable behavior?
• What are major life events that affect moms’
behaviors?
• Can these be automatically detected to trigger some
action?
8. Raw Passive Data Streams
GPS Data
AccelerometryAmbient Wi-Fi Signals
• Collect every 1 or 5 minutes.
• Over 300MB per mom.
• Noisy and hard to analyze.
10. Lifestreams
• Modular and extensible data processing
pipeline.
• Allows researchers and app developers
to plugin their best tools and build their
apps on top of existing modules.
• An initial set of Lifestreams modules
was developed for Mom’s study to
answer health-related questions.
Raw mHealth
data
Feature
Extraction
Feature
Selection
Inference
Visualization
13. Transform Raw GPS
& Wi-Fi Data
into Meaningful
Location Features
(home, work place, lunch
place, coffee shop, school,
grocery etc.)
Location Feature Extraction
Module
14. DBSCAN (A Spatial Clustering
Algorithm)
Time complexity: O(n2), where n is number of data
points. In Mom’s study, n > 200,000.
One-day location trace of a mom:
Data points are clustered into
geo-areas of meaningful places.
Home Lunch place
Work place
15. Proposed Algorithm:
Two-Phase DBSCAN
O(K2D+M2) K : # of data points in a day
D: # of days
M: # of places extracted in Phase I
O(K2+M2)
(if run incrementally)
Time complexity:
Location Traces DBSCAN
DBSCAN
DBSCAN
DBSCAN
…
DBSCAN
Day 1
Day 2
Day …
Day N-1
Day N
DBSCAN
L*
1,1 L*
1,2 …
L*
2,1 L*
2,2 …
L*
N-1,1 L*
N-1,2 …
L*
N,1 L*
N,2 …
L1 L2 L3 …
L1 L2 L3 L4 …
Our Approach: Two-Phase DBSCAN
Location Trace
Phase 1 Phase 2
18. • Over 140 features were automatically extracted for each
Mom.
• Perform feature selection to select relevant features.
• Manual selection by domain knowledge.
• Semi-auto selection assisted by statistical methods.
Feature Selection
Mutual Information
20. Change Detection
• Use: Identify changes in behaviors related to diet,
stress, exercise.
• Method: A statistical change detection algorithm is
used to identify change points in behavioral
features.
21. 1. Assume that we are now at time t.
2
3
4
5
0 50 100 150
time t
Statistical Change Detection Algorithm
Daily Stress Level of A Mom
22. 2
3
4
5
0 50 100 150
splitting points
time t
2. Iteratively analyze all the possible splitting points
Statistical Change Detection Algorithm
Daily Stress Level of A Mom
23. 2
3
4
5
0 50 100 150
splitting point S
time t
3. If a splitting point S make the difference between the
two subsets of data exceed a threshold.
Statistical Change Detection Algorithm
Daily Stress Level of A Mom
24. 2
3
4
5
0 50 100 150
Change point S.
time t
4. Consider S as a change point, discard previous data,
and restart the algorithm
Statistical Change Detection Algorithm
Daily Stress Level of A Mom
25. Measure Distribution Difference
Between Different Parts of Data
• Human behavior is not assumed to be normally
distributed.
• Mann-Whitney’s U is preferred over Student’s T
• Make no assumption about the distribution.
• Based on ranks of observations rather than absolute
values.
2
3
4
5
0 50 100 150
splitting point S
time t
26. Daily Stress Level
Daily Eating Quality
Stress Caused by Health
Walking Time (Minutes)
Driving Distance (Miles)
2
3
4
5
2
3
4
5
0
1
2
3
0
30
60
90
0
50
100
150
Apr Jul Oct
Change Point Weight Watcher Progra
May Jun Aug Sep
(# of Reports)
Change Detection Results
• Changes are
detected in diet,
stress behaviors.
• Results were
validated through
the interview.
Daily Stress Level
Daily Eating Quality
Stress Caused by Health
Walking Time (Minutes)
Driving Distance (Miles)
2
3
4
5
2
3
4
5
0
1
2
3
0
30
60
90
0
50
100
150
Apr Jul Oct
Change Point Weight Watcher Progra
May Jun Aug Sep
Change Point
Detection Time
Weight Watcher
Daily Stress Level
Daily Eating Quality
Stress Caused by Health
Walking Time (Minutes)
2
3
4
5
2
3
4
5
0
1
2
3
Change Point Weight Watcher Progra
Daily Stress Level
Daily Eating Quality
Stress Caused by Health
Walking Time (Minutes)
Driving Distance (Miles)
2
3
4
5
2
3
4
5
0
1
2
3
0
30
60
90
0
50
100
150
Apr Jul Oct
Change Point Weight Watcher Progra
May Jun Aug Sep
27. Correlation Analysis Module
• Use: Identify patterns of an undesirable behavior.
• Method: Five different measurements are used to
measure the correlation between different types of
behavioral features.
Table 1. Five different measures used to compute correlation
coefficients between quantitative, ordinal, and nominal
features.
Quantitative Ordinal Nominal
Quantitative Pearson’s r Spearman’s rho Point Biserial rpb
Ordinal Spearman’s rho Spearman’s rho Rank Bisereal rrb
Nominal Point Biserial rpb Rank Bisereal rrb Phi
Correlation measurements for different data types
28. 0.370.18-0.330.4500-0.280.38
0.45-0.410.600-0.360.44
-0.230.5600-0.320.24
-0.49000.55-0.51
00.27-0.610.72
000
-0.340.32
-0.83
Stress Level in Late Afternoon
Stress Level in Mid Day
Stress Level in Morning
Timefor Self
Stress Caused by Finances
Stress Caused by Traffic
Overall Stress Level
Time in New House (Place 2)
Time in Old House (Place 1)
e Arrive Work
edule Variance
Correlation Matrix for
Stress-Related Pattern
• Places vs. Stress
• Time for self vs. Stress
Positive
Negative
0-0.220000-0.220000
0.370.18-0.330.4500-0.280.3800.33
0.45-0.410.600-0.360.4400
-0.230.5600-0.320.2400
-0.49000.55-0.5100
00.27-0.610.7200.28
00000
-0.340.3200.31
-0.83-0.28-0.38
0.350.45
0.45
Reported Exercise Time
StressLevelinLateAfternoon
StressLevelin MidDay
StressLevelinMorning
TimeforSelf
StressCausedby Finances
StressCausedbyTraffic
Overall Stress Level
TimeinNew House (Place 1)
Time in OldHouse (Place 2)
Time Arrive Work
Work ScheduleVariance
-
Correlation
Coefficient
29. Correlation Change Detection
• Use: Identify changes in behavior patterns.
• Method: Similar to single-feature change detection,
but it measures the difference between the
correlations of two features of different subsets of
data.
30. Correlation Change Detection
Result
• Reversed correlation between exercise and
stress.
• Not revealed by the overall correlation.
Cor: -0.07Cor: 0.68
var1
var2
0.00
0.25
0.50
0.75
1.00
2.5
3.0
3.5
4.0
Apr Jul Oct
Cor: -0.58 Cor: -0.45
Cor: 0.71
0
10
20
30
40
50
2.5
3.0
3.5
4.0
Apr May Jun Jul Aug Sep Oct
ExerciseTime (Minutes)( )
DailyOverallStress
Overall Correlation: 0.10
Cor: -0.07Cor: 0.68
0.00
0.25
0.50
0.75
1.00
2.5
3.0
3.5
4.0
Apr Jul Oct
ExerciseWithChild
DailyMaximunStress
OverallCorrelation: 0.32
31. Extending Lifestreams
• Family Wellness Study:
• Study the interactions among family
members using self-reports and acoustic
data.
• Mobilize (participatory sensing
exercise for high school students)
• Study relation between the students’
attachment to phones and their
participation to the study.
• More Potential Use Cases
• PTSD, chronic pain, inflammatory, depression, insomnia,
trauma, asthma and more ...
32. Limitations and Challenges
• Missing data problem
• Need robust statistical techniques.
• More engaging mobile use experience.
• Difficulty in validation
• Interview data is insufficient.
• Expert knowledge will help.
• Too much complicated Information
• Need innovations in UI & data analysis to make
information more accessible for busy users.
33. Lifestreams is an open source
software
• We invite people to work with us to make sense of
data and to together, fulfill the promises of mHealth.
• Lifestreams: https://github.com/changun/Lifestreams
• Ohmage: https://github.com/ohmage/