2018 Florida Data Science for Social Good (FL-DSSG) Big Reveal Presentation

2018 Florida Data Science for Social Good Big RevealAugust 22, 2018
1
Data Science Meets Community Impact

2
FL-DSSG Team
Program Directors
Dr. Dan Richard
Associate Professor of Psychology,
Director of the Office of Faculty Enhancement,
University of North Florida (UNF)
Dr. Karthikeyan Umapathy
Associate Professor of Computing,
Distinguished FIS Professor,
University of North Florida (UNF)
Advisory Board Members
Arri Landsman-Roos
Director of Analytics
Jacksonville Jaguars
Robert Marsh
Chief Technology Officer
NLP Logix

3
Naveen Agarwal
Principal and Founder,
Creative Analytics Solutions
Kellen Blumberg
Manager of Advanced Analytics,
Jacksonville Jaguars
Jay Lewis
Digital Insights & Analytics Manager,
TIAA Bank
James Parks
Data Scientist,
AgileThought
Candace Dorn
Operations Analyst,
Jacksonville Energy Authority (JEA)
Industry Sherpas

4
Dr. Amanda Pascale
Higher Education Administration,
UNF College of Education &
Human Services
Dr. Lakshmi Goel
Management,
UNF Coggin College of Business
Dr. Emma Apatu
Public Health,
UNF Brooks College of Health
Dr. Beyza Aslan
Mathematics & Statistics,
UNF College of Arts and Sciences
Dr. Julie Merten
Public Health,
UNF Brooks College of Health
Dr. Georgette Dumont
Political Science & Public Administration,
UNF College of Arts and Sciences
Dr. Gordon Ratika
Anthropology,
Director of Academic Technology,
UNF College of Arts of Sciences
Dr. Sandeep Reddivari
Computing,
UNF College of Computing,
Engineering, and
Construction Management
Faculty Leads

5
2018 FL-DSSG Interns
Yekaterina (Kat) Bardash
Data Science,
Master of Science Student,
Regis University, Denver, CO
Gabrielle Coker
Mathematics,
Bachelor of Science Student,
UNF
William Giroux
Public Administration
Master of Public Administration Student
UNF
Tabitha Powell
Psychological Sciences,
Master of Science Student
UNF
Crista Cummings
Anthropology,
Bachelor of Arts Student
UNF
Danish Sayed
Statistics,
Bachelor of Science Student,
UNF
Habeeba Siddiqui
Computer Science,
Master of Science, 2017
University of Illinois,
Springfield, IL
Britni Surprenant
Psychological Sciences,
Master of Science Student
UNF

6
Identify a Nonprofit or Public
sector organization with a
”Wicked Problem”
Gather Data and
Formulate a Plan
Analyze the
Data
Improve Decision
Making Process
for our Nonprofit
Client
Data Science for Social Good (DSSG)
DSSG concept formed and started at the University of Chicago in 2013.

7
Gaining actionable
insights into data
Helping Public Sector
and Nonprofit
Organizations make
data-driven decisions
Training data scientists
with social conscious
Florida Data Science for Social Good (FL-DSSG)

8
Data Science is Hard!
Image source: https://deepconnect.cloud/data-science-is-hard/

9
DSSG is Fun

10
Rena Coughlin
Nonprofit Center, CEO
Dr. George Rainbolt
Dean of UNF College of Arts and
Sciences
Dr. Mark Tumeo
Dean of UNF College of
Computing, Engineering, and
Construction Management

11
Taylor Howard
Vice President - Build,
AgileThought

12
2018 FL-DSSG Projects
1. Baptist Health Y Healthy Living Centers - Addressing Metabolic Syndrome
2. The Performers Academy - Empowering At-risk Youths through the Arts
3. Girls Incorporated of Jacksonville - Breaking the Cycle of Poverty
4. Family Support Services of North Florida - Patterns and Trends in Child
Welfare Resource Systems

13
Baptist Health YHLCs
Evaluating Metabolic Syndrome

14
Healthy Living
Centers (YHLC)
Focus
Wellness vs.
Illness
Changing Lifestyle
Habits
Metabolic
Syndrome
What are
They?
Community
Wellness Center
Baptist Health –
YMCA
Partnership

15
High
Triglycerides
> 150 mg/dL
High
Glucose
> 100 mg/dL
High Blood
Pressure
> 130/85
mmHG
High Waist
Circumference
Men > 40 in
Women > 35 in
Low
HDL
Men < 40 mg/dL
Women < 50 mg/dL
Three of Five
Factors
Risk Factors for Metabolic Syndrome

16
$3,581Without Metabolic
Syndrome
$5,732With Metabolic Syndrome
Annual Health
Costs per
Person
Boudreau, D. M., Malone, D. C., Raebel, M. A., Fishman, P. A., Nichols, G. A., Feldstein, A. C., ... & Okamoto, L. J. (2009). Health care utilization and
costs by metabolic syndrome risk factors. Metabolic syndrome and related disorders, 7(4), 305-314.

17
$4,638Nondiabetics with similar
risk factors
$8,067Diabetics with high weight,
dyslipidemia, and hypertension
Annual Health
Costs per
Person
Boudreau, D. M., Malone, D. C., Raebel, M. A., Fishman, P. A., Nichols, G. A., Feldstein, A. C., ... & Okamoto, L. J. (2009). Health care utilization and
costs by metabolic syndrome risk factors. Metabolic syndrome and related disorders, 7(4), 305-314.

18
4) Programming
and Coaching
3) Baseline Health
Screening
YHLC Health Screening Process
Clients can sign up
voluntarily or be
referred by a doctor
Biometrics for client
are taken
Survey can be taken
online prior to screening
through email
Wellness coaches
guide clients based off
of health screening
Paper and Pencil option
available during the
health screening
2) Personal Health
Survey
1) Signing Up for
Health Screening

19
FL-DSSG Project Goals
Prevalence of Metabolic Syndrome
Changes in clients who completed multiple
years of health screenings
Finding patterns for predictions of what is most likely to
increase the likelihood of Metabolic Syndrome

20
YHLC
Data
Membership
Data
System
Applied
Health
Analytics
Eventbrite
Physician
Referrals
Access to YMCA through card swipe
Personal Healthy Survey
Biomarker Information
Register to attend YHLC Programs
Clients referred for services by
Physician
Demographics

21
Applied Heath Analytics Information
Personal Health Survey
• Stress
• Sadness
• Sleep
• Weight
• Nutrition
• Exercise
• Alcohol
• Smoking
• Medicine
• Finance*
Total of approximately 100
answers per client
Biomarkers
• Height
• Weight
• BMI
• Percent Body Fat
• Triglycerides
• Total Cholesterol
• LDL Cholesterol
• HDL Cholesterol
• Systolic and Diastolic
Blood Pressure
• Pulse
• Waist Circumference
• Glucose
• Fasting or Non-
fasting
Demographics
• Address
• Education
• Martial Status
• Employment
• Primary Care Physician
• Ethnicity
• Age
• Gender
• Personal Medical
History
• Family Medical History

22
High
Triglycerides
High
Glucose
High Blood
Pressure
High Waist
Circumference
Low
HDL
134 Clients
How do we
evaluate Metabolic
Syndrome missing
a risk factor?

23
Process of Calculating Waist Circumference
Waist
circumference
prediction
Regression
based on
Baptist dataMissing waist
circumference
Regression
based on
research
Clustering

24
Prevalence of Metabolic Syndrome
15.5%
Missing
Information
58.5%
Don’t have
Metabolic
Syndrome
26%
Have
Metabolic
Syndrome
Total Number of
Clients
1,983
National
Prevalence Rate
as of 2012:
34.2%
Moore JX, Chaudhary N, Akinyemiju T. Metabolic Syndrome Prevalence by Race/Ethnicity and Sex in the United States, National Health and Nutrition
Examination Survey, 1988–2012. Prev Chronic Dis 2017;14:160287. DOI: http://dx.doi.org/10.5888/pcd14.160287

25Clients with Metabolic Syndrome Across Locations

26
Differences in Survey Scores
Weight
Management
4.87
Nutrition
5.84
Sleep
Hygiene
3.70
Medication
Adherence
3.46
Exercise
3.73
Smoking
Status
9.71
-7.61 -7.80-10.10-11.05 -5.52-18.43
= No Metabolic Syndrome
= Metabolic Syndrome

27
Clients Across Time

28
These survey sections had a significant difference in the mean scores across time. Each section showed
an increase in scores indicating better health behavior perceptions for these sections.
Differences in Survey Scores Across Time
1
1
1
1
1
1 2
2
2
2
2
2

29
Variables Effecting Prediction of Metabolic Syndrome

30
Main Conclusions
Logistic regression model can help to guide future
areas of clinical focus05
04 No one became at risk who was not already
Eight people no longer met criteria
Clients significantly improved in several
sections of health perceptions
Differences in health perceptions
are mirrored in biomarkers
03
02
Rates appear to be on track
with the national average01

31
YHLC
Data
Membership
Data
System
Applied
Health
Analytics
Eventbrite
Physician
Referrals
Access to YMCA through card swipe
Personal Healthy Survey
Biomarker Information
Register to attend YHLC Programs
Clients referred for services by
Physician
Demographics

32
Recommendations
Tracking
Programming
Recording
attendance in a
way that will link
back to the Survey
ID number given by
AHA
01
Adjusting Survey
Questions
Examples - Include
finance section and
more explicit
question for health
insurance
02
Recording Doctor
Referrals
Record which
patients are
referred for
comparisons and
evaluating missing
data
03
Open Lines of
Communication
Providing feedback to
the clients and
provide programming
and health screening
information to
referring doctors
04

33
The Performers Academy

34
How do we express our emotions?

35
Art to
express
emotions
Power of
the
performing
arts
creativity
and
innovation
At-
Risk
Youth
Partnered
with FSS
Self-
expression
68% African-
American
25% Caucasian
7% Hispanic
15%
Incarcerated

36
Youth Aging out of Foster Care Statistics
Graduate
High School
Involved with
legal system
38%
1 out of 2 have had 4
or more adverse family
experiences
Have emotional
problems
25%
PTSD
50%
25%
48%
Child Trends Databank.
(2015). Foster care.
Substance
abuse
<3%
Earn college
degree

37
Structure of the “Just Like Me” Program
2 Projects during
3-weeks in summer
Performance
Building a
foundation“We have been
destined to succeed
because part of you is
just like me.”
- Brenda

38
Types of Art
Songwriting/
Rap
Poetry Musical
Instruments
Dance Acting
“Lies behind light, shadows under spite.
Feelings to get rid of because of fright.”
- TPA Student

39
What students learn?
Trust
Social
Interaction
Art
Expression
Trust exercises
Trusting adults
Honesty
Meaningful
relationships
Social skills
How to behave properly
in a social context
Not using anger or
violence to express
their feelings
Expressing how they
feel in a healthy way
Art as a tool for
expression
Artistic ability

40
Focus Areas

41
Focus Areas
Measure by Survey
or Testimonials

42
Focus Areas
Text Analytics for
poems and songs

43
The Data
A short pre/post survey
Attendance records
Text data from poems and video
transcriptions of interviews

44
FL-DSSG Approach
Finding a way to quantify
qualitative work
Analyzing the
art pieces
Revised the pre/post
survey to capture student
responses

45
Pre/Post Survey
TPA had their own pre/post
survey
DSSG Evaluated their survey
and looked for a new one
Consulted with the client for
what to keep and remove
New In-Depth Pre/Post Survey

46
Pre & Post Survey Analysis
Non-parametric paired
t-test (Wilcoxon Signed-
rank Test)
Exposure to arts?
Use art to
express yourself?
Create art with a
peer?
Use arts to express
difficulties?

47
Latent Dirichlet Allocation (LDA)
Associating words with topics
21 poems
LDA
Topic 1 Topic 2 Topic 3 Topic 4
real let know try
will feel love see
thing get heart don
lot look got one
make want now take
come pain day peopl
Reality Pain Love Struggle

48
Recommendations for TPA
• What is the process of
the art work through
out the program
• Opens up a possibility
to measure change
within the artwork
• Storing anything and
everything possible
• Helps better analysis
when more
documents are
needed
• i.e. TF-IDF and LDA
• Getting an idea of the
others input rather
than just the kids
• Case Managers and
teachers give a
detailed opinion
• Program directors
give a more broad
analysis
• Keeping track of
pre/post progress with
the child
• Allows another
dimension to analyze
progress using text
algorithms
Stages of Art Work Archiving Expert Evaluation Document Entry/Exit
Interview Notes
01 02 03 04

49
Recommendations for TPA
• What happens after
the student leaves the
TPA Program
• Do they keep these
changes within
themselves
• “Lives after TPA”
• Keeping a track of the
good and the bad
within the program
time
• Hole in the wall, when
a student speaks for
the first time, etc.
Longitudinal ImpactTracking Incidents and
Breakthroughs
0605

50

51
Body Image
Nutrition
Physical Activity
Friendships
Romance
Stress

52
Title I Schools in Duval County

53
Building Foundations for Success

54
Girls Inc. Focus

55
1864
Girls Inc. National
1970
Girls Inc. Jacksonville
2018
Girls Inc. Today

56
Programming
Middle School
Identity Program
Summer
Camps
Elementary
After School
Program

57
Middle School
Identity Programs
Summer
Camps
Elementary
After School
Program
Programming

58
Middle School Identity Programs
8/14 – 9/10
Stress
Management
9/15 – 10/15
Body
Image
10/20 – 11/4
Physical
Activity
11/9 – 12/10
Nutrition
12/15 – 3/5
Friendly
PEERsuasion
3/5 – 5/20
Will Power,
Won’t Power
Strong Programming
Bold Programming

59
Middle School Identity Programs
8/14 – 9/10 9/15 – 10/15 10/20 – 11/4 11/9 – 12/10 12/15 – 3/5
Nutrition
3/5 – 5/20

60
Our Data Science Focus
Do small incremental changes exist?

61
Girls Inc. Jacksonville Data
Middle
School
School attendance records
Demographics
School grades
Pre & Post Surveys
Behavioral reports
Program attendance

62
Data
Middle
School
School attendance records
Demographics
School grades
Pre & Post Surveys
Behavioral reports
Program attendance
Data housed by The Ounce of Prevention Fund

63
Sample Questions - Body Image Survey
I need to apply make-up or
try different diets to feel
better about myself.
I can tell you three things
that I really like about
myself.
Strongly Agree Agree I Don’t Know Disagree Strongly Disagree

64
In general,
middle school
girls are
performing
better on post
surveys.
pre
Body Image
Survey
Distribution
post

65
Will Power, Won’t Power had the largest gains.
0 0.1 0.2 0.3 0.4 0.5 0.6
Nutrition
Body Image
Physical
Stress
PEERsuasion
Will Power
Effect Size
Purple represents Bold programming Blue represents surveys in Strong programming.

66
Will Power, Won’t Power
Strongly Agree Agree I Don’t Know Disagree Strongly Disagree
Being assertive
means letting people
tell you what to do
and never standing
up for yourself.
There are no
emotional
consequences of
being intimate
before you are
ready.
Post test median score
Pre test median score

67
0
5
10
15
20
6th Pre 6th Post 7th Pre 7th Post 8th Pre 8th Post
Orange school did not having previous programming. Maximum total score of 20.
School 1
School 14
Stress Median Pre and Post Total Scores Timeline, 2015-2017

68
Previous programming slightly
improves post test scores.

69
Recommendations
Nurture current
school relationships
Reevaluate
survey questions
Measuring outcomes
Streamline data
collection
Data gaps, efficiency
Collect behavioral &
longitudinal data
Across years, pregnancy, graduation

70
- ARIANNA A.
- Leilani R.

71
Patterns and
Trends in Child
Welfare Resource
Systems

72
Do you know about
Florida Statute
Chapter 39 on
Proceedings Relating
To Children? Under Florida law,
every person is a
mandatory reporter.

73
v
FLORIDA
STATUTE
CHAPTER
39.201
Abuse Abandonment
Neglect
Mandatory
reporter of:

74
Maltreated Children are:
• 9 times more likely to become involved in criminal activity
• 25% more likely to experience teen pregnancy
v
Abuse Abandonment
Neglect

75
Reporting Process
Florida
Department
of Children
and Families
Child
Identified
Calls forwarded
Investigations
DCF intervention
202,300
277,016
21,606

76
Reporting Process
Florida
Department
of Children
and Families
Child
Identified
Family Support
Services

77
“Keeping children safe.”
Mission
Leader in providing
safety, stability, and
quality of life for all
children by working with
the community to
strengthen the family
unit.
Vision
Children grow up
connected to their own
families, supported by
families and protected by
the community.
Children have the
opportunity to achieve in
school and to learn to be
productive citizens.

78
Client Talks
“It was the
wake-up call
that I needed”
-Carollene
PRSERVATION KINSHIP CARE
“These children mean
so much to me. I
wouldn’t trade them for
anything.”
-Katherine Rankin,
Grandmother
“We treat them like
they’re ours and
always try to provide a
fun, loving
environment”
-Miranda
FOSTER CARE
“They have more
opportunities than
they had previously,
but if anyone’s lives
have changed for the
better, it's ours.”
- Toni
ADOPTION
“FSS has taught
me that I am better
and that I can be
better than I ever
imagined”
- Hafez
INDEPENDENT LIVING

79
Child Welfare Process
Florida Department
of Children and
Families
Family
Support
Services
Case
Management
Organization
Purchase of
Services
System
Child
Identified

80
The Purchase of Services System (POS)
Allows case workers to request goods and services to help children
and families
Loading…

81
The Purchase of Services System (POS)
65,000+
Requests
381
Types of
Goods &
Services
~3700
Providers
49
Case
Management
Units
Over the past 5 years

82
FSSNS Goal:
Independent Analysis
Our Role:
Aid FSSNF in developing their own adaptive data analysis process
POS
Updates
Ways to
reworking the
POS System to
allow for
efficient data
management
Visual
Analytics
Use
visualizations
software to
explore and
analyze trends
Data
Cleaning &
Prep
Clean and
merge data to
make a
functional
dataset

83
Paid
Report
Data Received from FSSNF
Outstanding
Report
New entry created
once a request is
authorized for payment
New entry created
once a payment is
invoiced for a request

84
Outstanding Paid
Who?
What?
When?
Where?
How Much?
Service Requested
Paid
Report
Merging the Data
Outstanding
Report
Participant
CMU
Case Worker
Participant
Date Authorize
Date Expires
Data Paid
Provider Used ---
Amount Authorized
Amount Invoiced
Amount Paid

85
Outstanding Paid
Who?
What?
When?
Where?
How Much?
Service Requested
Paid
Report
Outstanding
Report
Participant
CMU
Case Worker
Participant
Date Authorize
Date Expires
Data Paid
Provider Used ---
Amount Authorized
Amount Invoiced
Amount Paid
Merged Report
Merged
Who?
Participant
CMU
Case Worker
What? Service Requested
When? Date Paid
Where? Provider Used
How Much?
Amount Authorized
Invoiced
Paid
Merging the Data

86
The Problem with Providers
From Walmart
Requesting
School Supplies
17 Participants

87
From Walmart
Requesting
School Supplies
17 Participants

88
From Walmart
Requesting
School Supplies
17 Participants

89
Data Visualization

90

91

92
Recommendations
02
01
03
Development of Internal
Process for Visual Analytics
Rework POS System to
accommodate analysis
Sharing provider
information which CMOs

93
Closing
DCF CMO POS
The Florida Abuse Hotline:
1-800-962-2873
Florida Relay 711 or TTY:
1-800-955-8771
Child
Identified

94
Baptist Health The Performers Academy
Girls Inc. of Jacksonville
Julie Schafer Ebony Payne-English
Robin Rose
Director of Healthy Living Center Managing Director
Executive Director
Family Support Services of
North Florida
Steven Rodrigues
Process Improvement Specialist

95

96

97
Getting Ready for FL-DSSG 2019
Submit Proposal
Application in
January 2019
Identify Data
Sources and
associated
variables
Get Commitment
from everyone
involved
Identify a Wicked
Problem and its
Social Goodness

98

99
Resources
• FL-DSSG Website Link
http://dssg.unf.edu/
• PowerPoint Template
– This presentation was prepared using template developed by Aaron Kneile of DesignSmash.
Template is available in Envato Market.
– https://graphicriver.net/item/i9-template-system/10955645

2018 Florida Data Science for Social Good (FL-DSSG) Big Reveal Presentation

Recommended

Recommended

More Related Content

Similar to 2018 Florida Data Science for Social Good (FL-DSSG) Big Reveal Presentation

Similar to 2018 Florida Data Science for Social Good (FL-DSSG) Big Reveal Presentation (20)

More from Karthikeyan Umapathy

More from Karthikeyan Umapathy (18)

Recently uploaded

Recently uploaded (20)

2018 Florida Data Science for Social Good (FL-DSSG) Big Reveal Presentation

Editor's Notes