Analytics 101:
How to not fail at analytics
Daniel Haight
What is Analytics
Difficulty
Why Analytics?
Decision-making 1.0
Decision-making 2.0
Better
Decisions
The Problem
“70 – 80% of analytics projects fail” – Gartner
Group, 2011
Hypothesis:
Failure is lack of adoption.
Lack of adoption comes from misunderstanding
roles.
The Data
Steward
The Analytic
Explorer
The
Information
Artist
The
Automator
The Champion
Data
Steward
Analytic
Explorer
Information
Artist Automator
Champion
Data
Steward
Analytic
Explorer
Information
Artist Automator
Champion
Data
Scientist
Some observations…
Typical structure
Misaligned structure
IT
Outsourcing roles to software
Slotting staff in the wrong role
Even with the right team and
structure, success is not
guaranteed
The analytic process
Data
Steward
Analytic
Explorer
Information
Artist Automator
Idea
generation
Data
preparation
Exploration
Design
Tool
development
The analytic process
Data
Steward
Analytic
Explorer
Information
Artist Automator
Idea
generation
Data
preparation
Exploration
Design
Tool
development
Education Analytics
Student
forecasting
Teacher
Forecasting
Training
Teacher skills
allocation
Capacity planning
Student attrition analysis
School
security
Funding allocation
Teacher
attrition
analysis
Education Analytics
Student
forecasting
Teacher
Forecasting
Training
Teacher skills
allocation
Capacity planning
Student attrition analysis
School
security
Funding allocation
Teacher
attrition
analysis
Data
Steward
Analytic
Explorer
Information
Artist Automator
Idea
generation
Data
preparation
Exploration
Design
Tool
development
Is it accurate?
Data
Steward
Analytic
Explorer
Information
Artist Automator
Idea generation/
refinement
Data
preparation
Exploration
Design Tool
development
Is it clear?
Decision-making 3.0
Why doesn’t this
happen?
= /
+=
Age
Staff
Calculate
Staff
Attrition
Initial
Teachers
Initial
Population
Age
Population
Calculate
Migration
& Births
Compare
Staff and Students
Hire New
Staff
Calculate
Student
Participation
Cohort Component Model
X
Initial Population
050001000015000200002500030000
0
5
10
15
20
25
30
35
40
45
50
0 5000 10000 15000 20000 25000 30000
0
5
10
15
20
25
30
35
40
45
50
Age the Population
050001000015000200002500030000
0
5
10
15
20
25
30
35
40
45
50
0 5000 10000 15000 20000 25000 30000
0
5
10
15
20
25
30
35
40
45
50
Age the Population
050001000015000200002500030000
0
5
10
15
20
25
30
35
40
45
50
0 5000 10000 15000 20000 25000 30000
0
5
10
15
20
25
30
35
40
45
50
Add/Subtract Net-Migration
-20
-10
0
10
20
30
40
50
60
70
0
5
10
15
20
25
30
35
40
45
50
050001000015000200002500030000
0
5
10
15
20
25
30
35
40
45
50
0 5000 10000 15000 20000 25000 30000
0
5
10
15
20
25
30
35
40
45
50
Add/Subtract Net-Migration
-20
-10
0
10
20
30
40
50
60
70
0
5
10
15
20
25
30
35
40
45
50
050001000015000200002500030000
0
5
10
15
20
25
30
35
40
45
50
0 5000 10000 15000 20000 25000 30000
0
5
10
15
20
25
30
35
40
45
50
Add/Subtract Net-Migration
-20
-10
0
10
20
30
40
50
60
70
0
5
10
15
20
25
30
35
40
45
50
050001000015000200002500030000
0
5
10
15
20
25
30
35
40
45
50
0 5000 10000 15000 20000 25000 30000
0
5
10
15
20
25
30
35
40
45
50
Add/Subtract Net-Migration
050001000015000200002500030000
0
5
10
15
20
25
30
35
40
45
50
0 5000 10000 15000 20000 25000 30000
0
5
10
15
20
25
30
35
40
45
50
Add/Subtract Net-Migration
050001000015000200002500030000
0
5
10
15
20
25
30
35
40
45
50
0 5000 10000 15000 20000 25000 30000
0
5
10
15
20
25
30
35
40
45
50
Make Babies Using Fertility
050001000015000200002500030000
0
5
10
15
20
25
30
35
40
45
50
0 5000 10000 15000 20000 25000 30000
0
5
10
15
20
25
30
35
40
45
50
0%
2%
4%
6%
8%
10%
12%
14%
0
5
10
15
20
25
30
35
40
45
50
X
Make Babies Using Fertility
050001000015000200002500030000
0
5
10
15
20
25
30
35
40
45
50
0 5000 10000 15000 20000 25000 30000
0
5
10
15
20
25
30
35
40
45
50
X
Focus on Student Ages
050001000015000200002500030000
0
5
10
15
20
25
30
35
40
45
50
0 5000 10000 15000 20000 25000 30000
0
5
10
15
20
25
30
35
40
45
50
Schoo
l Aged
Focus on Student Ages
050001000015000200002500030000
0
5
10
15
20
0 5000 10000 15000 20000 25000 30000
0
5
10
15
20
Focus on Student Ages
050001000015000200002500030000
0
5
10
15
20
0 5000 10000 15000 20000 25000 30000
0
5
10
15
20
Estimate Participation
0%
20%
40%
60%
80%
100%
0
2
4
6
8
10
12
14
16
18
20
050001000015000200002500030000
0
5
10
15
20
0 5000 10000 15000 20000 25000 30000
0
5
10
15
20
Estimate Participation
0%
20%
40%
60%
80%
100%
0
2
4
6
8
10
12
14
16
18
20
050001000015000200002500030000
0
5
10
15
20
0 5000 10000 15000 20000 25000 30000
0
5
10
15
20
Estimate Participation
X
050001000015000200002500030000
0
5
10
15
20
0 5000 10000 15000 20000 25000 30000
0
5
10
15
20
Apply Participation
050001000015000200002500030000
0
5
10
15
20
0 5000 10000 15000 20000 25000 30000
0
5
10
15
20
Apply Participation
Student Count
Age
Staff
Calculate
Staff
Attrition
Initial
Teachers
Initial
Population
Age
Population
Calculate
Migration
& Births
Compare
Staff and Students
Hire New
Staff
Calculate
Student
Participation
Teacher Workforce
0200400600800
20
25
30
35
40
45
50
55
60
65
70
75
0 200 400 600 800
20
25
30
35
40
45
50
55
60
65
70
75
Age Workforce
0200400600800
20
25
30
35
40
45
50
55
60
65
70
75
0 200 400 600 800
20
25
30
35
40
45
50
55
60
65
70
75
Apply Attrition
0200400600800
20
25
30
35
40
45
50
55
60
65
70
75
0 200 400 600 800
20
25
30
35
40
45
50
55
60
65
70
75
0%
10%
20%
30%
40%
50%
20 25 30 35 40 45 50 55 60 65 70
Apply Attrition
0200400600800
20
25
30
35
40
45
50
55
60
65
70
75
0 200 400 600 800
20
25
30
35
40
45
50
55
60
65
70
75
0%
10%
20%
30%
40%
50%
20 25 30 35 40 45 50 55 60 65 70
Apply Attrition
0200400600800
20
25
30
35
40
45
50
55
60
65
70
75
0 200 400 600 800
20
25
30
35
40
45
50
55
60
65
70
75
X
Apply Attrition
0200400600800
20
25
30
35
40
45
50
55
60
65
70
75
0 200 400 600 800
20
25
30
35
40
45
50
55
60
65
70
75
Remaining Staff
0200400600800
20
25
30
35
40
45
50
55
60
65
70
75
0 200 400 600 800
20
25
30
35
40
45
50
55
60
65
70
75
Remaining St
Age
Staff
Calculate
Staff
Attrition
Initial
Teachers
Initial
Population
Age
Population
Calculate
Migration
& Births
Compare
Staff and Students
Hire New
Staff
Calculate
Student
Participation
Determine Hires
0200400600800
20
25
30
35
40
45
50
55
60
65
70
75
0 200 400 600 800
20
25
30
35
40
45
50
55
60
65
70
75
Remaining St
Calculate Hires with
Student to Staff Ratio
0200400600800
20
25
30
35
40
45
50
55
60
65
70
75
0 200 400 600 800
20
25
30
35
40
45
50
55
60
65
70
75
0100002000030000
0
5
10
15
20
0 10000 20000 30000
0
5
10
15
20
Remaining StaffStudent Count/ Student to Staff Ratio
= Required Staff Total
–
= Required Hires
Estimate Hire Ages
0200400600800
20
25
30
35
40
45
50
55
60
65
70
75
0 200 400 600 800
20
25
30
35
40
45
50
55
60
65
70
75
Required Hires
0%
1%
2%
3%
4%
5%
20 25 30 35 40 45 50 55 60 65 70 75
X
Estimate Hire Ages
0200400600800
20
25
30
35
40
45
50
55
60
65
70
75
0 200 400 600 800
20
25
30
35
40
45
50
55
60
65
70
75
0%
1%
2%
3%
4%
5%
20 25 30 35 40 45 50 55 60 65 70 75
X
Required Hires
Repeat
Is it timely?
Is it
responsive?
Estimated Time Remaining:
Still Calculating
Is it
interactive?
Does it
engage?
***

Analytics 101: How to not fail at analytics