1.
Shifting the Culture
to Data-driven
Engineering
Greg Bell
VP, Software Development

2.
Time
Results

3.
Cultural Change
Data-driven
Engineering

4.
Product
Management
Product
Design
Software
Development
Effective Product,
Design and Technical
Vision and Execution
x 30

5.
January 2018

6.
Objective 1
Key Results #1
Key Results #2
Key Results #3

7.
Engineering
Objective 1
Key Results #1
Key Results #2
Key Results #3
Engineering
Objective 2
Key Results #4
Key Results #5
Key Results #6
Engineering
Objective 3
Key Results #7
Key Results #8
Key Results #9

8.
Engineering
Objective 1
Key Results #1
Key Results #2
Key Results #3
Engineering
Objective 2
Key Results #4
Key Results #5
Key Results #6
Engineering
Objective 3
Key Results #7
Key Results #8
Key Results #9
Product
Objective 1
Key Results #10
Key Results #11
Key Results #12
Product
Objective 2
Key Results #13
Key Results #14
Key Results #15
Product
Objective 3
Key Results #16
Key Results #17
Key Results #18
Product
Objective 3
Key Results #19
Key Results #20
Key Results #21

9.
Engineering
Objective 1
Key Results #1
Key Results #2
Key Results #3
Engineering
Objective 2
Key Results #4
Key Results #5
Key Results #6
Engineering
Objective 3
Key Results #7
Key Results #8
Key Results #9
Product
Objective 1
Key Results #10
Key Results #11
Key Results #12
Product
Objective 2
Key Results #13
Key Results #14
Key Results #15
Product
Objective 3
Key Results #16
Key Results #17
Key Results #18
Product
Objective 3
Key Results #19
Key Results #20
Key Results #21
Ops
Objective 1
Key Results #22
Key Results #23
Key Results #34
Ops
Objective 2
Key Results #25
Key Results #26
Key Results #27
Ops
Objective 3
Key Results #28
Key Results #29
Key Results #30

10.
July 2018

11.
1/ Health Scorecard
2/ Roadmap
3/ Strategic Projects

12.
Predictability
% monthly
delivery against
roadmap
Quality
# closed bugs last
30 days / total
open bugs (TTCO)
Production
Incidents
Severity 1 and
Severity 2 sum of
time to recovery
Infrastructure
Cost
Total
Infrastructure
Costs
Load Time
North American
full page load time

13.
January 2019

14.
SLOs, SLIs &
Error Budgets

15.
Completed
Investments
Total Monthly
Completed
Quarterly
Investments
Bug Volume
# closed bugs last
30 days / total
open bugs (TTCO)
Recruit &
Retain
% Peeps in Seats
Service Level
Objectives
% attainment of all
SLOs
Production
Incidents
Severity 1 and
Severity 2 sum of
time to recovery
Investment
Forecast
Forecast end of
quarter
completion of
Investments

16.
-56%

17.
January 2020

18.
Reliability Delivery
% requests < x ms % deploys < x m
% requests succeed % change fail rate
% of UI TTIs < x s Escaped bugs per contributor rate < x
% of DAU experience no UI exception % bug/security SLAs
MTTR < x minutes/hours Security compliance score < x for all systems

19.
Health &
Strategic
Metrics
Prioritization
Empowered
Teams
Systems of
Accountability &
Alignment
Scoreboards
Systems
Thinking

20.
Thank
You!
Greg Bell
@gregbell