Usually, DataOps means applying DevOps principles to existing data analytics projects. We accidentally reversed it, taking a DevOps initiative and catalyzing adoption of data-driven practices across our company.
What started as a practical initiative to bring better reliability and visibility to our software product had the unexpected effect of catalyzing a transformation that helped our organization become more data-driven across the company. What we learned in the process was how and why DevOps principles can naturally expand the role of a traditional operations team and bring wider culture change to the organization.
6. DevOpsDays Detroit 2019 @stevewritescode
Petabytes
Facebook’s internal
analytics data
warehouse
Million
Builds per month
on CircleCI
Million
Github commits
last year
300 30 70
16. DevOpsDays Detroit 2019 @stevewritescode
tarball
jq
grep
profit
?
SCP / email / ??
Analytics Hunting and Gathering
Too much power,
too early
Annoying
free tier
Highly
recommend!
17. DevOpsDays Detroit 2019 @stevewritescode
Alert Volume by Customer
Total
User A
User B
User C
User D
18. DevOpsDays Detroit 2019 @stevewritescode
Alert Volume by Customer
Total
User A
User B
User C
User D
Global
Spike
19. DevOpsDays Detroit 2019 @stevewritescode
Alert Volume by Customer
Total
User A
User B
User C
User D
User D starts a trial
User
Spike!
Global
Spike
36. DevOpsDays Detroit 2019 @stevewritescode
Spread the Word
1. Sales ● Trials / Pre-sales
● Renewal / Retention
● Upsell / Cross-sell
@stevewritescode
37. DevOpsDays Detroit 2019 @stevewritescode
Spread the Word
1. Sales
2. Support
● Quick Triage
● Signal vs. Noise
● Ultimate self-service user
@stevewritescode
38. DevOpsDays Detroit 2019 @stevewritescode
Spread the Word
1. Sales
2. Support
3. Product
● Engagement & Usage
● Ad-hoc queries
@stevewritescode
39. DevOpsDays Detroit 2019 @stevewritescode
Spread the Word
1. Sales
2. Support
3. Product
4. Management
● Most in need of data
● Polished reports
● Sponsorship
@stevewritescode
45. DevOpsDays Detroit 2019 @stevewritescode
More Info
Ashish Thusoo, Joydeep Sen Sarma
“Creating a Data-Driven Enterprise with DataOps”
Oz Nova - “You Are Not Google”
https://medium.com/p/you-are-not-google-84912cf44afb
Nathen Harvey - “DevOps Is Dead” DevOpsDaysDC ‘16
https://youtu.be/H8M69Ljiito?t=11394