Azure Databricks has become very popular as a computing framework for big data. However, customers are finding unexpected costs eating into their cloud budget. Furthermore, lack of visibility to root cause and general inefficiency is costing organizations thousands, if not millions in operating their Azure Databricks environment. Join Unravel to discuss top 5 cost management techniques in Azure Databricks and new features to effectively help manage costs on Azure Databricks, including: Cost analytics to provide assurance and forecasting for optimizing databricks workloads as they scale. Accurate, detailed chargeback reporting of the cost of running data apps on Azure Databricks.

1. 1
EFFECTIVE COST
MANAGEMENT FOR
AZURE DATABRICKS
Unravel for Azure Databricks

2. 2
Today’s Speakers
Jason Baick
Senior Director of Product
Marketing, Unravel Data
jbaick@unraveldata.com
Scott Sumner
Director, Solutions Engineering
Unravel Data
scott@unraveldata.com

3. 3
1. Effective Cost Management for Azure Databricks
with Unravel
2. Demo: Unravel for Azure Databricks
Today’s
Agenda

4. 4
Unravel for
Azure Databricks

5. 5
Experienced Team
Strong Market Validation A Microsoft M12 Company
Broad Technology and Cloud Platform Coverage
Why Unravel?

6. 6
DataOps are more critical than ever..
Consequences of Missed SLAs go beyond cloud costs
Banking As fraud claims increase, fraudulent transactions in banking
not discovered in time, leading to millions in theft and fines.
Healthcare Patient profiles not accurately described, leading to
misdiagnosis, leading to poor allocation of resources.
Retail Customer demand improperly analyzed for a particular
product, underestimating deliveries leading to critical
shortages of food items and household goods.
Telecomm Equipment failure not detected with accuracy, leading to
costly maintenance calls

7. 7
Why Unravel for Azure Databricks?
Manage
Costs
Migrate
Intelligently
• Fine grained visibility
• Cut costs 30% - 50%
• Right-size cloud instances
• Automatic Hadoop inventory
• “GPS” Mapping to cloud
• Experienced Big Data team
• Quickly diagnose issues
• Free up 50% due to wasted time
• Rapidly resolve and stabilize
Manage
Performance
1 2 3

8. 8
Top 5 Productivity Costs
Poorly Performing or Failed Jobs
Getting to Root Cause Analysis
Missed Service Level Agreements
DevOps/IT Ops Blame Game
Chargeback/Showback
*IDC Economic benefits of migrating Apache Spark and Hadoop to cloud, 2018
Controlling IT Staff productivity costs
Troubleshooting
Managing capacity
Controlling cloud infrastructure costs
Compute
Storage
Networking

9. 9
Manual Cost Management
Choose Proper Azure VM topology
Choose Proper Storage and Networking
App performance optimization
Workload Identification
Manual instance matching
Unused compute elimination
These techniques require manual data collection and native tooling (Azure
Monitor, Spark web UI), but can be effective for managers versed in log
collection techniques for Spark.

10. 10
The Unravel Solution

11. 11
MAKE EVERYONE ON YOUR TEAM A DATA EXPERT

12. 12
MAKE EVERYONE ON YOUR TEAM A DATA EXPERT
Chargeback/Showback
Cost breakdown, organized by app type, user,
queue for easy chargeback and accountability
Rightsize Allocation of
Cluster Resources
Automatically size containers and cluster
configurations for optimal throughput in cloud
Alerts/Auto Actions

13. 13
Our Solution: Extensible Data Operations Platform

14. 14
With Unravel Without Unravel
Time to resolution:
Minutes
Time to resolution:
Days
Required Infrastructure:
ADLS - $100K/year
Azure VMs - $200K/year
DBU - $200K/year
Required Infrastructure:
ADLS - $150K/year
Azure VMs - $500K/year
DBU - $400K/year
Required Team:
Big Data Engineers - 10 hours/week
DevOps - 5 hours/week
Required Team:
Big Data Engineers - 40 hrs/week
DevOps - 10 hours/week
TCO: WITH AND WITHOUT UNRAVEL
LABOR
INFRASTRUCTURE &
SOFTWARE
PRODUCTIVITY

15. 15
Demo

16. 16
Unravel helps media company reduce costs and
guarantee SLAs on Azure Databricks
Unravel provided the visibility to track and analyze insights and
recommendations to improve their applications – ensuring
reliability to meet critical customer SLAs. Due to productivity
gains, the platform team can do more with less and reduce
costs.
• Prevent financial penalties - Speed up mean time to resolution of
failed jobs with automated application failure reasoning /
aggregated errors view
• Increasing team productivity - Enable self service for developers
by providing a single of pane of glass view for their
applications, reducing the need for providing admin access
• Lowering cloud costs - Easily understand applications which are
over-allocating resources

17. 17
Customer Offers
• Unravel for Azure Databricks on
Azure Marketplace
• $2000 in Free Azure Credits for
signing up
• $10000 in Free Azure Credits for
POC (negotiable)*
• Free “Rapid POC” – guided install
and formal read-out
Unravel Data + Azure Databricks
*Negotiable cloud credits available for POC agreement. Please
discuss with Unravel.

18. 18
CONTACT US TO TRY OUT UNRAVEL FOR AZURE DATABRICKS TODAY
hello@unraveldata.com