Apache Spark is an open-source unified analytics engine for large-scale data processing. Databricks provides a managed Apache Spark service that runs on Azure. Databricks offers a unified analytics platform that is optimized for speed and ease of use. It provides frictionless, optimized Spark clusters on Azure along with big data analytics and storage services to reduce administration and control costs.

1. Powerful Big Data Analytics as
a Service, with Apache Spark
and Azure Databricks
Sorin Pește
Technology Solutions Professional
Microsoft
source: xkcd.com

4. A PA C H E S PA R K
A unified, distributed, open source engine for large-scale data processing
Spark Structured
Streaming
Stream processing
Spark MLlib
Machine
Learning
Spark Core Engine
Spark SQL
Interactive
Queries
Yarn Mesos
Standalone
Scheduler
Spark MLlib
Machine
Learning
Spark
Streaming
Stream processing
GraphX
Graph
Computation

5. S PA R K : A B R I E F H I S T O R Y

6. S PA R K I N T H E R E A L W O R L D
still comes with challenges…
Spark MLlib
Machine
Learning

8. D ATA B R I C K S - C O M PA N Y O V E R V I E W

9. D A T A B R I C K S : T H E U N I F I E D A N A L Y T I C S P L A T F O R M





10. D A T A B R I C K S S P A R K I S F A S T
Benchmarks have shown Databricks to often have better performance than alternatives
SOURCE: Benchmarking Big Data SQL Platforms in the Cloud

11. Azure Databricks
Databricks Spark as a managed service on Azure

15. CONTROL EASE OF USE
Azure Data Lake
Analytics
Any Hadoop technology,
any distribution
Workload optimized,
managed clusters
Data Engineering in a
Job-as-a-service model
Azure Marketplace
HDP | CDH | MapR
Azure Data Lake
Analytics
Virtual Machines Managed Clusters Big Data as-a-service
Azure HDInsight
Frictionless & Optimized
Spark clusters
Azure Databricks
BIG
DATA
ANALYTICS
Reduced
Administration
B I G D ATA I N M I C R O S O F T A Z U R E
Azure Data Lake Store
Azure Storage
BIG
DATA
STORAGE

16. Azure Databricks
Demo
https://github.com/neaorin/databricks-demos

17. Azure Databricks
How to Try It Out?

18. https://www.visualstudio.com/dev-essentials/

19. https://community.cloud.databricks.com/