In this session you will learn how to develop data pipelines in Azure Data Factory and build a Cloud-based analytical solution adopting modern data warehouse approaches with Azure SQL Data Warehouse and implementing incremental ETL orchestration at scale. With the multiple sources and types of data available in an enterprise today Azure Data factory enables full integration of data and enables direct storage in Azure SQL Data Warehouse for powerful and high-performance query workloads which drive a majority of enterprise applications and business intelligence applications.

6. A fully-managed data integration service in the cloud
A Z U R E D A TA F A C T O R Y
H Y B R I D S C A L A B L EP R O D U C T I V E T R U S T E D
 Serverless scalability
with no infrastructure
to manage
 Drag & Drop UI
 Codeless Data
Movement
 Orchestrate where
your data lives
 Lift SSIS packages
to Azure
 Certified compliant
Data Movement

7. Modernize your enterprise data warehouse at scale
A Z U R E D A T A F A C T O R Y
Social
LOB
Graph
IoT
Image
CRM STORE
Azure Data Lake
and Azure Storage
MODEL &
SERVE
Azure SQL DW
HDInsight
Data Lake
PREP &
TRANSFORM
Data Transformation
Machine Learning
INGEST
Data orchestration,
scheduling
and monitoring
Apps and
Insights
Integrate via Azure Data Factory
Cloud
VNet
On-premise

8. EXTRACT TRANSFORM LOAD MODEL & SERVE
Drought
Weather
Counties
NOAA
Azure
Analysis Services
Azure SQL Data
Warehouse
Data Marts
for ML
Azure Databricks
Azure Data Factory
Power BI
Polybase
Data
Transformation
Apps and
Insights

9. Pipeline
Activity
Triggers
Pipeline Runs
Activity Runs
Trigger Runs
Linked
Service
Dataset
Data Movement
Data
Transformation
Dispatch
Integration
Runtime
Activity
Activity

11. Built-in source
control support

17. Secure. Compliant. Reliable.Unlimited scale
Seamlessly compatible across Microsoft and
other leading BI & Data Integration ser vices
The fast, flexible, and secure hub for all your data
TrustedFast
Fits your needs
Flexible

18. Introducing SQL Data Warehouse Gen2
5x improvement in performance
4x concurrent queries
5x scalability
Retains all elastic functionality

22. http://azure.com/adf
http://azure.com/sqldw
@AzureSqlDw
#AzureDataFactory
 @KromerBigData
 ADF Github code: https://github.com/kromerm/adfbuild2018
 Get Started with this ADW/ADF/Spark Template
 https://gallery.azure.ai/Tutorial/Data-Warehousing-and-Data-Science-with-SQL-Data-Warehouse-and-Spark-3