Level 300 slides describing ADF Mapping Data Flows

1. Azure Data Factory
Mapping Data Flows
Level 300

4. Modern Data Warehouse Pattern Today
Applications
Dashboards
Business/custom apps
(structured)
Logs, files, and media
(unstructured)
r
Ingest storage
Azure Storage/
Data Lake Store
Data
Loading
Azure Data
Factory
Load flat files
into data lake on a
schedule
Data processing
Read data from
files using DBFS
Orchestration
Azure Data
Factory
Extract and
transform
relational data
Azure Databricks
Serving storage
Azure SQL DW
Load processed
data into tables
optimized for
analytics
Clean and
join with
stored data
Load to SQL DW
Databases

5. Modern Data Warehouse Pattern with ADF Mapping Data Flows
Applications
Dashboards
Business/custom apps
(structured)
Logs, files, and media
(unstructured)
r Azure Storage/
Data Lake Store
Azure Data
Factory
Load files into data
lake on a schedule
Azure Data
Factory
Extract and
transform
relational data
Azure SQL DW
Load processed
data into tables
optimized for
analytics
Clean and
join disparate
data
Databases
Azure Databricks

7. Mapping Data Flow common
scenarios

15. List of columns
being modified
All available
functions, fields,
parameters …
Build expressions
here with full auto-
complete and
syntax checking
View results of your
expression in the data
preview pane with live,
interactive results

23. http://aka.ms/dataflowvideos
http://aka.ms/dataflowpatterns
https://docs.microsoft.com/en-us/azure/data-
factory/concepts-data-flow-overview
http://aka.ms/dataflowexpressions
https://aka.ms/dfperf
https://aka.ms/dflinks