Successfully reported this slideshow.
Your SlideShare is downloading. ×

Pipelines and Data Flows: Introduction to Data Integration in Azure Synapse Analytics (Data Toboggan 2021)

Ad

© 2021 Cathrine Wilhelmsen (hi@cathrinew.net)
Pipelines & Data Flows:
Introduction to Data Integration
in Azure Synapse An...

Ad

© 2021 Cathrine Wilhelmsen (hi@cathrinew.net)
Session Abstract
Do you regularly need to get data for your projects?
Yep! 🙋...

Ad

© 2021 Cathrine Wilhelmsen (hi@cathrinew.net)

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Check these out next

1 of 28 Ad
1 of 28 Ad

Pipelines and Data Flows: Introduction to Data Integration in Azure Synapse Analytics (Data Toboggan 2021)

Download to read offline

Pipelines and Data Flows: Introduction to Data Integration in Azure Synapse Analytics (Presented at Data Toboggan on January 30th, 2021)

Pipelines and Data Flows: Introduction to Data Integration in Azure Synapse Analytics (Presented at Data Toboggan on January 30th, 2021)

Advertisement
Advertisement

More Related Content

More from Cathrine Wilhelmsen

Advertisement

Pipelines and Data Flows: Introduction to Data Integration in Azure Synapse Analytics (Data Toboggan 2021)

  1. 1. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net) Pipelines & Data Flows: Introduction to Data Integration in Azure Synapse Analytics Cathrine Wilhelmsen Data Toboggan · January 30th, 2021
  2. 2. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net) Session Abstract Do you regularly need to get data for your projects? Yep! 🙋‍♀️ Data is at the core of every Business Intelligence, Data Science, and Machine Learning project. You need data to understand what has happened in the past, to predict what may happen in the future, to discover patterns and anomalies, and to gain the insight necessary for making faster and better decisions. But before you can do any of those things, you need to ingest, store, transform, integrate, and prepare your data. Guess what? You can do all of those things in Azure Synapse Analytics - without having to write any code! In this session, we will cover the fundamentals of data integration in Azure Synapse Analytics. First, we will go through what Pipelines and Data Flows are. Then, we will quickly build a solution for ingesting and transforming data. Finally, we will look at how to orchestrate and schedule our pipelines, and how to monitor our solution once it has been deployed.
  3. 3. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net)
  4. 4. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net) @cathrinew cathrinew.net
  5. 5. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net) Relational Data Data Warehouse Big Data Data Lake
  6. 6. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net) Relational Data Data Warehouse Big Data Data Lake
  7. 7. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net) Relational Data Data Warehouse Big Data Data Lake
  8. 8. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net) Integration Data
  9. 9. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net) Data Integration in Azure Synapse Code-Heavy Scripts, Notebooks Low-Code Pipelines, Data Flows
  10. 10. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net) Data Integration in Azure Synapse Copy Data Transform Data
  11. 11. Pipelines & Data Flows
  12. 12. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net) What are Pipelines?
  13. 13. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net) What are Activities?
  14. 14. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net) What are Datasets?
  15. 15. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net) What are Linked Services?
  16. 16. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net) What are Data Flows?
  17. 17. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net) What are Triggers?
  18. 18. DEMO DEMO Pipelines & Data Flows
  19. 19. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net)
  20. 20. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net)
  21. 21. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net)
  22. 22. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net)
  23. 23. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net)
  24. 24. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net)
  25. 25. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net)
  26. 26. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net)
  27. 27. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net) Code-Heavy Scripts, Notebooks Low-Code Pipelines, Data Flows
  28. 28. © 2021 Cathrine Wilhelmsen (hi@cathrinew.net) @cathrinew cathrinew.net hi@cathrinew.net cathrinew.net/adf

×