SlideShare a Scribd company logo
Data Factory &
Synapse Pipelines
Best Practices
Orlando Gomes
Cloud Solution Architect (Engineering) - Microsoft
Sp_help(palestrante)
• Cloud Solution Architect (Engineering) - Microsoft
• + 8 Years Experience - Microsoft BI Stack
• Microsoft MVP Reconnect
• Microsoft Certified Professional
• Pokemon & Soccer Lover
Orlando Gomes
linktr.ee/orlandogomes
Gratidão - Patrocinadores!
Data Factory
Introduction to Azure Data Factory - Azure Data Factory | Microsoft Learn
Azure Synapse Analytics
What is Azure Synapse Analytics? - Azure Synapse Analytics | Microsoft Learn
Ok…But…
When use
Data Factory -
Synapse Pipelines ?
Depends…
Ask yourself, customer, team, manager…
• How mature is my orgaization mature about Cloud – DW Process ?
• What I have today to attend orchestration ?
• Where my Data Sources are located ?
• What resources I need – wait from a ETL Cloud Based Tool ?
• I have a Data Factory, should I migrate to Synapse Pipelines ?
(Time, Cost, Compatibility, Resources...)
• If yes, what Synapse resources I will use ? (justify go only because Pipelines ?)
• I have my process on Synapse Pipelines, should I migrate to Data Factory ?
Is there some specifc resource I need there ?
• How Much ? $
Synapse Pipelines
Data Factory
Features
Differences from Azure Data Factory - Azure Synapse Analytics |
Microsoft Learn
(ETL Process) What I should care…
• Security;
• Performance;
• Network (Bandwith, Firewall);
• Identity;
• Productivity;
• Naming Standard (Datasets, Linked Services);
• Collaboration.
Enterprise Data Warehouse
Pricing Calculator | Microsoft Azure
Demo
Recommended
Recommended
Thanks! =D
https://linktr.ee/orlandogomes

More Related Content

Similar to Data Factory & Synapse Analytics - Best Practices

advance computing and big adata analytic.pptx
advance computing and big adata analytic.pptxadvance computing and big adata analytic.pptx
advance computing and big adata analytic.pptx
TeddyIswahyudi1
 
Yaroslav Ravlinko "Build your own Machine Learning Platform or how to develo...
Yaroslav Ravlinko  "Build your own Machine Learning Platform or how to develo...Yaroslav Ravlinko  "Build your own Machine Learning Platform or how to develo...
Yaroslav Ravlinko "Build your own Machine Learning Platform or how to develo...
Lviv Startup Club
 
How Azure Databricks helped make IoT Analytics a Reality with Janath Manohara...
How Azure Databricks helped make IoT Analytics a Reality with Janath Manohara...How Azure Databricks helped make IoT Analytics a Reality with Janath Manohara...
How Azure Databricks helped make IoT Analytics a Reality with Janath Manohara...
Databricks
 
Spca2014 sp ci with tfs online and azure matthias einig
Spca2014 sp ci with tfs online and azure matthias einigSpca2014 sp ci with tfs online and azure matthias einig
Spca2014 sp ci with tfs online and azure matthias einig
NCCOMMS
 

Similar to Data Factory & Synapse Analytics - Best Practices (20)

Introduction to the Typesafe Reactive Platform
Introduction to the Typesafe Reactive PlatformIntroduction to the Typesafe Reactive Platform
Introduction to the Typesafe Reactive Platform
 
Ai & Data Analytics 2018 - Azure Databricks for data scientist
Ai & Data Analytics 2018 - Azure Databricks for data scientistAi & Data Analytics 2018 - Azure Databricks for data scientist
Ai & Data Analytics 2018 - Azure Databricks for data scientist
 
201908 Overview of Automated ML
201908 Overview of Automated ML201908 Overview of Automated ML
201908 Overview of Automated ML
 
advance computing and big adata analytic.pptx
advance computing and big adata analytic.pptxadvance computing and big adata analytic.pptx
advance computing and big adata analytic.pptx
 
Dev/Test in the Cloud - F
Dev/Test in the Cloud - FDev/Test in the Cloud - F
Dev/Test in the Cloud - F
 
Using AWS To Build A Scalable Machine Data Analytics Service
Using AWS To Build A Scalable Machine Data Analytics ServiceUsing AWS To Build A Scalable Machine Data Analytics Service
Using AWS To Build A Scalable Machine Data Analytics Service
 
Azure Global Bootcamp - CIS Handson
Azure Global Bootcamp - CIS HandsonAzure Global Bootcamp - CIS Handson
Azure Global Bootcamp - CIS Handson
 
SRV318_Research at PNNL Powered by AWS
SRV318_Research at PNNL Powered by AWSSRV318_Research at PNNL Powered by AWS
SRV318_Research at PNNL Powered by AWS
 
Research at PNNL: Powered by AWS - SRV318 - re:Invent 2017
Research at PNNL: Powered by AWS - SRV318 - re:Invent 2017Research at PNNL: Powered by AWS - SRV318 - re:Invent 2017
Research at PNNL: Powered by AWS - SRV318 - re:Invent 2017
 
Powering a Startup with Apache Spark with Kevin Kim
Powering a Startup with Apache Spark with Kevin KimPowering a Startup with Apache Spark with Kevin Kim
Powering a Startup with Apache Spark with Kevin Kim
 
SharePoint Databases: What you need to know (201609)
SharePoint Databases: What you need to know (201609)SharePoint Databases: What you need to know (201609)
SharePoint Databases: What you need to know (201609)
 
Yaroslav Ravlinko "Build your own Machine Learning Platform or how to develo...
Yaroslav Ravlinko  "Build your own Machine Learning Platform or how to develo...Yaroslav Ravlinko  "Build your own Machine Learning Platform or how to develo...
Yaroslav Ravlinko "Build your own Machine Learning Platform or how to develo...
 
Lean Analytics: How to get more out of your data science team
Lean Analytics: How to get more out of your data science teamLean Analytics: How to get more out of your data science team
Lean Analytics: How to get more out of your data science team
 
Making Data Scientists Productive in Azure
Making Data Scientists Productive in AzureMaking Data Scientists Productive in Azure
Making Data Scientists Productive in Azure
 
SharePoint Databases: What you need to know (201509)
SharePoint Databases: What you need to know (201509)SharePoint Databases: What you need to know (201509)
SharePoint Databases: What you need to know (201509)
 
How Azure Databricks helped make IoT Analytics a Reality with Janath Manohara...
How Azure Databricks helped make IoT Analytics a Reality with Janath Manohara...How Azure Databricks helped make IoT Analytics a Reality with Janath Manohara...
How Azure Databricks helped make IoT Analytics a Reality with Janath Manohara...
 
I2 - SharePoint Hybrid Search Start to Finish - Thomas Vochten
I2 - SharePoint Hybrid Search Start to Finish - Thomas VochtenI2 - SharePoint Hybrid Search Start to Finish - Thomas Vochten
I2 - SharePoint Hybrid Search Start to Finish - Thomas Vochten
 
Real Time Big Data Processing on AWS
Real Time Big Data Processing on AWSReal Time Big Data Processing on AWS
Real Time Big Data Processing on AWS
 
Spca2014 sp ci with tfs online and azure matthias einig
Spca2014 sp ci with tfs online and azure matthias einigSpca2014 sp ci with tfs online and azure matthias einig
Spca2014 sp ci with tfs online and azure matthias einig
 
SKill Up Yourself with SQL, Azure, Power BI
SKill Up Yourself with SQL, Azure, Power BISKill Up Yourself with SQL, Azure, Power BI
SKill Up Yourself with SQL, Azure, Power BI
 

More from Orlando Mariano

More from Orlando Mariano (20)

MSPInspire - Azure ML and Power BI
MSPInspire - Azure ML and Power BIMSPInspire - Azure ML and Power BI
MSPInspire - Azure ML and Power BI
 
AnaliseDeDados_SQLSat906
AnaliseDeDados_SQLSat906AnaliseDeDados_SQLSat906
AnaliseDeDados_SQLSat906
 
2019 ImagineCup
2019 ImagineCup2019 ImagineCup
2019 ImagineCup
 
Analise de Dados Power BI
Analise de Dados Power BIAnalise de Dados Power BI
Analise de Dados Power BI
 
Sentiment Analysis_Power BI
Sentiment Analysis_Power BISentiment Analysis_Power BI
Sentiment Analysis_Power BI
 
Power BI_VSummit
Power BI_VSummitPower BI_VSummit
Power BI_VSummit
 
StreamingDados_PowerBI
StreamingDados_PowerBIStreamingDados_PowerBI
StreamingDados_PowerBI
 
Automated Machine Learning
Automated Machine LearningAutomated Machine Learning
Automated Machine Learning
 
Analise De Dados Azure ML
Analise De Dados Azure MLAnalise De Dados Azure ML
Analise De Dados Azure ML
 
Gerenciando seus Crushs com Power BI e Node JS
Gerenciando seus Crushs com Power BI e Node JSGerenciando seus Crushs com Power BI e Node JS
Gerenciando seus Crushs com Power BI e Node JS
 
Analise De Dados Azure ML - MVPConf 2019
Analise De Dados Azure ML -  MVPConf 2019Analise De Dados Azure ML -  MVPConf 2019
Analise De Dados Azure ML - MVPConf 2019
 
Analise de Dados - SQL Sat 817
Analise de Dados - SQL Sat 817Analise de Dados - SQL Sat 817
Analise de Dados - SQL Sat 817
 
Analise de Dados - SQL Sat 817
Analise de Dados - SQL Sat 817Analise de Dados - SQL Sat 817
Analise de Dados - SQL Sat 817
 
Madrugada Nerdzao - Trilha PBI
Madrugada Nerdzao - Trilha PBI Madrugada Nerdzao - Trilha PBI
Madrugada Nerdzao - Trilha PBI
 
Consumo Facebook Power BI
Consumo Facebook Power BIConsumo Facebook Power BI
Consumo Facebook Power BI
 
Deploy Azure ML Connect
Deploy Azure ML ConnectDeploy Azure ML Connect
Deploy Azure ML Connect
 
Sentiment Analysis Power - Global AI Bootcamp
Sentiment Analysis Power - Global AI BootcampSentiment Analysis Power - Global AI Bootcamp
Sentiment Analysis Power - Global AI Bootcamp
 
Analise de Dados com Azure Machine Learning, R e Power BI
Analise de Dados com Azure Machine Learning, R e Power BI Analise de Dados com Azure Machine Learning, R e Power BI
Analise de Dados com Azure Machine Learning, R e Power BI
 
Sentiment Analysis Power BI - Azure Conference
Sentiment Analysis Power BI - Azure ConferenceSentiment Analysis Power BI - Azure Conference
Sentiment Analysis Power BI - Azure Conference
 
Sentiment Analysis Azure Conference
Sentiment Analysis Azure ConferenceSentiment Analysis Azure Conference
Sentiment Analysis Azure Conference
 

Recently uploaded

Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical Futures
Bhaskar Mitra
 
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Peter Udo Diehl
 

Recently uploaded (20)

From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical Futures
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 
ODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User Group
 
Powerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara LaskowskaPowerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara Laskowska
 
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone KomSalesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
 
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya HalderCustom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
Custom Approval Process: A New Perspective, Pavel Hrbacek & Anindya Halder
 
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
 
UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptxUnpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
Introduction to Open Source RAG and RAG Evaluation
Introduction to Open Source RAG and RAG EvaluationIntroduction to Open Source RAG and RAG Evaluation
Introduction to Open Source RAG and RAG Evaluation
 
IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 

Data Factory & Synapse Analytics - Best Practices