Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
@cathrinew | cathrinew.net
Session Abstract
@cathrinew
cathrinew.net
Azure Data Factory
pricing is easy!
No upfront costs!
Pay only for usage!
…but how much will
that actually cost?
"I guess we just have to
wait for the invoice?"
Azure Data
Factory Pricing
Azure Data Factory Operations
Data Pipeline Orchestration and Execution
Data Flow Debugging and Execution
SQL Server Integ...
Azure Data Factory Operations
Read / Write: $0.50 per 50 000 modified entities
Operations: Create, Read, Update, Delete
En...
Azure Data Factory Operations
Data Pipeline Orchestration and Execution
Data Flow Debugging and Execution
SQL Server Integ...
Data Pipelines: Self-Hosted
$1.50 per 1000 runs
$0.10 per DIU-hour
$0.002 per hour
$0.0001 per hour
Data Pipelines: Azure
$1 per 1000 runs
$0.25 per DIU-hour
$0.005 per hour
$0.00025 per hour
Data Pipelines: Azure
Orchestration: $1 per 1000 runs
Activity, trigger and debug runs
Execution:
Data Movement Activities...
Auto = 4
Min = 2
Data Pipelines: Azure
Orchestration: $1 per 1000 runs
Activity, trigger and debug runs
Execution:
Data Movement Activities...
Actual time: 1 sec = Billed for: 1 min
Actual time: 1 min 1 sec = Billed for: 2 min
Actual time: 1 min 30 sec = Billed for: 2 min
Actual time: 9 min 1 sec = Billed for: 10 min*DIUs
Data Pipelines: Additional Costs
$0.80 per month
$0.05 - $0.087 per GB
Azure Data Factory Operations
Data Pipeline Orchestration and Execution
Data Flow Debugging and Execution
SQL Server Integ...
Data Flow Debugging and Execution
$0.199 per vCore-hour
$0.268 per vCore-hour
$0.345 per vCore-hour
Data Flow Debugging and Execution
Compute Optimized: $0.199 per vCore-hour
General Purpose: $0.268 per vCore-hour
Memory O...
Data Flow Debugging and Execution
Compute Optimized: $0.199 per vCore-hour
General Purpose: $0.268 per vCore-hour
Memory O...
Data Flow Debugging and Execution
Data Flow Debugging and Execution
$1.592 per hour
$2.144 per hour
$2.760 per hour
Data Flow Debugging and Execution
$54.128 per hour
$72.896 per hour
$93.84 per hour
Azure Data Factory Operations
Data Pipeline Orchestration and Execution
Data Flow Debugging and Execution
SQL Server Integ...
SQL Server Integration Services
$0.592 per node per hour
$18.212 per node per hour
SQL Server Integration Services
$1.665 per node per hour
$35.372 per node per hour
SQL Server Integration Services
Enterprise D1 V2: $1.665 per node per hour
1 core, 3.5 GB RAM, 50 GB Temporary Storage
Ent...
SQL Server Integration Services
SQL Server Integration Services
Lessons
Learned
Lessons Learned
Lessons Learned
Total cost per pipeline run: $0.17
Total cost per pipeline run: $0.17
Run once per night for 30 days: $5.1
Total cost per pipeline run: $0.17
$510
Total cost per pipeline run: $0.17
$12240
Lessons Learned
Lessons Learned
Pricing Calculator
azure.microsoft.com/pricing/
calculator/?service=data-factory
"I guess we just have to
wait for the invoice?"
"No, I got this!"
Good luck!
@cathrinew
cathrinew.net
hi@cathrinew.net
thank you!
Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019)
Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019)
Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019)
Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019)
Upcoming SlideShare
Loading in …5
×

of

Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 1 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 2 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 3 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 4 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 5 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 6 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 7 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 8 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 9 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 10 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 11 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 12 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 13 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 14 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 15 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 16 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 17 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 18 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 19 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 20 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 21 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 22 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 23 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 24 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 25 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 26 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 27 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 28 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 29 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 30 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 31 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 32 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 33 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 34 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 35 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 36 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 37 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 38 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 39 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 40 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 41 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 42 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 43 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 44 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 45 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 46 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 47 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 48 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 49 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 50 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 51 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 52 Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019) Slide 53
Upcoming SlideShare
What to Upload to SlideShare
Next
Download to read offline and view in fullscreen.

14 Likes

Share

Download to read offline

Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019)

Download to read offline

Lessons Learned: Understanding Azure Data Factory Pricing (Presented at Microsoft Ignite on November 6th, 2019)

Related Books

Free with a 30 day trial from Scribd

See all

Lessons Learned: Understanding Azure Data Factory Pricing (Microsoft Ignite 2019)

  1. 1. @cathrinew | cathrinew.net
  2. 2. Session Abstract
  3. 3. @cathrinew cathrinew.net
  4. 4. Azure Data Factory pricing is easy!
  5. 5. No upfront costs! Pay only for usage!
  6. 6. …but how much will that actually cost?
  7. 7. "I guess we just have to wait for the invoice?"
  8. 8. Azure Data Factory Pricing
  9. 9. Azure Data Factory Operations Data Pipeline Orchestration and Execution Data Flow Debugging and Execution SQL Server Integration Services
  10. 10. Azure Data Factory Operations Read / Write: $0.50 per 50 000 modified entities Operations: Create, Read, Update, Delete Entities: Datasets, Linked Services, Pipelines, Integration Runtimes, Triggers Monitoring: $0.25 per 50 000 run records retrieved Operations: Get, List Run Records: Pipeline Runs, Activity Runs, Trigger Runs, Debug Runs
  11. 11. Azure Data Factory Operations Data Pipeline Orchestration and Execution Data Flow Debugging and Execution SQL Server Integration Services
  12. 12. Data Pipelines: Self-Hosted $1.50 per 1000 runs $0.10 per DIU-hour $0.002 per hour $0.0001 per hour
  13. 13. Data Pipelines: Azure $1 per 1000 runs $0.25 per DIU-hour $0.005 per hour $0.00025 per hour
  14. 14. Data Pipelines: Azure Orchestration: $1 per 1000 runs Activity, trigger and debug runs Execution: Data Movement Activities: $0.25 per DIU-hour Pipeline Activities: $0.005 per hour External Activities: $0.00025 per hour All activities are prorated by the minute and rounded up
  15. 15. Auto = 4
  16. 16. Min = 2
  17. 17. Data Pipelines: Azure Orchestration: $1 per 1000 runs Activity, trigger and debug runs Execution: Data Movement Activities: $0.25 per DIU-hour Pipeline Activities: $0.005 per hour External Activities: $0.00025 per hour All activities are prorated by the minute and rounded up
  18. 18. Actual time: 1 sec = Billed for: 1 min
  19. 19. Actual time: 1 min 1 sec = Billed for: 2 min
  20. 20. Actual time: 1 min 30 sec = Billed for: 2 min
  21. 21. Actual time: 9 min 1 sec = Billed for: 10 min*DIUs
  22. 22. Data Pipelines: Additional Costs $0.80 per month $0.05 - $0.087 per GB
  23. 23. Azure Data Factory Operations Data Pipeline Orchestration and Execution Data Flow Debugging and Execution SQL Server Integration Services
  24. 24. Data Flow Debugging and Execution $0.199 per vCore-hour $0.268 per vCore-hour $0.345 per vCore-hour
  25. 25. Data Flow Debugging and Execution Compute Optimized: $0.199 per vCore-hour General Purpose: $0.268 per vCore-hour Memory Optimized: $0.345 per vCore-hour Charges are prorated by the minute and rounded up The minimum cluster size to run a data flow is 8 vCores
  26. 26. Data Flow Debugging and Execution Compute Optimized: $0.199 per vCore-hour General Purpose: $0.268 per vCore-hour Memory Optimized: $0.345 per vCore-hour Charges are prorated by the minute and rounded up The minimum cluster size to run a data flow is 8 vCores
  27. 27. Data Flow Debugging and Execution
  28. 28. Data Flow Debugging and Execution $1.592 per hour $2.144 per hour $2.760 per hour
  29. 29. Data Flow Debugging and Execution $54.128 per hour $72.896 per hour $93.84 per hour
  30. 30. Azure Data Factory Operations Data Pipeline Orchestration and Execution Data Flow Debugging and Execution SQL Server Integration Services
  31. 31. SQL Server Integration Services $0.592 per node per hour $18.212 per node per hour
  32. 32. SQL Server Integration Services $1.665 per node per hour $35.372 per node per hour
  33. 33. SQL Server Integration Services Enterprise D1 V2: $1.665 per node per hour 1 core, 3.5 GB RAM, 50 GB Temporary Storage Enterprise E64 V3: $35.372 per node per hour 64 cores, 432 GB RAM, 1600 GB Temporary Storage
  34. 34. SQL Server Integration Services
  35. 35. SQL Server Integration Services
  36. 36. Lessons Learned
  37. 37. Lessons Learned
  38. 38. Lessons Learned
  39. 39. Total cost per pipeline run: $0.17
  40. 40. Total cost per pipeline run: $0.17 Run once per night for 30 days: $5.1
  41. 41. Total cost per pipeline run: $0.17 $510
  42. 42. Total cost per pipeline run: $0.17 $12240
  43. 43. Lessons Learned
  44. 44. Lessons Learned
  45. 45. Pricing Calculator azure.microsoft.com/pricing/ calculator/?service=data-factory
  46. 46. "I guess we just have to wait for the invoice?"
  47. 47. "No, I got this!"
  48. 48. Good luck!
  49. 49. @cathrinew cathrinew.net hi@cathrinew.net thank you!
  • ryszardd

    Jun. 9, 2021
  • GianlucaDArdia

    May. 25, 2021
  • YUANYUAN18

    Apr. 7, 2021
  • JorgeMontecinosMeza

    Feb. 25, 2021
  • Kuya

    Oct. 9, 2020
  • tomtajic

    Sep. 17, 2020
  • ashokibm

    Sep. 13, 2020
  • SimonSimonson

    Jun. 10, 2020
  • MelissaLevitt

    May. 18, 2020
  • RaviKondapalli1

    Apr. 14, 2020
  • hmortada

    Apr. 12, 2020
  • WilfriedKamga

    Apr. 8, 2020
  • BaoBui3

    Mar. 12, 2020
  • StephenBullen2

    Jan. 17, 2020

Lessons Learned: Understanding Azure Data Factory Pricing (Presented at Microsoft Ignite on November 6th, 2019)

Views

Total views

15,243

On Slideshare

0

From embeds

0

Number of embeds

7,293

Actions

Downloads

336

Shares

0

Comments

0

Likes

14

×