This document discusses Azure virtual machines that support GPUs for graphics, compute, and deep learning workloads. It provides details on different VM families including the GPU models, memory, VM sizes and configurations, networking options, storage, and device drivers. It also discusses Azure Batch AI for provisioning GPU clusters, scheduling jobs, handling data and workflows, and integrating with tools. Sample recipes and related GitHub repositories are referenced.

2. https://www.flickr.com/photos/mwichary/3209181446

4. Virtual Machines
CPU GPU FPGA
Data Bricks Batch AI AKS
Azure Machine Learning SDK
應用程式及資料處理流程

6. https://www.flickr.com/photos/mwichary/4145891520

8. https://github.com/Azure/pixel_level_land_classification

9. Purpose Graphics
VM Family NV v1
GPU NVIDIA M60
GPU Memory 8 GB
Sizes 1, 2 or 4 GPU
Interconnect PCIe (dual root)
2nd Network
VM CPU Haswell
VM RAM 56-224 GB
Local SSD ~380-1500 GB
Storage Std Storage
Driver Quadro/Grid PC

10. Purpose Graphics Compute Compute Compute
VM Family NV v1 NC v1 NC v2 NC v3
GPU NVIDIA M60 NVIDIA K80 NVIDIA P100 NVIDIA V100
GPU Memory 8 GB 8 GB 16 GB 16 GB
Sizes 1, 2 or 4 GPU 1, 2 or 4 GPU 1, 2 or 4 GPU 1, 2 or 4 GPU
Interconnect PCIe (dual root) PCIe (dual root) PCIe (dual root) PCIe (dual root)
2nd Network FDR InfiniBand FDR InfiniBand FDR InfiniBand
VM CPU Haswell Haswell Broadwell Broadwell
VM RAM 56-224 GB 56-224 GB 112-448 GB 112-448 GB
Local SSD ~380-1500 GB ~380-1500 GB ~700-3000 GB ~700-3000 GB
Storage Std Storage Std Storage Prem Storage Prem Storage
Driver Quadro/Grid PC Tesla Tesla Tesla

11. Purpose Graphics Compute Compute Compute Deep Learning
VM Family NV v1 NC v1 NC v2 NC v3 ND v1
GPU NVIDIA M60 NVIDIA K80 NVIDIA P100 NVIDIA V100 NVIDIA P40
GPU Memory 8 GB 8 GB 16 GB 16 GB 24 GB
Sizes 1, 2 or 4 GPU 1, 2 or 4 GPU 1, 2 or 4 GPU 1, 2 or 4 GPU 1, 2 or 4 GPU
Interconnect PCIe (dual root) PCIe (dual root) PCIe (dual root) PCIe (dual root) PCIe (dual root)
2nd Network FDR InfiniBand FDR InfiniBand FDR InfiniBand FDR InfiniBand
VM CPU Haswell Haswell Broadwell Broadwell Broadwell
VM RAM 56-224 GB 56-224 GB 112-448 GB 112-448 GB 112-448 GB
Local SSD ~380-1500 GB ~380-1500 GB ~700-3000 GB ~700-3000 GB ~700-3000 GB
Storage Std Storage Std Storage Prem Storage Prem Storage Prem Storage
Driver Quadro/Grid PC Tesla Tesla Tesla Tesla

12. Purpose Graphics
VM Family NV v2
GPU NVIDIA M60
GPU Memory 8 GB
Sizes 1, 2 or 4 GPU
Interconnect PCIe (dual root)
2nd Network
VM CPU Broadwell
VM RAM 112-448 GB
Local SSD ~700-3000 GB
Storage Prem Storage
Driver Quadro/Grid PC

13. Purpose Graphics Deep Learning
VM Family NV v2 ND v2
GPU NVIDIA M60 NVIDIA V100
GPU Memory 8 GB 16 GB
Sizes 1, 2 or 4 GPU 8 GPU
Interconnect PCIe (dual root) NVLink
2nd Network
VM CPU Broadwell Skylake
VM RAM 112-448 GB 768 GB
Local SSD ~700-3000 GB ~1300 GB
Storage Prem Storage Prem Storage
Driver Quadro/Grid PC Tesla

15. https://www.flickr.com/photos/mwichary/4358127163

16. Clusters
• Provision GPUs
• Install drivers
and software
• Interactive use
Scheduling
• Queue work
• Prioritize jobs
• Start MPI
• Monitor
• Handle failures
Data
• Scale access to
training data
• Output logs &
models
• Secure &
compliant
Cost
• Scale up and
down
• Share reserved
instances
• Use low priority
Workflow
• Efficient
hardware
• Tooling
integration
• Laptop to cloud

19. New API coming soon

21. https://github.com/Azure/BatchAI/tree/master/recipes

24.  Azure Blob FUSE: Default in samples going forward

31. https://www.flickr.com/photos/mwichary/4358122657

32. https://github.com/saidbleik/batchai_mm_ad

34. https://github.com/Azure/doAzureParallel
https://github.com/Azure/aztk/
https://azure.github.io/batch-shipyard/
https://github.com/Azure/batch-shipyard

35. https://www.flickr.com/photos/mwichary/4148855707