This document discusses Dask, an open source parallel computing library for Python that scales existing libraries like NumPy, Pandas, and Scikit-learn to larger datasets and clusters. It allows workloads to run across multiple cores on a single machine or be distributed across a Google Cloud Platform cluster. The document provides an example of using Dask in a Google Kubernetes Engine cluster to parallelize machine learning workloads and speed up model training. It concludes that Dask is a good open source solution that can be configured for machine learning projects and allows workloads to be scaled horizontally or vertically for increased speed.

1. for analytics
Nico Liberato Candio

2. WHY DASK
DASK IN ACTION
RESULTS TABLE OF
CONTENTS
01
02
03
04 REFERENCES

3. 03
WHY DASK
01

4. Parallel computing
library that scales
the existing Python
ecosystem : NumPy,
Pandas , Scikit
PARALLELIZATION FLEXIBLE RESPONSIVE
Task scheduling
interface for more
custom workloads
and integration.
Single machine or
distributed
workloads across
GCP clusters
Runs resiliently up
to 1000s cores.
Horizontal and
vertical scaling.

5. 03
DASK IN ACTION
02

6. 6
Example:
1. Dask in GKE cluster
2. Models deployment (Helm)
3. Faster training and
workload parallelization
4. Scale via Kubernetes or
Dask (threads/workers)
Demo: simple tree
summation computation
with Dask installed in our
cluster.

7. Example: parallelization in GKE.

8. 03
CONCLUSIONS
03

9. WHY DASK IS
GOOD FOR US
OPEN SOURCE
Our setup is on GKE
with a single Dask
cluster deployed
with Helm. Open
Source solution
configurable for all
the ML projects.
SCALING
We scale the number
of workers (threads)
dividing the
workload in multiple
units. Horizontal or
vertical scaling via
dashboard.
SPEED
We speed up the
computation
achieving faster
times in training
models

10. Next?
Creation of Dask clusters
by computation context,
saving costs .
Storage and dataframes
parallelization refactoring
the model
implementation.

11. Questions?
nicoliberatoc@gmail.com
+353 089 44 207 64
THANKS!

12. CREDITS
This is where you give credit to the ones who are part of this
project.
Did you like the resources on this template? Get them for
free at our other websites.
◂ Presentation template by Slidesgo
◂ Icons by Flaticon
◂ Infographics by Freepik
◂ Images created by Freepik and rawpixel -Freepik
◂ Author introduction slide photo created by Freepik
◂ Text & Image slide photo created by Freepik.com