Talk at the Oct/19 Datalab Meetup about Kubeflow & MLOPs

1. DataLab | ©SerasaExperian 1
Kubeflow - A caixa de ferramentas para tirar seus
modelos do notebook e colocá-los em produção

2. DataLab | ©SerasaExperian 2
Quem é esse Pokemon?

3. DataLab | ©SerasaExperian 3
Por que o Kubeflow foi criado?
Does this sound like your organization? Your data science team works on
laptops using open source tools installed from the open Internet. They train
their models with a subset of production data that fits in memory on their local
machines. They share results with stakeholders via PowerPoint slides and
emails, not deployed REST APIs.
“

4. DataLab | ©SerasaExperian 4
”
Then, with management approval, the data science team will pass a model
over to the software engineering team, who will then rewrite the model in a
“production language” like Java. Sometimes this causes the model outcomes
to change and it always takes a significant amount of time.
Rory Merritt
https://www.anaconda.com/deploying-machine-learning-models-is-hard-but-it-doesnt-have-to-be/

5. DataLab | ©SerasaExperian 5
Overview de ferramentas
Argo Grafana Ambassador

6. DataLab | ©SerasaExperian 6
Kubeflow ML
Pipelines

7. DataLab | ©SerasaExperian 7
Katib

8. DataLab | ©SerasaExperian 8
Detalhes extras
• Suporte a GPU;
• Tolerância a falha.

9. DataLab | ©SerasaExperian 9
Not Everything
is straightforward...

10. DataLab | ©SerasaExperian 10
Jupyter Hub

11. DataLab | ©SerasaExperian 11
Jupyter Hub

12. DataLab | ©SerasaExperian 12
Seldon
O que é Seldon?

13. DataLab | ©SerasaExperian 13
Seldon
O que é Seldon?

14. DataLab | ©SerasaExperian 14
Seldon
Caso especial python
model.pkl
source2image
+
requirements.txt
+
model.py
Flask Spring

15. DataLab | ©SerasaExperian 15
Seldon
Caso especial python

16. DataLab | ©SerasaExperian 16
Seldon
Caso especial python

17. DataLab | ©SerasaExperian 17
Seldon
Caso especial python
$ s2i build . seldonio/seldon-core-s2i-python3:0.4 sk-iris:0.1
$ kubectl apply –f deploy.yaml

18. DataLab | ©SerasaExperian 18
Seldon

19. DataLab | ©SerasaExperian 19
Seldon

20. DataLab | ©SerasaExperian 20
Seldon

21. DataLab | ©SerasaExperian 21
Seldon
Ninja stuff
• Multi-arm prediction
• Shadow deploy
• AB test
• Outlier detection
• Predction/Inference graphs

22. DataLab | ©SerasaExperian 22
Temos vagas!
Vagas abertas:
datalabserasaexperian.com.br/
index.php/sobre/carreiras
Banco de currículos:
datalabserasaexperian.com.br/
index.php/sobre/faca-parte-da-equipe
@datalab.experian
Serasa Experian DataLab

23. DataLab | ©SerasaExperian 23
Muito Obrigado!
Otávio Vasques
otavio.vasques@br.experian.com
Rafael Monteiro
rafael.monteiro@br.experian.com