AI is the buzzword while ML is the underlying component... but when do we use ML? To solve problems that machines can find patterns without explicitly programming them to do so. But do you have a team building an ML model? How far are they from the IT team? Do they know how to deploy and serve that? Testing? And sharing what they have done? That's where a devops mindset comes in: reduce the batch size, continuous-everything and a culture of failure/experimentation are vital for your data team! In the end, I will show how the workflow of a data scientist can be in real life with a live demo!

1. @thiagoavadore#CodemotionMilan
AI WITH A DEVOPS MINDSET -
EXPERIMENTATION, SHARING AND EASY
ML DEPLOYMENT
THIAGO DE FARIA
DATAOPS & AI LEAD @LINKIT

2. @thiagoavadore#CodemotionMilan
…

3. @thiagoavadore#CodemotionMilan
~/
▸ ! @ "

4. @thiagoavadore#CodemotionMilan
~/
▸ ! @ "
▸ ❤ 👶 🎸 🎹 '

5. @thiagoavadore#CodemotionMilan
~/
▸ ! @ "
▸ Pure Math —> Software Engineer
▸ ❤ 👶 🎸 🎹 '

6. @thiagoavadore#CodemotionMilan
~/
▸ ! @ "
▸ Pure Math —> Software Engineer
▸ ❤ 👶 🎸 🎹 '
▸ OSS, 🐍, 🌧, Go, k8s, tensorflow, Scala & Spark

7. @thiagoavadore#CodemotionMilan
~/
▸ ! @ "
▸ Pure Math —> Software Engineer
▸ ❤ 👶 🎸 🎹 '
▸ OSS, 🐍, 🌧, Go, k8s, tensorflow, Scala & Spark
▸ Conference organiser - devopsdays,
Amsterdam.ai, ITNEXT, …

8. @thiagoavadore#CodemotionMilan
~/
▸ ! @ "
▸ Pure Math —> Software Engineer
▸ DevOps believer
▸ ❤ 👶 🎸 🎹 '
▸ OSS, 🐍, 🌧, Go, k8s, tensorflow, Scala & Spark
▸ Conference organiser - devopsdays,
Amsterdam.ai, ITNEXT, …

9. @thiagoavadore#CodemotionMilan
FIGHTING THE
DOWNWARDS SPIRAL
TIMELESS CONFLICT

10. @thiagoavadore#CodemotionMilan
Product
Dev
IT Ops
QA
Infosec

11. @thiagoavadore#CodemotionMilan
HYPE WARS - REVENGE OF AI

12. @thiagoavadore#CodemotionMilan
GOOGLE AI MAKES PHONE CALLS??!!
CAN YOU DO SOMETHING LIKE THAT USING
THAT TENSORFLOW STUFF?
OUR USERS WOULD LOVE THAT!
PERSON A, VP OF PRODUCT
The real goal? A great PR
HYPE WARS - REVENGE OF AI

13. @thiagoavadore#CodemotionMilan
HYPE WARS - OTHER HYPES STRIKE BACK

14. @thiagoavadore#CodemotionMilan
WAIT… CAN YOU ALSO DO
THAT IN A CONTAINER USING
BLOCKCHAIN?
PERSON B, appointed new VP of product
HYPE WARS - OTHER HYPES STRIKE BACK

15. @thiagoavadore#CodemotionMilan
HYPE WARS - THE ULTIMATE MEDIUM READER

16. @thiagoavadore#CodemotionMilan
WHY DON’T WE CREATE AN AI DEVOPS CLOUD-
NATIVE APP ON K8S USING BLOCKCHAIN
BACKED BY IOT DEVICES THAT THE USER WILL
EXPERIENCE WITH A VR HEADSET? A TRULY
DISRUPTIVE DIGITAL TRANSFORMATION!
HYPE WARS - THE ULTIMATE MEDIUM READER

17. @thiagoavadore#CodemotionMilan
WHY DON’T WE CREATE AN AI DEVOPS CLOUD-
NATIVE APP ON K8S USING BLOCKCHAIN
BACKED BY IOT DEVICES THAT THE USER WILL
EXPERIENCE WITH A VR HEADSET? A TRULY
DISRUPTIVE DIGITAL TRANSFORMATION!
PERSON C, appointed CEO and master-of-all things
Gets funded and moves to the Bay Area
HYPE WARS - THE ULTIMATE MEDIUM READER

18. @thiagoavadore#CodemotionMilan
AI
MAKE COMPUTERS
CAPABLE OF DOING
THINGS THAT WHEN
DONE BY A HUMAN,
WOULD BE THOUGHT
TO REQUIRE
INTELLIGENCE

19. @thiagoavadore#CodemotionMilan
MAKE MACHINES
FIND PATTERNS
WITHOUT EXPLICITLY
PROGRAMMING
THEM TO DO SO
AI
MACHINE
LEARNING

20. @thiagoavadore#CodemotionMilan
IF/ELSE, LOOPS &
FUNCTIONSNON-ML DEVELOPMENT

21. @thiagoavadore#CodemotionMilan

22. @thiagoavadore#CodemotionMilan

23. @thiagoavadore#CodemotionMilan
DATA &
HYPERPARAMETERS
ML DEVELOPMENT

24. @thiagoavadore#CodemotionMilan

25. @thiagoavadore#CodemotionMilan
DATA
PIPELINE
Manual
INGESTION
EXPLORE
CLEAN
FEATURE
ENGINEERING

26. @thiagoavadore#CodemotionMilan
DATA
PIPELINE
MODEL DEV
EXPLORE
CLEAN
FEATURE
ENGINEERING
TRAIN
TESTTUNE
Manual
INGESTION

27. @thiagoavadore#CodemotionMilan
DATA
PIPELINE
MODEL DEV
EXPLORE
CLEAN
FEATURE
ENGINEERING
TRAIN
TESTTUNE
Automated
INGESTION

28. @thiagoavadore#CodemotionMilan
DATA
PIPELINE
MODEL DEVOPERATIONS
EXPLORE
CLEAN
FEATURE
ENGINEERING
TRAIN
TEST
TUNE
PACKAGE
LOGGING
MONITOR
DEPLOY
Automated
INGESTION
SERVE

29. @thiagoavadore#CodemotionMilan
TRADITIONAL PROBLEMS ALONG THE WAY…

30. @thiagoavadore#CodemotionMilan
TRADITIONAL PROBLEMS ALONG THE WAY…
▸ Brown field

31. @thiagoavadore#CodemotionMilan
TRADITIONAL PROBLEMS ALONG THE WAY…
▸ Data & API changes
▸ Brown field

32. @thiagoavadore#CodemotionMilan
TRADITIONAL PROBLEMS ALONG THE WAY…
▸ Data & API changes
▸ Business does not know what
they want/need
▸ Brown field

33. @thiagoavadore#CodemotionMilan
TRADITIONAL PROBLEMS ALONG THE WAY…
▸ Data & API changes
▸ Business does not know what
they want/need
▸ Internal Politics
▸ Brown field

34. @thiagoavadore#CodemotionMilan
TRADITIONAL PROBLEMS ALONG THE WAY…
▸ Data & API changes
▸ Business does not know what
they want/need
▸ Internal Politics
▸ Going live
▸ Brown field

35. @thiagoavadore#CodemotionMilan
TRADITIONAL PROBLEMS ALONG THE WAY…
▸ Data & API changes
▸ Business does not know what
they want/need
▸ Internal Politics
▸ Going live
▸ Brown field
▸ Monitoring

36. @thiagoavadore#CodemotionMilan
TRADITIONAL PROBLEMS ALONG THE WAY…
▸ Data & API changes
▸ Business does not know what
they want/need
▸ Internal Politics
▸ Going live
▸ Brown field
▸ Monitoring
▸ Nobody wants be “on-call”

37. @thiagoavadore#CodemotionMilan
THE DATA PIPELINE & ML EXTRA PROBLEMS

38. @thiagoavadore#CodemotionMilan
THE DATA PIPELINE & ML EXTRA PROBLEMS
▸ DS != software engineers

39. @thiagoavadore#CodemotionMilan
THE DATA PIPELINE & ML EXTRA PROBLEMS
▸ DS != software engineers
▸ Data pipeline won’t scale

40. @thiagoavadore#CodemotionMilan
THE DATA PIPELINE & ML EXTRA PROBLEMS
▸ DS != software engineers
▸ Data pipeline won’t scale
▸ Local development, local data
& lack of versioning

41. @thiagoavadore#CodemotionMilan
THE DATA PIPELINE & ML EXTRA PROBLEMS
▸ DS != software engineers
▸ Data pipeline won’t scale
▸ Local development, local data
& lack of versioning
▸ Lot of rework

42. @thiagoavadore#CodemotionMilan
THE DATA PIPELINE & ML EXTRA PROBLEMS
▸ DS != software engineers
▸ Data pipeline won’t scale
▸ Local development, local data
& lack of versioning
▸ Lot of rework
▸ Packaging, deploying &
serving??!

43. @thiagoavadore#CodemotionMilan
THE DATA PIPELINE & ML EXTRA PROBLEMS
▸ DS != software engineers
▸ Data pipeline won’t scale
▸ Local development, local data
& lack of versioning
▸ Lot of rework
▸ Packaging, deploying &
serving??!
▸ Even harder to measure the
efficacy

44. @thiagoavadore#CodemotionMilan
SILVER BULLET
CULTURE CHANGE &
NEW WAYS OF WORKING.DOES IT SOUND SIMILAR?

45. @thiagoavadore#CodemotionMilan
CHANGE THE CULTURE.
INVOLVE ML/DS.

46. @thiagoavadore#CodemotionMilan
Product
Dev
IT Ops
QA
Infosec
ML Engineer
Data Scientist

47. @thiagoavadore#CodemotionMilan
LOCAL DATA
SCIENCE IS DEAD

48. @thiagoavadore#CodemotionMilan
CI/CD FOR ML
*IT ISN’T EASY…

49. @thiagoavadore#CodemotionMilan
MORE THAN CI/CD,
CONTINUOUS EVALUATION

50. @thiagoavadore#CodemotionMilan
BIAS, DRIFT & FRAGILITY
ARE ML’S BUGS

51. @thiagoavadore#CodemotionMilan
BIAS, DRIFT & FRAGILITY
ARE ML’S BUGS

52. @thiagoavadore#CodemotionMilan
BIAS, DRIFT & FRAGILITY
ARE ML’S BUGS

53. @thiagoavadore#CodemotionMilan
COLLABORATION.

54. @thiagoavadore#CodemotionMilan
COLLABORATION.
VERSION - CODE & DATA.

55. @thiagoavadore#CodemotionMilan
COLLABORATION.
VERSION - CODE & DATA.
EVALUATION.

56. @thiagoavadore#CodemotionMilan
COLLABORATION.
VERSION - CODE & DATA.
EVALUATION.
PACKAGING.

57. @thiagoavadore#CodemotionMilan
COLLABORATION.
VERSION - CODE & DATA.
EVALUATION.
PACKAGING.
DEPLOYMENT.

58. @thiagoavadore#CodemotionMilan
COLLABORATION.
VERSION - CODE & DATA.
EVALUATION.
PACKAGING.
DEPLOYMENT.
MODEL SERVING.

59. @thiagoavadore#CodemotionMilan
TOOLS TO HELP…
▸ 2.3 on
▸ …… on Ha. 3.1
▸ .
▸ .

60. @thiagoavadore#CodemotionMilan
DEMO GODS, BE KIND…

61. @thiagoavadore#CodemotionMilan
COLLABORATION
VERSION - CODE & DATA.
EVALUATION.
PACKAGING.
DEPLOYMENT.
MODEL SERVING.

62. @thiagoavadore#CodemotionMilan
COLLABORATION
VERSION - CODE & DATA.
EVALUATION.
PACKAGING.
DEPLOYMENT.
MODEL SERVING.
!DEVOPS MOVEMENT!
!CULTURE CHANGE!

63. @thiagoavadore#CodemotionMilan
COLLABORATION
VERSION - CODE & DATA.
EVALUATION.
PACKAGING.
DEPLOYMENT.
MODEL SERVING.
!DEVOPS MOVEMENT!
!CULTURE CHANGE!

64. @thiagoavadore#CodemotionMilan
COLLABORATION
VERSION - CODE & DATA.
EVALUATION.
PACKAGING.
DEPLOYMENT.
MODEL SERVING.
!DEVOPS MOVEMENT!
!CULTURE CHANGE!

65. @thiagoavadore#CodemotionMilan
COLLABORATION
VERSION - CODE & DATA.
EVALUATION.
PACKAGING.
DEPLOYMENT.
MODEL SERVING.
!DEVOPS MOVEMENT!
!CULTURE CHANGE!
& MANY OTHERS

66. @thiagoavadore#CodemotionMilan
Questions?

67. @thiagoavadore#CodemotionMilan
Questions?
SHAMELESS PLUG…

68. @thiagoavadore#CodemotionMilan
THE AMAZING PICTURES ARE FROM THE
GREAT JD HANCOCK!
PHOTOS.JDHANCOCK.COM