@thiagoavadore#devopsdays
AI WITH A DEVOPS MINDSET
EXPERIMENTATION, SHARING & EASY ML DEPLOYMENT
THIAGO DE FARIA

HEAD OF SOLUTIONS ENGINEERING @LINKIT
@thiagoavadore#devopsdays
▸ Pure Math —> Software Engineer
▸ ❤ 👶 🎸 🎹 %
▸ Anything-Data … I probably done it
▸ DevOps Amsterdam Alumnus
@thiagoavadore#devopsdays
GOOGLE AI MAKES PHONE
CALLS??!! CAN YOU DO
SOMETHING LIKE THAT USING
THAT TENSORFLOW STUFF?
USERS WOULD LOVE THAT!
PERSON A, VP OF PRODUCT

The real goal? A great PR
@thiagoavadore#devopsdays
WAIT… CAN YOU ALSO DO
THAT IN A CONTAINER USING
BLOCKCHAIN?
PERSON B, appointed new VP of product
@thiagoavadore#devopsdays
WHY DON’T WE CREATE AN AI
DEVOPS CLOUD-NATIVE APP ON
K8S USING BLOCKCHAIN BACKED
BY IOT DEVICES THAT THE USER
WILL EXPERIENCE WITH A VR
HEADSET? A TRULY DISRUPTIVE
DIGITAL TRANSFORMATION!
PERSON C, appointed CEO and master-of-all things

Gets funded and moves to the Bay Area
SERVICE MESH!
@thiagoavadore#devopsdays
Fighting the downwards spiral
TIMELESS CONFLICT
@thiagoavadore#devopsdays
Product
Dev
IT Ops
QA
Infosec
@thiagoavadore#devopsdays
AI
MAKE COMPUTERS
CAPABLE OF DOING
THINGS THAT WHEN
DONE BY A HUMAN,
WOULD BE THOUGHT
TO REQUIRE
INTELLIGENCE
@thiagoavadore#devopsdays
MAKE MACHINES
FIND PATTERNS
WITHOUT EXPLICITLY
PROGRAMMING
THEM TO DO SO
AI
MACHINE
LEARNING
@thiagoavadore#devopsdays
IF/ELSE, LOOPS & FUNCTIONS
NON-ML DEVELOPMENT
@thiagoavadore#devopsdays
@thiagoavadore#devopsdays
DATA & HYPERPARAMETERS
ML DEVELOPMENT
@thiagoavadore#devopsdays
ML LIFECYCLE
DIFFERENT, BUT NOT THAT MUCH…
@thiagoavadore#devopsdays
@thiagoavadore#devopsdays
DATA
PIPELINE
Manual

INGESTION
EXPLORE
CLEAN
FEATURE
ENGINEERING
@thiagoavadore#devopsdays
DATA
PIPELINE
MODEL DEV
EXPLORE
CLEAN FEATURE
ENGINEERING
TRAIN
TESTTUNE
Manual

INGESTION
@thiagoavadore#devopsdays
DATA
PIPELINE
MODEL DEV
EXPLORE
CLEAN
FEATURE
ENGINEERING
TRAIN
TESTTUNE
Automated

INGESTION
@thiagoavadore#devopsdays
@thiagoavadore#devopsdays
DATA
PIPELINE
MODEL DEV
EXPLORE
CLEAN
FEATURE
ENGINEERING
TRAIN
TESTTUNE
Automated

INGESTION
@thiagoavadore#devopsdays
DATA
PIPELINE
MODEL DEVOPERATIONS
EXPLORE
CLEAN
FEATURE
ENGINEERING
TRAIN
TEST
TUNE
PACKAGE
LOGGING
MONITOR
DEPLOY
SERVE
Automated

INGESTION
@thiagoavadore#devopsdays
PROBLEMS ALONG THE WAY
SURPRISE SURPRISE, CULTURE IS THE BIGGEST ONE…
@thiagoavadore#devopsdays
▸ Explainability & Ethics
▸ Hard to measure efficacy
▸ Nobody wants to be “on-call”
▸ Local Dev & Data —> Rework
@thiagoavadore#devopsdays
SILVER BULLET
CULTURE CHANGE. 

NEW WAYS OF WORKING.
@thiagoavadore#devopsdays
Product
Dev
IT Ops
QA
Infosec
ML Engineer
Data
Scientist
@thiagoavadore#devopsdays
LOCAL DATA
SCIENCE IS DEAD
@thiagoavadore#devopsdays
CI/CD FOR ML
*MORE THAN IT… CONTINUOUS EVALUATION
@thiagoavadore#devopsdays
BIAS, DRIFT &
FRAGILITY
@thiagoavadore#devopsdays
!DEVOPS MOVEMENT!

!CULTURE CHANGE!
& many others…
COLLABORATION
VERSION - CODE & DATA
EVALUATION
PACKAGING
DEPLOYMENT
MODEL SERVING
@thiagoavadore#devopsdays
SPEED
INVISIBLE WORK
COLLABORATION
OBSERVABILITY
CI/CD BECOME CONTINUOS EVALUATION
TRACKING
SERVING
REDUCE WASTE
FAIL CULTURE
@thiagoavadore#devopsdays
TOOLS TO HELP…
▸ 2.3 on
▸Cloud-Native ML
▸.
▸.
▸Pachiderm
▸…
@thiagoavadore#devopsdays
OSS!

DO NOT
REINVENT
THE WHEEL!
@thiagoavadore#devopsdays
Questions
?
SHAMELESS PLUG…
@thiagoavadore#devopsdays
DEMO GODS, BE KIND…
@thiagoavadore#devopsdays
THE AMAZING PICTURES ARE FROM THE
GREAT JD HANCOCK!



PHOTOS.JDHANCOCK.COM

DevOpsDays Istanbul 2019 - AI with a devops mindset