How can we use Machine Learning to drive innovation?In this session, we present how to democratize ML and give every team the ability to use ML for innovation.We’ll demonstrate how we can use Sagemaker’s built in algorithms and distributed training to experiment more often and iterate faster. We’ll build a prediction of flights delay and integrate it to the product to increase the efficiency of the ground processes. In addition, we present the use of Amazon Forecast for predicting the number of flights that might be delayed in the next few days.

1. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Unleash the Power of ML with AWS
Orit Alul
Solutions Architect
Amazon Web Services
D E V 3 0 4
@oritalul

2. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

3. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.

4. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWSome Airlines architecture
FrontendData Microservices Common
Interfaces
Machine Learning Services
Serverless Scheduler Data lake and Analytics
Flights
Resources
31
2
4
5

5. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What to expect from this session?
Predictive analytics for Awesome Airlines:
Ø Predict if a flight will be delayed or not
Ø Predict how many delays we’re going to have in an airport

6. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Full Disclosure:
I’m not a Data Scientist

7. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How?
• From 0 to a tuned flights delay prediction:
o Overview: ML on AWS
o Get the data and explore it
o Choose the algorithm
o Obtaining the intelligence (= train)
o Become smarter (= tune)
o Predict
** Bonus: Predict using Amazon Forecast

8. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Put machine learning in the
hands of every developer
Our mission at AWS

9. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The Amazon ML stack: Broadest & deepest set of capabilities
AI SERVICES
Easily add intelligence to applications without machine learning skills
Vision | Documents | Speech | Language | Chatbots | Forecasting | Recommendations
ML SERVICES
Build, Train, and Deploy machine learning models fast and at scale
Data labeling | Pre-built algorithms & notebooks | One-click training and deployment
ML FRAMEWORKS &
INFRASTRUCTURE
Flexibility & choice, highest-performing infrastructure
Support for ML frameworks | Compute options purpose-built for ML

10. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
M L F R A M E W O R K S &
I N F R A S T R U C T U R E
The Amazon ML Stack: Broadest & Deepest Set of Capabilities
A I S E R V I C E S
R E K O G N I T I O N
I M A G E
P O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D
C O M P R E H E N D
M E D I C A L
L E XR E K O G N I T I O N
V I D E O
Vision Speech Chatbots
A M A Z O N S A G E M A K E R
B U I L D T R A I N
F O R E C A S TT E X T R A C T P E R S O N A L I Z E
D E P L O Y
Pre-built algorithms & notebooks
Data labeling (G R O U N D T R U T H )
One-click model training & tuning
Optimization ( N E O )
One-click deployment & hosting
M L S E R V I C E S -
F r a m e w o r k s I n t e r f a c e s I n f r a s t r u c t u r e
E C 2 P 3
& P 3 d n
E C 2 C 5 F P G A s G R E E N G R A S S E L A S T I C
I N F E R E N C E
Models without training data (REINFORCEMENT LEARNING)
Algorithms & models ( A W S M A R K E T P L A C E )
Language Forecasting Recommendations
NEW NEWNEW
NEW
NEW
NEWNEW
NEW
NEW

11. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Textract
K E Y F E A T U R E S
Optical Character
Recognition (OCR)
Key-value pair
detection
Adjustable confidence
thresholds
Table
detection
Bounding box
coordinates
No ML experience
required
Extract text and data from virtually any document

12. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Forecast
K E Y F E A T U R E S
Consider
multiple
time-series
at once
Automatic
machine
learning
Visualize forecasts
& import results
into business apps
Evaluate model
accuracy
The picture can't be displayed.
Privacy &
encryption
Bring existing
algorithms from
Amazon
SageMaker
Improve forecasting accuracy by up to 50% at 1/10th the cost
Schedule
forecasts
and training

13. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Personalize
K E Y F E A T U R E S
Context-aware
Recommendations
Automated
machine learning
Bring existing algorithms
from Amazon SageMaker
Continuous
learning
Data is kept private
and encrypted
Improve customer experiences with personalization and recommendations

14. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
M L F R A M E W O R K S &
I N F R A S T R U C T U R E
The Amazon ML Stack: Broadest & Deepest Set of Capabilities
A I S E R V I C E S
R E K O G N I T I O N
I M A G E
P O L L Y T R A N S C R I B E T R A N S L A T E C O M P R E H E N D
C O M P R E H E N D
M E D I C A L
L E XR E K O G N I T I O N
V I D E O
Vision Speech Chatbots
A M A Z O N S A G E M A K E R
B U I L D T R A I N
F O R E C A S TT E X T R A C T P E R S O N A L I Z E
D E P L O Y
Pre-built algorithms & notebooks
Data labeling (G R O U N D T R U T H )
One-click model training & tuning
Optimization ( N E O )
One-click deployment & hosting
M L S E R V I C E S -
F r a m e w o r k s I n t e r f a c e s I n f r a s t r u c t u r e
E C 2 P 3
& P 3 d n
E C 2 C 5 F P G A s G R E E N G R A S S E L A S T I C
I N F E R E N C E
Models without training data (REINFORCEMENT LEARNING)
Algorithms & models ( A W S M A R K E T P L A C E )
Language Forecasting Recommendations
NEW NEWNEW
NEW
NEW
NEWNEW
NEW
NEW

15. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

16. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Human learning

17. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
T R A I N D E P L O Y
B U I L D
Build, train, tune, and host your own models
T U N E
Amazon SageMaker
Pre-built
notebooks for
common problems
Built-in, high
performance
algorithms

18. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
1
2
3
Amazon SageMaker:
Build, Train, and Deploy ML Models at Scale

19. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Get The Data:

20. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

21. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SageMaker:
Build, Train, and Deploy ML Models at Scale

22. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Start With a Working Example
https://github.com/awslabs/amazon-Sagemaker-examples
/blob/master/introduction_to_applying_machine_learning/
xgboost_customer_churn/xgboost_customer_churn.ipynb

23. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Choose The Algorithm: XGBoost
XGBoost (eXtreme Gradient Boosting) is a popular and efficient
open-source implementation of the gradient boosted trees
algorithm. Gradient boosting is a supervised learning algorithm that
attempts to accurately predict a target variable by combining the
estimates of a set of simpler, weaker models…
https://docs.aws.amazon.com/sagemaker/latest/dg/xgboost.html

24. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SageMaker:
Build, Train, and Deploy ML Models at Scale

25. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

26. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SageMaker:
Build, Train, and Deploy ML Models at Scale

27. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

28. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SageMaker:
Build, Train, and Deploy ML Models at Scale

29. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.

30. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

31. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon SageMaker:
Build, Train, and Deploy ML Models at Scale

32. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Forecast
K E Y F E A T U R E S
Consider
multiple
time-series
at once
Automatic
machine
learning
Visualize forecasts
& import results
into business apps
Evaluate model
accuracy
The picture can't be displayed.
Privacy &
encryption
Bring existing
algorithms from
Amazon
SageMaker
Improve forecasting accuracy by up to 50% at 1/10th the cost
Schedule
forecasts
and training

33. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Number of Delays in an Airport

34. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.

35. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Summary
Predictive analytics for Awesome Airlines:
ü Predict if a flight will be delayed or not
ü Predict how many delays we’re going to have in an airport

36. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What’s next
FrontendData Microservices Common
Interfaces
Machine Learning Services
Serverless Scheduler Data lake and Analytics
Flights
Resources
31
2
4
5

37. Thank you!
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
http://bit.ly/2SJ6ItO
Orit Alul
Solutions Architect
Amazon Web Services
@oritalul