AWS Machine Learning Big Data NYC

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

ALEXIS PERRIER
@alexip
Linkedin.com/in/alexisperrier
Data Scientist
Slides:

▸ AWS Machine Learning : predictive analytics
▸ Simple, efﬁcient but somewhat limited
▸ Auto-ML on AWS marketplace
AWS MAC...

DATA SCIENCE TAKE TIME AND RESOURCES

10 FALLACIES OF DATA SCIENCE
Shane Brennan https://medium.com/towards-data-science/the-ten-fallacies-of-data-science-9b2af...

“AWS WANTS TO PUT MACHINE
LEARNING IN REACH OF ANY
DEVELOPER“
April 2015 - Techcrunch
MACHINE LEARNING AS A SERVICE

AWS DATA ECOSYSTEM

AWS MACHINE LEARNING
WHAT IT DOES
▸ Supervised Predictive Analytics
▸ On structured data and text,
▸ Outcome as function o...

WORK FLOW - AWS ML PROJECT
Create a datasource from S3, RDS or Redshift
Transform the data with recipes (opt)
Train a Mode...

DATASOURCE
AWS extracts the schema
AWS analyses the data
Provides simple visualization
Offers default transformation
S3
Re...

TITANIC DATASET - DEFAULT SCHEMA

TITANIC DATASET - SIMPLE ANALYSIS

SCHEMA, RECIPES AND FEATURES
▸ From the data, AWS suggests the optimal transformations - recipe
▸ 7 transformations are av...

TITANIC DATASET - DATA TRANSFORMATION

TITANIC DATASET - DATA TRANSFORMATION

TRAIN YOUR MODEL
STOCHASTIC GRADIENT DESCENT
One model to rule them all
▸ Simple
▸ Regularization
▸ Epochs
▸ Shufﬂing
▸ Th...

STOCHASTIC GRADIENT DESCENT - TUNING
Epochs
Shufﬂing
Regularization

Stochastic Gradient in scikit-learn

CONVERGENCE - POWERFUL QUANTILE BINNING
Accuracy Accuracy

EVALUATION

EVALUATION

TEXT
END POINT - STREAMING

AWS INTEGRATION

STRONG POINTS
▸ Powerful modeling: SGD + quantile binning
▸ AWS ecosystem
▸ Multiple sources (S3, RDS, Redshift)
▸ Simple ...

ROOM FOR IMPROVEMENTS
‣ No cross validation!
‣ Can’t export your trained models*
‣ No scripting
(*) Stealing Machine Learn...

STILL A NEED FOR DOMAIN EXPERTISE
AND FEATURE ENGINEERING
GREAT TIME SAVER BUT

AUTO-ML ON AWS

Modeling is simpliﬁed
But feature engineering still needs attention
3
1
2 Feature engineering
Include all available datase...

‣ Feature importance
‣ Composite features surfacing
‣ Complementary dataset integration
AUTOMATIC FEATURE ENGINEERING
Smar...

ON AWS MARKETPLACE
EC2 INSTANCE

DATA EXPLORATION - FEATURE SELECTION

FEATURE SURFACING

AND ITERATE

+
‣ Reduced TTM + TCO
‣ Less resources
‣ Powerful benchmarking
‣ Fast iterations
‣ Holistic data integration

Jerry Hargrove @awsgeek https://www.awsgeek.com/posts/amazon-machine-learning-summary

LET’S CONNECT!
@alexip
linkedin.com/in/alexisperrier
THANK YOU

Share Slideshare

LinkedIn
Facebook
Twitter

Embed

Size (px)

Show related Slideshows at end

WordPress Shortcode

Link

Share
Email

2024 Trend Updates: What Really Wor... by Search Engine Jou... 1054718 views
Storytelling For The Web: Integrate... by Chiara Aliotta 970719 views
Artificial Intelligence, Data and C... by OECD Directorate ... 905165 views
How to Leverage AI to Boost Employe... by SocialHRCamp 382887 views
2024 State of Marketing Report – by... by Marius Sescu 216911 views
Everything You Need To Know About C... by Expeed Software 234552 views

View on Slideshare

1 of 37 Ad

View on Slideshare

1 of 37 Ad