Machine Learning as a Service

1. New Project Meteos :
Machine Learning as a Service
Hiroyuki Eguchi @NEC
Digambar Patil @Persistent Systems
Sharat Sharma @NEC

2. 2 © NEC Corporation 2017 NEC Group Internal Use Only
What is Machine Learning ?

3. 3 © NEC Corporation 2017 NEC Group Internal Use Only
What Does a Machine Learning Do?
Learning
Evaluation
Prediction
3 steps in Machine Learning
Learn from amount of data
and create Prediction Model
Evaluate accuracy of
Prediction Model
Input value to Prediction
Model and retrieve
predicted Data

4. 4 © NEC Corporation 2017 NEC Group Internal Use Only
Step 1 : Learning
Prediction Model
Training Dataset
(Past Email Data)
Example : Predict incoming mail is spam or not
…
Ham/Spam Body of Mail
Ham
I would like to set up a meeting by
below schedule. ...
Ham
Please send your bill to the followong
address. ...
Spam
SIX chances to win CASH! From 100
to 20,000 ...
Ham
Due to the Boston summit, we will skip
the IRC meetings ..
Spam
URGENT! You have won a 1 week
FREE membership in our ...
Ham Sorry, I'll call later in meeting. ..

5. 5 © NEC Corporation 2017 NEC Group Internal Use Only
Step 2 : Evaluation
Prediction Model
(Created at the previous step)
Test Dataset
(Past Email Data)
Model Evaluation
Accuracy ??%
Comparison
Ham/Spam Body of Mail
Hum
I want to have them by one week
earlier day/month ...
Spam
Here is your discount code
RP176781. To stop further ...
Hum
I would like to place an order for
the following. ...
Ham/Spam Body of Mail
Predicted
Result
Hum
I want to have them by one
week earlier day/month ...
Hum
Spam
Here is your discount code
RP176781. To stop further
...
Spam
Hum
I would like to place an order
for the following. ...
Spam
…

6. 6 © NEC Corporation 2017 NEC Group Internal Use Only
Step 3 : Prediction
Prediction Model
(Evaluated at the previous step)Input Value
(Incoming Mail)
Body of Mail
You have WON a guaranteed 1000 cash
or a 2000 prize. To claim ...
Body of Mail
Predicted
Result
You have WON a guaranteed 1000
cash or a 2000 prize. To claim ...
Spam

7. 7 © NEC Corporation 2017 NEC Group Internal Use Only
Machine Learning Algorithms
Classification Algorithm
(e.g) Spam Mail Detection, Predict weather it will rain or not
Regression Algorithm
(e.g) Predict Stock Price, Predict sales figures
Anomaly Detection Algorithm
(e.g) Credit card fraud detection
Clustering Algorithm
(e.g) Classify users by skill
Recommendation Algorithm
(e.g) Recommend Movie by similar user's preference

8. 8 © NEC Corporation 2017 NEC Group Internal Use Only
Architecture
Raw
Data
Input Data
Dataset
Experiment
meteos-ui
meteos-engine
Swift
Nova
Sahara
Glance Neutron
RabbitMQ
meteos-api
Upload
Raw Data
Create
Experiment Download
& Parse
DataSet
Create
& Evaluate
Model
Input Data Retrieve
Predicted
Data
Output
Data
Prediction Model

9. 9 © NEC Corporation 2017 NEC Group Internal Use Only
Demo1
(Spam Mail Detection)

10. 10 © NEC Corporation 2017 NEC Group Internal Use Only
Demo2
(Movie Recommendation)

11. 11 © NEC Corporation 2017 NEC Group Internal Use Only
Recommend Movie using Recommendation Model
User
Movie
1
Movie
2
Movie
3
Movie
4
1 -
2
3 -
4
5 -
6
Prediction Model
(Predict a rating of movie)
Training Dataset
(Movie Ratings Data)
User
Movie
1
Movie
2
Movie
3
Movie
4
6 ?
…
…

12. 12 © NEC Corporation 2017 NEC Group Internal Use Only
Current Status
Development Plan

13. 13 © NEC Corporation 2017 NEC Group Internal Use Only
Current Status
▌Preparing first stable release
Support Apache Spark ver 1.6 as a first target

14. 14 © NEC Corporation 2017 NEC Group Internal Use Only
Development Plan
▌Add Plugins
Apache Spark ver 2.0
Tensorflow
…
▌Add Documentations
▌Envision to be a Big Tent Project in R release cycle

15. 15 © NEC Corporation 2017 NEC Group Internal Use Only
Conclusion
▌OpenStack Meteos Wiki
https://wiki.openstack.org/wiki/Meteos
▌Getting Started with Meteos
https://wiki.openstack.org/wiki/Meteos/Devstack
▌IRC
#openstack-meteos
▌Etherpad
https://etherpad.openstack.org/p/openstack-meteos