Map r chicago_advanalytics_oct_meetup

© 2017 MapR TechnologiesMapR Confidential 1
Chicago Advanced Analytics
Meetup:
IoT Predictive Maintenance using
Recurrent Neural Networks
Justin Brandenburg
Data Scientist
10/12/17

Predictive Maintenance Importance
“The best way of thinking about predictive maintenance is by tying it
into a revenue stream. When your machines are up and running, you’re
making money. Instead of just looking at the average time between
failures, you’re looking for subtle clues within the machine itself. You’re
measuring sound, heat, vibration, tilt, acceleration, compression,
humidity, and checking to see if any of those are out of spec.”
- Greg Fell is the former CIO of Terex, a heavy equipment manufacturer

Predictive Maintenance
• The idea behind predictive maintenance is that the failure patterns of various
types of equipment are predictable. If we can predict when a piece of
hardware will fail accurately, and replace that component before it fails, we
can achieve much higher levels of operational efficiency.
• With many devices now including sensor data and other components that
send diagnosis reports, predictive maintenance using big data becomes
increasingly more accurate and effective.

Data is Generated One Event at a Time
“time” : “6:01.103”,
“event” : “RETWEET”,
“location” :
“lat” : 40.712784,
“lon” : -74.005941
“time: “5:04.120”,
“severity” : “CRITICAL”,
“msg” : “Service down”
“card_num” : 1234,
“merchant” : ”Apple”,
“amount” : 50

Stream
Welding Sensors
Stream
Press Sensors
Stream
Prod Line
Stream
Paint
Topic
Topic
Topic
Topic
• Insight on the entire process in real time
• Insight on individual components in real time
IoT Real Time Monitoring
Data Platform

From Monitoring to Classifying to Predicting
• Monitoring still requires active involvement and quick response
– Oil well that is indicating increased temperature or volume
– Network traffic for bot net activity or insider threat
• What are we monitoring?
– Is this behavior normal?
• Based on what we are monitoring, can we predict what will
happen?

Classifying vs Predicting in IoT
• Classification
• Prediction – Can we predict when this non-normal behavior will
occur?
Non-Normal

Deep Learning
Deep learning is a particular subset of ML methodologies using
artificial neural networks (ANN)
• Successfully applied to so many different domains (image, text, video,
speech, and vision)
• Success of DL is also due to the availability of more training data (such as
ImageNet for images) and the relatively low-cost availability of storage and
increase in computational power

Deep Learning Implementations
Convolutional
Neural
Networks
Deep
Neural
Networks
Recurrent
Neural
Networks
providing lift for
classification and
forecasting models
feature extraction
and classification of
images
for sequence of
events (sentences
or time series)

Recurrent Neural Network at a Glance
• A neural network that can be used when your data is treated as a
sequence, where the particular order of the data-points matter
• Sometimes, the input is a sequence and the output is a single
vector, or the other way around.

Recurrent Neural Network Topology
Unrolling through time

Other RNN Implementations

TensorFlow
TensorFlow is an open source software library for numerical
computation using data flow graphs
• Developed by Google, released to open source community in Nov 2015 and
quickly became one of the most popular deep learning frameworks
• Two months after its release it had already become the most popular forked
ML GitHub repository
• Built on C++ with a Python interface

What is a Tensor?
A Tensor is a n-dimensional matrix
• 1D is a vector
• 2D (M x M) matrix/tensor is a square array of numbers (m numbers tall and
m numbers wide)
• M x M x M tensor is a cube array (m tall, m wide, m deep)

Why TensorFlow for this problem?
• TensorFlow has rich documentation
• Works on CPUs and GPUs (most DL frameworks can)
• Versions 1.x and above have increased utility with function
abstraction
• Once model is trained, tested and optimized, it can be deployed
to edge computing structures or containers

What are we working with?
• Challenge: Sensor attached to a automated manufacturing
device capture position and calibration at each time stamp.
Sensor is capturing real time data on the device and its current
health. The data is stored for historical analysis to identify trends
and patterns to determine if any devices need to be taken out of
production for health checks and maintenance.
• Data: 2,013 .dat files that, when unpackaged, were xml format

Workflow
• Import Data into environment
• Perform data transformations
• Exploration of historical data
• Model Construction
• Model Testing
• Deploy Model into Streaming Consumer
• Integrate Visualization

Data Import
• MapR-FS allows for a user to ingest any file type
– Filesystem offers schema-on-read versus schema-on-write. Schema-on-
write necessitates knowing your schema before data is written and then
when data is read, it comes back in the schema defined up-front.
Schema-on-read allows data loading as-is, with no preprocessing thereby
removing obstacles for data capture.
• Data was uploaded in compressed file into MapR-FS via Hue UI
– Also can be done via NFS or scp
• Extract files from .zip file
• Extracted files were .dat filetypes, converted file extension to .xml
using standard bash commands

Data Transformation
• Using Spark to do bulk file ETL from many xml files to single csv
• XML format
• Dataframe

Data Exploration
• Use Jupyter Notebook for interactive data exploration and model
development

Data Prep and Model Building
• Use Jupyter Notebook for prepping data and developing your
model and setting hyper parameters

Model Training and Testing
• Use Jupyter
Notebook for
training and
testing the model

Model Deployment
• Can take tested RNN model and deploy the model on new data as
it streams from sensor attached to device
• Model will generate an alert if predicted metric exceeds historically
normal threshold

Visualization
• Dashboard can show in
real time trends and
behaviors of real time
sensor data and the next
period prediction

Improvement?
• Implement an LSTM RNN
• Change training batch sizes
• Adjust hyper-parameters
• Multi-variate inputs

Points to Remember
• TF is just one ML tool among many (but a great one)
• Choosing the right one depends on your problem
– Ex: Supervised or Unsupervised learning
• How does this model or solution scale?
• Once a model is optimized and insight gained, how can I deploy
my model to help my organization?
• Tools are never used in isolation, the platform matters!
– Support the Workflow, Not Just Modeling

Data Science In IoT…
… still evolving.

Q&A
ENGAGE WITH US
@mapr
Blog: https://mapr.com/blog/
MapR Academy
http://learn.mapr.com/

Map r chicago_advanalytics_oct_meetup

More Related Content

Similar to Map r chicago_advanalytics_oct_meetup

Recently uploaded

Map r chicago_advanalytics_oct_meetup