Unless stated otherwise all images are taken from wikipedia.org or openclipart.org
Why IoT (now) ?
• 15 Billion connected devices in 2015
• 40 Billion connected devices in 2020
• World population 7.4 Billi...
Machine Learning on
historic data
Source: deeplearning4j.org
Online Learning
Source: deeplearning4j.org
online vs. historic
• Pros
• low storage costs
• real-time model update
• Cons
• algorithm support
• software support
• no...
DeepLearning
DeepLearning
Apache Spark
Hadoop
Neural Networks
Neural Networks
Deeper (more) Layers
Convolutional
Convolutional
+ =
Convolutional
Learning of a function
A neural network can basically learn any
mathematical function
Recurrent
LSTM
“vanishing error problem” == influence of past inputs decay
quickly over time
LSTM
http://karpathy.github.io/2015/05/21/rnn-effectiveness/
•Outperformed traditional methods, such as
•cumulative sum (CUSUM)
•exponentially weighted moving average (EWMA)
•Hidden M...
Learning of an algorithm
A LSTM network is touring complete
Problems
• Neural Networks are computationally very complex
•especially during training
•but also during scoring
CPU (2009...
IBM TrueNorth
•Scalable
•Parallel
•Distributed
•Fault Tolerant
•No Clock ! :)
•IBM Cluster
• 4.096 chips
• 4 billion neuro...
DeepLearning
the future in cloud based analytics
Storage Layer (OpenStack SWIFT / Hadoop HDFS / IBM GPFS)
Execution Layer ...
bit.ly/gpy16
•IBM Cloud Free Tier
•http://ibm.biz/joinIBMCloud
•IBM GeoSpatial Service
•https://new-console.ng.bluemix.net/docs/service...
Geo Python16 keynote
Geo Python16 keynote
Geo Python16 keynote
Geo Python16 keynote
Geo Python16 keynote
Geo Python16 keynote
Geo Python16 keynote
Geo Python16 keynote
Geo Python16 keynote
Geo Python16 keynote
Geo Python16 keynote
Geo Python16 keynote
Geo Python16 keynote
Geo Python16 keynote
Geo Python16 keynote
Geo Python16 keynote
Geo Python16 keynote
Geo Python16 keynote
Geo Python16 keynote
Geo Python16 keynote
Geo Python16 keynote
Geo Python16 keynote
Geo Python16 keynote
Geo Python16 keynote
Upcoming SlideShare
Loading in …5
×

Geo Python16 keynote

582 views

Published on

Keynote: Artificial Intelligence Methods for Time Series Forecasting and Classification of Real-Time IoT Sensor Data Streams, Romeo Kienzler, Chief Data Scientist - IBM Watson IoT WW, IBM Academy of Technology

Published in: Data & Analytics
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
582
On SlideShare
0
From Embeds
0
Number of Embeds
23
Actions
Shares
0
Downloads
13
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Geo Python16 keynote

  1. 1. Unless stated otherwise all images are taken from wikipedia.org or openclipart.org
  2. 2. Why IoT (now) ? • 15 Billion connected devices in 2015 • 40 Billion connected devices in 2020 • World population 7.4 Billion in 2016
  3. 3. Machine Learning on historic data Source: deeplearning4j.org
  4. 4. Online Learning Source: deeplearning4j.org
  5. 5. online vs. historic • Pros • low storage costs • real-time model update • Cons • algorithm support • software support • no algorithmic improvement • compute power to be inline with data rate • Pros • all algorithms • abundance of software • model re-scoring / re- parameterisation (algorithmic improvement) • batch processing • Cons • high storage costs • batch model update
  6. 6. DeepLearning DeepLearning Apache Spark Hadoop
  7. 7. Neural Networks
  8. 8. Neural Networks
  9. 9. Deeper (more) Layers
  10. 10. Convolutional
  11. 11. Convolutional + =
  12. 12. Convolutional
  13. 13. Learning of a function A neural network can basically learn any mathematical function
  14. 14. Recurrent
  15. 15. LSTM “vanishing error problem” == influence of past inputs decay quickly over time
  16. 16. LSTM
  17. 17. http://karpathy.github.io/2015/05/21/rnn-effectiveness/
  18. 18. •Outperformed traditional methods, such as •cumulative sum (CUSUM) •exponentially weighted moving average (EWMA) •Hidden Markov Models (HMM) •Learned what “Normal” is •Raised error if time series pattern haven't been seen before
  19. 19. Learning of an algorithm A LSTM network is touring complete
  20. 20. Problems • Neural Networks are computationally very complex •especially during training •but also during scoring CPU (2009) GPU (2016) IBM TrueNorth (2017)
  21. 21. IBM TrueNorth •Scalable •Parallel •Distributed •Fault Tolerant •No Clock ! :) •IBM Cluster • 4.096 chips • 4 billion neurons • 1 trillion synapses •Human Brain • 100 billion neurons • 100 trillion synapses •1.000.000 neurons •250.000.000 synapses
  22. 22. DeepLearning the future in cloud based analytics Storage Layer (OpenStack SWIFT / Hadoop HDFS / IBM GPFS) Execution Layer (Spark Executor, YARN, Platform Symphony) Hardware Layer (Bare Metal High Performance Cluster) GraphXStreaming SQL MLLib BlinkDB DeepLearning4J
 
 ND4J R MLBase H2O Y O U GPUAVX Intel Xeon E7-4850 v2 48 core, 3 TB RAM, 72 GB HDD, 10Gbps, NVIDIA TESLA M60 GPU (cu)BLAS jcuBLAS S T R E A M S
  23. 23. bit.ly/gpy16
  24. 24. •IBM Cloud Free Tier •http://ibm.biz/joinIBMCloud •IBM GeoSpatial Service •https://new-console.ng.bluemix.net/docs/services/ geospatial/index.html#geospatial •Google TPU •http://www.recode.net/2016/5/20/11719392/google-ai-ch tpu-questions-answers •IBM Neuromorphic Chip •http://www.research.ibm.com/articles/brain-chip.shtm •Recoding of the Talk •https://www.youtube.com/watch?v=h5_NH3sL0Qw •Contact Romeo Kienzler on Twitter: @romeokienzler

×