Machine Learning Applied to Real Time Scoring in Manufacturing and Energy Utilities

152 views

Published on

Kai Wähner (@KaiWaehner) is a Technology Evangelist and Community Director at TIBCO Software - a leading provider of integration and analytics middleware. Kai is an experience guy in broad variety of topics like Big Data, Advanced Analytics & Machine Learning, he loves to write articles and blog about new technologies and make talks. The talk is about 3 different projects where Kai's team built analytic models with technologies R, Apache Spark or H2O.ai which were deployed to real time processing. The use cases include predictive maintenance in manufacturing but also fraud detection in banking and context-specific pricing in insurance. For one of the cases, Kai gonna show detailed steps will be, how it was built and deployed using supervised/unsupervised ML.

Talk was done together with my colleague Ankitaa Bhowmick.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
152
On SlideShare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Machine Learning Applied to Real Time Scoring in Manufacturing and Energy Utilities

  1. 1. Kai Wähner Technology Evangelist kontakt@kai-waehner.de LinkedIn @KaiWaehner www.kai-waehner.de Predictive Analytics Meetup Frankfurt (January 2017) Machine Learning Applied to Real Time Scoring in Manufacturing and Other Businesses Ankitaa Bhowmick Solution Consultant abhowmic@tibco.com LinkedIn
  2. 2. © Copyright 2000-2017 TIBCO Software Inc. Apply Big Data Analytics to Real Time Processing
  3. 3. © Copyright 2000-2017 TIBCO Software Inc. Agenda 1) Machine Learning and Big Data Analytics 2) Use Cases for Predictive Analytics 3) Predictive Maintenance (Energy Utilities) 4) Predictive Scrapping (Assembly Line)
  4. 4. © Copyright 2000-2017 TIBCO Software Inc. Agenda 1) Machine Learning and Big Data Analytics 2) Use Cases for Predictive Analytics 3) Predictive Maintenance (Energy Utilities) 4) Predictive Scrapping (Assembly Line)
  5. 5. Machine Learning …. allows computers to find hidden insights without being explicitly programmed where to look.
  6. 6. Real World Examples of Machine Learning Spam Detection Search Results + Product Recommendation Picture Detection (Friends, Locations, Products) Machine Learning is already present in daily life… Now, every enterprise is beginning to leverage it! The Next Disruption: Google Beats Go Champion
  7. 7. © Copyright 2000-2017 TIBCO Software Inc. From Insight to Action - Closed Loop for Big Data Analytics Insight ActionEVENTSEVENTS
  8. 8. © Copyright 2000-2017 TIBCO Software Inc. From Insight to Action - Closed Loop for Big Data Analytics Insight Action MONITOR PREDICT ACT DECIDE MODEL ACCESS ANALYZE WRANGLE
  9. 9. © Copyright 2000-2017 TIBCO Software Inc. • Business User / Analyst • Data Scientist • Citizen Data Scientist • Developer User Roles AI-DRIVEN VISUAL ANALYTICS DATA DISCOVERY DASHBOARDS DATA SCIENCE RE-IMAGINED PREDICTIVE MACHINE LEARNING STREAMING ANALYTICS REAL TIME ACTIONABLE
  10. 10. © Copyright 2000-2017 TIBCO Software Inc. Agenda 1) Machine Learning and Big Data Analytics 2) Use Cases for Predictive Analytics 3) Predictive Maintenance (Energy Utilities) 4) Predictive Scrapping (Assembly Line)
  11. 11. Banking – Fraud Detection Anti-Money Laundering (AML) Trade Surveillance Credit/Debit card monitoring Health Insurance Fraud Insurance Fraud Online Operations Act proactively before the fraud happened…
  12. 12. © Copyright 2000-2017 TIBCO Software Inc. Retailer – Cross Selling / Customer Satisfaction Sale of Premium Upgrade Sale of Perishable Goods Increase of Customer Satisfaction Partner Network Additional Services Complaint Management Capture – Engage – Expand - Monetize Patterns – Real time MORE PERSONAL MORE CONTEXT social CRM POS mobileweb e-mails © Copyright 2000-2015 TIBCO Software Inc.
  13. 13. © Copyright 2000-2017 TIBCO Software Inc. Insurance – Context-Specific Pricing Premium Price Quote Optimization Customer Risk Scoring Act proactively before the customer left the website…
  14. 14. © Copyright 2000-2017 TIBCO Software Inc. Telco – Detection of Anomalies before Network Outage Act proactively before the outage happens…
  15. 15. © Copyright 2000-2017 TIBCO Software Inc. Analyze and Act on Critical Business Moments
  16. 16. © Copyright 2000-2017 TIBCO Software Inc. Agenda 1) Machine Learning and Big Data Analytics 2) Use Cases for Predictive Analytics 3) Predictive Maintenance (Energy Utilities) 4) Predictive Scrapping (Assembly Line)
  17. 17. © Copyright 2000-2017 TIBCO Software Inc. Use case : Sensor based equipment monitoring • Reduce non-productive time: Big $$$ • System reliability • Optimal run-time / maintenance
  18. 18. 1A. Sensor Analytics – Leading Indicator Trend Analysis Combination of Rules CUSUM Analysis Statistical Analysis Statistical Process Control Machine Learning Location Change – Variable moves up or down Slope Change – Variable changes trend Variance Change – Variable becomes more/less volatile Process Threshold – Shewhart control chart Failure Model y (0/1) = f (X, b) + e; f = logistic regression, trees, svm, nnet, ... © Copyright 2000-2015 TIBCO Software Inc. Sensor Analytics – Leading Indicator Identification
  19. 19. 2. Find Leading Indicators 3. Backtest Rules / Models 4. Push Rules / Models to Event Server 1. Study Anomalies Sensor Analytics – Patterns in Historical Data
  20. 20. 1. Rules / models pushed from Spotfire 2. Data streams into StreamBase 3. Rules / models applied to streaming data 4. Notifications /Alerts Email, SMS, Spotfire RCA on trigger Database, BPM, … LiveView on streaming data © Copyright 2000-2015 TIBCO Software Inc. Sensor Analytics – Real-Time Surveillance
  21. 21. TIBCO Spotfire + R / TERR Live DemoLive Demo
  22. 22. © Copyright 2000-2017 TIBCO Software Inc. Agenda 1) Machine Learning and Big Data Analytics 2) Use Cases for Predictive Analytics 3) Predictive Maintenance (Energy Utilities) 4) Predictive Scrapping (Assembly Line)
  23. 23. Scenario: Predictive Scrapping of Parts in an Assembly Line Goal: Scrap parts as early as possible automatically to reduce costs in a manufacturing process. Question: When to scrap a part in Station 1 instead of doing re-work or sending it to Station 2? Station 1 Station 2 Cost Before 9€ 7€ 13€ Total Cost 29€ (or more) Scrap? Scrap?
  24. 24. TIBCO Spotfire with H2O.ai Integration © Copyright 2000-2017 TIBCO Software Inc. Example: Predictive Analytics for Manufacturing (“scrap parts as early as possible”)
  25. 25. TIBCO Spotfire with H2O.ai Integration © Copyright 2000-2017 TIBCO Software Inc. Example: Predictive Analytics for Manufacturing (“scrap parts as early as possible”)
  26. 26. Fast Data Architecture for Predictive Maintenance Operational Analytics Operations Live UI CSV Batch JSON Real Time XML Real Time Streaming AnalyticsAction Aggregate Rules Analytics Correlate Live Datamart Continuous query processing Alerts Manual action, escalation HISTORICAL ANALYSIS Data Scientists Flume HDFS Spotfire R / TERR HDFS Hadoop (Cloudera) StreamBase TIBCO Fast Data Platform H2O Oracle RDBMS Avro Parquet … PMML Internal Data
  27. 27. © Copyright 2000-2017 TIBCO Software Inc. TIBCO StreamBase Connector for R and TERR
  28. 28. © Copyright 2000-2017 TIBCO Software Inc. TIBCO StreamBase Connector for H2O.ai
  29. 29. © Copyright 2000-2017 TIBCO Software Inc. TIBCO StreamBase Connector for PMML
  30. 30. TIBCO Spotfire with H2O Integration Data Discovery / Data Mining (“Are parts that repeat a station more likely scrap parts?”)
  31. 31. TIBCO Live Datamart Operational Intelligence (“Monitor the manufacturing process and change rules in real time!”) Live Dartmart Desktop Client
  32. 32. TIBCO Live Datamart Operational Intelligence (“Monitor the manufacturing process and change rules in real time!”) Live Dartmart Web API
  33. 33. TIBCO Spotfire + StreamBase + H2O.ai + Live Datamart Live DemoLive Demo
  34. 34. © Copyright 2000-2017 TIBCO Software Inc. Key Take-Aways Ø Insights are hidden in Historical Data on Big Data Platforms Ø Machine Learning and Big Data Analytics find these Insights by building Analytics Models Ø Event Processing uses these Models (without Redevelopment) to take Action in Real Time
  35. 35. Questions? Please contact me! Kai Wähner Technology Evangelist kontakt@kai-waehner.de LinkedIn @KaiWaehner www.kai-waehner.de Ankitaa Bhowmick Solution Consultant abhowmic@tibco.com LinkedIn

×