9. Data Monitoring
• Motor temperature
• Motor vibration
• Current
• Intake pressure
• Intake
temperature
Ø Flow
Electrical power cable
Pump
Intake
Protector
ESP motor
Pump monitoring unit
Electric Submersible
Pumps (ESP)
Predictive Analytics - Fault Management
18. Scenario: Predictive Scrapping of Parts in an Assembly Line
Goal: Scrap parts as early as possible automatically to reduce costs in a manufacturing process.
Question: When to scrap a part in Station 1 instead of doing re-work or sending it to Station 2?
Station 1 Station 2
Cost Before
9€
7€ 13€
Total Cost
29€
(or more)
Scrap? Scrap?
40. Big Data Reference Architecture
Augmented Intelligence
Operations
SENSOR DATA
TRANSACTIONS
MESSAGE BUS
MACHINE DATA
SOCIAL DATA
Streaming AnalyticsAction
Aggregate
Rules
Stream Processing
Analytics
Correlate
Continuous query
processing
Alerts
Manual action,
escalation
Data Discovery
Python
R
Data
Scientists
Cleansed
Data
History
Visual Analytics
Spark
Integration
ERP MDM DB WMS
SOA / Microservices
BIG DATA
Data Warehouse, Hadoop
Internal Data
Integration Bus
API
Event Server
H2O.ai
Live UI
49. Dataflow Streaming Pipeline (Ingest, Preprocess)
Augmented Intelligence
Operations
SENSOR DATA
TRANSACTIONS
MESSAGE BUS
MACHINE DATA
SOCIAL DATA
Streaming AnalyticsAction
Aggregate
Rules
Stream Processing
Analytics
Correlate
Continuous query
processing
Alerts
Manual action,
escalation
Data Discovery
Python
R
Data
Scientists
Cleansed
Data
History
Visual Analytics
Spark
Integration
ERP MDM DB WMS
SOA / Microservices
BIG DATA
Data Warehouse, Hadoop
Internal Data
Integration Bus
API
Event Server
H2O.ai
Live UI
51. Streaming Analytics
Augmented Intelligence
Operations
SENSOR DATA
TRANSACTIONS
MESSAGE BUS
MACHINE DATA
SOCIAL DATA
Streaming AnalyticsAction
Aggregate
Rules
Stream Processing
Analytics
Correlate
Continuous query
processing
Alerts
Manual action,
escalation
Data Discovery
Python
R
Data
Scientists
Cleansed
Data
History
Visual Analytics
Spark
Integration
ERP MDM DB WMS
SOA / Microservices
BIG DATA
Data Warehouse, Hadoop
Internal Data
Integration Bus
API
Event Server
H2O.ai
Live UI
69. Dataflow Streaming Pipeline + Streaming Analytics
Augmented Intelligence
Operations
SENSOR DATA
TRANSACTIONS
MESSAGE BUS
MACHINE DATA
SOCIAL DATA
Streaming AnalyticsAction
Aggregate
Rules
Stream Processing
Analytics
Correlate
Continuous query
processing
Alerts
Manual action,
escalation
Data Discovery
Python
R
Data
Scientists
Cleansed
Data
History
Visual Analytics
Spark
Integration
ERP MDM DB WMS
SOA / Microservices
BIG DATA
Data Warehouse, Hadoop
Internal Data
Integration Bus
API
Event Server
H2O.ai
Live UI
74. Live UI for Augmented Intelligence
Augmented Intelligence
Operations
SENSOR DATA
TRANSACTIONS
MESSAGE BUS
MACHINE DATA
SOCIAL DATA
Streaming AnalyticsAction
Aggregate
Rules
Stream Processing
Analytics
Correlate
Continuous query
processing
Alerts
Manual action,
escalation
Data Discovery
Python
R
Data
Scientists
Cleansed
Data
History
Visual Analytics
Spark
Integration
ERP MDM DB WMS
SOA / Microservices
BIG DATA
Data Warehouse, Hadoop
Internal Data
Integration Bus
API
Event Server
H2O.ai
Live UI
83. Data Discovery via Visual Analytics, Big Data and Machine Learning
Augmented Intelligence
Operations
SENSOR DATA
TRANSACTIONS
MESSAGE BUS
MACHINE DATA
SOCIAL DATA
Streaming AnalyticsAction
Aggregate
Rules
Stream Processing
Analytics
Correlate
Continuous query
processing
Alerts
Manual action,
escalation
Data Discovery
Python
R
Data
Scientists
Cleansed
Data
History
Visual Analytics
Spark
Integration
ERP MDM DB WMS
SOA / Microservices
BIG DATA
Data Warehouse, Hadoop
Internal Data
Integration Bus
API
Event Server
H2O.ai
Live UI
84. Find Insights and Patterns in Historical Data
Visual Analytics + Machine Learning
85. Apply Insights and Analytic Models to Proactive Actions
Streaming
AnalyticsH20.ai
Open Source
R
TERR
Spark ML
MATLAB
SAS
PMML
87. Case Study: Streaming Analytics for Betting
• Situation: Today, 80% of Betting is Done After the
Game Starts
• It’s not your father’s bookie anymore!
• Problem: How to Analyze Big Betting Data?
• Thousands of concurrent games, constantly adjusting odds, dozens of
betting networks – firms must correlate millions of events a day to
find the best betting opportunities in real-time
• Solution: TIBCO for Fast Data Architecture
• TXOdds uses TIBCO to correlate, aggregate, and analyze large
volumes of streaming betting data in real-time and publish innovative
predictive betting analytics to their customers
• Result: TXOdds First to Market with Innovative Zero
Latency Betting Analytics
• Innovative real-time analytics help players who can process electronic
data in real-time the edge
“With StreamBase, in two
months we had our first
betting analytics feed live,
and we continually deploy
new ideas and evolve our
old ones.”
- Alex Kozlenkov, VP of technology,
TXOdds
89. Real-Time Social Media Analytics
Twitter
(#TomBradyBrokenLeg)
Twitter (#Boston)
Brady’s
Stats
Actionable
Insights
Twitter (#NFL)
Something relevant happening?
Every second counts!
Change Odds (automated or manually triggered):
Stop live-betting for the current running game?
• Who will win the game?
• How many interceptions will the Quarterback throw?
• Will the Patriots win the Super Bowl?
• …
92. Scenario: Predictive Scrapping of Parts in an Assembly Line
Goal: Scrap parts as early as possible automatically to reduce costs in a manufacturing process.
Question: When to scrap a part in Station 1 instead of doing re-work or sending it to Station 2?
Station 1 Station 2
Cost Before
9€
7€ 13€
Total Cost
29€
(or more)
Scrap? Scrap?
93. Big Data Architecture for Predictive Maintenance
Operational Analytics
Operations
Live UI
CSV Batch
JSON Real Time
XML Real Time
Streaming AnalyticsAction
Aggregate
Rules
Analytics
Correlate
Live Datamart
Continuous query
processing
Alerts
Manual action,
escalation
HISTORICAL ANALYSIS Data
Scientists
Flume
HDFS
Spotfire
R / TERR
HDFS
Hadoop (Cloudera)
StreamBase
TIBCO Fast Data Platform
H2O
Oracle RDBMS
Avro Parquet … PMML
Internal Data
96. Monitor Patterns à TIBCO Live Datamart
Augmented Intelligence (“Monitor the manufacturing process and change rules in real time!”)
Live Dartmart Desktop Client
97. Monitor Patterns à TIBCO Live Datamart
Augmented Intelligence (“Monitor the manufacturing process and change rules in real time!”)
Live Dartmart Web API
98. TIBCO Spotfire + StreamBase + Live Datamart + H2O.ai
Live DemoLive Demo