AI in Software for Augmenting Intelligence Across the Enterprise

AI in Software for
Augmenting Intelligence across the Enterprise
© Copyright 2000-2017 TIBCO Software Inc.
Michael O’Connell
Chief Analytics Officer
TIBCO
Ahmer Srivastava
Director of Analytics, Wafer Operations
Western Digital

• Chief Analytics Officer atTIBCO, a Global Software Company with
> $1B revenue, >3,000 employees and >10,000 customers worldwide.
• Works withTIBCO customers and analytics product teams to develop
analytic solutions and provide input for product evolution.
• Leads theTIBCO Data Science team.
• Over 20 years in the analytics software industry.
• PhD in Statistics from NC State University,Adjunct Faculty.
Michael O’Connell
Chief Analytics Officer
TIBCO Software
moconnell@tibco.com @MichOConnell
Michael O’Connell, CAO, TIBCO

©2017 Western Digital Corporation or its affiliates. All rights reserved.
• Director of Analytics for Wafer Operations at Western Digital, a Fortune 500
company and global leader in storage solutions. Subsidiaries include HGST and
SanDisk.
• Responsible for helping Western Digital realize the power of data and create
transformative initiatives for smart factory systems.
• Leads a team that enables manufacturing operations to effectively access, analyze,
and leverage product and sensor data to achieve quality, factory asset utilization
and product performance goals.
• Over 15 years in the storage technology sector.
• Worked in Product Management, Engineering, Failure Analysis, and Continuous
Process Improvement initiatives at Western Digital, HGST and IBM
• University of California, San Diego Alumnus
Ahmer Srivastava
Director of Analytics
Western Digital® ahmer.srivastava@wdc.com linkedin.com/in/nomadiclens
Ahmer Srivastava, Director of Analytics, Western Digital

This document (including, without limitation, any product roadmap or statement of direction data) illustrates the planned testing, release and availability dates for TIBCO products and services. It is
for informational purposes only and its contents are subject to change without notice. © Copyright 2000-2017 TIBCO Software Inc. All rights reserved. TIBCO Proprietary Information.
DISCLAIMER
During the course of this presentation, TIBCO or its representatives may make forward-looking statements
regarding future events, TIBCO’s future results or our future financial performance. Although we believe that the
expectations reflected in the forward-looking statements contained in this presentation are reasonable, these
expectations or any of the forward-looking statements could prove to be incorrect and actual results or financial
performance could differ materially from those stated herein.
TIBCO could experience factors that could cause actual results or financial performance to differ materially from
those contained in any forward-looking statement made in connection with this presentation. TIBCO does not
undertake to update any forward-looking statements that may be made from time to time or on its behalf.
This document (including, without limitation, any product roadmap or statement of direction data) illustrates the
planned testing, release and availability dates for TIBCO products and services. This document is provided for
informational purposes only and its contents are subject to change without notice. TIBCO makes no warranties,
express or implied, in or relating to this document or any information in it, including, without limitation, that the
information is error-free or meets any conditions of merchantability or fitness for a particular purpose. This
document may not be reproduced or transmitted in any form or by any means without our prior written permission.
The material provided is for informational purposes only, and should not be relied on in making a purchasing
decision. The information is not a commitment, promise or legal obligation to deliver any material, code, or
functionality. The development, release, and timing of any features or functionality described for our products
remains at our sole discretion.

INTERCONNECT
EVERYTHING
AUGMENT
INTELLIGENCE

CORE EDGE
The (new) Spectrum of Integration
APIS
MICRO
SERVICES
SAAS DEVICES

AUGMENT INTELLIGENCE
Visual
Analytics
Streaming
Analytics
Predictive
Analytics
Model business and system
behavior using data big and small
Deliver recommendation driven
insight to business and operations
Sense and take action in the right
moment to improve business
outcomes

• Founded in 1997
• Based in Palo Alto, California
• Present in 30+ countries
• 3000+ employees
• 10000+ customers

©2017 Western Digital Corporation or its affiliates. All rights reserved. Confidential.
• In a strong strategic position to lead global
evolution of broad-based and changing
storage industry
• Broad storage portfolio, including HDDs,
SSDs, embedded and removable flash
memory, and storage-related systems
• Vertically integrated business model to
maximize operational efficiency
• Consistent profitable performance, strong
free cash flow
~72B
Total Addressable
Market (TAM)*
13,500+
Total Issued Patents,
Worldwide
70000+
Employees
Worldwide
*

Augment Intelligence at TIBCO
Make TIBCO Software Smart and Easy to Use
• Augment / Analytics : Recommendations
• Interconnect : Smart Systems Provisioning and UX
AI: Rules & Machine Learning for Customers
• Augment / Analytics (data at-rest) : Spotfire
• Point-click machine learning / Ecosystem: R, Python, …
• Augment / Analytics (data in-motion) : Business Events, StreamBase, AMX BPM
• Point-click rules specification, management; Real-time math; Smart allocation
Embedded AI
• TIBCO Insight Platform – Continuous Closed Loop Learning

#1. Make TIBCO Software Smarter
TIBCO Spotfire - Recommendations
AI for Analysis Recommendations and Dashboard Guidance
TIBCO Business Events, TIBCO StreamBase
AI Rules / BE State Machine
Real-time math; PMML-PFA-POJO enabled
TIBCO GridServer, TIBCO BPM
Smart routing, task / resource allocation, elastic provisioning
Technology - TIBCO Enterprise Runtime for R (TERR)
Embedded in Spotfire, Business Events, StreamBase, GridServer, BPM

#2. Smart Analytic Apps for Customers
1.
2. 3.
1. Out of box & Right-click ML
2. Custom Expression functions
3. Embed Data Functions

#3. Embedded AI: the TIBCO Insight Platform
https://community.tibco.com/wiki/tibco-insight-platform

Optimize
Pricing Prevent
Fraud
Smart cross-sell
offers
Real-Time
inventory
Management
Optimize
Routes
Deliver proactive
customer service
Predict impending
equipment failure Anticipate
and handle
disruptions
#3. Embedded AI: the TIBCO Insight Platform

#1. Make Product Smarter

Spotfire : Recommendations

Visual Analytics – Spotfire Dashboards

“Our teams need concise, actionable takeaways from
the data in our Spotfire dashboards,” said Sasha
Teska, Business Insights Manager at Constellation
Brands Canada Inc., a market leader in the Canadian
wine industry and a shared customer
of Automated Insights and TIBCO.
“TIBCO is the core of our reporting and we use
Wordsmith's natural language to provide digestible
information. Now, they can get personalized
summaries telling them exactly what they need to
know.”
Utterance
eg “State”
Glue
Intent
Parameters
Filter, Mark,..
Narrative
https://automatedinsights.com/tibco
Natural Language – Input, Output

Smarter Software – Spotfire Recommendations
Spotfire recommendations - starting point for data analysis
Better viz + reduce data exploration time
Dashboard Graph
Recommendation Modes
All columns used in plot
Subset of columns
used in plots
1. User selects columns of interest
2. Heuristics rules-driven recommendations
3. On user data: not static images!
4. Inductive learning: “more like this”

Examples
1. Metadata Sales: Continuous & Numerical,
Dept: Categorical with X unique values,
OrderDate: Continuous & Datetime with Hierarchy
2. Filtering: with OrderDat & Dept selected pie charts don’t survive
3. Global Scoring: Bar charts are rated higher than Line charts
Exhaustive Display: Bar charts plotted before Line charts
x-axis – Time with calculated hierarchies
Recommendations - Under the hood
1. Generate Metadata 2. Filter Out Plots
3. Global Scoring &
4. Exhaustive Display
Raw Data
Data Types
Min/Max Range
Hierarchy
Num / Cat
Heuristic
Rules
Surviving Plots
Bar Charts
Scatter Plots
Tree Maps
Other Advanced

Current Work
• Know more about your data: Spread, Correlations
• Not only Viz, use recommendations in data prep, modeling
• Use domain knowledge
• Analyze and score companywide dashboards
• Ecosystem of modules on Exchange
Crowdsource
Data
Analytics
Better
Recommendations
www.community.tibco.com/exchange

Inline Data Wrangling
Immersive
Flexible
Smart
Graphical
Traceable

• Visual Wrangling - group,
split, type change, un-pivot
on the fly
• Data Lineage -
self-documenting, reusable,
visual data workflow
• Smart Inference-driven
ingest - associate & append
• In-lake/db - search based
exploration & source data
catalog
Inline Data Wrangling

#2. AI/Machine Learning
for TIBCO / Customers

Spotfire
Analyst
Spotfire
Consumer
Spotfire
iOS
Spotfire
Automation
Spotfire
Library
DataLDAP
Data Science at Your Fingertips with TERR / R
Mass Communicate the Power of Data Science
• Spotfire has an embedded R Engine
• Client and Server
• Spotfire makes it easy for Data
Scientists to share their work
• Spotfire Data Functions support
many Stats Engines
• Spotfire Library manages
components for re-use & sharing
• TIBCO Community shares data
science components

What does TERR do in Spotfire?
• Adds stats on the Visual environment
• Can be used directly in Expressions (Data Wrangling)
• Runs R Data Functions in Spotfire analyses
• Powers the Predictive Modeling Tools
• Can extend Spotfire graphics palette
TIBCO Enterprise Runtime for R (TERR) and Spotfire

Spotfire Map
Spotfire TERR Data Function
contourLines(x,y)

Spotfire MapSpotfire TERR Data Function
Data Functions
Wafer diameter
Die width, height
Spotfire/TERR(parameters)
Spotfire Map Chart
fields package for smoothing
Spotfire TERR Data Functions
wafer(die width, height)
fields: tps()

Spotfire TERR Data Function Anomaly Detection
h2o.deeplearning(…)
h2o.deeplearning(x,..)

Spotfire TERR Machine Learning Data Functions
Spotfire Modeling Data Functions
• Machine Learning
• Gradient Boosting
• Random Forests
• Deep Learning
• Anomaly Detection
• Segmentation
• Propensity
• Affinity
• Non-Linear Regression; Decline
Curves
• Modeling & Simulation
• Optimization
• Genetic Algorithms

• TIBCO GridServer + Spotfire + TERR
• TERR on Nodes: Monte Carlo
• Formulation for Regulatory Requirements eg
VaR, Economic Capital
• TIBCO Mashery + Spotfire + TERR
• Bot Detection
• TIBCO BPM + Spotfire + TERR
• Sankey chart
• Case prediction
• Work pool prediction, SLAs
• Optimal resource assignment
TERR and Smart Apps across TIBCO Products

Route Optimization: Spotfire +TERR + GeoAnalytics
lpsolveAPI( )

Optimizing Resource Allocation to Tasks in BPM
lpsolveAPI( )
Before AfterData Function Settings

#2. AI/Machine Learning
for TIBCO / Customers
#3. Embedded AI

Insight Action
MONITOR
PREDICT
ACT
DECIDE
MODEL
ACCESS
ANALYZE
WRANGLE
Operational CyclesTIBCO Insight Platform
Data Discovery
TIBCO Spotfire
Insight Deployment
TIBCO StreamBase
Data Integration: TIBCO Active Matrix Business Works

Optimize
Pricing Prevent
Fraud
Smart cross-sell
offers
Real-Time
inventory
Management
Optimize
Routes
Deliver proactive
customer service
Predict impending
equipment failure Anticipate
and handle
disruptions
Operational CyclesHigh Value Analytic Applications

ActionInsightPattern
Applications
Capabilities
Operational CyclesAnalytic Applications at Scale

Western Digital
Digital Business Journey

Intelligence Augmentation in
High-Tech Device Manufacturing
Ahmer Srivastava
Director of Analytics,Wafer Operations
April 06, 2017
4/17/17©2017 Western Digital Corporation or its affiliates. All rights reserved.
HIVE Event with Michael O’Connell, Chief Analytics
Officer, TIBCO on “AI in Software for Augmenting
Intelligence” across the Enterprise

6 Decades of Innovations – Phenomenal Scaling!
HOW DO WE SURVIVE?
IBM RAMAC
(first HDD)
CAPACITY
12 TB
FORMAT
8 disks 3.5”
AREAL DENSITY
864 Gbit/sqin
DATA RATE
12 Gb/s
POWER
~10 W
COST/MB
<$0.000032
Ultrastar HE12
(latest HDD)
2016
2.4M x
increase
>99.9%
smaller
432M x
density
80K x
faster
99.6%
less power
1956
CAPACITY
5 MB
FORMAT
50 disks 24”
AREAL DENSITY
2 Kbit/sqin
DATA RATE
150 Kb/s
POWER
2374 W
COST/MB
$10,0001
x 108
cost improvement
1
source: anandtech
2
source: website©2017 Western Digital Corporation or affiliates. All rights reserved.

Industry 4.0 – Next wave in Manufacturing
OVERVIEW OF INDUSTRIAL REVOLUTIONS
Adapted from Christoph Roser
http://www.allaboutlean.com
(Wikipedia)
Industry 1.0
Mechanical production
powered by steam and
water
Industry 2.0
Mass production assembly
lines, division of labor,
powered by electricity
Industry 3.0
Automated production using
advances in electronics and
information technology
Industry 4.0
Intelligent production incorporated with
IOT, cloud and big data; physical and
software components are deeply
intertwined
18th
Century 19th
Century 20th
Century Today “SMART”
FACTORY
©2017 Western Digital Corporation or affiliates. All rights reserved.

Magnetic Head Fabrication. 3-Dimensional, Complex Fabrication at Nanoscale
q Manufacturing process with extremely high # of unit operations; with high “device” counts/wafer
q Nanoscale 3D fabrication process requiring tight tolerance controls
q Functional geometries < 20nm
q Material layers down to 3-4 atoms thick
Perspective: Individual Magnetic Heads on a Dime
A nanometer
is to a tennis
ball as a
tennis ball is
to the Earth.

Wafer Fabrication Process Steps
GENERAL OVERVIEW
SOURCE: LAM Research
http://www.lamresearch.com/products/products-overview
…
Xn
(Repeat)

Operational Imperatives of a Data Systems Project
Operational Realities
OPERATIONS REALITIES
• Long total cycle times
• Large number of permutations
• Global manufacturing footprint
• Leading edge technology
• Increasing product complexity
• High unit volumes
BUSINESS DRIVERS
• Cost reductions
• Quality improvements
• Improving asset utilization
• Improve labor efficiency
• Highly competitive environment
52
B O T T O M L I N E
Less variation
Improved asset utilization
Improved efficiency
Courtesy of Dave Rauch, SVP Western Digital

Smart Manufacturing (SM) enables all information about the manufacturing process to be available when it is
needed, where it is needed, and in the form it is needed across the entire manufacturing value-chain to power smart
decisions. Smart Manufacturing Leadership Coalition SMLC / CESMII
Artificial intelligence (AI) is intelligence exhibited by machines. In computer science, the field of AI
research defines itself as the study of "intelligent agents": any device that perceives its environment and takes
actions that maximize its chance of success at some goal.
Intelligence Augmentation (IA), on the other hand, is the idea of a computer system that
supplements and supports human thinking, analysis, and planning, leaving the intentionality of a human actor at
the heart of the human-computer interaction.
KeyThemes Discussed: General Definitions

• Next-generation Advanced Process Control … overview of APC
(see slide 56-58)
• Virtual Metrology &Virtual Fabrication (digital 3D reconstruction of device
for design & process optimization)
• “Digital twin” for equipment fingerprinting, fleet chamber matching,
predictive maintenance (PdM)
• Predictive Analytics forYield Optimization & IntelligentTesting
• Capacity Modeling, Real-Time Inventory Management & Smart Dispatch
• Digital Assistant for managing manufacturing operations àTraditional BI
reporting to AI-based Recommendation Engines
• Application of machine learning and deep learning for intelligent pattern
recognition & process optimization (see slide 59)
Opportunities for Intelligence Augmentation in a Smart Factory
54
*”Digital twins” refer to computerized companions of physical assets
Based
on
Ishikawa
diagram
&
Lean
Six
Sigma

Advanced Process Control:An Overview
• APC is an extension of Process Control which fundamentally is about reducing variability
• The use of automation technologies + equipment interfaces + applied statistics
• A vehicle for putting into action the insights learned with data science
“In control theory, Advanced Process Control (APC) refers to a broad range of
techniques and technologies implemented within industrial process control
systems.”
RUN-TO-RUN CONTROL FAULT DETECTION FAULT CLASSIFICATION
KEY COMPONENTS

Advanced Process Control: Key Components
RUN-TO-RUN CONTROL FAULT DETECTION FAULT CLASSIFICATION
(R2R) (FD) (FC)
Definitions from SEMI Standard
The technique of
modifying recipe
parameters or the
selection of control
parameters between runs
to improve processing
performance.A ‘run’ can be
a batch, lot, or an individual
wafer.
The technique of monitoring
and analyzing variations in
tool and/or process data to
detect anomalies. Fault
detection includes both
univariate and multivariate
statistical analysis techniques.
The technique of
determining the cause of
a fault once it has been
detected.

Feedforward Run-to-Run
controller
Run-to-Run
controller
Feedback Feedback
Advanced Process Control
FUNCTIONAL DESIGN
57
Shop Floor
Metrology Process ToolProcess ToolMetrology
Process
flow
Metrology
Fault
Detection
database
for offline
analysis
Fault Detection
models
Fault Detection
models
Stop
process
ACTIONS
MES
Tool Maintenance
MES
Product Hold
Email
Notification
Stop Eq.
Process
Stop
process
Courtesy of Norm Armour
Fault Detection
(Tool)
Run-to-Run control
(Product)

Intelligent Pattern Recognition
COMMON FRAMEWORK FOR
REPRESENTING KNOWLEDGE
DATA AUTOMATION
DATA VISUALIZATION
ENG. PRODUCTIVITY
DIAGNOSTIC
MACHINE LEARNING FOR
CLASSIFICATION
PREDICTIVE
EMBEDDED CLOSED-LOOP
ANALYTICS (EDGE)
PRESCRIPTIVE
Machine-intelligent ecosystem for continuous detection, classification, and
predictive quality management of unit of production
COLLECT VISUALIZE MODEL OPERATIONALIZE

Western Digital and TIBCO
Insight to Action

This document (including, without limitation, any product roadmap or statement of direction data) illustrates the planned testing, release and availability dates for TIBCO products and services. It is
for informational purposes only and its contents are subject to change without notice. © Copyright 2000-2017 TIBCO Software Inc. All rights reserved. TIBCO Proprietary Information.
The TIBCO Insight Platform
Insight Action
TIBCO Spotfire TIBCO StreamBase®
TIBCO Active Matrix Business Works™

Insight Platform - Documents
https://community.tibco.com/wiki/tibco-insight-platform
https://www.linkedin.com/pulse/tibco-insight-
platform-iiot-michael-o-connell?trk=prof-post

community.tibco.com

Spotfire Wiki
community.tibco.com

Best in Class AI-Driven Visual Analytics & Dashboards
#MOREWITHSPOTFIRE

Wrap Up
Thank you!
Michael
O’Connell,
PhD
Chief
Analytics
Officer
TIBCO
Fellow
moconnell@tibco.com
@MichOConnell
Contact
Ahmer Srivastava
Director
of
Analytics
Western
Digital
ahmer.srivastava@wdc.com
linkedin.com/in/nomadiclens

AI in Software for Augmenting Intelligence Across the Enterprise

AI in Software for Augmenting Intelligence Across the Enterprise

More Related Content

What's hot

Similar to AI in Software for Augmenting Intelligence Across the Enterprise

More from The Hive

Recently uploaded

AI in Software for Augmenting Intelligence Across the Enterprise