SlideShare a Scribd company logo
1 of 29
Addressing Connectivity Challenges
of Disparate Data Sources
in Smart Manufacturing
Smart Manufacturing Pavilion:
The Road to the Smart, Digital
and Connected Fab
Alan Weber, July 10, 2019
 Problem statement
 Gigafactory context
 Smart Manufacturing data sources
 Unifying concepts
 Characteristics
 Challenges
 Example solution architectures
 Questions
Outline
Problem statement
 Background
 Data collection is the principal enabling technology for
maintaining a Smart Factory’s “digital twin”
 The diversity of data sources in Smart Manufacturing
environments is growing, not shrinking
 Goals
 Access important information in these data sources with
minimal custom software
 Leverage existing data collection infrastructure to
seamlessly integrate data from all sources
Gigafactory context
In every minute of every day…
GEM messages
coordinate hundreds
of transactions…
GEM300 events
track thousands of
activities…
EDA services
collect millions
of parameters…
Copyright © 2019 Cimetrix. All Rights Reserved.
What is “Smart Manufacturing?”
From Industry 4.0 Wikipedia…
 “… cyber-physical systems monitor physical processes,
create a virtual copy of the physical world and make
decentralized decisions.
 Over the Internet of Things, cyber-physical systems
communicate and cooperate with each other and with
humans in real time…”
 Problem statement
 Gigafactory context
 Smart Manufacturing data sources
 Unifying concepts
 Characteristics
 Challenges
 Example solution architectures
 Questions
Outline
 SEMI Standards-compliant interfaces
 EDA/Interface A
 SECS/GEM/GEM300
 Custom interfaces
 Purpose-specific (EUV data collection)
 External sensors (RGA, OES, …)
 Equipment log files (many examples)
 OPC-enabled equipment/subsystems
 OPC Classic DA (Data Acquisition)
 OPC UA (Unified Architecture)
 IIoT…
Semiconductor Smart Manufacturing
Data sources (current sampling…)
 Models may or may not reflect equipment
structure, depending on when they were defined
 Models may not provide sufficient visibility into
equipment behavior
 Interface performance may not match expectations
if control system was not redesigned
 All of this is improving rapidly as fabs take a more
prescriptive approach to their automation specs
Issues with SEMI EDA data sources
Equipment models are vendor specific
Valid Entries:
Comply
Comply by (Date)
Partially Comply (Notes)
Do no comply
N/A
EDA adoption status
Cumulative # of production tools installed
9
We are here !
All are now requiring latest SEMI Standards for
equipment modeling and data acquisition
Principal Motivation: Flexibility…
• Data collection plan
• Changing requirements
• Multi-client architecture
Unifying concepts/relationships
Generalizable from SEMI EDA standards
Data
Equipment
Model
Equipment
Data
Consumers
Data
Collection
Plans
Manufacturing
Stakeholders
and their KPIs
Unifying concepts
Metadata model and data collection plan (DCP)
 Structure exactly reflects equipment
hardware organization
 Provides complete description of all
useful information in the equipment
 Always accurate and available – no
additional documentation required*
 Common point of reference across all
factory and supplier stakeholders
 Source of unambiguous information for
database configuration
 Reduces integration engineering
Shared equipment model benefits
Driven by factory requirements…
Process Module #1
Gate Valve Data
Substrate Location
Utilization
More Data,
Events, Alarms
Process Tracking
Other
Components
* As long as it can be queried from the equipment
 GEM/GEM300 will persist as the principal
“command and control” interface
 Data collection mechanisms are fixed and limited
 Event reporting
 Trace reporting
 Variable status queries
 Equipment “model” must be derived from lists of
variables, events, constants, state machines, etc.
 The recent SEMI E172 standard (SECS Equipment Data
Dictionary) offers a partial solution
 But must be specified if it is to be delivered
Issues with SEMI GEM data sources
Equipment model is not explicit
SEDD – SECS Equipment Data Dictionary
Schema and examples
….
GEM equipment model structure
Embedded in E172 (SEDD) <source> elements
 Set of architectural specifications for creating
integrated factory systems
 Systems include manufacturing equipment,
applications, data repositories, and the other
components that interconnect them all
 Interoperability of the system components
depends on their respective suppliers having
chosen compatible and similarly scoped profiles
 Because of the breadth of OPC UA’s applicability
and variety of implementation options, this itself
is a significant system engineering task
Issues with OPC UA data sources
OPC UA is an architecture, not a standard
Interoperability of OPC UA components
Requires compatible “mappings” and “profiles”
Figure 1 – The OPC UA Stack Overview
(from Volume 6)
Figure 1 – Profile – Conformance Unit – Test Cases
(from Volume 7)
Typical challenges….
1. Finding a sensor that works
2. Sampling/process synchronization
3. Dealing with multiple timestamps
4. Scaling and units conversion
5. Applying factory naming convention
6. Associating context and sensor data
7. Ensuring statistical validity
8. Aligning results in process database
Issues with external sensors
Implementations are factory specific
 Problem statement
 Gigafactory context
 Smart Manufacturing data sources
 Unifying concepts
 Characteristics
 Challenges
 Example solution architectures
 Questions
Outline
Example solution architecture
EDA-based sensor integration
OEM Tool
EDAGEM
Sensor/Actuator Gateway
Device Drivers
DP ATP S1
TPPump
I/F
FICS / MES
EDA Client
EDA Server
EDA Client
Smart
Data
Model
Raw Data
Metadata Model
Public
Data
DCIM* DCIM
Proprietary
Applications
Process-specific
applications Factory-level
EDA Client Apps
(DOE, FDC, PHM, …)
Custom
or
EtherCAT
TCP/IP
HTTP
HTTP HTTP
To factory-level systems
Context data
Synchronization data
S2 S3
* DCIM =
Data Collection
Interface Module
Synchronization signals
Process
Engineering
Database
 Optimized for ease of creation
 NOT consumption
 Type of information included varies
 Mixture of events, parameters, alarms
 Mixture of critical data and “just in case” stuff
 Parameter values often stored in native, binary form
 Format may change throughout the log
 Not just a simple set of identical records
 Multiple sections, headers, record layouts, even files
Issues with equipment log files
Their formats are custom designs
 Usually circular file system
 Fixed limits for file sizes and number
 When limits are reached, oldest files are overwritten
 Retention period may vary with activity
 And available storage space
Issues with equipment log files
They disappear over time
 Part of the local file/directory system
 Access methods dictated by platform technology
 Special permissions may be required to keep from
invalidating tool warranty
 They depend on the tool’s clock
 So the timestamps are almost always wrong…
 May be able to correct reports if offset from factory
reference clock is tracked continuously
Issues with equipment log files
They reside on the tool
Example solution architecture
Equipment Log File Processing
EDA
NewData
Reports
• Trace data
• Event data
• Context data
Factory
EDA Client
Software
Process
Data
Repository
(Historian)
Data Collection Plan
SEMI E134 .wsdl
(schema)
Data Source
Models
(1 per tool type)
DataSourceModel
.xsd
(schema)
Data Source
Model Validator
Log File Processor
XML/Text
Model
Editor
EDA
Server
Equipment
Control Platform
Log
Files
elastic
logstash
elastic
Filebeat
Isolates
Custom
content
 Foundation for entire system architecture
 Could be derived from EDA equipment metadata model
 Identifies type/name of the system that generated log file
 E.g., process equipment, supplier, tool type, model name, etc.
 Maps contents of custom log file into standard tool data reports
using unique “keys” for items of interest
 Keys are assigned in the log file parser
 Keys appear in correct equipment structural context in the DSM, resulting
in proper sourceId (location) and parameterName
 Includes optional elements for
 Data type declaration: necessary for subsequent report processing
 Units conversion: raw binary to scaled engineering units
 Event augmentation: generate enumerated state values
Key system components
Data Source Model (DSM)
 This is where most of the NRE (non-recurring engineering
effort) will be spent
 Some of this will be custom code, but it is also possible to
use commercial ETL (extraction, transformation, and
loading) software in many cases
 Example: elastic Filebeat and Logstash products
 Perhaps elasticsearch and Kibana for centralized storage and
visualization as well
 The back end of each parser is a standard EDA-compliant
data report generator
 Output format for all sources is the same
 This is NOT rocket science… just tedious
Key system components
Data source parser
 Analyze format and content of log file
 Identify data items of interest
 Don’t have to collect everything in the log file
 Develop custom parser, assign keys to items of interest
 Create Data Source Model with keys in hierarchical context
 May also derive it from EDA equipment metadata model
 Include scaling, units, and new state value elements as needed
 Validate with DSM validation utility
 Add new event states and other parameters to client
applications and data collection infrastructure
Implementation process
For each vendor/equipment type
 Danke
 감사합니다
 唔該
 Merci
 多謝
 Grazie
 ありがとうございます
 Gracias
Acknowledgements and Thanks
 SEMI staff and standards volunteers for decades of support !
 Problem statement
 Gigafactory context
 Smart Manufacturing data sources
 Unifying concepts
 Characteristics
 Challenges
 Example solution architectures
 Questions
Outline

More Related Content

What's hot

The Role of Models in Semiconductor Smart Manufacturing
The Role of Models in Semiconductor Smart ManufacturingThe Role of Models in Semiconductor Smart Manufacturing
The Role of Models in Semiconductor Smart ManufacturingKimberly Daich
 
Alan weber semicon_integrated_equipment_data_collection_smart_manufacturing
Alan weber semicon_integrated_equipment_data_collection_smart_manufacturingAlan weber semicon_integrated_equipment_data_collection_smart_manufacturing
Alan weber semicon_integrated_equipment_data_collection_smart_manufacturingKimberly Daich
 
Roi-based Data Collection by Alan Weber at Cimetrix
Roi-based Data Collection by Alan Weber at CimetrixRoi-based Data Collection by Alan Weber at Cimetrix
Roi-based Data Collection by Alan Weber at CimetrixKimberly Daich
 
Smarter Manufacturing through Equipment Data-Driven Application Design
Smarter Manufacturing through Equipment Data-Driven Application DesignSmarter Manufacturing through Equipment Data-Driven Application Design
Smarter Manufacturing through Equipment Data-Driven Application DesignKimberly Daich
 
Smart Manufacturing Requirements for Equipment Capability and Control
Smart Manufacturing Requirements forEquipment Capability and ControlSmart Manufacturing Requirements forEquipment Capability and Control
Smart Manufacturing Requirements for Equipment Capability and ControlKimberly Daich
 
ROI-based Approach for Evaluating Application Data Collection Use Case Altern...
ROI-based Approach for Evaluating Application Data Collection Use Case Altern...ROI-based Approach for Evaluating Application Data Collection Use Case Altern...
ROI-based Approach for Evaluating Application Data Collection Use Case Altern...Kimberly Daich
 
eMDC 2017 Reath Weber Device Scaling v Process Control Scaling
eMDC 2017 Reath Weber Device Scaling v Process Control ScalingeMDC 2017 Reath Weber Device Scaling v Process Control Scaling
eMDC 2017 Reath Weber Device Scaling v Process Control ScalingKimberly Daich
 
Wsanacip tampres cluster meeting
Wsanacip tampres cluster meetingWsanacip tampres cluster meeting
Wsanacip tampres cluster meetingfcleary
 
How Test Labs Reduce Cyber Security Threats to Industrial Control Systemse cy...
How Test Labs Reduce Cyber Security Threats to Industrial Control Systemse cy...How Test Labs Reduce Cyber Security Threats to Industrial Control Systemse cy...
How Test Labs Reduce Cyber Security Threats to Industrial Control Systemse cy...Schneider Electric
 
PlantConnect Presentation
PlantConnect PresentationPlantConnect Presentation
PlantConnect PresentationAkshay Tilak
 
PlantConnect plastics presentation
PlantConnect plastics presentationPlantConnect plastics presentation
PlantConnect plastics presentationAkshay Tilak
 
01 intel v_tune_session_01
01 intel v_tune_session_0101 intel v_tune_session_01
01 intel v_tune_session_01Vivek chan
 
Asset Insight Manager Introduction 2014 (2)
Asset Insight Manager Introduction 2014 (2)Asset Insight Manager Introduction 2014 (2)
Asset Insight Manager Introduction 2014 (2)Dean Bishop
 
Machine Learning & Predictive Maintenance
Machine Learning &  Predictive MaintenanceMachine Learning &  Predictive Maintenance
Machine Learning & Predictive MaintenanceArnab Biswas
 
One Day Version 10.3 Upgrade - How a Large Biotech Plant's DeltaV Systems Wer...
One Day Version 10.3 Upgrade - How a Large Biotech Plant's DeltaV Systems Wer...One Day Version 10.3 Upgrade - How a Large Biotech Plant's DeltaV Systems Wer...
One Day Version 10.3 Upgrade - How a Large Biotech Plant's DeltaV Systems Wer...Emerson Exchange
 
Government Agencies Using Splunk: Is Your Critical Data Missing?
Government Agencies Using Splunk: Is Your Critical Data Missing?Government Agencies Using Splunk: Is Your Critical Data Missing?
Government Agencies Using Splunk: Is Your Critical Data Missing?Precisely
 
Eaton Enterprise Data Centers Sep 2010
Eaton Enterprise Data Centers Sep 2010Eaton Enterprise Data Centers Sep 2010
Eaton Enterprise Data Centers Sep 2010uhlmanken
 
PlantConnect RAMS - Give Voice to Your Machines
PlantConnect RAMS - Give Voice to Your MachinesPlantConnect RAMS - Give Voice to Your Machines
PlantConnect RAMS - Give Voice to Your MachinesAkshay Tilak
 

What's hot (20)

The Role of Models in Semiconductor Smart Manufacturing
The Role of Models in Semiconductor Smart ManufacturingThe Role of Models in Semiconductor Smart Manufacturing
The Role of Models in Semiconductor Smart Manufacturing
 
Alan weber semicon_integrated_equipment_data_collection_smart_manufacturing
Alan weber semicon_integrated_equipment_data_collection_smart_manufacturingAlan weber semicon_integrated_equipment_data_collection_smart_manufacturing
Alan weber semicon_integrated_equipment_data_collection_smart_manufacturing
 
Roi-based Data Collection by Alan Weber at Cimetrix
Roi-based Data Collection by Alan Weber at CimetrixRoi-based Data Collection by Alan Weber at Cimetrix
Roi-based Data Collection by Alan Weber at Cimetrix
 
Smarter Manufacturing through Equipment Data-Driven Application Design
Smarter Manufacturing through Equipment Data-Driven Application DesignSmarter Manufacturing through Equipment Data-Driven Application Design
Smarter Manufacturing through Equipment Data-Driven Application Design
 
Smart Manufacturing Requirements for Equipment Capability and Control
Smart Manufacturing Requirements forEquipment Capability and ControlSmart Manufacturing Requirements forEquipment Capability and Control
Smart Manufacturing Requirements for Equipment Capability and Control
 
ROI-based Approach for Evaluating Application Data Collection Use Case Altern...
ROI-based Approach for Evaluating Application Data Collection Use Case Altern...ROI-based Approach for Evaluating Application Data Collection Use Case Altern...
ROI-based Approach for Evaluating Application Data Collection Use Case Altern...
 
eMDC 2017 Reath Weber Device Scaling v Process Control Scaling
eMDC 2017 Reath Weber Device Scaling v Process Control ScalingeMDC 2017 Reath Weber Device Scaling v Process Control Scaling
eMDC 2017 Reath Weber Device Scaling v Process Control Scaling
 
Wsanacip tampres cluster meeting
Wsanacip tampres cluster meetingWsanacip tampres cluster meeting
Wsanacip tampres cluster meeting
 
How Test Labs Reduce Cyber Security Threats to Industrial Control Systemse cy...
How Test Labs Reduce Cyber Security Threats to Industrial Control Systemse cy...How Test Labs Reduce Cyber Security Threats to Industrial Control Systemse cy...
How Test Labs Reduce Cyber Security Threats to Industrial Control Systemse cy...
 
PlantConnect Presentation
PlantConnect PresentationPlantConnect Presentation
PlantConnect Presentation
 
PlantConnect plastics presentation
PlantConnect plastics presentationPlantConnect plastics presentation
PlantConnect plastics presentation
 
01 intel v_tune_session_01
01 intel v_tune_session_0101 intel v_tune_session_01
01 intel v_tune_session_01
 
Asset Insight Manager Introduction 2014 (2)
Asset Insight Manager Introduction 2014 (2)Asset Insight Manager Introduction 2014 (2)
Asset Insight Manager Introduction 2014 (2)
 
Hardware-Software Codesign
Hardware-Software CodesignHardware-Software Codesign
Hardware-Software Codesign
 
Machine Learning & Predictive Maintenance
Machine Learning &  Predictive MaintenanceMachine Learning &  Predictive Maintenance
Machine Learning & Predictive Maintenance
 
One Day Version 10.3 Upgrade - How a Large Biotech Plant's DeltaV Systems Wer...
One Day Version 10.3 Upgrade - How a Large Biotech Plant's DeltaV Systems Wer...One Day Version 10.3 Upgrade - How a Large Biotech Plant's DeltaV Systems Wer...
One Day Version 10.3 Upgrade - How a Large Biotech Plant's DeltaV Systems Wer...
 
How to get the most out of your existing DCS
How to get the most out of your existing DCSHow to get the most out of your existing DCS
How to get the most out of your existing DCS
 
Government Agencies Using Splunk: Is Your Critical Data Missing?
Government Agencies Using Splunk: Is Your Critical Data Missing?Government Agencies Using Splunk: Is Your Critical Data Missing?
Government Agencies Using Splunk: Is Your Critical Data Missing?
 
Eaton Enterprise Data Centers Sep 2010
Eaton Enterprise Data Centers Sep 2010Eaton Enterprise Data Centers Sep 2010
Eaton Enterprise Data Centers Sep 2010
 
PlantConnect RAMS - Give Voice to Your Machines
PlantConnect RAMS - Give Voice to Your MachinesPlantConnect RAMS - Give Voice to Your Machines
PlantConnect RAMS - Give Voice to Your Machines
 

Similar to Addressing Connectivity Challenges of Disparate Data Sources in Smart Manufacturing

Data fusion at the source standards and technologies for seamless sensor in...
Data fusion at the source   standards and technologies for seamless sensor in...Data fusion at the source   standards and technologies for seamless sensor in...
Data fusion at the source standards and technologies for seamless sensor in...Kimberly Daich
 
System analysis and design
System analysis and designSystem analysis and design
System analysis and designRobinsonObura
 
RA TechED 2019 - SY08 - Developing Information Ready Applications using Smart...
RA TechED 2019 - SY08 - Developing Information Ready Applications using Smart...RA TechED 2019 - SY08 - Developing Information Ready Applications using Smart...
RA TechED 2019 - SY08 - Developing Information Ready Applications using Smart...Rockwell Automation
 
DRAFT - Enterprise Data and Analytics Architecture Overview for Electric Utility
DRAFT - Enterprise Data and Analytics Architecture Overview for Electric UtilityDRAFT - Enterprise Data and Analytics Architecture Overview for Electric Utility
DRAFT - Enterprise Data and Analytics Architecture Overview for Electric UtilityPrajesh Bhattacharya
 
Click to Disk Troubleshooting with AppDynamics and OpsDataStore - AppSphere16
Click to Disk Troubleshooting with AppDynamics and OpsDataStore - AppSphere16Click to Disk Troubleshooting with AppDynamics and OpsDataStore - AppSphere16
Click to Disk Troubleshooting with AppDynamics and OpsDataStore - AppSphere16AppDynamics
 
Database Systems.ppt
Database Systems.pptDatabase Systems.ppt
Database Systems.pptArbazAli27
 
From allotrope to reference master data management
From allotrope to reference master data management From allotrope to reference master data management
From allotrope to reference master data management OSTHUS
 
3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.pptBsMath3rdsem
 
MOND Semantics Integration
MOND Semantics IntegrationMOND Semantics Integration
MOND Semantics IntegrationSales Emea
 
ML on Big Data: Real-Time Analysis on Time Series
ML on Big Data: Real-Time Analysis on Time SeriesML on Big Data: Real-Time Analysis on Time Series
ML on Big Data: Real-Time Analysis on Time SeriesSigmoid
 
Why Data Virtualization? An Introduction by Denodo
Why Data Virtualization? An Introduction by DenodoWhy Data Virtualization? An Introduction by Denodo
Why Data Virtualization? An Introduction by DenodoJusto Hidalgo
 
IMS02 autonomics for ims with the ibm management console for ims and db2 fo...
IMS02   autonomics for ims with the ibm management console for ims and db2 fo...IMS02   autonomics for ims with the ibm management console for ims and db2 fo...
IMS02 autonomics for ims with the ibm management console for ims and db2 fo...Robert Hain
 
t2_4-architecting-data-for-integration-and-longevity
t2_4-architecting-data-for-integration-and-longevityt2_4-architecting-data-for-integration-and-longevity
t2_4-architecting-data-for-integration-and-longevityJonathan Hamilton Solórzano
 
“Lights Out”Configuration using Tivoli Netcool AutoDiscovery Tools
“Lights Out”Configuration using Tivoli Netcool AutoDiscovery Tools“Lights Out”Configuration using Tivoli Netcool AutoDiscovery Tools
“Lights Out”Configuration using Tivoli Netcool AutoDiscovery ToolsAntonio Rolle
 
Ibm Optim Techical Overview 01282009
Ibm Optim Techical Overview 01282009Ibm Optim Techical Overview 01282009
Ibm Optim Techical Overview 01282009lucascibm
 
Python + MPP Database = Large Scale AI/ML Projects in Production Faster
Python + MPP Database = Large Scale AI/ML Projects in Production FasterPython + MPP Database = Large Scale AI/ML Projects in Production Faster
Python + MPP Database = Large Scale AI/ML Projects in Production FasterPaige_Roberts
 
GraphSummit - Process Tempo - Build Graph Applications.pdf
GraphSummit - Process Tempo - Build Graph Applications.pdfGraphSummit - Process Tempo - Build Graph Applications.pdf
GraphSummit - Process Tempo - Build Graph Applications.pdfNeo4j
 

Similar to Addressing Connectivity Challenges of Disparate Data Sources in Smart Manufacturing (20)

Data fusion at the source standards and technologies for seamless sensor in...
Data fusion at the source   standards and technologies for seamless sensor in...Data fusion at the source   standards and technologies for seamless sensor in...
Data fusion at the source standards and technologies for seamless sensor in...
 
James hall ch 14
James hall ch 14James hall ch 14
James hall ch 14
 
System analysis and design
System analysis and designSystem analysis and design
System analysis and design
 
Embedded
EmbeddedEmbedded
Embedded
 
RA TechED 2019 - SY08 - Developing Information Ready Applications using Smart...
RA TechED 2019 - SY08 - Developing Information Ready Applications using Smart...RA TechED 2019 - SY08 - Developing Information Ready Applications using Smart...
RA TechED 2019 - SY08 - Developing Information Ready Applications using Smart...
 
DRAFT - Enterprise Data and Analytics Architecture Overview for Electric Utility
DRAFT - Enterprise Data and Analytics Architecture Overview for Electric UtilityDRAFT - Enterprise Data and Analytics Architecture Overview for Electric Utility
DRAFT - Enterprise Data and Analytics Architecture Overview for Electric Utility
 
Click to Disk Troubleshooting with AppDynamics and OpsDataStore - AppSphere16
Click to Disk Troubleshooting with AppDynamics and OpsDataStore - AppSphere16Click to Disk Troubleshooting with AppDynamics and OpsDataStore - AppSphere16
Click to Disk Troubleshooting with AppDynamics and OpsDataStore - AppSphere16
 
Database Systems.ppt
Database Systems.pptDatabase Systems.ppt
Database Systems.ppt
 
From allotrope to reference master data management
From allotrope to reference master data management From allotrope to reference master data management
From allotrope to reference master data management
 
3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt
 
MOND Semantics Integration
MOND Semantics IntegrationMOND Semantics Integration
MOND Semantics Integration
 
ML on Big Data: Real-Time Analysis on Time Series
ML on Big Data: Real-Time Analysis on Time SeriesML on Big Data: Real-Time Analysis on Time Series
ML on Big Data: Real-Time Analysis on Time Series
 
Why Data Virtualization? An Introduction by Denodo
Why Data Virtualization? An Introduction by DenodoWhy Data Virtualization? An Introduction by Denodo
Why Data Virtualization? An Introduction by Denodo
 
IMS02 autonomics for ims with the ibm management console for ims and db2 fo...
IMS02   autonomics for ims with the ibm management console for ims and db2 fo...IMS02   autonomics for ims with the ibm management console for ims and db2 fo...
IMS02 autonomics for ims with the ibm management console for ims and db2 fo...
 
t2_4-architecting-data-for-integration-and-longevity
t2_4-architecting-data-for-integration-and-longevityt2_4-architecting-data-for-integration-and-longevity
t2_4-architecting-data-for-integration-and-longevity
 
“Lights Out”Configuration using Tivoli Netcool AutoDiscovery Tools
“Lights Out”Configuration using Tivoli Netcool AutoDiscovery Tools“Lights Out”Configuration using Tivoli Netcool AutoDiscovery Tools
“Lights Out”Configuration using Tivoli Netcool AutoDiscovery Tools
 
Ibm Optim Techical Overview 01282009
Ibm Optim Techical Overview 01282009Ibm Optim Techical Overview 01282009
Ibm Optim Techical Overview 01282009
 
Ibm irl
Ibm irlIbm irl
Ibm irl
 
Python + MPP Database = Large Scale AI/ML Projects in Production Faster
Python + MPP Database = Large Scale AI/ML Projects in Production FasterPython + MPP Database = Large Scale AI/ML Projects in Production Faster
Python + MPP Database = Large Scale AI/ML Projects in Production Faster
 
GraphSummit - Process Tempo - Build Graph Applications.pdf
GraphSummit - Process Tempo - Build Graph Applications.pdfGraphSummit - Process Tempo - Build Graph Applications.pdf
GraphSummit - Process Tempo - Build Graph Applications.pdf
 

Recently uploaded

CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Neo4j
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 

Recently uploaded (20)

CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 

Addressing Connectivity Challenges of Disparate Data Sources in Smart Manufacturing

  • 1. Addressing Connectivity Challenges of Disparate Data Sources in Smart Manufacturing Smart Manufacturing Pavilion: The Road to the Smart, Digital and Connected Fab Alan Weber, July 10, 2019
  • 2.  Problem statement  Gigafactory context  Smart Manufacturing data sources  Unifying concepts  Characteristics  Challenges  Example solution architectures  Questions Outline
  • 3. Problem statement  Background  Data collection is the principal enabling technology for maintaining a Smart Factory’s “digital twin”  The diversity of data sources in Smart Manufacturing environments is growing, not shrinking  Goals  Access important information in these data sources with minimal custom software  Leverage existing data collection infrastructure to seamlessly integrate data from all sources
  • 4. Gigafactory context In every minute of every day… GEM messages coordinate hundreds of transactions… GEM300 events track thousands of activities… EDA services collect millions of parameters… Copyright © 2019 Cimetrix. All Rights Reserved.
  • 5. What is “Smart Manufacturing?” From Industry 4.0 Wikipedia…  “… cyber-physical systems monitor physical processes, create a virtual copy of the physical world and make decentralized decisions.  Over the Internet of Things, cyber-physical systems communicate and cooperate with each other and with humans in real time…”
  • 6.  Problem statement  Gigafactory context  Smart Manufacturing data sources  Unifying concepts  Characteristics  Challenges  Example solution architectures  Questions Outline
  • 7.  SEMI Standards-compliant interfaces  EDA/Interface A  SECS/GEM/GEM300  Custom interfaces  Purpose-specific (EUV data collection)  External sensors (RGA, OES, …)  Equipment log files (many examples)  OPC-enabled equipment/subsystems  OPC Classic DA (Data Acquisition)  OPC UA (Unified Architecture)  IIoT… Semiconductor Smart Manufacturing Data sources (current sampling…)
  • 8.  Models may or may not reflect equipment structure, depending on when they were defined  Models may not provide sufficient visibility into equipment behavior  Interface performance may not match expectations if control system was not redesigned  All of this is improving rapidly as fabs take a more prescriptive approach to their automation specs Issues with SEMI EDA data sources Equipment models are vendor specific Valid Entries: Comply Comply by (Date) Partially Comply (Notes) Do no comply N/A
  • 9. EDA adoption status Cumulative # of production tools installed 9 We are here ! All are now requiring latest SEMI Standards for equipment modeling and data acquisition Principal Motivation: Flexibility… • Data collection plan • Changing requirements • Multi-client architecture
  • 10. Unifying concepts/relationships Generalizable from SEMI EDA standards Data Equipment Model Equipment Data Consumers Data Collection Plans Manufacturing Stakeholders and their KPIs
  • 11. Unifying concepts Metadata model and data collection plan (DCP)
  • 12.  Structure exactly reflects equipment hardware organization  Provides complete description of all useful information in the equipment  Always accurate and available – no additional documentation required*  Common point of reference across all factory and supplier stakeholders  Source of unambiguous information for database configuration  Reduces integration engineering Shared equipment model benefits Driven by factory requirements… Process Module #1 Gate Valve Data Substrate Location Utilization More Data, Events, Alarms Process Tracking Other Components * As long as it can be queried from the equipment
  • 13.  GEM/GEM300 will persist as the principal “command and control” interface  Data collection mechanisms are fixed and limited  Event reporting  Trace reporting  Variable status queries  Equipment “model” must be derived from lists of variables, events, constants, state machines, etc.  The recent SEMI E172 standard (SECS Equipment Data Dictionary) offers a partial solution  But must be specified if it is to be delivered Issues with SEMI GEM data sources Equipment model is not explicit
  • 14. SEDD – SECS Equipment Data Dictionary Schema and examples ….
  • 15. GEM equipment model structure Embedded in E172 (SEDD) <source> elements
  • 16.  Set of architectural specifications for creating integrated factory systems  Systems include manufacturing equipment, applications, data repositories, and the other components that interconnect them all  Interoperability of the system components depends on their respective suppliers having chosen compatible and similarly scoped profiles  Because of the breadth of OPC UA’s applicability and variety of implementation options, this itself is a significant system engineering task Issues with OPC UA data sources OPC UA is an architecture, not a standard
  • 17. Interoperability of OPC UA components Requires compatible “mappings” and “profiles” Figure 1 – The OPC UA Stack Overview (from Volume 6) Figure 1 – Profile – Conformance Unit – Test Cases (from Volume 7)
  • 18. Typical challenges…. 1. Finding a sensor that works 2. Sampling/process synchronization 3. Dealing with multiple timestamps 4. Scaling and units conversion 5. Applying factory naming convention 6. Associating context and sensor data 7. Ensuring statistical validity 8. Aligning results in process database Issues with external sensors Implementations are factory specific
  • 19.  Problem statement  Gigafactory context  Smart Manufacturing data sources  Unifying concepts  Characteristics  Challenges  Example solution architectures  Questions Outline
  • 20. Example solution architecture EDA-based sensor integration OEM Tool EDAGEM Sensor/Actuator Gateway Device Drivers DP ATP S1 TPPump I/F FICS / MES EDA Client EDA Server EDA Client Smart Data Model Raw Data Metadata Model Public Data DCIM* DCIM Proprietary Applications Process-specific applications Factory-level EDA Client Apps (DOE, FDC, PHM, …) Custom or EtherCAT TCP/IP HTTP HTTP HTTP To factory-level systems Context data Synchronization data S2 S3 * DCIM = Data Collection Interface Module Synchronization signals Process Engineering Database
  • 21.  Optimized for ease of creation  NOT consumption  Type of information included varies  Mixture of events, parameters, alarms  Mixture of critical data and “just in case” stuff  Parameter values often stored in native, binary form  Format may change throughout the log  Not just a simple set of identical records  Multiple sections, headers, record layouts, even files Issues with equipment log files Their formats are custom designs
  • 22.  Usually circular file system  Fixed limits for file sizes and number  When limits are reached, oldest files are overwritten  Retention period may vary with activity  And available storage space Issues with equipment log files They disappear over time
  • 23.  Part of the local file/directory system  Access methods dictated by platform technology  Special permissions may be required to keep from invalidating tool warranty  They depend on the tool’s clock  So the timestamps are almost always wrong…  May be able to correct reports if offset from factory reference clock is tracked continuously Issues with equipment log files They reside on the tool
  • 24. Example solution architecture Equipment Log File Processing EDA NewData Reports • Trace data • Event data • Context data Factory EDA Client Software Process Data Repository (Historian) Data Collection Plan SEMI E134 .wsdl (schema) Data Source Models (1 per tool type) DataSourceModel .xsd (schema) Data Source Model Validator Log File Processor XML/Text Model Editor EDA Server Equipment Control Platform Log Files elastic logstash elastic Filebeat Isolates Custom content
  • 25.  Foundation for entire system architecture  Could be derived from EDA equipment metadata model  Identifies type/name of the system that generated log file  E.g., process equipment, supplier, tool type, model name, etc.  Maps contents of custom log file into standard tool data reports using unique “keys” for items of interest  Keys are assigned in the log file parser  Keys appear in correct equipment structural context in the DSM, resulting in proper sourceId (location) and parameterName  Includes optional elements for  Data type declaration: necessary for subsequent report processing  Units conversion: raw binary to scaled engineering units  Event augmentation: generate enumerated state values Key system components Data Source Model (DSM)
  • 26.  This is where most of the NRE (non-recurring engineering effort) will be spent  Some of this will be custom code, but it is also possible to use commercial ETL (extraction, transformation, and loading) software in many cases  Example: elastic Filebeat and Logstash products  Perhaps elasticsearch and Kibana for centralized storage and visualization as well  The back end of each parser is a standard EDA-compliant data report generator  Output format for all sources is the same  This is NOT rocket science… just tedious Key system components Data source parser
  • 27.  Analyze format and content of log file  Identify data items of interest  Don’t have to collect everything in the log file  Develop custom parser, assign keys to items of interest  Create Data Source Model with keys in hierarchical context  May also derive it from EDA equipment metadata model  Include scaling, units, and new state value elements as needed  Validate with DSM validation utility  Add new event states and other parameters to client applications and data collection infrastructure Implementation process For each vendor/equipment type
  • 28.  Danke  감사합니다  唔該  Merci  多謝  Grazie  ありがとうございます  Gracias Acknowledgements and Thanks  SEMI staff and standards volunteers for decades of support !
  • 29.  Problem statement  Gigafactory context  Smart Manufacturing data sources  Unifying concepts  Characteristics  Challenges  Example solution architectures  Questions Outline