Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 1
How to Design
Integrated Control
and Information
System Architecture
Across Largescale
Critical Infrastructure
e-mail: ahmam1@emirates.net.ae
LinkedIn: https://ae.linkedin.com/in/Alaa-Mahjoub
By: Alaa Mahjoub
Data Management Senior Expert
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 2
AGENDA
1) Largescale Critical Infrastructure Domains, Levels, Ownership
and Operation Model
2) Examples of Largescale Critical Infrastructures
3) Layers of Largescale Critical Infrastructure
4) Cyber Critical Infrastructure
5) Evolution Trends Associated with IACS Systems
6) Architecture Development Method of Cyber Critical
Infrastructure
7) Example 1: Establishment of Enterprise Networking &
Communications for Petroleum Industry Integrated
Operations
8) Example 2: Establishment of Control and Information
Architecture for a Transmission System Operator in
Deregulated Electricity Market
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 3
AGENDA
1) Largescale Critical Infrastructure Domains, Levels, Ownership
and Operation Model
2) Examples of Largescale Critical Infrastructures
3) Layers of Largescale Critical Infrastructure
4) Cyber Critical Infrastructure
5) Evolution Trends Associated with IACS Systems
6) Architecture Development Method of Cyber Critical
Infrastructure
7) Example 1: Establishment of Enterprise Networking &
Communications for Petroleum Industry Integrated
Operations
8) Example 2: Establishment of Control and Information
Architecture for a Transmission System Operator in
Deregulated Electricity Market
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 4
LARGESCALE CRITICAL INFRASTRUCTURE DOMAINS
- Electrical Utilities
• Power Transmission
• Power Generation
• Power Distribution
- Water
• Water production
• Water Transmission
• Water Distribution
- Telecom
• Fibber Optics Transport
• Microwave
- Transportation
• Rail (Railway, Rolling Stock,
Stations)
• Busses
• Traffic control
- Municipalities
• Sewage stations
• Sewage pipelines
- Oil & Gas
• O&G Pipelines
• Oil terminals
• Refineries
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 5
LEVELS OF LARGESCALE CRITICAL INFRASTRUCTURE
- Enterprise
- Corporate
- National
- Regional
- International
- Electrical Utilities
- Water
- Telecom
- Transportation
- Municipalities
- Oil & Gas
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 6
OWNERSHIP AND OPERATION MODEL
- Government
- Private Sector
- Hybrid
- Government
- Private Sector
- Hybrid
ASSET OWNER SYSTEM OPERATOR
Asset owner can operate the asset by itself or fully or partially
outsource the operation to somebody else
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 7
AGENDA
1) Largescale Critical Infrastructure Domains, Levels, Ownership
and Operation Model
2) Examples of Largescale Critical Infrastructures
3) Layers of Largescale Critical Infrastructure
4) Cyber Critical Infrastructure
5) Evolution Trends Associated with IACS Systems
6) Architecture Development Method of Cyber Critical
Infrastructure
7) Example 1: Establishment of Enterprise Networking &
Communications for Petroleum Industry Integrated
Operations
8) Example 2: Establishment of Control and Information
Architecture for a Transmission System Operator in
Deregulated Electricity Market
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 8
Telecom Network- Power Transmission Grid
- Gas Pipelines Network
Transportation Network
(Railway)
EXAMPLES OF NATIONAL LEVEL CRITICAL INFRASTRUCTURE NETWORKS
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 9
UAE
Emirates National Grid
Interconnections
2000 to 2006 2003 
GCC Grid
Interconnections
EXAMPLES OF NATIONAL & REGIONAL LEVEL CRITICAL INFRASTRUCTURE NETWORKS
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 10
EXAMPLES OF INTERNATIONAL LEVEL CRITICAL INFRASTRUCTURE NETWORKS
EU Energy Network European High Voltage Transmission Grid
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 11
O&G Export Network from
Russia Europe
EXAMPLES OF INTERNATIONAL LEVEL CRITICAL INFRASTRUCTURE NETWORKS
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 12
THE PLANET MEGA INFRASTRUCTURE
The Connectivity Atlas: https://atlas.developmentseed.org/
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 13
ELECTRICITY NETWORKS
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 14
RAILWAY NETWORKS
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 15
GLOBAL SUBWAY MAP  POTENTIAL GLOBAL HYPERLOOP?
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 16
O&G NETWORKS
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 17
TELECOM NETWORKS
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 18
Navigate the Mega Infrastructure with the Harvard World Map of connectography
https://worldmap.harvard.edu/maps/connectography
MEGA-INFRASTRUCTURE WORLDWIDE
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 19
AGENDA
1) Largescale Critical Infrastructure Domains, Levels, Ownership
and Operation Model
2) Examples of Largescale Critical Infrastructures
3) Layers of Largescale Critical Infrastructure
4) Cyber Critical Infrastructure
5) Evolution Trends Associated with IACS Systems
6) Architecture Development Method of Cyber Critical
Infrastructure
7) Example 1: Establishment of Enterprise Networking &
Communications for Petroleum Industry Integrated
Operations
8) Example 2: Establishment of Control and Information
Architecture for a Transmission System Operator in
Deregulated Electricity Market
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 20
LAYERS OF CRITICAL INFRASTRUCTURE
Human Operation Layer
IACS Cyber Layer
Physical Layer
- People & Process
(People use information to manage
the physical and cyber layers)
- Computers, networks, IACS
Software and data gathering
sensors used to monitor and
control the physical layer
- Physical Assets
(Vertical Industry Dependent )
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 21
EXAMPLE 1: TRANSMISSION SYSTEM OPERATOR CRITICAL INFRASTRUCTURE
Electricity Market Evolution
Vertically Integrated Style of Ownership & Control
Horizontally Integrated Style of Ownership & Control
with Integrated SO & TO (TSO)
Separate SO and TO (ISO)
Support of DSO Model?
SO … System Operator
TO … Transmission Asset Owner
TSO … Transmission System Operator
ISO … Independent System Operator
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 22
(The Operations Perspective)
IACS Cyber Layer
Human Operations Layer
Physical Layer
Electricity Network TSO Telecom Network Civil Infrastructure Facilities
etc
Transformers
Breakers
TX Lines
etc
Wireless (e.g. WiMax)
Multiplexers (e.g. SDH)
Cables (e.g. OPGW)
etc
Control Centers / DR Centers
Administration Buildings
Substations
Telecom equipment Status and
Monitoring / etc
Breaker Status / Control Signals
Access Control / Fire Fighting/ AC/
Ventilation Control / Surveillance
Power flow / Energy Readings
etc
RTUs / Meters / SCMS /
PLC
PCNs
Supervisory Stations
Recovery from Failures, etc.
Energy Management
Security Enforcement
Monitoring & Control of Cyber
and Physical Layers
TSO CRITICAL INFRASTRUCTURE
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 23
(The IT Perspective)
TSO CRITICAL INFRASTRUCTURE
IS/IT Layer
Human Layer
Physical Layer
HRMS /
Financial …
Electricity Network Telecom Network Civil Infrastructure Facilities Other Enterprise Assets
Internet
Access
KMOffice
Automation
EmailGISCMMSERP
etc
Maintenance Tools
Non Operational Equipment
Vehicles
Information & Collaboration Services
…
Computers
IT Networks
IT Applications
Operations-Staff …
Employees
Non-Operations Staff
Managers
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 24
Human Layer
Enterprise Information Architecture Layer
Physical Layer
Electricity Network Telecommunications NetworkCivil Infrastructure
Facilities
Other Enterprise Assets
IACS Cyber Layer
Operations Staff Non-Operational Staff
Integration with
customers and
ecosystem
EPM
BI/RT OI/ BDA
Enterprise-wide Business
Process Management
MDM/MEM/DW/ECM
Enterprise Asset
management
Telecom for IACS Cyber Layer & IS/IT Layer
TSO-wide Integrated Perspective =
Operations Perspective + IT Perspective
TSO CRITICAL INFRASTRUCTURE
Customers,
Ecosystems & IoT
IS/IT Layer
Partners’
IACS
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 25
EXAMPLE 2: PETROLEUM INDUSTRY UPSTREAM OPERATOR
CRITICAL INFRASTRUCTURE
Petroleum Industry Upstream O&G Operator
Business Value-chain Model
1- Licensing 2- Exploration 3- Appraisal
4- Development 5- Production 6- Delivery 7- Abandonment
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 26
(The Operations Perspective)
IACS Cyber Layer
Human Operations Layer
Physical Layer
Petroleum Industry Assets, Surface & Subsurface Facilities Civil Infrastructure Facilities
etc
Flow lines & Pumping Units
Power System and Telecom System
Reservoirs, Wells, Surface & subsurface Facilities
etc
Control Centers / DR Centers
Administration Buildings
Fields Constructions
Communications infrastructure
Status and Monitoring / etc
Valves Status / Control Signals
Access Control / Fire Fighting/ HVAC
/ Surveillance
Oil Flow / PVT Readings
etc
RTUs / Meters / PLC / DCS
PCNs
Supervisory Stations
Recovery from Failures / etc
Security Enforcement
Operations staff: Monitoring & Control of
Physical and Cyber Layers
Production Management
PETROLEUM INDUSTRY UPSTREAM OPERATOR
CRITICAL INFRASTRUCTURE
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 27
PETROLEUM INDUSTRY UPSTREAM OPERATOR
CRITICAL INFRASTRUCTURE
(The IT Perspective)
Information Systems Layer
Human Layer
Physical Layer
HRMS /
Financial …
Petroleum Industry Assets, Surface &
Subsurface Facilities
Civil Infrastructure Facilities Other Enterprise Assets
Internet
Access
KMOffice
Automation
EmailGISCMMSERP
etc
Maintenance Tools
Non Operational Equipment
Vehicles
Information & Collaboration Services
…
Computers
IT Networks
IS Applications
Operations-Staff …
Employees
Non-Operations Staff
Managers
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 28
Corporate-wide Integrated Perspective =
Operations Perspective + IT Perspective
Human Layer
Enterprise Information Architecture Layer
Physical Layer
Petroleum Industry Assets,
Surface & Subsurface Facilities
Telecommunications Network
Civil Infrastructure Facilities Other Enterprise Assets
IACS Cyber Layer
Operations Staff Non-Operational Staff
Customers,
Ecosystems & IoT
PETROLEUM INDUSTRY UPSTREAM OPERATOR
CRITICAL INFRASTRUCTURE
Telecom for IACS Cyber Layer &
IS/IT Layer
Integration with customers
and ecosystem
EPM
BI/RT OI/ BDA
Enterprise-wide Business
Process Management
MDM/MEM/DW/ECM
Enterprise Asset management
Non-operational Information
operational Information
Enterprise Information
(Operational + Non-
Operational
Other Organizations’
IACS
IS/IT Layer
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 29
AGENDA
1) Largescale Critical Infrastructure Domains, Levels, Ownership
and Operation Model
2) Examples of Largescale Critical Infrastructures
3) Layers of Largescale Critical Infrastructure
4) Cyber Critical Infrastructure
5) Evolution Trends Associated with IACS Systems
6) Architecture Development Method of Cyber Critical
Infrastructure
7) Example 1: Establishment of Enterprise Networking &
Communications for Petroleum Industry Integrated
Operations
8) Example 2: Establishment of Control and Information
Architecture for a Transmission System Operator in
Deregulated Electricity Market
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 30
PETROLEUM INDUSTRY UPSTREAM OPERATOR
CRITICAL INFRASTRUCTURE
Enterprise
Communications
Petroleum Industry Operator Architecture
Technology Domain
Cyber Critical Infrastructure
Business Domain
IACS IS/IT
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 31
AGENDA
1) Largescale Critical Infrastructure Domains, Levels, Ownership
and Operation Model
2) Examples of Largescale Critical Infrastructures
3) Layers of Largescale Critical Infrastructure
4) Cyber Critical Infrastructure
5) Evolution Trends Associated with IACS Systems
6) Architecture Development Method of Cyber Critical
Infrastructure
7) Example 1: Establishment of Enterprise Networking &
Communications for Petroleum Industry Integrated
Operations
8) Example 2: Establishment of Control and Information
Architecture for a Transmission System Operator in
Deregulated Electricity Market
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 32
EVOLUTION TRENDS
1. Edge Computing
2. Integration with Business Intelligence, Realtime
Operational Intelligence and Big Date Analytics
3. Integration with Digital Business Platforms
4. Convergence in Cyber Critical Infrastructure Components
and their Supporting Organizational Models (OT, IT ,
Telecom)
5. Leveraging of Mobility, Cloud Computing and Social
Media
6. Digital Twins, AR and ML
7. Open IACS
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 33
1- Augmenting IACS Systems with Realtime Operational Intelligence systems
with Edge Computing Capabilities
Realtime Drilling/Production
Operation Center
Drilling / Production Platforms
Telecommunication between
Fields and Operation center
The solution is based on Complex Event Processing hub and spoke architecture
IACS
System
IACS
System
IACS
System
Edge
Computing
EVOLUTION TRENDS
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 34
EVOLUTION TRENDS
2- Augmenting IACS Systems with BI, Realtime Operational Intelligence and Big data Analytics
34
DB
Consolidation
Server(s)
DW (Dedicated Repository)
Archival
Sector
Analytics Applications
…
System 1
System N
DB 1
DB N
…
Metadata
Management
DI Tools
(e.g. ETL)
ILM
Fields HQ
Real-time Production Data
Real-time Drilling data
DTS data
WITSML
Server(s)
(Drilling)
OPC Server(s)
(production)
Field’sData
Acquisition
Equipment
IACS / DCS/
WITSML
Data
Source(s)/
PRODML
Data
Source(s)
PRODML
Server(s)
(DTS)
Alerts
CEP
&
BAM
WITSML
Server(s)
PRODML
Server(s)
OPC Server(s)
…
Integrated
Sector
Metadata Repository
Integrated
Sector DB
II- Operational Intelligence III- Big Data Analytics
Business Intelligence Platform / tools
Data Federation / Virtualization
Platform
I - Business Intelligence
Master Data
Transactional,
Operational &
Analytical Data
Meta Data
CEP: Complex Event Processing
BAM: Business Activity Monitoring
ILM: Information Lifecycle Management
OPC: OLE for ProcessControl
DTS: DistributedTemperature Sensing
DCS: Distributed Control Systems
Master Data
Management
Platform
DistributedProcessingCluster
(e.g.HADOOP)
Interactive
Sector
System M
System N+1
System N+2
Database
Database
Database
Database
DB Consolidation
Real-time
Data
Replication
In-Memory
Database
Logical
Data
warehouse
Backend Drilling Realtime Operation Centre Backend Production Realtime Operation Centre
LDW : Logical DataWarehouse
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 35
EmployeesCustomers
Things
Ecosystems
Platform
IoT
Platforms
Data &
Analytics
Platform
Information
Systems
Partners
Customer
Experience
Platform
EVOLUTION TRENDS
3- Integration with Digital Business Platform (example from transportation industry)
IACS
Runs the core business applications,
back office applications,
infrastructure applications, endpoint
device applications and operational
technology applications
IT
Run the customers and
citizens facing applications
such as customer portals,
B2C and B2B
Connects physical assets (Things)
such as Busses, Taxis and Traffic
Signals for monitoring, optimization,
control and monetization
Supports the creation of, and connection to, external
ecosystems, marketplaces and communities relevant to the
transportation agency business such as government
agencies, smart cities, credit card networks, police,
ambulance, etc.
Contains the Data
Management and
Analytics tools and
applications
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 36
EVOLUTION TRENDS
4- Convergence in Cyber Critical Infrastructure Components and Organization Models
(Telecom, OT, IT)
- IT/OT Convergence
- IT/OT Integration
- Organization Model Convergence
- Telecommunications Infrastructure Integration and
Service Convergence
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 37
Operational technology is the hardware and software that detects or causes
a change of state through the direct monitoring and/or control of physical
devices, processes and events in the enterprise.
The IT and OT convergence brings the two worlds together to deliver new
levels of decision support, by putting a business context on various
data streams comes from the IT world, while the use of embedded and
proprietary systems to capture and distribute machine/operations data
comes from the OT world. 1
4.1. IT / OT Convergence
1 On Gartner, Inc.
IT Data Streams OT Data Streams
New Level of Decision Support
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 38
IT/OT integration is …
… the end state sought by organizations (most commonly, asset-intensive
organizations such as O&G and Utilities) where instead of a separation of IT
and OT as technology areas with different areas of authority and
responsibility, there is integrated process and information flow
4.2. IT / OT INTEGRATION
Information Technology Operational Technology
Integrated
Process &
Information
Flow
Business Outcomes
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 39
4.3. ORGANIZATION MODEL CONVERGENCE
Example: Organizing for the TSO Cyber Critical Infrastructure
Enterprise
Communications
TSO Architecture
Technology Domain
Cyber Critical Infrastructure
Business Domain
IACS IS/IT
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 40
4.3. ORGANIZATION MODEL CONVERGENCE
Example: Organizing for the TSO Cyber Critical Infrastructure
Organizational FAQs!
1. Who’s right in the fight for control system security? The IT or the IACS?
2. How can the IT securely connect to the IACS?
3. Will the Telecommunications report to the Real-time Operations, the
Control Centre Manager, or to the TSO high management?
4. Will the IACS report to the Control Centre or to the IT?
5. Can the IT report to the IACS?
6. Which organization scenario is ideal for the IACS & the IT to better
serve the enterprise asset management requirements?
7. Telemetry, is it better to be with the Financial Settlement Department,
the Control Centre, the IACS or the Telecommunications?
8. The Substation Control System (SCS) and modern RTUs in the
substations, it is better to be with a separate Tele-control team, with the
IACS or with the protection department?
9. Is it better to outsource the whole IT & control systems infrastructure?
10. Which organization scenario of all of these is best for safeguarding the
TSO critical infrastructure?... !!!
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 41
4.3. ORGANIZATION MODEL CONVERGENCE
Example: The TSO Cyber Critical Infrastructure is the TSO Digital Nervous System
TSO Digital Nervous System
TSO control and information architecture
‘digital nervous system’
Enterprise Information Architecture Layer
Telecommunications Network
IACS Cyber LayerIS/IT Layer
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 42
Analogy
Enterprise Information Systems
Cyber Control Systems
Telecommunications Network
External world
Corporate IT
Systems Data
Input &
reporting
Field Equipment:
Meters, SCS, PLC,
RTU, DCS, etc
Actuators (Relays
/ Tap Changers)
Process
Sensors
(CT/VT)
Spinal cord &
peripheral
Nerves
Human
Senses
Muscles
4.3. ORGANIZATION MODEL CONVERGENCE
Example: The TSO Cyber Critical Infrastructure is the TSO Digital Nervous System
Autonomic &
Somatic
Nervous
System
Brain
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 43
4.3. ORGANIZATION MODEL CONVERGENCE
TSO Cyber Critical Infrastructure – Business Capability Model
Enterprise
Information
Management
Computer System
Infrastructure
Information &
Collaboration
Services & Apps.
Operational
Technology
(SCSDA- Metering – SCS- RTU,
PLC, DCS)
Telecom
Network Management
Network operation
Enterprise
Architecture
Digital Business
Capabilities
Business Architecture
Information
Architecture
Apps. Architecture
Tech. Architecture
Sourcing
Management
Resource
Management
Cost & Revenue
Management
Stakeholder
Engagement
Technical Support
- Business Capability model is used to integrate strategy with Execution
- It is also used with the Operating Model as a thinking tool to support the
development of new organizational structures
The Change
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 44
4.3. ORGANIZATION MODEL CONVERGENCE
TSO Cyber Critical Infrastructure – Business Capability Model
Enterprise
Information
Management
Computer System
Infrastructure
Information &
Collaboration
Services & Apps.
Operational
Technology
(SCSDA- Metering – SCS- RTU,
PLC, DCS)
Telecom
Network Management
Network operation
Enterprise
Architecture
Digital Business
Capabilities
Business Architecture
Information
Architecture
Apps. Architecture
Tech. Architecture
Sourcing
Management
Resource
Management
Cost & Revenue
Management
Stakeholder
Engagement
Technical Support
- Business Capability model is used to integrate strategy with Execution
- It is also used with the Operating Model as a thinking tool to support the
development of new organizational structures
The Change
Digital Business
Create new Business
Models
Analyse Customers &
Partners
Manage Ecosystem
Players
Manage Contextual
Information
Design & Implement
Digital Services
Formulate Digital
Business Strategy
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 45
Communication Network (Infrastructure)
Media / Waves
Fiber optic
cables
Cupper
twisted pair
Wireless
broadband
SatelliteMicrowave Wireless Mobile
Telecom
Communication Services
Equipment
Network
management
Fiber
Switch/Mux
LAN
switches
Router Firewall IDS
Equipment
Network
management
Fiber
Switch/Mux LAN switchesRouter Firewall
IDS
Site X Site Y
Voice VoiceFax FaxVideo Video
Real Time Monitoring
& Control
Real Time
Monitoring & ControlData Data
4.4. CONVERGENCE IN ENTERPRISE NETWORKING & COMMUNICATIONS
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 46
4.4 COMMUNICATION NETWORKS CONVERGENCE
Communication Networks Convergence is defined where common
standards allow several types of networks to connect to each other.
Consequentially, communication services can travel over any combination of
network
Voice Communication
Network
Data Communication
Network
IACS Communication
Network
Example
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 47
4.4 COMMUNICATION SERVICES Convergence
Communication Services Convergence is defined where a single
communication network is used to provide several communication services
that traditionally required several networks
Single Communication Network
Several Communication Services
Site X Site Y
Voice VoiceFax FaxVideo Video
RT Monitoring & Control RT Monitoring & Control
Data Data
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 48
4.4 UNIFIED COMMUNICATIONS
Unified communications (UC) describes …
… the Convergence and integration of non real-time communication
methods and technologies such as messaging (voicemail, e-mail, SMS and
fax) with real-time communication methods and technologies such as
instant messaging, presence information, IP telephony, video conferencing,
web conferencing, call control and speech recognition and with other
business applications.
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 49
5. LEVERAGING OF MOBILITY, SOCIAL MEDIA AND CLOUD COMPUTING
High level Technical architecture
SMS/
Social
Can be deployed as:
- in premises
- Public cloud
- private cloud
- community cloud
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 50
5. LEVERAGING OF MOBILITY, CLOUD COMPUTING AND SOCIAL MEDIA
5.1. Leveraging Enterprise Mobility
Database tier (Back-end)
- Notification Messages Database
Applications tier (business logic)
IACS tier
- SMS Dispatcher module
- Email Dispatcher module
- Messages Data Loader module
-Administration module
Email ServerSMS Server
(web-based)
Terminal Service server 1
- Message Composer module
- MNS Subscription module
Terminal Service server 2
- Message Composer module
- MNS Subscription module
Web
server 1
Web
server 2
IVR
Server
IACS ServersMetering
Servers
Dispatch Systems
Servers
Web tier (front-end) IVR Server
IVR web server
TTS
Engine
ASR
Engine
Telephony
Services
IVR Application
IVR configuration database
IVR
configuration data
Application Server
Custom-made in-house Developed
Applications
Central Database Servers
SCSDA/EMS, Metering & Dispatching
Servers
Technical architecture of Mobile Users Notification System (MNS)
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 51
6. LEVERAGING OF MOBILITY, CLOUD COMPUTING AND SOCIAL MEDIA
5.1. Leveraging Enterprise Mobility
Conceptual Data Model of Mobile Users Notification System (MNS)
User
Subscription
Message
Category
Message-User Link
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 52
6. Digital Twins AR and ML
Digital Twin: Turbine generated power, health and wind sapped are displayed
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 53
7. Open IACS
Open Standards such as OPC UA, OPA and CIM help
implementing:
- better IACS System to SCATA System Interoperability
- better integration with the IT and application worlds
OPA forum initiative was initiated by ExxonMobil and managed by The Open
Group, this initiative aims to build a proof-of-concept prototype, establish
standards for, and ultimately build commercial open process automation
systems that minimize vendor-specific technologies and increase overall
return on system investment
http://www.opengroup.org/open-process-automation
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 54
AGENDA
1) Largescale Critical Infrastructure Domains, Levels, Ownership
and Operation Model
2) Examples of Largescale Critical Infrastructures
3) Layers of Largescale Critical Infrastructure
4) Cyber Critical Infrastructure
5) Evolution Trends Associated with IACS Systems
6) Architecture Development Method of Cyber Critical
Infrastructure
7) Example 1: Establishment of Enterprise Networking &
Communications for Petroleum Industry Integrated
Operations
8) Example 2: Establishment of Control and Information
Architecture for a Transmission System Operator in
Deregulated Electricity Market
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 55
ARCHITECTURE DEVELOPMENT METHOD
Technology
Architecture
Information
Architecture
Business
Architecture
Application
Architecture
1. Establish vision
2. Formulate Strategy
3. Assess the As-IS IACS & IS system
architecture including:
A. Business Architecture
B. Data/Information Architecture
C. Application Architecture
D. Technology Architecture
E. Security Architecture
4. Develop the To-Be IACS & IS system
architecture including:
A. Business Architecture
B. Data/Information Architecture
C. Application Architecture
D. Technology Architecture
E. Security Architecture
5. Identify opportunities and gaps
6. Develop Transition Architectures
7. Establish Implementation Governance
8. Change Management
SecurityArchitecture
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 56
AGENDA
1) Largescale Critical Infrastructure Domains, Levels, Ownership
and Operation Model
2) Examples of Largescale Critical Infrastructures
3) Layers of Largescale Critical Infrastructure
4) Cyber Critical Infrastructure
5) Evolution Trends Associated with IACS Systems
6) Architecture Development Method of Cyber Critical
Infrastructure
7) Example 1: Establishment of Enterprise Networking &
Communications for Petroleum Industry Integrated
Operations
8) Example 2: Establishment of Control and Information
Architecture for a Transmission System Operator in
Deregulated Electricity Market
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 57
Example 1: ENTERPRISE NETWORKING & COMMUNICATIONS FOR
PETROLEUM INDUSTRY INTEGRATED OPERATIONS
Physical Layer Cyber Layer Human Layer
Integrated Operations is commonly used to describe the new operating model which has
been optimized for the businesses of oil industry operators and facilitated by new
information, communication and real-time process control technology
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 58
ENTERPRISE COMMUNICATIONS VISION
Vision: Connected Enterprise…
… From the Wells to the Terminals
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 59
Enterprise Business
Context
General Business Context
Digital Business Context
Enterprise
Business Context
Market Trends
Current State
Communications
Architecture
Challenges
Drivers for
Enterprise
Network
Evolution
Enterprise Communications
Development Strategy:
- Strategic Objectives
- Principal Policies
FORMULATION OF ENTERPRISE-WIDE COMMUNICATIONS STRATEGY
Business Vision
Business Objectives
Business Strategy
Key Business
Challenges
Integrated Operations
Requirements
IT Objectives
IT Strategy
Inf. Systems Program
IT Infrastructure Program
OT Objectives
OT Strategies
OT Program
Future State Architecture
and Implementation
Roadmap
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 60
THE “AS IS” ARCHITECTURE
Traditional oil operator’s fragmented communication Networks
CyberLayer
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 61
3- IACS Network:
SDH + Ethernet
2- Data Network:
E1 + Ethernet
1- Voice Network:
PABX + Twisted pairs
THE “AS IS” NETWORKS: THREE SEPARATE NETWORKS
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 62
DRIVERS FOR ENTERPRISE COMMUNICATIONS EVOLUTION
Fragmented Networks in HQ and Remote Fields…
… physical barrier for effective corporate-wide system integration
… redundant infrastructure that defies cost savings
… poor communication network assets utilization
Fragmented Management Model …
…. Cross-functional model, not well coordinated between the IT
and IACS Operations teams
Different visions for IT, IACS and Voice communication
teams … barrier for effective corporate-wide system
integration and digital business transformation efforts
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 63
Converged Enterprise Communication Architecture
Converged oil operator’s architecture
THE “TO BE” ARCHITECTURE
CyberLayer
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 64
1) Communication Network Infrastructure Integration (IACS, Voice
, Information Systems networks)
ENTERPRISE COMMUNICATIONS STRATEGIC OBJECTIVES &
ARCHITECTURE REQUIREMENTS
Voice Network
(Telephony)
Data Network
(Information Technology)
IACS Network
(IACS)
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 65
2) Communication Service Convergence (voicemail, e-mail, SMS, fax,
instant messaging, presence information, IP telephony, video
conferencing, web conferencing, call control and speech recognition,
business applications data
ENTERPRISE COMMUNICATIONS STRATEGIC OBJECTIVES &
ARCHITECTURE REQUIREMENTS
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 66
3) Communication Network Management Convergence
IACS
Voice
Data
Network Management
ENTERPRISE COMMUNICATIONS STRATEGIC OBJECTIVES &
ARCHITECTURE REQUIREMENTS
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 67
4) Organization Model Convergence of Enterprise Communication
Function
The special requirements of the individual systems …
…security, availability, performance, etc.) should be preserved while
integrating the network infrastructures and communication services.
Voice Network Team Data Network Team
IACS Network Team
ENTERPRISE COMMUNICATIONS STRATEGIC OBJECTIVES &
ARCHITECTURE REQUIREMENTS
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 68
PRINCIPAL POLICIES
Leverage Existing Communication Assets by …
… building on the existing communication media, equipment and services
and optimize their utilization (if possible)
Adopt Standards and Apply Best Practices for …
… transition from the As Is to the To Be Enterprise Communication
Network
Maintain High Degree of Dependability, i.e. ……
…availability, security, performance, scalability, manageability, reliability
and agility
Use Hybrid Saucing model …
… In-sourcing versus Outsourcing model is justified on a case-by-case
basis
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 69
ILLUSTRATIVE EXAMPLE - O&G INTEGRATED OPERATIONS
Example of two sites connected via
the converged enterprise network:
- The oil operator’s headquarter.
- A remote field site
- The Headquarter site includes
the Integrated Operation Center
(IOC), back offices and the
enterprise data center.
- The remote field site includes
field’s control center (CC),
administration offices, remote
rig sites and remote well sites.
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 70
TRANSITION ARCHITECTURE IMPLEMENTATION ROADMAP
Implement Enterprise Communications Function Management Model
Integrate Communication Network
Infrastructure & NM Technology Platforms
Implement Communication
Services Convergence
(UC)
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 71
AGENDA
1) Largescale Critical Infrastructure Domains, Levels, Ownership
and Operation Model
2) Examples of Largescale Critical Infrastructures
3) Layers of Largescale Critical Infrastructure
4) Cyber Critical Infrastructure
5) Evolution Trends Associated with IACS Systems
6) Architecture Development Method of Cyber Critical
Infrastructure
7) Example 1: Establishment of Enterprise Networking &
Communications for Petroleum Industry Integrated
Operations
8) Example 2: Establishment of Control and Information
Architecture for a Transmission System Operator in
Deregulated Electricity Market
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 72
Example 2: ESTABLISHMENT OF THE CONTROL AND INFORMATION
ARCHITECTURE OF A NEW TSO IN A DEREGULATED ELECTRICITY MARKET
New Market New Architecture

New Market  New Architecture
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 73
Example 2 : ESTABLISHMENT OF THE CONTROL AND INFORMATION
ARCHITECTURE OF A NEW TSO IN A DEREGULATED ELECTRICITY MARKET
Transformation of the Electricity Sector
(The As-Is Market)
Generation
Transmission
Distribution
Single Electricity Utility Consumer Tarif
+
Government Subsidy
Supply of Electricity
Payments
Vertically integrated style of ownership and control
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 74
Example 2 : ESTABLISHMENT OF THE CONTROL AND INFORMATION
ARCHITECTURE OF A NEW TSO IN A DEREGULATED ELECTRICITY MARKET
Disco 1
Genco 1
Consumer
Tarif
+
Government
Subsidy
Horizontally integrated style of ownership and control
Transformation of the Electricity Sector
(The To- Be Market)
Genco 2
…
Genco n
TSO
Disco 2
Disco 3
Sector Regulator
Supply of Electricity Payments
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 75
The To-Be Business
Architecture Requirements
-Availability, Security, Manageability,
Economic Dispatch System / EMS
- Data Quality requirements
- Comply with Open System International
Standards (e.g. OPC UA)
- Distributed system architecture
- Agility (Virtualization and Logical DW)
- Scalability
- RT Operational Intelligence, Business
Intelligence & Bigdata Analytics
-Performance of Computer &
Telecom Systems
-In-house Application Development
- Enterprise Mobility
-EMS & Settlement Systems
- Robust comprehensive DR Solution
The To-Be Technical
Architecture Requirements
- Secure & Economic Operation
- Sharing IACS/EMS/WMS
Information:
- Within Enterprise
- With All Market Players
- Change Management
- Competitive Advantage In New Market
- Connect to National & International partners
Financial Settlement within market players
- Business Continuity
Example 2 : ESTABLISHMENT OF THE CONTROL AND INFORMATION
ARCHITECTURE OF A NEW TSO IN A DEREGULATED ELECTRICITY MARKET
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 76
The To- Be Technical Architecture (Conceptual)
CC With Integrated DC
& DR Site
GENCOs
TSO HQ
DISCOs
International Grids
Integrated Data Center (IDC)
Control Center
National GridF. Settlement AuthorityRegulator
Example 2 : ESTABLISHMENT OF THE CONTROL AND INFORMATION
ARCHITECTURE OF A NEW TSO IN A DEREGULATED ELECTRICITY MARKET
DR Site
Typically distributed architecture
across the CC and the HQs
READY FOR INFORMATION SHARING
CCs. of DISCOs, National and
International Grids
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 77
The To- Be Technical Architecture
Example 2 : ESTABLISHMENT OF THE CONTROL AND INFORMATION
ARCHITECTURE OF A NEW TSO IN A DEREGULATED ELECTRICITY MARKET
Settlement
Meters
RTUs
PLCs
RTUs
SCMSs
PLCs
RTUs
SCMSs
PLCs
EMS
DMS DMS
R DMS
Support
ISDN/PSTN
CWDM
Mux
Backend Frontend Storage
GE
FC
&
GE
Transports
Data Centre
ICCP
Server
National &
Reginal
Partners
Control
Centres
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 78
Settlement
Meters
RTUs
PLCs
RTUs
SCMSs
PLCs
RTUs
SCMSs
PLCs
EMS
DMS DMS
R DMS
Support
ISDN/PSTN
CWDM
Mux
Frontend Backend Storage
GE
FC
&
GE
Transports
Data Centre
ICCP
Server
National &
Reginal
Partners
Control
Centres
AvailabilitySecurity
Scalability &
Modularity
Agility
Business
Continuity
Mobility
Example 2 : ESTABLISHMENT OF THE CONTROL AND INFORMATION
ARCHITECTURE OF A NEW TSO IN A DEREGULATED ELECTRICITY MARKET
Achieving the Design Goals
Logical DW,
Analytics: BI,
RT OI, BDA
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 79
Country 2 Country 1
Country 3
Country 4
Example 2 : ESTABLISHMENT OF THE CONTROL AND INFORMATION
ARCHITECTURE OF A NEW TSO IN A DEREGULATED ELECTRICITY MARKET
Achieving the Design Goals: Extensibility
Local
Level
International
Level
National
Level
Control & Information Network for load dispatch, financial settlements and real-time information sharing
Designing Next Generation IACS System Architecture Across Large Scale Critical Infrastructure
Slide 80
THANK You
Alaa Mahjoub is a data management senior expert with
decades of insightful experience in Transportation, Oil &
Gas, Utility and Defense.
Participated as a leading contributor to the Enterprise
Information Management (EIM), Enterprise Architecture
(EA) and Industrial Automation & Control Systems
(IACS) Programs in, ADCO, TRANSCO and DoT.
Led the transformation of the control and information
systems’ architecture during the restructuring of the
water & electricity sector in the Emirate of Abu Dhabi.
He is a holder of B.Sc. and M.Sc. in Computer
Engineering and has numerous research publications in
credit in Digital Energy, Transportation and Data
Management.

How to Design Integrated Control and Information System Architecture Across Largescale Critical Infrastructure

  • 1.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 1 How to Design Integrated Control and Information System Architecture Across Largescale Critical Infrastructure e-mail: ahmam1@emirates.net.ae LinkedIn: https://ae.linkedin.com/in/Alaa-Mahjoub By: Alaa Mahjoub Data Management Senior Expert
  • 2.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 2 AGENDA 1) Largescale Critical Infrastructure Domains, Levels, Ownership and Operation Model 2) Examples of Largescale Critical Infrastructures 3) Layers of Largescale Critical Infrastructure 4) Cyber Critical Infrastructure 5) Evolution Trends Associated with IACS Systems 6) Architecture Development Method of Cyber Critical Infrastructure 7) Example 1: Establishment of Enterprise Networking & Communications for Petroleum Industry Integrated Operations 8) Example 2: Establishment of Control and Information Architecture for a Transmission System Operator in Deregulated Electricity Market
  • 3.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 3 AGENDA 1) Largescale Critical Infrastructure Domains, Levels, Ownership and Operation Model 2) Examples of Largescale Critical Infrastructures 3) Layers of Largescale Critical Infrastructure 4) Cyber Critical Infrastructure 5) Evolution Trends Associated with IACS Systems 6) Architecture Development Method of Cyber Critical Infrastructure 7) Example 1: Establishment of Enterprise Networking & Communications for Petroleum Industry Integrated Operations 8) Example 2: Establishment of Control and Information Architecture for a Transmission System Operator in Deregulated Electricity Market
  • 4.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 4 LARGESCALE CRITICAL INFRASTRUCTURE DOMAINS - Electrical Utilities • Power Transmission • Power Generation • Power Distribution - Water • Water production • Water Transmission • Water Distribution - Telecom • Fibber Optics Transport • Microwave - Transportation • Rail (Railway, Rolling Stock, Stations) • Busses • Traffic control - Municipalities • Sewage stations • Sewage pipelines - Oil & Gas • O&G Pipelines • Oil terminals • Refineries
  • 5.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 5 LEVELS OF LARGESCALE CRITICAL INFRASTRUCTURE - Enterprise - Corporate - National - Regional - International - Electrical Utilities - Water - Telecom - Transportation - Municipalities - Oil & Gas
  • 6.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 6 OWNERSHIP AND OPERATION MODEL - Government - Private Sector - Hybrid - Government - Private Sector - Hybrid ASSET OWNER SYSTEM OPERATOR Asset owner can operate the asset by itself or fully or partially outsource the operation to somebody else
  • 7.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 7 AGENDA 1) Largescale Critical Infrastructure Domains, Levels, Ownership and Operation Model 2) Examples of Largescale Critical Infrastructures 3) Layers of Largescale Critical Infrastructure 4) Cyber Critical Infrastructure 5) Evolution Trends Associated with IACS Systems 6) Architecture Development Method of Cyber Critical Infrastructure 7) Example 1: Establishment of Enterprise Networking & Communications for Petroleum Industry Integrated Operations 8) Example 2: Establishment of Control and Information Architecture for a Transmission System Operator in Deregulated Electricity Market
  • 8.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 8 Telecom Network- Power Transmission Grid - Gas Pipelines Network Transportation Network (Railway) EXAMPLES OF NATIONAL LEVEL CRITICAL INFRASTRUCTURE NETWORKS
  • 9.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 9 UAE Emirates National Grid Interconnections 2000 to 2006 2003  GCC Grid Interconnections EXAMPLES OF NATIONAL & REGIONAL LEVEL CRITICAL INFRASTRUCTURE NETWORKS
  • 10.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 10 EXAMPLES OF INTERNATIONAL LEVEL CRITICAL INFRASTRUCTURE NETWORKS EU Energy Network European High Voltage Transmission Grid
  • 11.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 11 O&G Export Network from Russia Europe EXAMPLES OF INTERNATIONAL LEVEL CRITICAL INFRASTRUCTURE NETWORKS
  • 12.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 12 THE PLANET MEGA INFRASTRUCTURE The Connectivity Atlas: https://atlas.developmentseed.org/
  • 13.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 13 ELECTRICITY NETWORKS
  • 14.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 14 RAILWAY NETWORKS
  • 15.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 15 GLOBAL SUBWAY MAP  POTENTIAL GLOBAL HYPERLOOP?
  • 16.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 16 O&G NETWORKS
  • 17.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 17 TELECOM NETWORKS
  • 18.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 18 Navigate the Mega Infrastructure with the Harvard World Map of connectography https://worldmap.harvard.edu/maps/connectography MEGA-INFRASTRUCTURE WORLDWIDE
  • 19.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 19 AGENDA 1) Largescale Critical Infrastructure Domains, Levels, Ownership and Operation Model 2) Examples of Largescale Critical Infrastructures 3) Layers of Largescale Critical Infrastructure 4) Cyber Critical Infrastructure 5) Evolution Trends Associated with IACS Systems 6) Architecture Development Method of Cyber Critical Infrastructure 7) Example 1: Establishment of Enterprise Networking & Communications for Petroleum Industry Integrated Operations 8) Example 2: Establishment of Control and Information Architecture for a Transmission System Operator in Deregulated Electricity Market
  • 20.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 20 LAYERS OF CRITICAL INFRASTRUCTURE Human Operation Layer IACS Cyber Layer Physical Layer - People & Process (People use information to manage the physical and cyber layers) - Computers, networks, IACS Software and data gathering sensors used to monitor and control the physical layer - Physical Assets (Vertical Industry Dependent )
  • 21.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 21 EXAMPLE 1: TRANSMISSION SYSTEM OPERATOR CRITICAL INFRASTRUCTURE Electricity Market Evolution Vertically Integrated Style of Ownership & Control Horizontally Integrated Style of Ownership & Control with Integrated SO & TO (TSO) Separate SO and TO (ISO) Support of DSO Model? SO … System Operator TO … Transmission Asset Owner TSO … Transmission System Operator ISO … Independent System Operator
  • 22.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 22 (The Operations Perspective) IACS Cyber Layer Human Operations Layer Physical Layer Electricity Network TSO Telecom Network Civil Infrastructure Facilities etc Transformers Breakers TX Lines etc Wireless (e.g. WiMax) Multiplexers (e.g. SDH) Cables (e.g. OPGW) etc Control Centers / DR Centers Administration Buildings Substations Telecom equipment Status and Monitoring / etc Breaker Status / Control Signals Access Control / Fire Fighting/ AC/ Ventilation Control / Surveillance Power flow / Energy Readings etc RTUs / Meters / SCMS / PLC PCNs Supervisory Stations Recovery from Failures, etc. Energy Management Security Enforcement Monitoring & Control of Cyber and Physical Layers TSO CRITICAL INFRASTRUCTURE
  • 23.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 23 (The IT Perspective) TSO CRITICAL INFRASTRUCTURE IS/IT Layer Human Layer Physical Layer HRMS / Financial … Electricity Network Telecom Network Civil Infrastructure Facilities Other Enterprise Assets Internet Access KMOffice Automation EmailGISCMMSERP etc Maintenance Tools Non Operational Equipment Vehicles Information & Collaboration Services … Computers IT Networks IT Applications Operations-Staff … Employees Non-Operations Staff Managers
  • 24.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 24 Human Layer Enterprise Information Architecture Layer Physical Layer Electricity Network Telecommunications NetworkCivil Infrastructure Facilities Other Enterprise Assets IACS Cyber Layer Operations Staff Non-Operational Staff Integration with customers and ecosystem EPM BI/RT OI/ BDA Enterprise-wide Business Process Management MDM/MEM/DW/ECM Enterprise Asset management Telecom for IACS Cyber Layer & IS/IT Layer TSO-wide Integrated Perspective = Operations Perspective + IT Perspective TSO CRITICAL INFRASTRUCTURE Customers, Ecosystems & IoT IS/IT Layer Partners’ IACS
  • 25.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 25 EXAMPLE 2: PETROLEUM INDUSTRY UPSTREAM OPERATOR CRITICAL INFRASTRUCTURE Petroleum Industry Upstream O&G Operator Business Value-chain Model 1- Licensing 2- Exploration 3- Appraisal 4- Development 5- Production 6- Delivery 7- Abandonment
  • 26.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 26 (The Operations Perspective) IACS Cyber Layer Human Operations Layer Physical Layer Petroleum Industry Assets, Surface & Subsurface Facilities Civil Infrastructure Facilities etc Flow lines & Pumping Units Power System and Telecom System Reservoirs, Wells, Surface & subsurface Facilities etc Control Centers / DR Centers Administration Buildings Fields Constructions Communications infrastructure Status and Monitoring / etc Valves Status / Control Signals Access Control / Fire Fighting/ HVAC / Surveillance Oil Flow / PVT Readings etc RTUs / Meters / PLC / DCS PCNs Supervisory Stations Recovery from Failures / etc Security Enforcement Operations staff: Monitoring & Control of Physical and Cyber Layers Production Management PETROLEUM INDUSTRY UPSTREAM OPERATOR CRITICAL INFRASTRUCTURE
  • 27.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 27 PETROLEUM INDUSTRY UPSTREAM OPERATOR CRITICAL INFRASTRUCTURE (The IT Perspective) Information Systems Layer Human Layer Physical Layer HRMS / Financial … Petroleum Industry Assets, Surface & Subsurface Facilities Civil Infrastructure Facilities Other Enterprise Assets Internet Access KMOffice Automation EmailGISCMMSERP etc Maintenance Tools Non Operational Equipment Vehicles Information & Collaboration Services … Computers IT Networks IS Applications Operations-Staff … Employees Non-Operations Staff Managers
  • 28.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 28 Corporate-wide Integrated Perspective = Operations Perspective + IT Perspective Human Layer Enterprise Information Architecture Layer Physical Layer Petroleum Industry Assets, Surface & Subsurface Facilities Telecommunications Network Civil Infrastructure Facilities Other Enterprise Assets IACS Cyber Layer Operations Staff Non-Operational Staff Customers, Ecosystems & IoT PETROLEUM INDUSTRY UPSTREAM OPERATOR CRITICAL INFRASTRUCTURE Telecom for IACS Cyber Layer & IS/IT Layer Integration with customers and ecosystem EPM BI/RT OI/ BDA Enterprise-wide Business Process Management MDM/MEM/DW/ECM Enterprise Asset management Non-operational Information operational Information Enterprise Information (Operational + Non- Operational Other Organizations’ IACS IS/IT Layer
  • 29.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 29 AGENDA 1) Largescale Critical Infrastructure Domains, Levels, Ownership and Operation Model 2) Examples of Largescale Critical Infrastructures 3) Layers of Largescale Critical Infrastructure 4) Cyber Critical Infrastructure 5) Evolution Trends Associated with IACS Systems 6) Architecture Development Method of Cyber Critical Infrastructure 7) Example 1: Establishment of Enterprise Networking & Communications for Petroleum Industry Integrated Operations 8) Example 2: Establishment of Control and Information Architecture for a Transmission System Operator in Deregulated Electricity Market
  • 30.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 30 PETROLEUM INDUSTRY UPSTREAM OPERATOR CRITICAL INFRASTRUCTURE Enterprise Communications Petroleum Industry Operator Architecture Technology Domain Cyber Critical Infrastructure Business Domain IACS IS/IT
  • 31.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 31 AGENDA 1) Largescale Critical Infrastructure Domains, Levels, Ownership and Operation Model 2) Examples of Largescale Critical Infrastructures 3) Layers of Largescale Critical Infrastructure 4) Cyber Critical Infrastructure 5) Evolution Trends Associated with IACS Systems 6) Architecture Development Method of Cyber Critical Infrastructure 7) Example 1: Establishment of Enterprise Networking & Communications for Petroleum Industry Integrated Operations 8) Example 2: Establishment of Control and Information Architecture for a Transmission System Operator in Deregulated Electricity Market
  • 32.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 32 EVOLUTION TRENDS 1. Edge Computing 2. Integration with Business Intelligence, Realtime Operational Intelligence and Big Date Analytics 3. Integration with Digital Business Platforms 4. Convergence in Cyber Critical Infrastructure Components and their Supporting Organizational Models (OT, IT , Telecom) 5. Leveraging of Mobility, Cloud Computing and Social Media 6. Digital Twins, AR and ML 7. Open IACS
  • 33.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 33 1- Augmenting IACS Systems with Realtime Operational Intelligence systems with Edge Computing Capabilities Realtime Drilling/Production Operation Center Drilling / Production Platforms Telecommunication between Fields and Operation center The solution is based on Complex Event Processing hub and spoke architecture IACS System IACS System IACS System Edge Computing EVOLUTION TRENDS
  • 34.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 34 EVOLUTION TRENDS 2- Augmenting IACS Systems with BI, Realtime Operational Intelligence and Big data Analytics 34 DB Consolidation Server(s) DW (Dedicated Repository) Archival Sector Analytics Applications … System 1 System N DB 1 DB N … Metadata Management DI Tools (e.g. ETL) ILM Fields HQ Real-time Production Data Real-time Drilling data DTS data WITSML Server(s) (Drilling) OPC Server(s) (production) Field’sData Acquisition Equipment IACS / DCS/ WITSML Data Source(s)/ PRODML Data Source(s) PRODML Server(s) (DTS) Alerts CEP & BAM WITSML Server(s) PRODML Server(s) OPC Server(s) … Integrated Sector Metadata Repository Integrated Sector DB II- Operational Intelligence III- Big Data Analytics Business Intelligence Platform / tools Data Federation / Virtualization Platform I - Business Intelligence Master Data Transactional, Operational & Analytical Data Meta Data CEP: Complex Event Processing BAM: Business Activity Monitoring ILM: Information Lifecycle Management OPC: OLE for ProcessControl DTS: DistributedTemperature Sensing DCS: Distributed Control Systems Master Data Management Platform DistributedProcessingCluster (e.g.HADOOP) Interactive Sector System M System N+1 System N+2 Database Database Database Database DB Consolidation Real-time Data Replication In-Memory Database Logical Data warehouse Backend Drilling Realtime Operation Centre Backend Production Realtime Operation Centre LDW : Logical DataWarehouse
  • 35.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 35 EmployeesCustomers Things Ecosystems Platform IoT Platforms Data & Analytics Platform Information Systems Partners Customer Experience Platform EVOLUTION TRENDS 3- Integration with Digital Business Platform (example from transportation industry) IACS Runs the core business applications, back office applications, infrastructure applications, endpoint device applications and operational technology applications IT Run the customers and citizens facing applications such as customer portals, B2C and B2B Connects physical assets (Things) such as Busses, Taxis and Traffic Signals for monitoring, optimization, control and monetization Supports the creation of, and connection to, external ecosystems, marketplaces and communities relevant to the transportation agency business such as government agencies, smart cities, credit card networks, police, ambulance, etc. Contains the Data Management and Analytics tools and applications
  • 36.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 36 EVOLUTION TRENDS 4- Convergence in Cyber Critical Infrastructure Components and Organization Models (Telecom, OT, IT) - IT/OT Convergence - IT/OT Integration - Organization Model Convergence - Telecommunications Infrastructure Integration and Service Convergence
  • 37.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 37 Operational technology is the hardware and software that detects or causes a change of state through the direct monitoring and/or control of physical devices, processes and events in the enterprise. The IT and OT convergence brings the two worlds together to deliver new levels of decision support, by putting a business context on various data streams comes from the IT world, while the use of embedded and proprietary systems to capture and distribute machine/operations data comes from the OT world. 1 4.1. IT / OT Convergence 1 On Gartner, Inc. IT Data Streams OT Data Streams New Level of Decision Support
  • 38.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 38 IT/OT integration is … … the end state sought by organizations (most commonly, asset-intensive organizations such as O&G and Utilities) where instead of a separation of IT and OT as technology areas with different areas of authority and responsibility, there is integrated process and information flow 4.2. IT / OT INTEGRATION Information Technology Operational Technology Integrated Process & Information Flow Business Outcomes
  • 39.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 39 4.3. ORGANIZATION MODEL CONVERGENCE Example: Organizing for the TSO Cyber Critical Infrastructure Enterprise Communications TSO Architecture Technology Domain Cyber Critical Infrastructure Business Domain IACS IS/IT
  • 40.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 40 4.3. ORGANIZATION MODEL CONVERGENCE Example: Organizing for the TSO Cyber Critical Infrastructure Organizational FAQs! 1. Who’s right in the fight for control system security? The IT or the IACS? 2. How can the IT securely connect to the IACS? 3. Will the Telecommunications report to the Real-time Operations, the Control Centre Manager, or to the TSO high management? 4. Will the IACS report to the Control Centre or to the IT? 5. Can the IT report to the IACS? 6. Which organization scenario is ideal for the IACS & the IT to better serve the enterprise asset management requirements? 7. Telemetry, is it better to be with the Financial Settlement Department, the Control Centre, the IACS or the Telecommunications? 8. The Substation Control System (SCS) and modern RTUs in the substations, it is better to be with a separate Tele-control team, with the IACS or with the protection department? 9. Is it better to outsource the whole IT & control systems infrastructure? 10. Which organization scenario of all of these is best for safeguarding the TSO critical infrastructure?... !!!
  • 41.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 41 4.3. ORGANIZATION MODEL CONVERGENCE Example: The TSO Cyber Critical Infrastructure is the TSO Digital Nervous System TSO Digital Nervous System TSO control and information architecture ‘digital nervous system’ Enterprise Information Architecture Layer Telecommunications Network IACS Cyber LayerIS/IT Layer
  • 42.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 42 Analogy Enterprise Information Systems Cyber Control Systems Telecommunications Network External world Corporate IT Systems Data Input & reporting Field Equipment: Meters, SCS, PLC, RTU, DCS, etc Actuators (Relays / Tap Changers) Process Sensors (CT/VT) Spinal cord & peripheral Nerves Human Senses Muscles 4.3. ORGANIZATION MODEL CONVERGENCE Example: The TSO Cyber Critical Infrastructure is the TSO Digital Nervous System Autonomic & Somatic Nervous System Brain
  • 43.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 43 4.3. ORGANIZATION MODEL CONVERGENCE TSO Cyber Critical Infrastructure – Business Capability Model Enterprise Information Management Computer System Infrastructure Information & Collaboration Services & Apps. Operational Technology (SCSDA- Metering – SCS- RTU, PLC, DCS) Telecom Network Management Network operation Enterprise Architecture Digital Business Capabilities Business Architecture Information Architecture Apps. Architecture Tech. Architecture Sourcing Management Resource Management Cost & Revenue Management Stakeholder Engagement Technical Support - Business Capability model is used to integrate strategy with Execution - It is also used with the Operating Model as a thinking tool to support the development of new organizational structures The Change
  • 44.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 44 4.3. ORGANIZATION MODEL CONVERGENCE TSO Cyber Critical Infrastructure – Business Capability Model Enterprise Information Management Computer System Infrastructure Information & Collaboration Services & Apps. Operational Technology (SCSDA- Metering – SCS- RTU, PLC, DCS) Telecom Network Management Network operation Enterprise Architecture Digital Business Capabilities Business Architecture Information Architecture Apps. Architecture Tech. Architecture Sourcing Management Resource Management Cost & Revenue Management Stakeholder Engagement Technical Support - Business Capability model is used to integrate strategy with Execution - It is also used with the Operating Model as a thinking tool to support the development of new organizational structures The Change Digital Business Create new Business Models Analyse Customers & Partners Manage Ecosystem Players Manage Contextual Information Design & Implement Digital Services Formulate Digital Business Strategy
  • 45.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 45 Communication Network (Infrastructure) Media / Waves Fiber optic cables Cupper twisted pair Wireless broadband SatelliteMicrowave Wireless Mobile Telecom Communication Services Equipment Network management Fiber Switch/Mux LAN switches Router Firewall IDS Equipment Network management Fiber Switch/Mux LAN switchesRouter Firewall IDS Site X Site Y Voice VoiceFax FaxVideo Video Real Time Monitoring & Control Real Time Monitoring & ControlData Data 4.4. CONVERGENCE IN ENTERPRISE NETWORKING & COMMUNICATIONS
  • 46.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 46 4.4 COMMUNICATION NETWORKS CONVERGENCE Communication Networks Convergence is defined where common standards allow several types of networks to connect to each other. Consequentially, communication services can travel over any combination of network Voice Communication Network Data Communication Network IACS Communication Network Example
  • 47.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 47 4.4 COMMUNICATION SERVICES Convergence Communication Services Convergence is defined where a single communication network is used to provide several communication services that traditionally required several networks Single Communication Network Several Communication Services Site X Site Y Voice VoiceFax FaxVideo Video RT Monitoring & Control RT Monitoring & Control Data Data
  • 48.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 48 4.4 UNIFIED COMMUNICATIONS Unified communications (UC) describes … … the Convergence and integration of non real-time communication methods and technologies such as messaging (voicemail, e-mail, SMS and fax) with real-time communication methods and technologies such as instant messaging, presence information, IP telephony, video conferencing, web conferencing, call control and speech recognition and with other business applications.
  • 49.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 49 5. LEVERAGING OF MOBILITY, SOCIAL MEDIA AND CLOUD COMPUTING High level Technical architecture SMS/ Social Can be deployed as: - in premises - Public cloud - private cloud - community cloud
  • 50.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 50 5. LEVERAGING OF MOBILITY, CLOUD COMPUTING AND SOCIAL MEDIA 5.1. Leveraging Enterprise Mobility Database tier (Back-end) - Notification Messages Database Applications tier (business logic) IACS tier - SMS Dispatcher module - Email Dispatcher module - Messages Data Loader module -Administration module Email ServerSMS Server (web-based) Terminal Service server 1 - Message Composer module - MNS Subscription module Terminal Service server 2 - Message Composer module - MNS Subscription module Web server 1 Web server 2 IVR Server IACS ServersMetering Servers Dispatch Systems Servers Web tier (front-end) IVR Server IVR web server TTS Engine ASR Engine Telephony Services IVR Application IVR configuration database IVR configuration data Application Server Custom-made in-house Developed Applications Central Database Servers SCSDA/EMS, Metering & Dispatching Servers Technical architecture of Mobile Users Notification System (MNS)
  • 51.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 51 6. LEVERAGING OF MOBILITY, CLOUD COMPUTING AND SOCIAL MEDIA 5.1. Leveraging Enterprise Mobility Conceptual Data Model of Mobile Users Notification System (MNS) User Subscription Message Category Message-User Link
  • 52.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 52 6. Digital Twins AR and ML Digital Twin: Turbine generated power, health and wind sapped are displayed
  • 53.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 53 7. Open IACS Open Standards such as OPC UA, OPA and CIM help implementing: - better IACS System to SCATA System Interoperability - better integration with the IT and application worlds OPA forum initiative was initiated by ExxonMobil and managed by The Open Group, this initiative aims to build a proof-of-concept prototype, establish standards for, and ultimately build commercial open process automation systems that minimize vendor-specific technologies and increase overall return on system investment http://www.opengroup.org/open-process-automation
  • 54.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 54 AGENDA 1) Largescale Critical Infrastructure Domains, Levels, Ownership and Operation Model 2) Examples of Largescale Critical Infrastructures 3) Layers of Largescale Critical Infrastructure 4) Cyber Critical Infrastructure 5) Evolution Trends Associated with IACS Systems 6) Architecture Development Method of Cyber Critical Infrastructure 7) Example 1: Establishment of Enterprise Networking & Communications for Petroleum Industry Integrated Operations 8) Example 2: Establishment of Control and Information Architecture for a Transmission System Operator in Deregulated Electricity Market
  • 55.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 55 ARCHITECTURE DEVELOPMENT METHOD Technology Architecture Information Architecture Business Architecture Application Architecture 1. Establish vision 2. Formulate Strategy 3. Assess the As-IS IACS & IS system architecture including: A. Business Architecture B. Data/Information Architecture C. Application Architecture D. Technology Architecture E. Security Architecture 4. Develop the To-Be IACS & IS system architecture including: A. Business Architecture B. Data/Information Architecture C. Application Architecture D. Technology Architecture E. Security Architecture 5. Identify opportunities and gaps 6. Develop Transition Architectures 7. Establish Implementation Governance 8. Change Management SecurityArchitecture
  • 56.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 56 AGENDA 1) Largescale Critical Infrastructure Domains, Levels, Ownership and Operation Model 2) Examples of Largescale Critical Infrastructures 3) Layers of Largescale Critical Infrastructure 4) Cyber Critical Infrastructure 5) Evolution Trends Associated with IACS Systems 6) Architecture Development Method of Cyber Critical Infrastructure 7) Example 1: Establishment of Enterprise Networking & Communications for Petroleum Industry Integrated Operations 8) Example 2: Establishment of Control and Information Architecture for a Transmission System Operator in Deregulated Electricity Market
  • 57.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 57 Example 1: ENTERPRISE NETWORKING & COMMUNICATIONS FOR PETROLEUM INDUSTRY INTEGRATED OPERATIONS Physical Layer Cyber Layer Human Layer Integrated Operations is commonly used to describe the new operating model which has been optimized for the businesses of oil industry operators and facilitated by new information, communication and real-time process control technology
  • 58.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 58 ENTERPRISE COMMUNICATIONS VISION Vision: Connected Enterprise… … From the Wells to the Terminals
  • 59.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 59 Enterprise Business Context General Business Context Digital Business Context Enterprise Business Context Market Trends Current State Communications Architecture Challenges Drivers for Enterprise Network Evolution Enterprise Communications Development Strategy: - Strategic Objectives - Principal Policies FORMULATION OF ENTERPRISE-WIDE COMMUNICATIONS STRATEGY Business Vision Business Objectives Business Strategy Key Business Challenges Integrated Operations Requirements IT Objectives IT Strategy Inf. Systems Program IT Infrastructure Program OT Objectives OT Strategies OT Program Future State Architecture and Implementation Roadmap
  • 60.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 60 THE “AS IS” ARCHITECTURE Traditional oil operator’s fragmented communication Networks CyberLayer
  • 61.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 61 3- IACS Network: SDH + Ethernet 2- Data Network: E1 + Ethernet 1- Voice Network: PABX + Twisted pairs THE “AS IS” NETWORKS: THREE SEPARATE NETWORKS
  • 62.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 62 DRIVERS FOR ENTERPRISE COMMUNICATIONS EVOLUTION Fragmented Networks in HQ and Remote Fields… … physical barrier for effective corporate-wide system integration … redundant infrastructure that defies cost savings … poor communication network assets utilization Fragmented Management Model … …. Cross-functional model, not well coordinated between the IT and IACS Operations teams Different visions for IT, IACS and Voice communication teams … barrier for effective corporate-wide system integration and digital business transformation efforts
  • 63.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 63 Converged Enterprise Communication Architecture Converged oil operator’s architecture THE “TO BE” ARCHITECTURE CyberLayer
  • 64.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 64 1) Communication Network Infrastructure Integration (IACS, Voice , Information Systems networks) ENTERPRISE COMMUNICATIONS STRATEGIC OBJECTIVES & ARCHITECTURE REQUIREMENTS Voice Network (Telephony) Data Network (Information Technology) IACS Network (IACS)
  • 65.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 65 2) Communication Service Convergence (voicemail, e-mail, SMS, fax, instant messaging, presence information, IP telephony, video conferencing, web conferencing, call control and speech recognition, business applications data ENTERPRISE COMMUNICATIONS STRATEGIC OBJECTIVES & ARCHITECTURE REQUIREMENTS
  • 66.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 66 3) Communication Network Management Convergence IACS Voice Data Network Management ENTERPRISE COMMUNICATIONS STRATEGIC OBJECTIVES & ARCHITECTURE REQUIREMENTS
  • 67.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 67 4) Organization Model Convergence of Enterprise Communication Function The special requirements of the individual systems … …security, availability, performance, etc.) should be preserved while integrating the network infrastructures and communication services. Voice Network Team Data Network Team IACS Network Team ENTERPRISE COMMUNICATIONS STRATEGIC OBJECTIVES & ARCHITECTURE REQUIREMENTS
  • 68.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 68 PRINCIPAL POLICIES Leverage Existing Communication Assets by … … building on the existing communication media, equipment and services and optimize their utilization (if possible) Adopt Standards and Apply Best Practices for … … transition from the As Is to the To Be Enterprise Communication Network Maintain High Degree of Dependability, i.e. …… …availability, security, performance, scalability, manageability, reliability and agility Use Hybrid Saucing model … … In-sourcing versus Outsourcing model is justified on a case-by-case basis
  • 69.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 69 ILLUSTRATIVE EXAMPLE - O&G INTEGRATED OPERATIONS Example of two sites connected via the converged enterprise network: - The oil operator’s headquarter. - A remote field site - The Headquarter site includes the Integrated Operation Center (IOC), back offices and the enterprise data center. - The remote field site includes field’s control center (CC), administration offices, remote rig sites and remote well sites.
  • 70.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 70 TRANSITION ARCHITECTURE IMPLEMENTATION ROADMAP Implement Enterprise Communications Function Management Model Integrate Communication Network Infrastructure & NM Technology Platforms Implement Communication Services Convergence (UC)
  • 71.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 71 AGENDA 1) Largescale Critical Infrastructure Domains, Levels, Ownership and Operation Model 2) Examples of Largescale Critical Infrastructures 3) Layers of Largescale Critical Infrastructure 4) Cyber Critical Infrastructure 5) Evolution Trends Associated with IACS Systems 6) Architecture Development Method of Cyber Critical Infrastructure 7) Example 1: Establishment of Enterprise Networking & Communications for Petroleum Industry Integrated Operations 8) Example 2: Establishment of Control and Information Architecture for a Transmission System Operator in Deregulated Electricity Market
  • 72.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 72 Example 2: ESTABLISHMENT OF THE CONTROL AND INFORMATION ARCHITECTURE OF A NEW TSO IN A DEREGULATED ELECTRICITY MARKET New Market New Architecture  New Market  New Architecture
  • 73.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 73 Example 2 : ESTABLISHMENT OF THE CONTROL AND INFORMATION ARCHITECTURE OF A NEW TSO IN A DEREGULATED ELECTRICITY MARKET Transformation of the Electricity Sector (The As-Is Market) Generation Transmission Distribution Single Electricity Utility Consumer Tarif + Government Subsidy Supply of Electricity Payments Vertically integrated style of ownership and control
  • 74.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 74 Example 2 : ESTABLISHMENT OF THE CONTROL AND INFORMATION ARCHITECTURE OF A NEW TSO IN A DEREGULATED ELECTRICITY MARKET Disco 1 Genco 1 Consumer Tarif + Government Subsidy Horizontally integrated style of ownership and control Transformation of the Electricity Sector (The To- Be Market) Genco 2 … Genco n TSO Disco 2 Disco 3 Sector Regulator Supply of Electricity Payments
  • 75.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 75 The To-Be Business Architecture Requirements -Availability, Security, Manageability, Economic Dispatch System / EMS - Data Quality requirements - Comply with Open System International Standards (e.g. OPC UA) - Distributed system architecture - Agility (Virtualization and Logical DW) - Scalability - RT Operational Intelligence, Business Intelligence & Bigdata Analytics -Performance of Computer & Telecom Systems -In-house Application Development - Enterprise Mobility -EMS & Settlement Systems - Robust comprehensive DR Solution The To-Be Technical Architecture Requirements - Secure & Economic Operation - Sharing IACS/EMS/WMS Information: - Within Enterprise - With All Market Players - Change Management - Competitive Advantage In New Market - Connect to National & International partners Financial Settlement within market players - Business Continuity Example 2 : ESTABLISHMENT OF THE CONTROL AND INFORMATION ARCHITECTURE OF A NEW TSO IN A DEREGULATED ELECTRICITY MARKET
  • 76.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 76 The To- Be Technical Architecture (Conceptual) CC With Integrated DC & DR Site GENCOs TSO HQ DISCOs International Grids Integrated Data Center (IDC) Control Center National GridF. Settlement AuthorityRegulator Example 2 : ESTABLISHMENT OF THE CONTROL AND INFORMATION ARCHITECTURE OF A NEW TSO IN A DEREGULATED ELECTRICITY MARKET DR Site Typically distributed architecture across the CC and the HQs READY FOR INFORMATION SHARING CCs. of DISCOs, National and International Grids
  • 77.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 77 The To- Be Technical Architecture Example 2 : ESTABLISHMENT OF THE CONTROL AND INFORMATION ARCHITECTURE OF A NEW TSO IN A DEREGULATED ELECTRICITY MARKET Settlement Meters RTUs PLCs RTUs SCMSs PLCs RTUs SCMSs PLCs EMS DMS DMS R DMS Support ISDN/PSTN CWDM Mux Backend Frontend Storage GE FC & GE Transports Data Centre ICCP Server National & Reginal Partners Control Centres
  • 78.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 78 Settlement Meters RTUs PLCs RTUs SCMSs PLCs RTUs SCMSs PLCs EMS DMS DMS R DMS Support ISDN/PSTN CWDM Mux Frontend Backend Storage GE FC & GE Transports Data Centre ICCP Server National & Reginal Partners Control Centres AvailabilitySecurity Scalability & Modularity Agility Business Continuity Mobility Example 2 : ESTABLISHMENT OF THE CONTROL AND INFORMATION ARCHITECTURE OF A NEW TSO IN A DEREGULATED ELECTRICITY MARKET Achieving the Design Goals Logical DW, Analytics: BI, RT OI, BDA
  • 79.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 79 Country 2 Country 1 Country 3 Country 4 Example 2 : ESTABLISHMENT OF THE CONTROL AND INFORMATION ARCHITECTURE OF A NEW TSO IN A DEREGULATED ELECTRICITY MARKET Achieving the Design Goals: Extensibility Local Level International Level National Level Control & Information Network for load dispatch, financial settlements and real-time information sharing
  • 80.
    Designing Next GenerationIACS System Architecture Across Large Scale Critical Infrastructure Slide 80 THANK You Alaa Mahjoub is a data management senior expert with decades of insightful experience in Transportation, Oil & Gas, Utility and Defense. Participated as a leading contributor to the Enterprise Information Management (EIM), Enterprise Architecture (EA) and Industrial Automation & Control Systems (IACS) Programs in, ADCO, TRANSCO and DoT. Led the transformation of the control and information systems’ architecture during the restructuring of the water & electricity sector in the Emirate of Abu Dhabi. He is a holder of B.Sc. and M.Sc. in Computer Engineering and has numerous research publications in credit in Digital Energy, Transportation and Data Management.

Editor's Notes