SlideShare a Scribd company logo
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
Integration of Big Data Analytics with IoT and
OT Systems to Turn Insights into Strategic &
Operational Business Decisions
By: Alaa Mahjoub
Data Management Senior Expert
e-mail: ahmam1@emirates.net.ae
LinkedIn: https://ae.linkedin.com/in/Alaa-Mahjoub
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
Part II
How to Integrate Big Data Analytics with IoT
and OT Systems to Turn Insights into
Strategic and Operational Business
Decisions
Part I
The Role of OT & IoT in Digital Business
Transformation
PRESENTATION AGENDA
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
PART I: OT & IOT PLATFORMS AS ESSENTIAL PARTS OF
MODERN ENTERPRISE DIGITAL BUSINESS PLATFORM
 What is Digital Business
 Architecture of digital business platform
 How to use the enterprise architecture to plan
and implement digital business transformation
 Use case: transportation industry digital
business platform
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
PART II: INTEGRATION OF BIG DATA ANALYTICS WITH IoT AND OT
Systems TO TURN INSIGHTS INTO STRATEGIC AND OPERATIONAL
BUSINESS DECISIONS
 Basic definitions related to big data analytics
 Essentials of big data strategy
 Use cases of integrating big data analytics with
IoT and OT Systems
 Big data platform integration options and their cost
benefit trade-offs
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
Part I
IACS & IoT Platforms as Parts of
Modern Enterprise Digital Business Platform
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
PART I AGENDA
 What is Digital Business
 Architecture of digital business platform
 How to use the enterprise architecture to plan
and implement digital business
 Use case: transportation industry digital
business platform
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
DIGITAL BUSINESS
Digital business is …
… the creation of new business designs by blurring the digital and physical
worlds due to the convergence of people, business and things
Things
BusinessPeople
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
People
Social Network
Calendar
Location
Online Transportation Request
Places
No. of People Here
No. of People Visited
Wait Time
Reservation Service
Information
Bus Schedule
Expected Disruptions
DIGITAL BUSINESS CONNECTS PEOPLE, PLACES, THINGS AND INFORMATION
Things
Time to Green
No. of Cars: No Stop
No. of Cars: Stopped
Taxi Location
Speed
Online Request
Location
Diagnostics
Digital business delivers value by …
… rethinking, reinventing, reimagining and transforming current business models
to leverage social, mobile, information and cloud, as well as the Internet of Things
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
LEVERAGING THE INFORMATION COLLECTED FROM THE MANY SOURCES
EXAMPLE : LONDON TUBE HEARTBEAT (BY HERE)
HTTPS://COMPANY.HERE.COM/HERE/
Click here to access the web site
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
 What is Digital Business
 Architecture of digital business platform
 How to use the enterprise architecture to plan
and implement digital business
 Use cases: transportation industry digital
business platform
PART I AGENDA
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
EmployeesCustomers
Things
Ecosystems
Platform
IoT
Platform
Data &
Analytics
Platform
Information
Systems
Platform
Partners
ARCHITECTURE OF TRANSPORTATION DIGITAL BUSINESS PLATFORM
Renovate (Mode 1 IT Style) Explore (Mode 2 IT Style)
Customer
Experience
Platform
Runs the core business applications,
back office applications, infrastructure
applications, endpoint device
applications and operational
technology applications
IT
Run the customers and citizens
facing applications such as
customer portals, B2C and B2B
Connects physical assets (Things)
such as Busses, Taxis and Traffic
Signals for monitoring, optimization,
control and monetization
Supports the creation of, and connection to, external
ecosystems, marketplaces and communities relevant to the
transportation agency business such as government
agencies, smart cities, credit card networks, police,
ambulance, etc.
Contains the Data
Management and
Analytics tools and
applications
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
THE INTEGRATED ARCHITECTURE MODEL FROM CYBER SECURITY VIEW POINT
BASED ON THE PURDUE MODEL FOR CONTROL HIERARCHY
INCORPORATED INTO THE ISA99/IEC 62443 SECURITY STANDARD
VPN Web FTP/SFTP Email Gateway
CMMS Planning Email Printing DNS/DHCP…
Shared Historian FTP/SFTP
Remote Access Server
Patch/AV Servers
Shared Application Servers
Plant Historian Production Scheduling
DNS/DHCP/LDAP/… Engineering Workstations
File Ser.
ERP ECM Business Applications
Control Room
Workstations
Human Machine
Interface
Alarms
Systems
PLC DCS RTU
Sensors Actuators Valves
Safety Subsystems (SIS)
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
EmployeesCustomers
Things
Ecosystems
Platform
IoT
Platforms
Data &
Analytics
Platform
Information
Systems
Partners
Customer
Experience
Platform
Integration with Digital Business Technology Platform
Reference Architecture (Revisited)
OT
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
EmployeesCustomers
Things
Ecosystems
Platform
IoT
Platforms
Data &
Analytics
Platform
Information
Systems
Partners
Customer
Experience
Platform
Integration with Digital Business Technology Platform
Reference Architecture (Revisited)
OT
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
IOT PLATFORM ARCHITECTURAL BUILDING BLOCKS
Partner Owned
Things
Gateways
Agents
Customer Owned
Things
Gateways
Agents
Gateways
Agents
Gateways
Agents
AggregatedDeviceManagement
IntegrationMiddleware
BI and Analytics
Data
Orchestration
To other Digital Business Platforms
CommunicationEnterprise Owned
Things
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
DATA AND ANALYTICS PLATFORM
Data Virtualization
Analytics Applications
Business
Intelligence
Data
Warehouse,
ODS, DM
RT Operational
Intelligence
Big Data Analytics
Big Data
ETL
CEP
MDM
MEM
DQ
ILM
Data
Taxonomy
Auto
Classification
Data
Modelling
Enterprise
Content
Management
Analytics Platform(s)
Data and Analytics Platform
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
 What is Digital Business
 Architecture of digital business platform
 How to use the enterprise architecture to plan
and implement digital business
 Use cases: transportation industry digital
business platform
PART I AGENDA
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
Enterprise Architecture is the process of translating business vision
and strategy into effective enterprise change by creating,
communicating and improving the key requirements, principles and
models that describe the enterprise's future state and enable its
evolution
LEVERAGE ENTERPRISE ARCHITECTURE PRACTICE
Uses and produces
Is supported by
Run on
Enterprise Architecture Domains
Technology Architecture Layer
Information Architecture Layer
Business Architecture Layer
Application Architecture Layer
Start from Business
Architecture:
Strategy Maps
Capability Models
Process Models
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
EXAMPLE: TRANSPORTATION AGENCY BUSINESS CAPABILITY MODEL WITH
NEW DIGITAL BUSINESS CAPABILITIES
Regulate Operate Business Administration
Manage Demand Develop Projects
Manage Assets Manage Operation Manage
Maintenance
Manage Customers
& Market
Digital Business
Create new Business
Models
Analyse Customers
& Partners
Manage Ecosystem
Players
Manage Contextual
Information
Design & Implement
Digital Services
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
Digital Business
Create new Business
Models
Analyse Customers &
Partners
Manage Ecosystem
Players
Manage Contextual
Information
Design & Implement
Digital Services
- Persona Development
- Segmentation
- Customer Journey MappingCombine capital assets, partnerships and
resources to generate new ways of
competing
To connect the individual "nodes" in the
ecosystem and support ecosystem
decisions
Understand the customer needs, and
the possibilities of the ecosystem, to
create useful digital services
⁻ Other Transportation Agencies
⁻ Police
⁻ Ambulance
⁻ Smart City
⁻ E-government
⁻ Insurance Companies
⁻ Credit Card Networks
⁻ Vendors
⁻ Clouded Service Providers
⁻ Telecom and Internet Service
Providers
PARTNERING WITH ECOSYSTEM PLAYERS
EXAMPLE OF NEW DIGITAL BUSINESS CAPABILITIES
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
OT AND IOT PLATFORMA AS CORE BUILDING BLOCKS FOR
ENTERPRISE DIGITAL BUSINESS TRANSFORMATION
Technology
Architecture
Information
Architecture
Business
Architecture
Application
Architecture
The new digital business services differ …
… from the traditional e-business and digital marketing services
because of the specific integration of "things“
IoT Platform
Operational
Technology
Things
OT Platform
Consumer
Things
Operational technology Things refer to enterprise assets, such as manufacturing
equipment, jet turbines and office buildings.
Consumer-oriented Things include smart cars, household appliances and
wearable devices.
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
 What is Digital Business
 How to use the enterprise architecture to plan
and implement digital business
 Architecture of digital business platform
 Use cases: transportation industry digital
business platform
PART I AGENDA
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
Build Rail
Network
1
TRANSPORTATION DIGITAL BUSINESS PLARFORM USE CASE ILLSTRATIVE EXAMPLE
CONNECTED METRORAIL
Connect IoT
Endpoints
4
Install IoT
Endpoints
(e.g., Turnstiles)
2
Customer
s
Connect
Customer
5
Connect
Ecosystems
6
Install
Digital
Business
Platform
Ecosystems
Platform
IoT Platform
Customer
Experience
Platform
Data &
Analytics
Platform
Information
Systems
Platform
3
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
USE CASE ILLUSTRATIVE EXAMPLE
COORDINATION OF MULTI-MODAL TRANSPORTATION NETWORK
Coordination of Multi-modal Transportation Network
Integrate with Door to Door Travel as a Service
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
Part II
How to Integrate Big Data Analytics with IoT and OT
Systems to Turn Insights into Strategic and
Operational Business Decisions
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
PART II AGENDA
 Basic definitions related to big data analytics
 Essentials of big data strategy
 Use cases of integrating big data analytics with IoT
and IACS
 Big data platform integration options and their cost
benefit trade-offs
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
BUSINESS INTELLEGENCE
An umbrella term that spans the people, processes and
applications/tools to organize information, enable access to it
and analyze it to improve decisions and manage performance
People ToolsProcess
Performance
Information
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
REAL-TIME OPERATIONAL INTELLIGENCE
A real-time dynamic business analytics that delivers visibility
and insight into data, streaming events and business operations
Orient Decide ActObserve
OODA Loop
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
BIG DATA
High volume, velocity and/or variety information assets that
demand cost-effective, innovative forms of information
processing that enable enhanced insight, decision making, and
process automation
VarityVelocity
Volume
BIG DATA
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
Is a specific form of analytics: a collection of related analytics
techniques and tools, usually including predictive analytics, data
mining, statistical analysis, and complex SQL.
Analytics
Advanced
Analytics
ADVANCED ANALYTICS
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
BIG DATA ANALYTICS
Big data analytics = advanced analytics + big data sets
Big Data Advanced
Analytics
Big Data Analytics
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
ANALYTIC ASCENDENCY MODEL
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
 Basic definitions related to big data analytics
 Essentials of big data strategy
 Use cases of integrating big data analytics with IoT
and IACS
 Big data platform integration options and their cost
benefit trade-offs
PART II AGENDA
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
ESSENTIALS OF BIG DATA ENTERPRISE BUSINESS STRATEGY
AND IT STRATEGY
- Identifying potentially valuable
data sources
- Generating ideas for big data
Essentials of Big data Strategy
IT RelatedBusiness Related
- Ensuring infrastructure adequacy
- Expanding analytical capabilities
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
 Basic definitions related to big data analytics
 Essentials of big data strategy
 Use cases of integrating big data analytics with IoT
and IACS
 Big data platform integration options and their cost
benefit trade-offs
PART II AGENDA
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
INTEGRATION OF BIG DATA ANALYTICS WITH IoT SYSTEMS
USE CASE: TRANSPORT FOR LONDON
- TfL is a Local Government Body
- Responsible for the transport
system in London including:
• Underground
• Over ground
• Rail
• Trams
• Buses
• Taxis
• Cycling
• River services
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
USE CASE – TRANSPORT FOR LONDON
30 Million journeys/day
19 Million e-card ticketing
system taps/day
14,000 sensors
780 Million events/day
Source: Strata + Hadoop World Conference March 2017
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
BUSINESS CHALLENGE
Understanding customers’
behaviours and their transport
needs
Planning and providing good
transportation services and
value for money for passengers
Providing information to
customer
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
MARKET TRENDS
Innovation
Disrupt or be
disrupted
Source: Bus Priority: The London Perspective
http://www.greenerjourneys.com/blog/bus-priority-the-london-perspective/
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
- Identifying potentially valuable
data sources
- Generating big ideas for big data
- Ensuring infrastructure adequacy
- Expanding analytical capabilities
BIG DATA STRATEGY
IT Related
Essentials of Big data Strategy
Business Related
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
BIG DATA STRATEGY
Identifying valuable data sources:
Oyster smartcard tickets Contactless payment cards
The Oyster and contactless ticketing systems generate
19 million taps each day that can be used for analysis
Oyster and contactless payment cards
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
BIG DATA STRATEGY
Identifying valuable data sources: Oyster smartcard tickets
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
BIG DATA STRATEGY
Contactless payment cardsIdentifying valuable data sources:
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
BIG DATA STRATEGY
Identifying valuable data sources:
Traffic Counters
Traffic Signals
Smart Parking
Loop Sensors & Red
Light Cameras
Moving vehicles/
Bus Stop Sensors
Social Media
Underground Stations
Cycle hire Bikes Emirates Airlines
Sensors and social media
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
Emirates Airlines Cable Car
BIG DATA STRATEGY
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
- Identifying potentially valuable
data sources
- Generating big ideas for big data
- Ensuring infrastructure adequacy
- Expanding analytical capabilities
BIG DATA STRATEGY
IT Related
Essentials of Big data Strategy
Business Related
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
Generating big ideas for big data:
BIG DATA STRATEGY
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
Generating big ideas for big data:
BIG DATA STRATEGY
Providing Information to Customers
Source: https://tfl.gov.uk/
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
Transport for London Journey Planning web site
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
Generating big ideas for big data:
BIG DATA STRATEGY
Real-time Traffic Control Sensors’ data
Source: Strata + Hadoop World Conference March 2017
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
Predicting Congestion
Generating big ideas for big data:
BIG DATA STRATEGY
Source: Strata + Hadoop World Conference March 2017
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
Other big ideas for big data:
BIG DATA STRATEGY
Managing Disrupted Schedules
Offering Personalized News & Travel Updates
Displaying Common Travel Mapping Inferring where someone exited a bus
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
Generating big ideas for big data:
BIG DATA STRATEGY
Managing Disrupted Schedules
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
Generating big ideas for big data:
BIG DATA STRATEGY
Offering Personalized News & Travel Updates
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
Generating big ideas for big data:
BIG DATA STRATEGY
Displaying Common Travel
Mapping
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
Generating big ideas for big data:
BIG DATA STRATEGY
Inferring where someone exited a bus
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
MAIN TECHNICAL ARCHITECTURE CAPABILITIES
Things
Integration
Data & Analytics Platform
Amazon S3 (Simple Storage Service)
SQL and No SQL
SOA Platform ‒ WSO2
Data Warehouse - Oracle RDBMS
Resizable compute capacity in the cloud
Spatial - ESRI
Commodity Cloud
Configured Platform Services
Amazon & Google Cloud Offerings
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
Ecosystems
Platform
IoT Platform
Data &
Analytics
Platform
Information
Systems
Platform
Customer
Experience
Platform
TRANSPORTATION AGENCY CAN USE THE DIGITAL BIASNESS
PLATFORM REFERENCE ARCHITECTURE TO SUPPORT SIMILAR
BUSINESS DEMANDS
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
 Basic definitions related to big data analytics
 Essentials of big data strategy
 Use cases of integrating big data analytics with IoT
and OT Systems
 Big data platform integration options and their cost
benefit trade-offs
PART II AGENDA
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
WITSML
Servers
PRODML
Servers
OPC Servers
Real-time
Production
Data
Real-time
Drilling data
WITSML
Servers
(Drilling)
OPC Servers
(production)
WITSML
Data
Sources
PRODML
Data
Sources
Field’s
Data
Acquisition
Equipment
SCADA
/DCS
Platforms
PRODML
Servers
(e.g. DTS)
Other OPC
Real-time Data
Fields HeadquarterWide Area
Network
Data Virtualization
Analytics Applications
Business
Intelligence
Data
Warehouse,
ODS, DM
RT Operational
Intelligence
Big Data
Analytics
Big Data
ETL
ESP
MDM
MEM
DQ
ILM
Data
Taxonomy
Auto
Classification
Data
Modelling
Enterprise
Content
Management
Analytics Platform(s)
Data and Analytics Platform
Alerts / Dashboards
INTEGRATION OF BIG DATA ANALYTICS WITH OT SYSTEMS
(USE CASE 2: REAL-TIME DATA STREAM PROCESSING IN INTELLIGENT OILFIELD)
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
STEP A: REAL-TIME CLEANSING OF IACS (SCADA) DATA
The objective is …
... to filter (in real-time) out bad events generated due to instrumentation
or interface errors, to avoid misleading results and inappropriate
decisions
Out of range values Frozen values
Real-time Data Cleansing
Sensors
Data
High
Quality
Data
Reverse Meter Polarity
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
High Quality Well Data
- Well ID
- Timestamp
- Oil, Gas, Water Rates
- Choke Position
- Wellhead Pressure
Data
Mapping
STEP B: ANALYSIS OF IACS (SCADA) DATA
Statistical Analysis:
- Summation
- Averaging
- standard division
- Etc.
Pattern Recognition:
E.g. bottom-hole
pressure build-up and
drawdown during
- Shut-in period
- Transit state
- Choke position
change
High Quality Sensors Data
- Sensor ID
- Timestamp
- Measurement Value
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
 Basic definitions related to big data analytics
 Essentials of big data strategy
 Use cases of integrating big data analytics with IoT
and OT Systems
 Big data platform integration options and their cost
benefit trade-offs
PART II AGENDA
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
BIG DATA PLATFORM INTEGRATION COST BENEFIT TRADEOFFS
Deployment Mode Public
Cloud
Private
Cloud
Hybrid
Cloud
Community
Cloud
In
Premises
Cost
Availability
24/7 technical expertise
On demand scalability
Easy and inexpensive
setup
Data security
Privacy
Integration of Big Data Analytics with IoT & OT Systems to Turn
Insights into Strategic Business Decisions
By: Alaa Mahjoub
e-mail: ahmam1@emirates.net.ae
LinkedIn: https://ae.linkedin.com/in/Alaa-Mahjoub
THANK You
Alaa Mahjoub is a data management senior expert with
decades of insightful experience in Transportation, Oil & Gas,
Utility and Defense.
Participated as a leading contributor to the Enterprise
Information Management (EIM), Enterprise Architecture (EA)
and Industrial Automation & Control Systems (IACS) Programs
in, ADCO, TRANSCO and DoT.
Led the transformation of the control and information systems’
architecture during the restructuring of the water & electricity
sector in the Emirate of Abu Dhabi.
He is a holder of B.Sc. and M.Sc. in Computer Engineering
and has numerous research publications in credit in Digital
Energy, Transportation and Data Management.

More Related Content

What's hot

Digital Twin Market by Type, Application, Technology and Region: Global Indus...
Digital Twin Market by Type, Application, Technology and Region: Global Indus...Digital Twin Market by Type, Application, Technology and Region: Global Indus...
Digital Twin Market by Type, Application, Technology and Region: Global Indus...
ReportCruxMarketRese
 
Cloud computing market
Cloud computing marketCloud computing market
Cloud computing market
ReportCruxMarketRese
 
Advanced manufacturing syposium 2016 siaa colin koh
Advanced manufacturing syposium 2016 siaa colin kohAdvanced manufacturing syposium 2016 siaa colin koh
Advanced manufacturing syposium 2016 siaa colin koh
Colin Koh (許国仁)
 
Harnessing transportation big data with analytics in the age of digital busin...
Harnessing transportation big data with analytics in the age of digital busin...Harnessing transportation big data with analytics in the age of digital busin...
Harnessing transportation big data with analytics in the age of digital busin...
aaaa1954
 
Research computing, content, applications, and commerce in the cloud legacy ...
Research  computing, content, applications, and commerce in the cloud legacy ...Research  computing, content, applications, and commerce in the cloud legacy ...
Research computing, content, applications, and commerce in the cloud legacy ...
Neel Terde
 
Analytics in IoT
Analytics in IoTAnalytics in IoT
Analytics in IoT
wesley Dias
 
Three Macrotrends Impacting the Journey to 2030: Super Humans, Fluid Organiza...
Three Macrotrends Impacting the Journey to 2030: Super Humans, Fluid Organiza...Three Macrotrends Impacting the Journey to 2030: Super Humans, Fluid Organiza...
Three Macrotrends Impacting the Journey to 2030: Super Humans, Fluid Organiza...
Kaleido Insights
 
The Internet of Things
The Internet of ThingsThe Internet of Things
The Internet of Things
The Marketing Distillery
 
IoT Solutions For Land Transport and Rail
IoT Solutions For Land Transport and RailIoT Solutions For Land Transport and Rail
IoT Solutions For Land Transport and Rail
ST Engineering iDirect
 
TODE 17 How Assurance and Emerging Audit Technologies
TODE 17 How Assurance and Emerging Audit Technologies TODE 17 How Assurance and Emerging Audit Technologies
TODE 17 How Assurance and Emerging Audit Technologies
Workiva
 
Ecosystem Building for Hong Kong's IT Industry
Ecosystem Building for Hong Kong's IT IndustryEcosystem Building for Hong Kong's IT Industry
Ecosystem Building for Hong Kong's IT Industry
Asia Pacific Cloud Apps Alliance
 
Teradata and Cisco integrated journey to IoT and Smart city
Teradata and Cisco integrated journey to IoT and Smart cityTeradata and Cisco integrated journey to IoT and Smart city
Teradata and Cisco integrated journey to IoT and Smart city
Artur Borycki
 
Industrial engineering 4.0
Industrial engineering 4.0Industrial engineering 4.0
Industrial engineering 4.0
Pramod kathamore
 
Artificial Intelligence in Energy and Utilities
Artificial Intelligence in Energy and Utilities Artificial Intelligence in Energy and Utilities
Artificial Intelligence in Energy and Utilities
Indigo Advisory Group
 
How Cloud Based Market Data Enables Innovation
How Cloud Based Market Data Enables InnovationHow Cloud Based Market Data Enables Innovation
How Cloud Based Market Data Enables Innovation
Stephane Dubois
 
Energy & Utilities Manufacturing Industry Ppt
Energy & Utilities   Manufacturing Industry   PptEnergy & Utilities   Manufacturing Industry   Ppt
Energy & Utilities Manufacturing Industry Ppt
vidya2avs
 
Harnessing potential of artificial intelligence in energy & oil and gas
Harnessing potential of artificial intelligence in energy & oil and gasHarnessing potential of artificial intelligence in energy & oil and gas
Harnessing potential of artificial intelligence in energy & oil and gas
CANOPY ONE SOLUTIONS
 
Industrial revolution 4.0
Industrial revolution 4.0 Industrial revolution 4.0
Industrial revolution 4.0
Aditya Randika
 
IoT Solutions for Utilities
IoT Solutions for UtilitiesIoT Solutions for Utilities
IoT Solutions for Utilities
ST Engineering iDirect
 
Industry 4.0 and sustainable energy
Industry 4.0 and sustainable energyIndustry 4.0 and sustainable energy
Industry 4.0 and sustainable energy
Bayu imadul Bilad
 

What's hot (20)

Digital Twin Market by Type, Application, Technology and Region: Global Indus...
Digital Twin Market by Type, Application, Technology and Region: Global Indus...Digital Twin Market by Type, Application, Technology and Region: Global Indus...
Digital Twin Market by Type, Application, Technology and Region: Global Indus...
 
Cloud computing market
Cloud computing marketCloud computing market
Cloud computing market
 
Advanced manufacturing syposium 2016 siaa colin koh
Advanced manufacturing syposium 2016 siaa colin kohAdvanced manufacturing syposium 2016 siaa colin koh
Advanced manufacturing syposium 2016 siaa colin koh
 
Harnessing transportation big data with analytics in the age of digital busin...
Harnessing transportation big data with analytics in the age of digital busin...Harnessing transportation big data with analytics in the age of digital busin...
Harnessing transportation big data with analytics in the age of digital busin...
 
Research computing, content, applications, and commerce in the cloud legacy ...
Research  computing, content, applications, and commerce in the cloud legacy ...Research  computing, content, applications, and commerce in the cloud legacy ...
Research computing, content, applications, and commerce in the cloud legacy ...
 
Analytics in IoT
Analytics in IoTAnalytics in IoT
Analytics in IoT
 
Three Macrotrends Impacting the Journey to 2030: Super Humans, Fluid Organiza...
Three Macrotrends Impacting the Journey to 2030: Super Humans, Fluid Organiza...Three Macrotrends Impacting the Journey to 2030: Super Humans, Fluid Organiza...
Three Macrotrends Impacting the Journey to 2030: Super Humans, Fluid Organiza...
 
The Internet of Things
The Internet of ThingsThe Internet of Things
The Internet of Things
 
IoT Solutions For Land Transport and Rail
IoT Solutions For Land Transport and RailIoT Solutions For Land Transport and Rail
IoT Solutions For Land Transport and Rail
 
TODE 17 How Assurance and Emerging Audit Technologies
TODE 17 How Assurance and Emerging Audit Technologies TODE 17 How Assurance and Emerging Audit Technologies
TODE 17 How Assurance and Emerging Audit Technologies
 
Ecosystem Building for Hong Kong's IT Industry
Ecosystem Building for Hong Kong's IT IndustryEcosystem Building for Hong Kong's IT Industry
Ecosystem Building for Hong Kong's IT Industry
 
Teradata and Cisco integrated journey to IoT and Smart city
Teradata and Cisco integrated journey to IoT and Smart cityTeradata and Cisco integrated journey to IoT and Smart city
Teradata and Cisco integrated journey to IoT and Smart city
 
Industrial engineering 4.0
Industrial engineering 4.0Industrial engineering 4.0
Industrial engineering 4.0
 
Artificial Intelligence in Energy and Utilities
Artificial Intelligence in Energy and Utilities Artificial Intelligence in Energy and Utilities
Artificial Intelligence in Energy and Utilities
 
How Cloud Based Market Data Enables Innovation
How Cloud Based Market Data Enables InnovationHow Cloud Based Market Data Enables Innovation
How Cloud Based Market Data Enables Innovation
 
Energy & Utilities Manufacturing Industry Ppt
Energy & Utilities   Manufacturing Industry   PptEnergy & Utilities   Manufacturing Industry   Ppt
Energy & Utilities Manufacturing Industry Ppt
 
Harnessing potential of artificial intelligence in energy & oil and gas
Harnessing potential of artificial intelligence in energy & oil and gasHarnessing potential of artificial intelligence in energy & oil and gas
Harnessing potential of artificial intelligence in energy & oil and gas
 
Industrial revolution 4.0
Industrial revolution 4.0 Industrial revolution 4.0
Industrial revolution 4.0
 
IoT Solutions for Utilities
IoT Solutions for UtilitiesIoT Solutions for Utilities
IoT Solutions for Utilities
 
Industry 4.0 and sustainable energy
Industry 4.0 and sustainable energyIndustry 4.0 and sustainable energy
Industry 4.0 and sustainable energy
 

Similar to Integration of Big Data Analytics with IoT and OT Systems to Turn Insights into Strategic and Operational Business Decisions

Harnessing transportation big data with analytics in the age of digital busin...
Harnessing transportation big data with analytics in the age of digital busin...Harnessing transportation big data with analytics in the age of digital busin...
Harnessing transportation big data with analytics in the age of digital busin...
Alaa Mahjoub
 
Event-driven Business: How Leading Companies Are Adopting Streaming Strategies
Event-driven Business: How Leading Companies Are Adopting Streaming StrategiesEvent-driven Business: How Leading Companies Are Adopting Streaming Strategies
Event-driven Business: How Leading Companies Are Adopting Streaming Strategies
confluent
 
Tech Leaders of DFW presentation by Mirza Chughtai, April 2018
Tech Leaders of DFW presentation by Mirza Chughtai, April 2018Tech Leaders of DFW presentation by Mirza Chughtai, April 2018
Tech Leaders of DFW presentation by Mirza Chughtai, April 2018
Rob McIntosh
 
Digital Factory with Oracle IOT
Digital Factory with Oracle IOTDigital Factory with Oracle IOT
Digital Factory with Oracle IOT
Zensar Technologies Ltd.
 
A Winning Strategy for the Digital Economy
A Winning Strategy for the Digital EconomyA Winning Strategy for the Digital Economy
A Winning Strategy for the Digital Economy
Eric Kavanagh
 
Self-service analytics @ Leaseplan Digital: from business intelligence to int...
Self-service analytics @ Leaseplan Digital: from business intelligence to int...Self-service analytics @ Leaseplan Digital: from business intelligence to int...
Self-service analytics @ Leaseplan Digital: from business intelligence to int...
webwinkelvakdag
 
Di in the age of digital disruptions v1.0
Di in the age of digital disruptions v1.0Di in the age of digital disruptions v1.0
Di in the age of digital disruptions v1.0
Amar Roy
 
The Next Digital Marketing- Digital Pharma presentation by Ci&T and Google
The Next Digital Marketing- Digital Pharma presentation by Ci&T and GoogleThe Next Digital Marketing- Digital Pharma presentation by Ci&T and Google
The Next Digital Marketing- Digital Pharma presentation by Ci&T and Google
CI&T
 
Digital marketing pharma - google event
Digital marketing   pharma - google eventDigital marketing   pharma - google event
Digital marketing pharma - google event
Daniel Viveiros
 
Bitrock manufacturing
Bitrock manufacturing Bitrock manufacturing
Bitrock manufacturing
cosma_r
 
IoT-Use-Case-eBook
IoT-Use-Case-eBookIoT-Use-Case-eBook
IoT-Use-Case-eBook
Nicolas Delorme
 
DataOps: Control-M's role in data pipeline orchestration
DataOps: Control-M's role in data pipeline orchestrationDataOps: Control-M's role in data pipeline orchestration
DataOps: Control-M's role in data pipeline orchestration
pzjnjr6rsg
 
Three Dimensions of Data as a Service
Three Dimensions of Data as a ServiceThree Dimensions of Data as a Service
Three Dimensions of Data as a Service
Denodo
 
Bilytica - Corporate Introduction - Jan 2015
Bilytica - Corporate Introduction - Jan 2015Bilytica - Corporate Introduction - Jan 2015
Bilytica - Corporate Introduction - Jan 2015
Hannah Naser
 
Customer Presentation - IBM Cloud Pak for Data Overview (Level 100).PPTX
Customer Presentation - IBM Cloud Pak for Data Overview (Level 100).PPTXCustomer Presentation - IBM Cloud Pak for Data Overview (Level 100).PPTX
Customer Presentation - IBM Cloud Pak for Data Overview (Level 100).PPTX
tsigitnist02
 
I Love APIs London 2016 Keynote
I Love APIs London 2016 Keynote I Love APIs London 2016 Keynote
I Love APIs London 2016 Keynote
Apigee | Google Cloud
 
Event-driven Business: How Leading Companies are Adopting Streaming Strategies
Event-driven Business: How Leading Companies are Adopting Streaming StrategiesEvent-driven Business: How Leading Companies are Adopting Streaming Strategies
Event-driven Business: How Leading Companies are Adopting Streaming Strategies
Enterprise Management Associates
 
Gartner AADI 2010 Sponsor Presentation
Gartner AADI 2010 Sponsor PresentationGartner AADI 2010 Sponsor Presentation
Gartner AADI 2010 Sponsor Presentation
Pascal Winckel
 
Artificial intelligence capabilities overview yashowardhan sowale cwin18-india
Artificial intelligence capabilities overview yashowardhan sowale cwin18-indiaArtificial intelligence capabilities overview yashowardhan sowale cwin18-india
Artificial intelligence capabilities overview yashowardhan sowale cwin18-india
Capgemini
 
POV: Industry 4.0 and M&A Prespective
POV: Industry 4.0 and M&A PrespectivePOV: Industry 4.0 and M&A Prespective
POV: Industry 4.0 and M&A Prespective
Sanjay Talukdar
 

Similar to Integration of Big Data Analytics with IoT and OT Systems to Turn Insights into Strategic and Operational Business Decisions (20)

Harnessing transportation big data with analytics in the age of digital busin...
Harnessing transportation big data with analytics in the age of digital busin...Harnessing transportation big data with analytics in the age of digital busin...
Harnessing transportation big data with analytics in the age of digital busin...
 
Event-driven Business: How Leading Companies Are Adopting Streaming Strategies
Event-driven Business: How Leading Companies Are Adopting Streaming StrategiesEvent-driven Business: How Leading Companies Are Adopting Streaming Strategies
Event-driven Business: How Leading Companies Are Adopting Streaming Strategies
 
Tech Leaders of DFW presentation by Mirza Chughtai, April 2018
Tech Leaders of DFW presentation by Mirza Chughtai, April 2018Tech Leaders of DFW presentation by Mirza Chughtai, April 2018
Tech Leaders of DFW presentation by Mirza Chughtai, April 2018
 
Digital Factory with Oracle IOT
Digital Factory with Oracle IOTDigital Factory with Oracle IOT
Digital Factory with Oracle IOT
 
A Winning Strategy for the Digital Economy
A Winning Strategy for the Digital EconomyA Winning Strategy for the Digital Economy
A Winning Strategy for the Digital Economy
 
Self-service analytics @ Leaseplan Digital: from business intelligence to int...
Self-service analytics @ Leaseplan Digital: from business intelligence to int...Self-service analytics @ Leaseplan Digital: from business intelligence to int...
Self-service analytics @ Leaseplan Digital: from business intelligence to int...
 
Di in the age of digital disruptions v1.0
Di in the age of digital disruptions v1.0Di in the age of digital disruptions v1.0
Di in the age of digital disruptions v1.0
 
The Next Digital Marketing- Digital Pharma presentation by Ci&T and Google
The Next Digital Marketing- Digital Pharma presentation by Ci&T and GoogleThe Next Digital Marketing- Digital Pharma presentation by Ci&T and Google
The Next Digital Marketing- Digital Pharma presentation by Ci&T and Google
 
Digital marketing pharma - google event
Digital marketing   pharma - google eventDigital marketing   pharma - google event
Digital marketing pharma - google event
 
Bitrock manufacturing
Bitrock manufacturing Bitrock manufacturing
Bitrock manufacturing
 
IoT-Use-Case-eBook
IoT-Use-Case-eBookIoT-Use-Case-eBook
IoT-Use-Case-eBook
 
DataOps: Control-M's role in data pipeline orchestration
DataOps: Control-M's role in data pipeline orchestrationDataOps: Control-M's role in data pipeline orchestration
DataOps: Control-M's role in data pipeline orchestration
 
Three Dimensions of Data as a Service
Three Dimensions of Data as a ServiceThree Dimensions of Data as a Service
Three Dimensions of Data as a Service
 
Bilytica - Corporate Introduction - Jan 2015
Bilytica - Corporate Introduction - Jan 2015Bilytica - Corporate Introduction - Jan 2015
Bilytica - Corporate Introduction - Jan 2015
 
Customer Presentation - IBM Cloud Pak for Data Overview (Level 100).PPTX
Customer Presentation - IBM Cloud Pak for Data Overview (Level 100).PPTXCustomer Presentation - IBM Cloud Pak for Data Overview (Level 100).PPTX
Customer Presentation - IBM Cloud Pak for Data Overview (Level 100).PPTX
 
I Love APIs London 2016 Keynote
I Love APIs London 2016 Keynote I Love APIs London 2016 Keynote
I Love APIs London 2016 Keynote
 
Event-driven Business: How Leading Companies are Adopting Streaming Strategies
Event-driven Business: How Leading Companies are Adopting Streaming StrategiesEvent-driven Business: How Leading Companies are Adopting Streaming Strategies
Event-driven Business: How Leading Companies are Adopting Streaming Strategies
 
Gartner AADI 2010 Sponsor Presentation
Gartner AADI 2010 Sponsor PresentationGartner AADI 2010 Sponsor Presentation
Gartner AADI 2010 Sponsor Presentation
 
Artificial intelligence capabilities overview yashowardhan sowale cwin18-india
Artificial intelligence capabilities overview yashowardhan sowale cwin18-indiaArtificial intelligence capabilities overview yashowardhan sowale cwin18-india
Artificial intelligence capabilities overview yashowardhan sowale cwin18-india
 
POV: Industry 4.0 and M&A Prespective
POV: Industry 4.0 and M&A PrespectivePOV: Industry 4.0 and M&A Prespective
POV: Industry 4.0 and M&A Prespective
 

More from Alaa Mahjoub

Implementingdigitalbusinesstransformationinthehighereducationindustry4
Implementingdigitalbusinesstransformationinthehighereducationindustry4Implementingdigitalbusinesstransformationinthehighereducationindustry4
Implementingdigitalbusinesstransformationinthehighereducationindustry4
Alaa Mahjoub
 
Implementingdigitalbusinesstransformationinthehighereducationindustry4
Implementingdigitalbusinesstransformationinthehighereducationindustry4Implementingdigitalbusinesstransformationinthehighereducationindustry4
Implementingdigitalbusinesstransformationinthehighereducationindustry4
Alaa Mahjoub
 
Implementingdigitalbusinesstransformationinthehighereducationindustry4
Implementingdigitalbusinesstransformationinthehighereducationindustry4Implementingdigitalbusinesstransformationinthehighereducationindustry4
Implementingdigitalbusinesstransformationinthehighereducationindustry4
Alaa Mahjoub
 
Enabling business excellence through eim
Enabling business excellence through eimEnabling business excellence through eim
Enabling business excellence through eim
Alaa Mahjoub
 
How to Implement Digital Business Transformation in Higher Education
How to Implement Digital Business Transformation  in Higher EducationHow to Implement Digital Business Transformation  in Higher Education
How to Implement Digital Business Transformation in Higher Education
Alaa Mahjoub
 
Alaa Mahjoub Presentation16
Alaa Mahjoub Presentation16Alaa Mahjoub Presentation16
Alaa Mahjoub Presentation16
Alaa Mahjoub
 

More from Alaa Mahjoub (6)

Implementingdigitalbusinesstransformationinthehighereducationindustry4
Implementingdigitalbusinesstransformationinthehighereducationindustry4Implementingdigitalbusinesstransformationinthehighereducationindustry4
Implementingdigitalbusinesstransformationinthehighereducationindustry4
 
Implementingdigitalbusinesstransformationinthehighereducationindustry4
Implementingdigitalbusinesstransformationinthehighereducationindustry4Implementingdigitalbusinesstransformationinthehighereducationindustry4
Implementingdigitalbusinesstransformationinthehighereducationindustry4
 
Implementingdigitalbusinesstransformationinthehighereducationindustry4
Implementingdigitalbusinesstransformationinthehighereducationindustry4Implementingdigitalbusinesstransformationinthehighereducationindustry4
Implementingdigitalbusinesstransformationinthehighereducationindustry4
 
Enabling business excellence through eim
Enabling business excellence through eimEnabling business excellence through eim
Enabling business excellence through eim
 
How to Implement Digital Business Transformation in Higher Education
How to Implement Digital Business Transformation  in Higher EducationHow to Implement Digital Business Transformation  in Higher Education
How to Implement Digital Business Transformation in Higher Education
 
Alaa Mahjoub Presentation16
Alaa Mahjoub Presentation16Alaa Mahjoub Presentation16
Alaa Mahjoub Presentation16
 

Recently uploaded

06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
Timothy Spann
 
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
Timothy Spann
 
Enhanced Enterprise Intelligence with your personal AI Data Copilot.pdf
Enhanced Enterprise Intelligence with your personal AI Data Copilot.pdfEnhanced Enterprise Intelligence with your personal AI Data Copilot.pdf
Enhanced Enterprise Intelligence with your personal AI Data Copilot.pdf
GetInData
 
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
slg6lamcq
 
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
nuttdpt
 
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data LakeViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
Walaa Eldin Moustafa
 
End-to-end pipeline agility - Berlin Buzzwords 2024
End-to-end pipeline agility - Berlin Buzzwords 2024End-to-end pipeline agility - Berlin Buzzwords 2024
End-to-end pipeline agility - Berlin Buzzwords 2024
Lars Albertsson
 
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
apvysm8
 
一比一原版(爱大毕业证书)爱丁堡大学毕业证如何办理
一比一原版(爱大毕业证书)爱丁堡大学毕业证如何办理一比一原版(爱大毕业证书)爱丁堡大学毕业证如何办理
一比一原版(爱大毕业证书)爱丁堡大学毕业证如何办理
g4dpvqap0
 
Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You...
Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You...Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You...
Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You...
Aggregage
 
Everything you wanted to know about LIHTC
Everything you wanted to know about LIHTCEverything you wanted to know about LIHTC
Everything you wanted to know about LIHTC
Roger Valdez
 
一比一原版(Chester毕业证书)切斯特大学毕业证如何办理
一比一原版(Chester毕业证书)切斯特大学毕业证如何办理一比一原版(Chester毕业证书)切斯特大学毕业证如何办理
一比一原版(Chester毕业证书)切斯特大学毕业证如何办理
74nqk8xf
 
一比一原版(Glasgow毕业证书)格拉斯哥大学毕业证如何办理
一比一原版(Glasgow毕业证书)格拉斯哥大学毕业证如何办理一比一原版(Glasgow毕业证书)格拉斯哥大学毕业证如何办理
一比一原版(Glasgow毕业证书)格拉斯哥大学毕业证如何办理
g4dpvqap0
 
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
sameer shah
 
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
u86oixdj
 
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
ahzuo
 
Global Situational Awareness of A.I. and where its headed
Global Situational Awareness of A.I. and where its headedGlobal Situational Awareness of A.I. and where its headed
Global Situational Awareness of A.I. and where its headed
vikram sood
 
一比一原版(牛布毕业证书)牛津布鲁克斯大学毕业证如何办理
一比一原版(牛布毕业证书)牛津布鲁克斯大学毕业证如何办理一比一原版(牛布毕业证书)牛津布鲁克斯大学毕业证如何办理
一比一原版(牛布毕业证书)牛津布鲁克斯大学毕业证如何办理
74nqk8xf
 
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
v7oacc3l
 
一比一原版(UO毕业证)渥太华大学毕业证如何办理
一比一原版(UO毕业证)渥太华大学毕业证如何办理一比一原版(UO毕业证)渥太华大学毕业证如何办理
一比一原版(UO毕业证)渥太华大学毕业证如何办理
aqzctr7x
 

Recently uploaded (20)

06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
 
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Dat...
 
Enhanced Enterprise Intelligence with your personal AI Data Copilot.pdf
Enhanced Enterprise Intelligence with your personal AI Data Copilot.pdfEnhanced Enterprise Intelligence with your personal AI Data Copilot.pdf
Enhanced Enterprise Intelligence with your personal AI Data Copilot.pdf
 
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
一比一原版(UniSA毕业证书)南澳大学毕业证如何办理
 
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
 
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data LakeViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
 
End-to-end pipeline agility - Berlin Buzzwords 2024
End-to-end pipeline agility - Berlin Buzzwords 2024End-to-end pipeline agility - Berlin Buzzwords 2024
End-to-end pipeline agility - Berlin Buzzwords 2024
 
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
 
一比一原版(爱大毕业证书)爱丁堡大学毕业证如何办理
一比一原版(爱大毕业证书)爱丁堡大学毕业证如何办理一比一原版(爱大毕业证书)爱丁堡大学毕业证如何办理
一比一原版(爱大毕业证书)爱丁堡大学毕业证如何办理
 
Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You...
Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You...Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You...
Beyond the Basics of A/B Tests: Highly Innovative Experimentation Tactics You...
 
Everything you wanted to know about LIHTC
Everything you wanted to know about LIHTCEverything you wanted to know about LIHTC
Everything you wanted to know about LIHTC
 
一比一原版(Chester毕业证书)切斯特大学毕业证如何办理
一比一原版(Chester毕业证书)切斯特大学毕业证如何办理一比一原版(Chester毕业证书)切斯特大学毕业证如何办理
一比一原版(Chester毕业证书)切斯特大学毕业证如何办理
 
一比一原版(Glasgow毕业证书)格拉斯哥大学毕业证如何办理
一比一原版(Glasgow毕业证书)格拉斯哥大学毕业证如何办理一比一原版(Glasgow毕业证书)格拉斯哥大学毕业证如何办理
一比一原版(Glasgow毕业证书)格拉斯哥大学毕业证如何办理
 
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
 
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
原版制作(Deakin毕业证书)迪肯大学毕业证学位证一模一样
 
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
一比一原版(UIUC毕业证)伊利诺伊大学|厄巴纳-香槟分校毕业证如何办理
 
Global Situational Awareness of A.I. and where its headed
Global Situational Awareness of A.I. and where its headedGlobal Situational Awareness of A.I. and where its headed
Global Situational Awareness of A.I. and where its headed
 
一比一原版(牛布毕业证书)牛津布鲁克斯大学毕业证如何办理
一比一原版(牛布毕业证书)牛津布鲁克斯大学毕业证如何办理一比一原版(牛布毕业证书)牛津布鲁克斯大学毕业证如何办理
一比一原版(牛布毕业证书)牛津布鲁克斯大学毕业证如何办理
 
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
 
一比一原版(UO毕业证)渥太华大学毕业证如何办理
一比一原版(UO毕业证)渥太华大学毕业证如何办理一比一原版(UO毕业证)渥太华大学毕业证如何办理
一比一原版(UO毕业证)渥太华大学毕业证如何办理
 

Integration of Big Data Analytics with IoT and OT Systems to Turn Insights into Strategic and Operational Business Decisions

  • 1. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub Integration of Big Data Analytics with IoT and OT Systems to Turn Insights into Strategic & Operational Business Decisions By: Alaa Mahjoub Data Management Senior Expert e-mail: ahmam1@emirates.net.ae LinkedIn: https://ae.linkedin.com/in/Alaa-Mahjoub
  • 2. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub Part II How to Integrate Big Data Analytics with IoT and OT Systems to Turn Insights into Strategic and Operational Business Decisions Part I The Role of OT & IoT in Digital Business Transformation PRESENTATION AGENDA
  • 3. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub PART I: OT & IOT PLATFORMS AS ESSENTIAL PARTS OF MODERN ENTERPRISE DIGITAL BUSINESS PLATFORM  What is Digital Business  Architecture of digital business platform  How to use the enterprise architecture to plan and implement digital business transformation  Use case: transportation industry digital business platform
  • 4. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub PART II: INTEGRATION OF BIG DATA ANALYTICS WITH IoT AND OT Systems TO TURN INSIGHTS INTO STRATEGIC AND OPERATIONAL BUSINESS DECISIONS  Basic definitions related to big data analytics  Essentials of big data strategy  Use cases of integrating big data analytics with IoT and OT Systems  Big data platform integration options and their cost benefit trade-offs
  • 5. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub Part I IACS & IoT Platforms as Parts of Modern Enterprise Digital Business Platform
  • 6. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub PART I AGENDA  What is Digital Business  Architecture of digital business platform  How to use the enterprise architecture to plan and implement digital business  Use case: transportation industry digital business platform
  • 7. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub DIGITAL BUSINESS Digital business is … … the creation of new business designs by blurring the digital and physical worlds due to the convergence of people, business and things Things BusinessPeople
  • 8. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub People Social Network Calendar Location Online Transportation Request Places No. of People Here No. of People Visited Wait Time Reservation Service Information Bus Schedule Expected Disruptions DIGITAL BUSINESS CONNECTS PEOPLE, PLACES, THINGS AND INFORMATION Things Time to Green No. of Cars: No Stop No. of Cars: Stopped Taxi Location Speed Online Request Location Diagnostics Digital business delivers value by … … rethinking, reinventing, reimagining and transforming current business models to leverage social, mobile, information and cloud, as well as the Internet of Things
  • 9. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub LEVERAGING THE INFORMATION COLLECTED FROM THE MANY SOURCES EXAMPLE : LONDON TUBE HEARTBEAT (BY HERE) HTTPS://COMPANY.HERE.COM/HERE/ Click here to access the web site
  • 10. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub  What is Digital Business  Architecture of digital business platform  How to use the enterprise architecture to plan and implement digital business  Use cases: transportation industry digital business platform PART I AGENDA
  • 11. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub EmployeesCustomers Things Ecosystems Platform IoT Platform Data & Analytics Platform Information Systems Platform Partners ARCHITECTURE OF TRANSPORTATION DIGITAL BUSINESS PLATFORM Renovate (Mode 1 IT Style) Explore (Mode 2 IT Style) Customer Experience Platform Runs the core business applications, back office applications, infrastructure applications, endpoint device applications and operational technology applications IT Run the customers and citizens facing applications such as customer portals, B2C and B2B Connects physical assets (Things) such as Busses, Taxis and Traffic Signals for monitoring, optimization, control and monetization Supports the creation of, and connection to, external ecosystems, marketplaces and communities relevant to the transportation agency business such as government agencies, smart cities, credit card networks, police, ambulance, etc. Contains the Data Management and Analytics tools and applications
  • 12. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub THE INTEGRATED ARCHITECTURE MODEL FROM CYBER SECURITY VIEW POINT BASED ON THE PURDUE MODEL FOR CONTROL HIERARCHY INCORPORATED INTO THE ISA99/IEC 62443 SECURITY STANDARD VPN Web FTP/SFTP Email Gateway CMMS Planning Email Printing DNS/DHCP… Shared Historian FTP/SFTP Remote Access Server Patch/AV Servers Shared Application Servers Plant Historian Production Scheduling DNS/DHCP/LDAP/… Engineering Workstations File Ser. ERP ECM Business Applications Control Room Workstations Human Machine Interface Alarms Systems PLC DCS RTU Sensors Actuators Valves Safety Subsystems (SIS)
  • 13. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub EmployeesCustomers Things Ecosystems Platform IoT Platforms Data & Analytics Platform Information Systems Partners Customer Experience Platform Integration with Digital Business Technology Platform Reference Architecture (Revisited) OT
  • 14. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub EmployeesCustomers Things Ecosystems Platform IoT Platforms Data & Analytics Platform Information Systems Partners Customer Experience Platform Integration with Digital Business Technology Platform Reference Architecture (Revisited) OT
  • 15. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub IOT PLATFORM ARCHITECTURAL BUILDING BLOCKS Partner Owned Things Gateways Agents Customer Owned Things Gateways Agents Gateways Agents Gateways Agents AggregatedDeviceManagement IntegrationMiddleware BI and Analytics Data Orchestration To other Digital Business Platforms CommunicationEnterprise Owned Things
  • 16. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub DATA AND ANALYTICS PLATFORM Data Virtualization Analytics Applications Business Intelligence Data Warehouse, ODS, DM RT Operational Intelligence Big Data Analytics Big Data ETL CEP MDM MEM DQ ILM Data Taxonomy Auto Classification Data Modelling Enterprise Content Management Analytics Platform(s) Data and Analytics Platform
  • 17. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub  What is Digital Business  Architecture of digital business platform  How to use the enterprise architecture to plan and implement digital business  Use cases: transportation industry digital business platform PART I AGENDA
  • 18. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub Enterprise Architecture is the process of translating business vision and strategy into effective enterprise change by creating, communicating and improving the key requirements, principles and models that describe the enterprise's future state and enable its evolution LEVERAGE ENTERPRISE ARCHITECTURE PRACTICE Uses and produces Is supported by Run on Enterprise Architecture Domains Technology Architecture Layer Information Architecture Layer Business Architecture Layer Application Architecture Layer Start from Business Architecture: Strategy Maps Capability Models Process Models
  • 19. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub EXAMPLE: TRANSPORTATION AGENCY BUSINESS CAPABILITY MODEL WITH NEW DIGITAL BUSINESS CAPABILITIES Regulate Operate Business Administration Manage Demand Develop Projects Manage Assets Manage Operation Manage Maintenance Manage Customers & Market Digital Business Create new Business Models Analyse Customers & Partners Manage Ecosystem Players Manage Contextual Information Design & Implement Digital Services
  • 20. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub Digital Business Create new Business Models Analyse Customers & Partners Manage Ecosystem Players Manage Contextual Information Design & Implement Digital Services - Persona Development - Segmentation - Customer Journey MappingCombine capital assets, partnerships and resources to generate new ways of competing To connect the individual "nodes" in the ecosystem and support ecosystem decisions Understand the customer needs, and the possibilities of the ecosystem, to create useful digital services ⁻ Other Transportation Agencies ⁻ Police ⁻ Ambulance ⁻ Smart City ⁻ E-government ⁻ Insurance Companies ⁻ Credit Card Networks ⁻ Vendors ⁻ Clouded Service Providers ⁻ Telecom and Internet Service Providers PARTNERING WITH ECOSYSTEM PLAYERS EXAMPLE OF NEW DIGITAL BUSINESS CAPABILITIES
  • 21. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub OT AND IOT PLATFORMA AS CORE BUILDING BLOCKS FOR ENTERPRISE DIGITAL BUSINESS TRANSFORMATION Technology Architecture Information Architecture Business Architecture Application Architecture The new digital business services differ … … from the traditional e-business and digital marketing services because of the specific integration of "things“ IoT Platform Operational Technology Things OT Platform Consumer Things Operational technology Things refer to enterprise assets, such as manufacturing equipment, jet turbines and office buildings. Consumer-oriented Things include smart cars, household appliances and wearable devices.
  • 22. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub  What is Digital Business  How to use the enterprise architecture to plan and implement digital business  Architecture of digital business platform  Use cases: transportation industry digital business platform PART I AGENDA
  • 23. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub Build Rail Network 1 TRANSPORTATION DIGITAL BUSINESS PLARFORM USE CASE ILLSTRATIVE EXAMPLE CONNECTED METRORAIL Connect IoT Endpoints 4 Install IoT Endpoints (e.g., Turnstiles) 2 Customer s Connect Customer 5 Connect Ecosystems 6 Install Digital Business Platform Ecosystems Platform IoT Platform Customer Experience Platform Data & Analytics Platform Information Systems Platform 3
  • 24. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub USE CASE ILLUSTRATIVE EXAMPLE COORDINATION OF MULTI-MODAL TRANSPORTATION NETWORK Coordination of Multi-modal Transportation Network Integrate with Door to Door Travel as a Service
  • 25. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub Part II How to Integrate Big Data Analytics with IoT and OT Systems to Turn Insights into Strategic and Operational Business Decisions
  • 26. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub PART II AGENDA  Basic definitions related to big data analytics  Essentials of big data strategy  Use cases of integrating big data analytics with IoT and IACS  Big data platform integration options and their cost benefit trade-offs
  • 27. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub BUSINESS INTELLEGENCE An umbrella term that spans the people, processes and applications/tools to organize information, enable access to it and analyze it to improve decisions and manage performance People ToolsProcess Performance Information
  • 28. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub REAL-TIME OPERATIONAL INTELLIGENCE A real-time dynamic business analytics that delivers visibility and insight into data, streaming events and business operations Orient Decide ActObserve OODA Loop
  • 29. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub BIG DATA High volume, velocity and/or variety information assets that demand cost-effective, innovative forms of information processing that enable enhanced insight, decision making, and process automation VarityVelocity Volume BIG DATA
  • 30. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub Is a specific form of analytics: a collection of related analytics techniques and tools, usually including predictive analytics, data mining, statistical analysis, and complex SQL. Analytics Advanced Analytics ADVANCED ANALYTICS
  • 31. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub BIG DATA ANALYTICS Big data analytics = advanced analytics + big data sets Big Data Advanced Analytics Big Data Analytics
  • 32. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub ANALYTIC ASCENDENCY MODEL
  • 33. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub  Basic definitions related to big data analytics  Essentials of big data strategy  Use cases of integrating big data analytics with IoT and IACS  Big data platform integration options and their cost benefit trade-offs PART II AGENDA
  • 34. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub ESSENTIALS OF BIG DATA ENTERPRISE BUSINESS STRATEGY AND IT STRATEGY - Identifying potentially valuable data sources - Generating ideas for big data Essentials of Big data Strategy IT RelatedBusiness Related - Ensuring infrastructure adequacy - Expanding analytical capabilities
  • 35. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub  Basic definitions related to big data analytics  Essentials of big data strategy  Use cases of integrating big data analytics with IoT and IACS  Big data platform integration options and their cost benefit trade-offs PART II AGENDA
  • 36. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub INTEGRATION OF BIG DATA ANALYTICS WITH IoT SYSTEMS USE CASE: TRANSPORT FOR LONDON - TfL is a Local Government Body - Responsible for the transport system in London including: • Underground • Over ground • Rail • Trams • Buses • Taxis • Cycling • River services
  • 37. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub USE CASE – TRANSPORT FOR LONDON 30 Million journeys/day 19 Million e-card ticketing system taps/day 14,000 sensors 780 Million events/day Source: Strata + Hadoop World Conference March 2017
  • 38. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub BUSINESS CHALLENGE Understanding customers’ behaviours and their transport needs Planning and providing good transportation services and value for money for passengers Providing information to customer
  • 39. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub MARKET TRENDS Innovation Disrupt or be disrupted Source: Bus Priority: The London Perspective http://www.greenerjourneys.com/blog/bus-priority-the-london-perspective/
  • 40. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub - Identifying potentially valuable data sources - Generating big ideas for big data - Ensuring infrastructure adequacy - Expanding analytical capabilities BIG DATA STRATEGY IT Related Essentials of Big data Strategy Business Related
  • 41. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub BIG DATA STRATEGY Identifying valuable data sources: Oyster smartcard tickets Contactless payment cards The Oyster and contactless ticketing systems generate 19 million taps each day that can be used for analysis Oyster and contactless payment cards
  • 42. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub BIG DATA STRATEGY Identifying valuable data sources: Oyster smartcard tickets
  • 43. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub BIG DATA STRATEGY Contactless payment cardsIdentifying valuable data sources:
  • 44. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub BIG DATA STRATEGY Identifying valuable data sources: Traffic Counters Traffic Signals Smart Parking Loop Sensors & Red Light Cameras Moving vehicles/ Bus Stop Sensors Social Media Underground Stations Cycle hire Bikes Emirates Airlines Sensors and social media
  • 45. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub Emirates Airlines Cable Car BIG DATA STRATEGY
  • 46. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub - Identifying potentially valuable data sources - Generating big ideas for big data - Ensuring infrastructure adequacy - Expanding analytical capabilities BIG DATA STRATEGY IT Related Essentials of Big data Strategy Business Related
  • 47. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub Generating big ideas for big data: BIG DATA STRATEGY
  • 48. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub Generating big ideas for big data: BIG DATA STRATEGY Providing Information to Customers Source: https://tfl.gov.uk/
  • 49. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub Transport for London Journey Planning web site
  • 50. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub Generating big ideas for big data: BIG DATA STRATEGY Real-time Traffic Control Sensors’ data Source: Strata + Hadoop World Conference March 2017
  • 51. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub Predicting Congestion Generating big ideas for big data: BIG DATA STRATEGY Source: Strata + Hadoop World Conference March 2017
  • 52. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub Other big ideas for big data: BIG DATA STRATEGY Managing Disrupted Schedules Offering Personalized News & Travel Updates Displaying Common Travel Mapping Inferring where someone exited a bus
  • 53. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub Generating big ideas for big data: BIG DATA STRATEGY Managing Disrupted Schedules
  • 54. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub Generating big ideas for big data: BIG DATA STRATEGY Offering Personalized News & Travel Updates
  • 55. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub Generating big ideas for big data: BIG DATA STRATEGY Displaying Common Travel Mapping
  • 56. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub Generating big ideas for big data: BIG DATA STRATEGY Inferring where someone exited a bus
  • 57. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub MAIN TECHNICAL ARCHITECTURE CAPABILITIES Things Integration Data & Analytics Platform Amazon S3 (Simple Storage Service) SQL and No SQL SOA Platform ‒ WSO2 Data Warehouse - Oracle RDBMS Resizable compute capacity in the cloud Spatial - ESRI Commodity Cloud Configured Platform Services Amazon & Google Cloud Offerings
  • 58. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub Ecosystems Platform IoT Platform Data & Analytics Platform Information Systems Platform Customer Experience Platform TRANSPORTATION AGENCY CAN USE THE DIGITAL BIASNESS PLATFORM REFERENCE ARCHITECTURE TO SUPPORT SIMILAR BUSINESS DEMANDS
  • 59. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub  Basic definitions related to big data analytics  Essentials of big data strategy  Use cases of integrating big data analytics with IoT and OT Systems  Big data platform integration options and their cost benefit trade-offs PART II AGENDA
  • 60. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub WITSML Servers PRODML Servers OPC Servers Real-time Production Data Real-time Drilling data WITSML Servers (Drilling) OPC Servers (production) WITSML Data Sources PRODML Data Sources Field’s Data Acquisition Equipment SCADA /DCS Platforms PRODML Servers (e.g. DTS) Other OPC Real-time Data Fields HeadquarterWide Area Network Data Virtualization Analytics Applications Business Intelligence Data Warehouse, ODS, DM RT Operational Intelligence Big Data Analytics Big Data ETL ESP MDM MEM DQ ILM Data Taxonomy Auto Classification Data Modelling Enterprise Content Management Analytics Platform(s) Data and Analytics Platform Alerts / Dashboards INTEGRATION OF BIG DATA ANALYTICS WITH OT SYSTEMS (USE CASE 2: REAL-TIME DATA STREAM PROCESSING IN INTELLIGENT OILFIELD)
  • 61. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub STEP A: REAL-TIME CLEANSING OF IACS (SCADA) DATA The objective is … ... to filter (in real-time) out bad events generated due to instrumentation or interface errors, to avoid misleading results and inappropriate decisions Out of range values Frozen values Real-time Data Cleansing Sensors Data High Quality Data Reverse Meter Polarity
  • 62. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub High Quality Well Data - Well ID - Timestamp - Oil, Gas, Water Rates - Choke Position - Wellhead Pressure Data Mapping STEP B: ANALYSIS OF IACS (SCADA) DATA Statistical Analysis: - Summation - Averaging - standard division - Etc. Pattern Recognition: E.g. bottom-hole pressure build-up and drawdown during - Shut-in period - Transit state - Choke position change High Quality Sensors Data - Sensor ID - Timestamp - Measurement Value
  • 63. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub  Basic definitions related to big data analytics  Essentials of big data strategy  Use cases of integrating big data analytics with IoT and OT Systems  Big data platform integration options and their cost benefit trade-offs PART II AGENDA
  • 64. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub BIG DATA PLATFORM INTEGRATION COST BENEFIT TRADEOFFS Deployment Mode Public Cloud Private Cloud Hybrid Cloud Community Cloud In Premises Cost Availability 24/7 technical expertise On demand scalability Easy and inexpensive setup Data security Privacy
  • 65. Integration of Big Data Analytics with IoT & OT Systems to Turn Insights into Strategic Business Decisions By: Alaa Mahjoub e-mail: ahmam1@emirates.net.ae LinkedIn: https://ae.linkedin.com/in/Alaa-Mahjoub THANK You Alaa Mahjoub is a data management senior expert with decades of insightful experience in Transportation, Oil & Gas, Utility and Defense. Participated as a leading contributor to the Enterprise Information Management (EIM), Enterprise Architecture (EA) and Industrial Automation & Control Systems (IACS) Programs in, ADCO, TRANSCO and DoT. Led the transformation of the control and information systems’ architecture during the restructuring of the water & electricity sector in the Emirate of Abu Dhabi. He is a holder of B.Sc. and M.Sc. in Computer Engineering and has numerous research publications in credit in Digital Energy, Transportation and Data Management.