SlideShare a Scribd company logo
1 of 14
1
BIG DATA IN OIL &
GAS
BERT BEALS
CHIEF TECHNOLOGIST – ENERGY INDUSTRIES
BJORN ANDERSSON
SOLUTIONS MARKETING DIRECTOR – ENERGY
INDUSTRIES
2
DEFINING BIG DATA AND ANALYTICS
 Data Volume
‒ Terabytes to Petabytes and beyond
 Data Variety
‒ Many sources, structured data and more unstructured data
 Data Velocity
‒ Streaming from sensors, generated secondary data
 Value
‒ Derived business value
‒ Quicker and more accurate decisions
© Hitachi Data Systems 2013
3
BUSINESS
PROCESS
DATABASE DATA
HUMAN
ENTERPRISE CONTENT,
EXTERNAL SOURCES
MACHINE
SENSOR DATA, COMPLEX DATA
SOURCES OF BIG DATA GROWTH
THE DATA MULTIPLIER EFFECT
More Data with More Complex Relationships…in Real Time and At Scale
To manage, govern and analyze
1X 10X 100XOLTP
EMAIL
DOCUMENTS
WEB LOGS SOCIAL
SENSORS M2M LOG
FILES
RECORDING
VIDEO
SATELLITE
IMAGING BIO-
INFORMATICS
VARIETY
VOLUME
VARIETY
VOLUME
VELOCITY VOLUME
© Hitachi Data Systems 2013
4
BIG DATA – THE PROMISE
The Hype
 Turning data flood into transformative
insight
 Exploration without preconceived
notions
The Reality
 Big Data application stack is complex
 Data is highly fragmented
 New skill sets
 Difficult to know where to start
SORTING THE REALITY FROM THE HYPE
Unstructured
Structured
Semi-structured
Video
WebLogs
HTML
Clickstream
Text
Audio
NoSQL
Hadoop
Machine Data
Database
Analytics
Machine Learning
Visualization
ETL
Business Process
Model
Stream Processing
In Memory DB
Connectors
Virtualization
Search
FederationMPP
MetaData
Social Media
Dark Data
Real Time
NAS
How does Big Data help my Business?
How much will it cost?
What’s the ROI? How risky is it? When will I see results?
© Hitachi Data Systems 2013
BIG DATA DRIVING BIG INNOVATION TODAY
Hitachi
Transportation:
Bullet Trains
• Track/train sensors
• Keep trains on schedule
• Proactive maintenance
• Telemetry from seismic sensors
• Time series data
• Operational data from sensors
• Insight for fleet managers
Hitachi Power:
Power Stations
Hitachi
Construction:
Excavators
Hitachi, Ltd.:
Tokyo Stock
Exchange
• High-speed index service
• 1/100th faster
© Hitachi Data Systems 2013
6
#1 INDUSTRY MEGA DRIVER –
SIMPLY STATED: WE NEED MORE ENERGY
INCREASE PRODUCTION AND KNOWN ENERGY RESERVES
Dramatic increase in demand
from emerging economies
(non-OECD)
Discover new reserves now:
75% of today’s oil was
discovered before 1980
© ExxonMobil 2012© BP 2011
Sources: “2012 The Outlook for Energy: A View to 2040”, ExxonMobil 2012; and “BP Energy Outlook 2030”, BP 2011
© ExxonMobil 2012
© Hitachi Data Systems 2013
7
OIL&GAS REPRESENT THE MAJORITY OF
THE ENERGY INDUSTRY
 60% of Global Energy demand fulfilled by Oil&Gas
‒ Natural Gas is the fastest growing fuel source
©BP2011
Sources: “2012 The Outlook for Energy: A View to 2040”, ExxonMobil 2012; and “BP Energy Outlook 2030”, BP 2011
©ExxonMobil2012
© Hitachi Data Systems 2013
8
MORE BIG DATA
 More Volume
‒ New sensor and acquisition technology: Isometrix, WAZ
‒ More data being integrated: Drilling, Production
 More Velocity
‒ Real time data from operations, sensors
‒ Streaming vs batch processing
 More Variety
‒ Structured, Unstructured, semi-structured
‒ Complexity involving multiple disciplines
 Potential Value
‒ Clearer view, better understanding by combining data sources
‒ Capitalizing on opportunities
‒ Lower risk for failures
VOLUME, VELOCITY AND VARIETY
© Hitachi Data Systems 2013
BIG DATA IN ACTION IN OIL&GAS
Exploration
Production
Refining
Distribution
Marketing and retail
Geo-technical applications
Resource planning
Business intelligence
Databases
Office applications
Seismic data
Bore hole sensors
Environmental sensors
Weather data
Production utilization
Storage capacities
Spot pricing (trading)
Transportation
Inventory levels
Demand & forecast
Location data
Big Data Analysis = Value
Business Decisions
E&P Investments
Inventory locations
Production planning
Safety
© Hitachi Data Systems 2013
• Growing data
> 300 MB / Km2 early 90s
> 25 GB / km2 in 2006
> Growing… to PBs / km2
 Yesterday: 20 – 25,000 sensors, 500MB/s – 2GB/s, 50 –
200,000 shots, 50 – 200TB data
 Now: Full 3D acquisition, 8GB/s – 20GB/s, 250TB – 1 PB
 Tomorrow: 50GB/s
Sources, Grid Computing Ahmar Abbas:
1 Luigi Salvador, High Performance Computing for the Oil and Gas Industry
2 ML Geovision www.alkorinternational.com
VELOCITY – INGEST MORE DATA FASTER
© Hitachi Data Systems 2013
VOLUME - INSATIABLE APPETITE FOR INFORMATION
 Technology as a
competitive weapon
‒ Pushing technology
boundaries
‒ Never resting, methods
ready for anticipated
technology advances
 Big Data in use
‒ A different scale, PB file
systems as caches
‒ Live in-feed from sensors
from sites world wide
IT STARTS WITH THE DATA,
THEN IT NEEDS TO BE ANALYZED
TO EXTRACT INFORMATION
Source:HenriCalandra,JohnEtgen,
ScottMorton–RiceUniversity
Realtime drilling
operation center, a fully
integrated part of the
Valhall drilling operations
in Norway.
© Hitachi Data Systems 2013
VARIETY: FIND AND PRODUCE FASTER,
SAFER, AND MORE EFFICIENTLY
Upstream Oil&Gas:
 Many interconnected, increasingly complex
and rapidly changing workflows
 Exponential growth in the volume of data
 Computational demands increasing by orders of magnitude
 Manage complexity and increase efficiency
 Facilitate collaborative computing and secure access to data
Increase efficiency and accelerate the TOTAL workflow
Data
Acquisition
Visual
Interpretation
Modeling
Automation
SimulationSeismic
Processing
Property
Modeling
Data
Management
Petrophysical
Analysis
Increase Reserves - Capacity scaling, changing workloads
© Hitachi Data Systems 2013
UNIFIED STORAGE FOR UPSTREAM OIL AND
GAS ORGANIZATIONS
 Accelerated exploration with optimized file storage
‒ Highest per-node IOPs for unpredictable I/O
‒ Ideal for mixed workflows requiring performance for
throughput-oriented and also for random data flows
‒ Easy scalability and high availability
‒ Open file system standards:
‒ CIFS, NFS, iSCSI, Lustre, Hadoop
 One storage platform for E&P and
the entire oil and gas enterprise
‒ Single architecture for file and block
‒ Comprehensive data management
across technologies
‒ No compromise of performance versus control
Structured
Unstructured
Technical
Enterprise
Unified
Reduce Cost - Reduced complexity, higher efficiency
© Hitachi Data Systems 2013
THANK YOU

More Related Content

What's hot

OilGasDigitalTransformationWhitePaper
OilGasDigitalTransformationWhitePaperOilGasDigitalTransformationWhitePaper
OilGasDigitalTransformationWhitePaperAndre Vieira
 
The Marriage of the Data Lake and the Data Warehouse and Why You Need Both
The Marriage of the Data Lake and the Data Warehouse and Why You Need BothThe Marriage of the Data Lake and the Data Warehouse and Why You Need Both
The Marriage of the Data Lake and the Data Warehouse and Why You Need BothAdaryl "Bob" Wakefield, MBA
 
Business Analytics to solve your Business Problems
Business Analytics to solve your Business ProblemsBusiness Analytics to solve your Business Problems
Business Analytics to solve your Business ProblemsVishal Pawar
 
Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?DATAVERSITY
 
Driven by data - Why we need a Modern Enterprise Data Analytics Platform
Driven by data - Why we need a Modern Enterprise Data Analytics PlatformDriven by data - Why we need a Modern Enterprise Data Analytics Platform
Driven by data - Why we need a Modern Enterprise Data Analytics PlatformArne Roßmann
 
Data Architecture Strategies: Data Architecture for Digital Transformation
Data Architecture Strategies: Data Architecture for Digital TransformationData Architecture Strategies: Data Architecture for Digital Transformation
Data Architecture Strategies: Data Architecture for Digital TransformationDATAVERSITY
 
Data Strategy Best Practices
Data Strategy Best PracticesData Strategy Best Practices
Data Strategy Best PracticesDATAVERSITY
 
Idiro Analytics - Analytics & Big Data
Idiro Analytics - Analytics & Big DataIdiro Analytics - Analytics & Big Data
Idiro Analytics - Analytics & Big DataIdiro Analytics
 
Glossaries, Dictionaries, and Catalogs Result in Data Governance
Glossaries, Dictionaries, and Catalogs Result in Data GovernanceGlossaries, Dictionaries, and Catalogs Result in Data Governance
Glossaries, Dictionaries, and Catalogs Result in Data GovernanceDATAVERSITY
 
Data quality architecture
Data quality architectureData quality architecture
Data quality architectureanicewick
 
Slides: Data Monetization — Demonstrating Quantifiable Financial Benefits fro...
Slides: Data Monetization — Demonstrating Quantifiable Financial Benefits fro...Slides: Data Monetization — Demonstrating Quantifiable Financial Benefits fro...
Slides: Data Monetization — Demonstrating Quantifiable Financial Benefits fro...DATAVERSITY
 
Data Quality Strategy: A Step-by-Step Approach
Data Quality Strategy: A Step-by-Step ApproachData Quality Strategy: A Step-by-Step Approach
Data Quality Strategy: A Step-by-Step ApproachFindWhitePapers
 
RWDG Slides: A Complete Set of Data Governance Roles & Responsibilities
RWDG Slides: A Complete Set of Data Governance Roles & ResponsibilitiesRWDG Slides: A Complete Set of Data Governance Roles & Responsibilities
RWDG Slides: A Complete Set of Data Governance Roles & ResponsibilitiesDATAVERSITY
 
Big data by Mithlesh sadh
Big data by Mithlesh sadhBig data by Mithlesh sadh
Big data by Mithlesh sadhMithlesh Sadh
 
Building a Logical Data Fabric using Data Virtualization (ASEAN)
Building a Logical Data Fabric using Data Virtualization (ASEAN)Building a Logical Data Fabric using Data Virtualization (ASEAN)
Building a Logical Data Fabric using Data Virtualization (ASEAN)Denodo
 
How to Build & Sustain a Data Governance Operating Model
How to Build & Sustain a Data Governance Operating Model How to Build & Sustain a Data Governance Operating Model
How to Build & Sustain a Data Governance Operating Model DATUM LLC
 
Data Quality Best Practices
Data Quality Best PracticesData Quality Best Practices
Data Quality Best PracticesDATAVERSITY
 

What's hot (20)

OilGasDigitalTransformationWhitePaper
OilGasDigitalTransformationWhitePaperOilGasDigitalTransformationWhitePaper
OilGasDigitalTransformationWhitePaper
 
The Marriage of the Data Lake and the Data Warehouse and Why You Need Both
The Marriage of the Data Lake and the Data Warehouse and Why You Need BothThe Marriage of the Data Lake and the Data Warehouse and Why You Need Both
The Marriage of the Data Lake and the Data Warehouse and Why You Need Both
 
Business Analytics to solve your Business Problems
Business Analytics to solve your Business ProblemsBusiness Analytics to solve your Business Problems
Business Analytics to solve your Business Problems
 
Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?
 
Driven by data - Why we need a Modern Enterprise Data Analytics Platform
Driven by data - Why we need a Modern Enterprise Data Analytics PlatformDriven by data - Why we need a Modern Enterprise Data Analytics Platform
Driven by data - Why we need a Modern Enterprise Data Analytics Platform
 
Data Architecture Strategies: Data Architecture for Digital Transformation
Data Architecture Strategies: Data Architecture for Digital TransformationData Architecture Strategies: Data Architecture for Digital Transformation
Data Architecture Strategies: Data Architecture for Digital Transformation
 
Data Strategy Best Practices
Data Strategy Best PracticesData Strategy Best Practices
Data Strategy Best Practices
 
Idiro Analytics - Analytics & Big Data
Idiro Analytics - Analytics & Big DataIdiro Analytics - Analytics & Big Data
Idiro Analytics - Analytics & Big Data
 
Data Domain-Driven Design
Data Domain-Driven DesignData Domain-Driven Design
Data Domain-Driven Design
 
Glossaries, Dictionaries, and Catalogs Result in Data Governance
Glossaries, Dictionaries, and Catalogs Result in Data GovernanceGlossaries, Dictionaries, and Catalogs Result in Data Governance
Glossaries, Dictionaries, and Catalogs Result in Data Governance
 
Data quality architecture
Data quality architectureData quality architecture
Data quality architecture
 
Slides: Data Monetization — Demonstrating Quantifiable Financial Benefits fro...
Slides: Data Monetization — Demonstrating Quantifiable Financial Benefits fro...Slides: Data Monetization — Demonstrating Quantifiable Financial Benefits fro...
Slides: Data Monetization — Demonstrating Quantifiable Financial Benefits fro...
 
Big Data
Big DataBig Data
Big Data
 
Data Quality Strategy: A Step-by-Step Approach
Data Quality Strategy: A Step-by-Step ApproachData Quality Strategy: A Step-by-Step Approach
Data Quality Strategy: A Step-by-Step Approach
 
RWDG Slides: A Complete Set of Data Governance Roles & Responsibilities
RWDG Slides: A Complete Set of Data Governance Roles & ResponsibilitiesRWDG Slides: A Complete Set of Data Governance Roles & Responsibilities
RWDG Slides: A Complete Set of Data Governance Roles & Responsibilities
 
Big data by Mithlesh sadh
Big data by Mithlesh sadhBig data by Mithlesh sadh
Big data by Mithlesh sadh
 
Building a Logical Data Fabric using Data Virtualization (ASEAN)
Building a Logical Data Fabric using Data Virtualization (ASEAN)Building a Logical Data Fabric using Data Virtualization (ASEAN)
Building a Logical Data Fabric using Data Virtualization (ASEAN)
 
How to Build & Sustain a Data Governance Operating Model
How to Build & Sustain a Data Governance Operating Model How to Build & Sustain a Data Governance Operating Model
How to Build & Sustain a Data Governance Operating Model
 
[XConf Brasil 2020] Data mesh
[XConf Brasil 2020] Data mesh[XConf Brasil 2020] Data mesh
[XConf Brasil 2020] Data mesh
 
Data Quality Best Practices
Data Quality Best PracticesData Quality Best Practices
Data Quality Best Practices
 

Viewers also liked

Imagine the Digital Supply Chain
Imagine the Digital Supply ChainImagine the Digital Supply Chain
Imagine the Digital Supply ChainLora Cecere
 
Big Data in Oil and Gas: How to Tap Its Full Potential
Big Data in Oil and Gas: How to Tap Its Full PotentialBig Data in Oil and Gas: How to Tap Its Full Potential
Big Data in Oil and Gas: How to Tap Its Full PotentialHitachi Vantara
 
Import - Export Policy of India (EXIM POLICY)
Import - Export Policy of  India(EXIM POLICY)Import - Export Policy of  India(EXIM POLICY)
Import - Export Policy of India (EXIM POLICY)Sandip Besra
 
Digital transformation of supply chain
Digital transformation of supply chainDigital transformation of supply chain
Digital transformation of supply chainSandip Besra
 
Oil & Gas Big Data use cases
Oil & Gas Big Data use casesOil & Gas Big Data use cases
Oil & Gas Big Data use caseselephantscale
 
Creating a Digital Supply Chain: Monsanto's Journey
Creating a Digital Supply Chain:  Monsanto's JourneyCreating a Digital Supply Chain:  Monsanto's Journey
Creating a Digital Supply Chain: Monsanto's JourneyThe Boeing Center
 
Digital Supply Chain - Insights on Driving the Digital Supply Chain Transform...
Digital Supply Chain - Insights on Driving the Digital Supply Chain Transform...Digital Supply Chain - Insights on Driving the Digital Supply Chain Transform...
Digital Supply Chain - Insights on Driving the Digital Supply Chain Transform...Lora Cecere
 

Viewers also liked (7)

Imagine the Digital Supply Chain
Imagine the Digital Supply ChainImagine the Digital Supply Chain
Imagine the Digital Supply Chain
 
Big Data in Oil and Gas: How to Tap Its Full Potential
Big Data in Oil and Gas: How to Tap Its Full PotentialBig Data in Oil and Gas: How to Tap Its Full Potential
Big Data in Oil and Gas: How to Tap Its Full Potential
 
Import - Export Policy of India (EXIM POLICY)
Import - Export Policy of  India(EXIM POLICY)Import - Export Policy of  India(EXIM POLICY)
Import - Export Policy of India (EXIM POLICY)
 
Digital transformation of supply chain
Digital transformation of supply chainDigital transformation of supply chain
Digital transformation of supply chain
 
Oil & Gas Big Data use cases
Oil & Gas Big Data use casesOil & Gas Big Data use cases
Oil & Gas Big Data use cases
 
Creating a Digital Supply Chain: Monsanto's Journey
Creating a Digital Supply Chain:  Monsanto's JourneyCreating a Digital Supply Chain:  Monsanto's Journey
Creating a Digital Supply Chain: Monsanto's Journey
 
Digital Supply Chain - Insights on Driving the Digital Supply Chain Transform...
Digital Supply Chain - Insights on Driving the Digital Supply Chain Transform...Digital Supply Chain - Insights on Driving the Digital Supply Chain Transform...
Digital Supply Chain - Insights on Driving the Digital Supply Chain Transform...
 

Similar to Big Data in Oil and Gas

Big Data - Applications and Technologies Overview
Big Data - Applications and Technologies OverviewBig Data - Applications and Technologies Overview
Big Data - Applications and Technologies OverviewSivashankar Ganapathy
 
Guest Lecture: Introduction to Big Data at Indian Institute of Technology
Guest Lecture: Introduction to Big Data at Indian Institute of TechnologyGuest Lecture: Introduction to Big Data at Indian Institute of Technology
Guest Lecture: Introduction to Big Data at Indian Institute of TechnologyNishant Gandhi
 
Innovating With Data and Analytics
Innovating With Data and AnalyticsInnovating With Data and Analytics
Innovating With Data and AnalyticsVMware Tanzu
 
Capitalize on Big Data Through Hitachi Innovation
Capitalize on Big Data Through Hitachi InnovationCapitalize on Big Data Through Hitachi Innovation
Capitalize on Big Data Through Hitachi InnovationHitachi Vantara
 
The Evolution of Data Architecture
The Evolution of Data ArchitectureThe Evolution of Data Architecture
The Evolution of Data ArchitectureWei-Chiu Chuang
 
Building Confidence in Big Data - IBM Smarter Business 2013
Building Confidence in Big Data - IBM Smarter Business 2013 Building Confidence in Big Data - IBM Smarter Business 2013
Building Confidence in Big Data - IBM Smarter Business 2013 IBM Sverige
 
Hortonworks Open Connected Data Platforms for IoT and Predictive Big Data Ana...
Hortonworks Open Connected Data Platforms for IoT and Predictive Big Data Ana...Hortonworks Open Connected Data Platforms for IoT and Predictive Big Data Ana...
Hortonworks Open Connected Data Platforms for IoT and Predictive Big Data Ana...DataWorks Summit
 
Aws keynote oil and gas calgary industry day - jon guidroz
Aws keynote oil and gas calgary industry day -  jon guidrozAws keynote oil and gas calgary industry day -  jon guidroz
Aws keynote oil and gas calgary industry day - jon guidrozAmazon Web Services
 
Smarter planet and mega trends presentation 2012
Smarter planet and mega trends presentation 2012Smarter planet and mega trends presentation 2012
Smarter planet and mega trends presentation 2012Joergen Floes
 
Kaushal Amin & Big 5 IT trends in the world
Kaushal Amin & Big 5 IT trends in the worldKaushal Amin & Big 5 IT trends in the world
Kaushal Amin & Big 5 IT trends in the worldQuang PM
 
Technology Trends and Big Data in 2013-2014
Technology Trends and Big Data in 2013-2014Technology Trends and Big Data in 2013-2014
Technology Trends and Big Data in 2013-2014KMS Technology
 
Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...
Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...
Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...mattdenesuk
 
Ab cs of big data
Ab cs of big dataAb cs of big data
Ab cs of big dataDigimark
 
Big Data Techcon 2014
Big Data Techcon 2014Big Data Techcon 2014
Big Data Techcon 2014Samir Lad
 
Pouring the Foundation: Data Management in the Energy Industry
Pouring the Foundation: Data Management in the Energy IndustryPouring the Foundation: Data Management in the Energy Industry
Pouring the Foundation: Data Management in the Energy IndustryDataWorks Summit
 
Big Data - A Real Life Revolution
Big Data - A Real Life RevolutionBig Data - A Real Life Revolution
Big Data - A Real Life RevolutionCapgemini
 

Similar to Big Data in Oil and Gas (20)

Big Data - Applications and Technologies Overview
Big Data - Applications and Technologies OverviewBig Data - Applications and Technologies Overview
Big Data - Applications and Technologies Overview
 
Guest Lecture: Introduction to Big Data at Indian Institute of Technology
Guest Lecture: Introduction to Big Data at Indian Institute of TechnologyGuest Lecture: Introduction to Big Data at Indian Institute of Technology
Guest Lecture: Introduction to Big Data at Indian Institute of Technology
 
The New Age of the Industrial Internet
The New Age of the Industrial InternetThe New Age of the Industrial Internet
The New Age of the Industrial Internet
 
Innovating With Data and Analytics
Innovating With Data and AnalyticsInnovating With Data and Analytics
Innovating With Data and Analytics
 
Capitalize on Big Data Through Hitachi Innovation
Capitalize on Big Data Through Hitachi InnovationCapitalize on Big Data Through Hitachi Innovation
Capitalize on Big Data Through Hitachi Innovation
 
The Evolution of Data Architecture
The Evolution of Data ArchitectureThe Evolution of Data Architecture
The Evolution of Data Architecture
 
Building Confidence in Big Data - IBM Smarter Business 2013
Building Confidence in Big Data - IBM Smarter Business 2013 Building Confidence in Big Data - IBM Smarter Business 2013
Building Confidence in Big Data - IBM Smarter Business 2013
 
Hortonworks Open Connected Data Platforms for IoT and Predictive Big Data Ana...
Hortonworks Open Connected Data Platforms for IoT and Predictive Big Data Ana...Hortonworks Open Connected Data Platforms for IoT and Predictive Big Data Ana...
Hortonworks Open Connected Data Platforms for IoT and Predictive Big Data Ana...
 
The ABCs of Big Data
The ABCs of Big DataThe ABCs of Big Data
The ABCs of Big Data
 
Big data ppt
Big data pptBig data ppt
Big data ppt
 
Aws keynote oil and gas calgary industry day - jon guidroz
Aws keynote oil and gas calgary industry day -  jon guidrozAws keynote oil and gas calgary industry day -  jon guidroz
Aws keynote oil and gas calgary industry day - jon guidroz
 
Smarter planet and mega trends presentation 2012
Smarter planet and mega trends presentation 2012Smarter planet and mega trends presentation 2012
Smarter planet and mega trends presentation 2012
 
Kaushal Amin & Big 5 IT trends in the world
Kaushal Amin & Big 5 IT trends in the worldKaushal Amin & Big 5 IT trends in the world
Kaushal Amin & Big 5 IT trends in the world
 
Technology Trends and Big Data in 2013-2014
Technology Trends and Big Data in 2013-2014Technology Trends and Big Data in 2013-2014
Technology Trends and Big Data in 2013-2014
 
Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...
Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...
Big Data, Physics, and the Industrial Internet: How Modeling & Analytics are ...
 
Adam wray 945
Adam wray   945Adam wray   945
Adam wray 945
 
Ab cs of big data
Ab cs of big dataAb cs of big data
Ab cs of big data
 
Big Data Techcon 2014
Big Data Techcon 2014Big Data Techcon 2014
Big Data Techcon 2014
 
Pouring the Foundation: Data Management in the Energy Industry
Pouring the Foundation: Data Management in the Energy IndustryPouring the Foundation: Data Management in the Energy Industry
Pouring the Foundation: Data Management in the Energy Industry
 
Big Data - A Real Life Revolution
Big Data - A Real Life RevolutionBig Data - A Real Life Revolution
Big Data - A Real Life Revolution
 

Recently uploaded

How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfHow we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfSrushith Repakula
 
Design and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data ScienceDesign and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data SciencePaolo Missier
 
Working together SRE & Platform Engineering
Working together SRE & Platform EngineeringWorking together SRE & Platform Engineering
Working together SRE & Platform EngineeringMarcus Vechiato
 
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...Skynet Technologies
 
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...ScyllaDB
 
Using IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & IrelandUsing IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & IrelandIES VE
 
Long journey of Ruby Standard library at RubyKaigi 2024
Long journey of Ruby Standard library at RubyKaigi 2024Long journey of Ruby Standard library at RubyKaigi 2024
Long journey of Ruby Standard library at RubyKaigi 2024Hiroshi SHIBATA
 
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)Paige Cruz
 
The Metaverse: Are We There Yet?
The  Metaverse:    Are   We  There  Yet?The  Metaverse:    Are   We  There  Yet?
The Metaverse: Are We There Yet?Mark Billinghurst
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...panagenda
 
Design Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptxDesign Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptxFIDO Alliance
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc
 
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdfSimplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdfFIDO Alliance
 
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsContinuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsLeah Henrickson
 
AI mind or machine power point presentation
AI mind or machine power point presentationAI mind or machine power point presentation
AI mind or machine power point presentationyogeshlabana357357
 
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...FIDO Alliance
 
Generative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdfGenerative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdfalexjohnson7307
 
ADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptxADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptxFIDO Alliance
 
State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!Memoori
 
Vector Search @ sw2con for slideshare.pptx
Vector Search @ sw2con for slideshare.pptxVector Search @ sw2con for slideshare.pptx
Vector Search @ sw2con for slideshare.pptxjbellis
 

Recently uploaded (20)

How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfHow we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdf
 
Design and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data ScienceDesign and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data Science
 
Working together SRE & Platform Engineering
Working together SRE & Platform EngineeringWorking together SRE & Platform Engineering
Working together SRE & Platform Engineering
 
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
 
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
 
Using IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & IrelandUsing IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & Ireland
 
Long journey of Ruby Standard library at RubyKaigi 2024
Long journey of Ruby Standard library at RubyKaigi 2024Long journey of Ruby Standard library at RubyKaigi 2024
Long journey of Ruby Standard library at RubyKaigi 2024
 
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
 
The Metaverse: Are We There Yet?
The  Metaverse:    Are   We  There  Yet?The  Metaverse:    Are   We  There  Yet?
The Metaverse: Are We There Yet?
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
 
Design Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptxDesign Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptx
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
 
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdfSimplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
Simplified FDO Manufacturing Flow with TPMs _ Liam at Infineon.pdf
 
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsContinuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
 
AI mind or machine power point presentation
AI mind or machine power point presentationAI mind or machine power point presentation
AI mind or machine power point presentation
 
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
 
Generative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdfGenerative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdf
 
ADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptxADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptx
 
State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!
 
Vector Search @ sw2con for slideshare.pptx
Vector Search @ sw2con for slideshare.pptxVector Search @ sw2con for slideshare.pptx
Vector Search @ sw2con for slideshare.pptx
 

Big Data in Oil and Gas

  • 1. 1 BIG DATA IN OIL & GAS BERT BEALS CHIEF TECHNOLOGIST – ENERGY INDUSTRIES BJORN ANDERSSON SOLUTIONS MARKETING DIRECTOR – ENERGY INDUSTRIES
  • 2. 2 DEFINING BIG DATA AND ANALYTICS  Data Volume ‒ Terabytes to Petabytes and beyond  Data Variety ‒ Many sources, structured data and more unstructured data  Data Velocity ‒ Streaming from sensors, generated secondary data  Value ‒ Derived business value ‒ Quicker and more accurate decisions © Hitachi Data Systems 2013
  • 3. 3 BUSINESS PROCESS DATABASE DATA HUMAN ENTERPRISE CONTENT, EXTERNAL SOURCES MACHINE SENSOR DATA, COMPLEX DATA SOURCES OF BIG DATA GROWTH THE DATA MULTIPLIER EFFECT More Data with More Complex Relationships…in Real Time and At Scale To manage, govern and analyze 1X 10X 100XOLTP EMAIL DOCUMENTS WEB LOGS SOCIAL SENSORS M2M LOG FILES RECORDING VIDEO SATELLITE IMAGING BIO- INFORMATICS VARIETY VOLUME VARIETY VOLUME VELOCITY VOLUME © Hitachi Data Systems 2013
  • 4. 4 BIG DATA – THE PROMISE The Hype  Turning data flood into transformative insight  Exploration without preconceived notions The Reality  Big Data application stack is complex  Data is highly fragmented  New skill sets  Difficult to know where to start SORTING THE REALITY FROM THE HYPE Unstructured Structured Semi-structured Video WebLogs HTML Clickstream Text Audio NoSQL Hadoop Machine Data Database Analytics Machine Learning Visualization ETL Business Process Model Stream Processing In Memory DB Connectors Virtualization Search FederationMPP MetaData Social Media Dark Data Real Time NAS How does Big Data help my Business? How much will it cost? What’s the ROI? How risky is it? When will I see results? © Hitachi Data Systems 2013
  • 5. BIG DATA DRIVING BIG INNOVATION TODAY Hitachi Transportation: Bullet Trains • Track/train sensors • Keep trains on schedule • Proactive maintenance • Telemetry from seismic sensors • Time series data • Operational data from sensors • Insight for fleet managers Hitachi Power: Power Stations Hitachi Construction: Excavators Hitachi, Ltd.: Tokyo Stock Exchange • High-speed index service • 1/100th faster © Hitachi Data Systems 2013
  • 6. 6 #1 INDUSTRY MEGA DRIVER – SIMPLY STATED: WE NEED MORE ENERGY INCREASE PRODUCTION AND KNOWN ENERGY RESERVES Dramatic increase in demand from emerging economies (non-OECD) Discover new reserves now: 75% of today’s oil was discovered before 1980 © ExxonMobil 2012© BP 2011 Sources: “2012 The Outlook for Energy: A View to 2040”, ExxonMobil 2012; and “BP Energy Outlook 2030”, BP 2011 © ExxonMobil 2012 © Hitachi Data Systems 2013
  • 7. 7 OIL&GAS REPRESENT THE MAJORITY OF THE ENERGY INDUSTRY  60% of Global Energy demand fulfilled by Oil&Gas ‒ Natural Gas is the fastest growing fuel source ©BP2011 Sources: “2012 The Outlook for Energy: A View to 2040”, ExxonMobil 2012; and “BP Energy Outlook 2030”, BP 2011 ©ExxonMobil2012 © Hitachi Data Systems 2013
  • 8. 8 MORE BIG DATA  More Volume ‒ New sensor and acquisition technology: Isometrix, WAZ ‒ More data being integrated: Drilling, Production  More Velocity ‒ Real time data from operations, sensors ‒ Streaming vs batch processing  More Variety ‒ Structured, Unstructured, semi-structured ‒ Complexity involving multiple disciplines  Potential Value ‒ Clearer view, better understanding by combining data sources ‒ Capitalizing on opportunities ‒ Lower risk for failures VOLUME, VELOCITY AND VARIETY © Hitachi Data Systems 2013
  • 9. BIG DATA IN ACTION IN OIL&GAS Exploration Production Refining Distribution Marketing and retail Geo-technical applications Resource planning Business intelligence Databases Office applications Seismic data Bore hole sensors Environmental sensors Weather data Production utilization Storage capacities Spot pricing (trading) Transportation Inventory levels Demand & forecast Location data Big Data Analysis = Value Business Decisions E&P Investments Inventory locations Production planning Safety © Hitachi Data Systems 2013
  • 10. • Growing data > 300 MB / Km2 early 90s > 25 GB / km2 in 2006 > Growing… to PBs / km2  Yesterday: 20 – 25,000 sensors, 500MB/s – 2GB/s, 50 – 200,000 shots, 50 – 200TB data  Now: Full 3D acquisition, 8GB/s – 20GB/s, 250TB – 1 PB  Tomorrow: 50GB/s Sources, Grid Computing Ahmar Abbas: 1 Luigi Salvador, High Performance Computing for the Oil and Gas Industry 2 ML Geovision www.alkorinternational.com VELOCITY – INGEST MORE DATA FASTER © Hitachi Data Systems 2013
  • 11. VOLUME - INSATIABLE APPETITE FOR INFORMATION  Technology as a competitive weapon ‒ Pushing technology boundaries ‒ Never resting, methods ready for anticipated technology advances  Big Data in use ‒ A different scale, PB file systems as caches ‒ Live in-feed from sensors from sites world wide IT STARTS WITH THE DATA, THEN IT NEEDS TO BE ANALYZED TO EXTRACT INFORMATION Source:HenriCalandra,JohnEtgen, ScottMorton–RiceUniversity Realtime drilling operation center, a fully integrated part of the Valhall drilling operations in Norway. © Hitachi Data Systems 2013
  • 12. VARIETY: FIND AND PRODUCE FASTER, SAFER, AND MORE EFFICIENTLY Upstream Oil&Gas:  Many interconnected, increasingly complex and rapidly changing workflows  Exponential growth in the volume of data  Computational demands increasing by orders of magnitude  Manage complexity and increase efficiency  Facilitate collaborative computing and secure access to data Increase efficiency and accelerate the TOTAL workflow Data Acquisition Visual Interpretation Modeling Automation SimulationSeismic Processing Property Modeling Data Management Petrophysical Analysis Increase Reserves - Capacity scaling, changing workloads © Hitachi Data Systems 2013
  • 13. UNIFIED STORAGE FOR UPSTREAM OIL AND GAS ORGANIZATIONS  Accelerated exploration with optimized file storage ‒ Highest per-node IOPs for unpredictable I/O ‒ Ideal for mixed workflows requiring performance for throughput-oriented and also for random data flows ‒ Easy scalability and high availability ‒ Open file system standards: ‒ CIFS, NFS, iSCSI, Lustre, Hadoop  One storage platform for E&P and the entire oil and gas enterprise ‒ Single architecture for file and block ‒ Comprehensive data management across technologies ‒ No compromise of performance versus control Structured Unstructured Technical Enterprise Unified Reduce Cost - Reduced complexity, higher efficiency © Hitachi Data Systems 2013