Tips & Tricks
Big Data in Oil and Gas
Like this presentation? Why not share!
Big data in Oil and Gas Industry
by Suvradeep Rudra
Big Data in Oil and Gas: How to Tap...
by Hitachi Data Systems
Big Data Analytics in Oil & Gas
Oil and gas big data analytics data...
Overview ppdm data_architecture_in_...
by Suvradeep Rudra,CSM
Business Analytics for the Oil & Ga...
by Stephen Sweeney
Email sent successfully!
Show related SlideShares at end
Big Data in Oil and Gas
Hitachi Data Systems
Sep 03, 2013
Presented by Bert Beals and Bjorn Andersson
Comment goes here.
12 hours ago
Are you sure you want to
Your message goes here
Be the first to comment
15 seconds ago
UNIX & Oracle Software Developer / Analyst
2 weeks ago
3 weeks ago
Jae Beom Park
7 months ago
7 months ago
Number of Embeds
No notes for slide
Big Data in Oil and Gas
1. 1 BIG DATA IN OIL & GAS BERT BEALS CHIEF TECHNOLOGIST – ENERGY INDUSTRIES BJORN ANDERSSON SOLUTIONS MARKETING DIRECTOR – ENERGY INDUSTRIES
2 DEFINING BIG DATA AND ANALYTICS Data Volume ‒ Terabytes to Petabytes and beyond Data Variety ‒ Many sources, structured data and more unstructured data Data Velocity ‒ Streaming from sensors, generated secondary data Value ‒ Derived business value ‒ Quicker and more accurate decisions © Hitachi Data Systems 2013
3 BUSINESS PROCESS DATABASE DATA HUMAN ENTERPRISE CONTENT, EXTERNAL SOURCES MACHINE SENSOR DATA, COMPLEX DATA SOURCES OF BIG DATA GROWTH THE DATA MULTIPLIER EFFECT More Data with More Complex Relationships…in Real Time and At Scale To manage, govern and analyze 1X 10X 100XOLTP EMAIL DOCUMENTS WEB LOGS SOCIAL SENSORS M2M LOG FILES RECORDING VIDEO SATELLITE IMAGING BIO- INFORMATICS VARIETY VOLUME VARIETY VOLUME VELOCITY VOLUME © Hitachi Data Systems 2013
4 BIG DATA – THE PROMISE The Hype Turning data flood into transformative insight Exploration without preconceived notions The Reality Big Data application stack is complex Data is highly fragmented New skill sets Difficult to know where to start SORTING THE REALITY FROM THE HYPE Unstructured Structured Semi-structured Video WebLogs HTML Clickstream Text Audio NoSQL Hadoop Machine Data Database Analytics Machine Learning Visualization ETL Business Process Model Stream Processing In Memory DB Connectors Virtualization Search FederationMPP MetaData Social Media Dark Data Real Time NAS How does Big Data help my Business? How much will it cost? What’s the ROI? How risky is it? When will I see results? © Hitachi Data Systems 2013
BIG DATA DRIVING BIG INNOVATION TODAY Hitachi Transportation: Bullet Trains • Track/train sensors • Keep trains on schedule • Proactive maintenance • Telemetry from seismic sensors • Time series data • Operational data from sensors • Insight for fleet managers Hitachi Power: Power Stations Hitachi Construction: Excavators Hitachi, Ltd.: Tokyo Stock Exchange • High-speed index service • 1/100th faster © Hitachi Data Systems 2013
6 #1 INDUSTRY MEGA DRIVER – SIMPLY STATED: WE NEED MORE ENERGY INCREASE PRODUCTION AND KNOWN ENERGY RESERVES Dramatic increase in demand from emerging economies (non-OECD) Discover new reserves now: 75% of today’s oil was discovered before 1980 © ExxonMobil 2012© BP 2011 Sources: “2012 The Outlook for Energy: A View to 2040”, ExxonMobil 2012; and “BP Energy Outlook 2030”, BP 2011 © ExxonMobil 2012 © Hitachi Data Systems 2013
7 OIL&GAS REPRESENT THE MAJORITY OF THE ENERGY INDUSTRY 60% of Global Energy demand fulfilled by Oil&Gas ‒ Natural Gas is the fastest growing fuel source ©BP2011 Sources: “2012 The Outlook for Energy: A View to 2040”, ExxonMobil 2012; and “BP Energy Outlook 2030”, BP 2011 ©ExxonMobil2012 © Hitachi Data Systems 2013
8 MORE BIG DATA More Volume ‒ New sensor and acquisition technology: Isometrix, WAZ ‒ More data being integrated: Drilling, Production More Velocity ‒ Real time data from operations, sensors ‒ Streaming vs batch processing More Variety ‒ Structured, Unstructured, semi-structured ‒ Complexity involving multiple disciplines Potential Value ‒ Clearer view, better understanding by combining data sources ‒ Capitalizing on opportunities ‒ Lower risk for failures VOLUME, VELOCITY AND VARIETY © Hitachi Data Systems 2013
BIG DATA IN ACTION IN OIL&GAS Exploration Production Refining Distribution Marketing and retail Geo-technical applications Resource planning Business intelligence Databases Office applications Seismic data Bore hole sensors Environmental sensors Weather data Production utilization Storage capacities Spot pricing (trading) Transportation Inventory levels Demand & forecast Location data Big Data Analysis = Value Business Decisions E&P Investments Inventory locations Production planning Safety © Hitachi Data Systems 2013
• Growing data > 300 MB / Km2 early 90s > 25 GB / km2 in 2006 > Growing… to PBs / km2 Yesterday: 20 – 25,000 sensors, 500MB/s – 2GB/s, 50 – 200,000 shots, 50 – 200TB data Now: Full 3D acquisition, 8GB/s – 20GB/s, 250TB – 1 PB Tomorrow: 50GB/s Sources, Grid Computing Ahmar Abbas: 1 Luigi Salvador, High Performance Computing for the Oil and Gas Industry 2 ML Geovision www.alkorinternational.com VELOCITY – INGEST MORE DATA FASTER © Hitachi Data Systems 2013
VOLUME - INSATIABLE APPETITE FOR INFORMATION Technology as a competitive weapon ‒ Pushing technology boundaries ‒ Never resting, methods ready for anticipated technology advances Big Data in use ‒ A different scale, PB file systems as caches ‒ Live in-feed from sensors from sites world wide IT STARTS WITH THE DATA, THEN IT NEEDS TO BE ANALYZED TO EXTRACT INFORMATION Source:HenriCalandra,JohnEtgen, ScottMorton–RiceUniversity Realtime drilling operation center, a fully integrated part of the Valhall drilling operations in Norway. © Hitachi Data Systems 2013
VARIETY: FIND AND PRODUCE FASTER, SAFER, AND MORE EFFICIENTLY Upstream Oil&Gas: Many interconnected, increasingly complex and rapidly changing workflows Exponential growth in the volume of data Computational demands increasing by orders of magnitude Manage complexity and increase efficiency Facilitate collaborative computing and secure access to data Increase efficiency and accelerate the TOTAL workflow Data Acquisition Visual Interpretation Modeling Automation SimulationSeismic Processing Property Modeling Data Management Petrophysical Analysis Increase Reserves - Capacity scaling, changing workloads © Hitachi Data Systems 2013
UNIFIED STORAGE FOR UPSTREAM OIL AND GAS ORGANIZATIONS Accelerated exploration with optimized file storage ‒ Highest per-node IOPs for unpredictable I/O ‒ Ideal for mixed workflows requiring performance for throughput-oriented and also for random data flows ‒ Easy scalability and high availability ‒ Open file system standards: ‒ CIFS, NFS, iSCSI, Lustre, Hadoop One storage platform for E&P and the entire oil and gas enterprise ‒ Single architecture for file and block ‒ Comprehensive data management across technologies ‒ No compromise of performance versus control Structured Unstructured Technical Enterprise Unified Reduce Cost - Reduced complexity, higher efficiency © Hitachi Data Systems 2013
Email sent successfully..