SlideShare a Scribd company logo
Petrophysics and Big Data
Presented at Annual SPWLA show in Houston, TX
Dec. 6, 2016
Presentation Overview
 Part 1
– Cloud and Big Data in Petrophysics
 Part 2
– How we teach this at Elephant Scale
Copyright © 2016 Elephant Scale. All rights reserved. 2
Motivation
 Born out of last meeting of SPWLA in 2015
 In cooperation with Antaeus
 Chapter in “Guide to Big Data Applications” published Q1 of 2017
Copyright © 2016 Elephant Scale. All rights reserved. 3
Cloud and Big Data in Petrophysics
Cloud and Big Data in Petrophysics
How we teach Big Data at Elephant Scale
(c) ElephantScale.com 2016. All rights reserved. 5
Data as oil replacement?
Challenges of technologies and Big Data
 Technology is becoming a differentiator
 Data is becoming a differentiator
 O&G needs an overhaul
 ”If it ain’t broke don’t fix it” – may not work anymore
6Copyright © 2016 Elephant Scale. All rights reserved.
Predictions (for what they are worth  )
 Oil and oil-service companies will become
– more of technology companies
 Companies like Antaeus will show the way
– (Pierre Jean is my good friend)
 Knowledge and learning are paramount
– (We do the teaching/training)
7Copyright © 2016 Elephant Scale. All rights reserved.
Terms and pre-requisites
 Big Data
– More than can be stored on on computer
– But also 3V (Volume, Variety, Velocity)
 Cloud
– NOT delivery through internet
– YES – computing resources with unlimited scalability
– Better name: elastic cloud (Price, Performance, Security)
 Browser delivery
– Ubiquitous, but not in O&G (Standard UI, Security)
 O&G specific
– Wi-Fi may be unavailable/intermittent/sub-par
8Copyright © 2016 Elephant Scale. All rights reserved.
Advantages
 Unlimited, centralized storage
 Modern technologies
– Not seen in O&G but well developed at Google, Facebook, etc.
 Machine Learning as the killer app for Big Data
 Why did AI fail for O&G in the 1980’s?
– Technology not deep enough
– Outside consultants not knowledgeable in O&G
 This should change through education
– Side benefit – next slide
9Copyright © 2016 Elephant Scale. All rights reserved.
Side benefit of AI – being popular at parties
10(c) ElephantScale.com 2016. All rights reserved.
What’s going on in Houston
11Copyright © 2016 Elephant Scale. All rights reserved.
How we teach Big Data at Elephant Scale
Cloud and Big Data in Petrophysics
How we teach Big Data at Elephant Scale
What’s there to learn?
1. How to store your data for archiving
2. How to use the data in real-time
3. How to learn from your data
4. What is deep learning
5. How to do it better in the cloud
13Copyright © 2016 Elephant Scale. All rights reserved.
How to store your data
 Hadoop
– Storage
– Processing
– Ecosystem
• Hive, Pig, etc.
 Benefits
– Centralized storage
– Perfect online archiving
 Courses for
– Developers
– Administrators
– Business analysts
– Architects
14Copyright © 2016 Elephant Scale. All rights reserved.
How to process your data in real-time
 NoSQL
– Scalable to billions of rows and millions of columns
– Good for incomplete real-world data
– Extremely fast reads and writes without lockups
 Benefit
– Perfect log/header store
– Flexible data format
 Courses
– Developers/admins
– NoSQL data modelers
15Copyright © 2016 Elephant Scale. All rights reserved.
How to learn from your data
 Machine learning tools
16Copyright © 2016 Elephant Scale. All rights reserved.
Machine learning and AI
 Machine Learning "is an algorithm that learns from data"
 Usually improves its performance with more data.
 Uses statistical / mathematical techniques to build a model
from observed data rather than relying on explicit instructions
 “More data usually beats better algorithms”
– Anant Rajaraman said it first (?)
• Amazon Retail Platform (25% US transactions)
• WalmartLabs/Kosmix
• Etc.
17
 What is deep learning?
– Neural networks with more than one hidden layer
 Rebranded neural net with some twists 
 Reemerging due to cluster computing and GPU
 Steps towards Artificial Intelligence (AI)
 Examples (all world titles)
– Facebook Deep Face
– Google Translate
– Google DeepMind playing GO game
– IBM Deep Blue winning Jeopardy
Latest: Deep Learning
18
(c)
Elephant
Scale.co
m 2016.
All
rights
reserved
 Modeled loosely after the human brain
 Designed to recognize patterns
 Input comes from sensory data
– machine perception
– labeling
– clustering raw input
 Recognized patterns
– Numerical
– Contained in vectors
– Translated from real-world data
Images, Sound, Text, Time series
 Popular in 80s
 Fell out of favor in 90s in 2000s as statistical based methods
yielded better results
 Came back with a vengeance
Neural Networks
19
Deep neural network
20
(c)
Elephant
Scale.co
m 2016.
All
rights
reserved
Our publications
 Hadoop illuminated book
 HBase Design Patterns book
 O’Reilly Data Analytics course
(c) ElephantScale.com 2016. All rights reserved. 21
Our credentials
22Copyright © 2016 Elephant Scale. All rights reserved.
• Thousands of students
• Dozens of clients/channels
• A large variety of course
• Experts who do and teach
Our courses (www.elephantscale.com)
23Copyright © 2016 Elephant Scale. All rights reserved.

More Related Content

Viewers also liked

MICP QC & Interpretation Workflow
MICP QC & Interpretation WorkflowMICP QC & Interpretation Workflow
MICP QC & Interpretation Workflow
Jules Reed
 
Operationalizing Big Data to Reduce Risk of High Consequence Decisions in Com...
Operationalizing Big Data to Reduce Risk of High Consequence Decisions in Com...Operationalizing Big Data to Reduce Risk of High Consequence Decisions in Com...
Operationalizing Big Data to Reduce Risk of High Consequence Decisions in Com...
OAG Analytics
 
Integrated petrophysical parameters and petrographic analysis characterizing ...
Integrated petrophysical parameters and petrographic analysis characterizing ...Integrated petrophysical parameters and petrographic analysis characterizing ...
Integrated petrophysical parameters and petrographic analysis characterizing ...
Khalid Al-Khidir
 
Petrophysics More Important Than Ever
Petrophysics   More Important Than EverPetrophysics   More Important Than Ever
Petrophysics More Important Than Ever
Graham Davis
 
Session 1 log-analysis
Session 1 log-analysisSession 1 log-analysis
Session 1 log-analysis
abdelrahman2012
 
Basic well log interpretation
Basic well log interpretationBasic well log interpretation
Basic well log interpretationShahnawaz Mustafa
 
Determinstic petrophysics factsheet 2017
Determinstic petrophysics factsheet 2017Determinstic petrophysics factsheet 2017
Determinstic petrophysics factsheet 2017
Jurgis 'Jogi' Klaudius
 
MICP QC & Interpretation Workflow
MICP QC & Interpretation WorkflowMICP QC & Interpretation Workflow
MICP QC & Interpretation Workflow
Jules Reed
 
U5. El turismo, ocio y entretenimiento
U5. El turismo, ocio y entretenimientoU5. El turismo, ocio y entretenimiento
U5. El turismo, ocio y entretenimiento
Iván Heredia Urzáiz
 
SPWLA-2015-GGGG
SPWLA-2015-GGGGSPWLA-2015-GGGG
SPWLA-2015-GGGGRamy Essam
 
Overview of Experimental works conducted in this work
Overview of Experimental works conducted in this workOverview of Experimental works conducted in this work
Overview of Experimental works conducted in this work
mohull
 
BE&GG, Agnis Noviani Noor, Hapzi Ali, Business Ethics & Good Governance ; Ph...
BE&GG, Agnis Noviani Noor, Hapzi Ali, Business Ethics & Good Governance  ; Ph...BE&GG, Agnis Noviani Noor, Hapzi Ali, Business Ethics & Good Governance  ; Ph...
BE&GG, Agnis Noviani Noor, Hapzi Ali, Business Ethics & Good Governance ; Ph...
Agnis Noviani Noor
 
Lecture 23 april29 static correction
Lecture 23 april29 static correctionLecture 23 april29 static correction
Lecture 23 april29 static correction
Amin khalil
 
E&P data management: Implementing data standards
E&P data management: Implementing data standardsE&P data management: Implementing data standards
E&P data management: Implementing data standards
ETLSolutions
 
A 5-step methodology for complex E&P data management
A 5-step methodology for complex E&P data managementA 5-step methodology for complex E&P data management
A 5-step methodology for complex E&P data management
ETLSolutions
 
Top 10 Data Science Practitioner Pitfalls
Top 10 Data Science Practitioner PitfallsTop 10 Data Science Practitioner Pitfalls
Top 10 Data Science Practitioner Pitfalls
Sri Ambati
 
Satelites Artificiales
Satelites ArtificialesSatelites Artificiales
Satelites Artificiales
Santiago Calero Pedrín
 
WesternGeco presentation - Seismic Data Processing
WesternGeco presentation - Seismic Data ProcessingWesternGeco presentation - Seismic Data Processing
WesternGeco presentation - Seismic Data Processing
Hatem Radwan
 
Правила дорожные знать каждому положено
Правила дорожные знать каждому положеноПравила дорожные знать каждому положено
Правила дорожные знать каждому положено
Anastasia Simonova
 

Viewers also liked (20)

Basic Petrophysics
Basic PetrophysicsBasic Petrophysics
Basic Petrophysics
 
MICP QC & Interpretation Workflow
MICP QC & Interpretation WorkflowMICP QC & Interpretation Workflow
MICP QC & Interpretation Workflow
 
Operationalizing Big Data to Reduce Risk of High Consequence Decisions in Com...
Operationalizing Big Data to Reduce Risk of High Consequence Decisions in Com...Operationalizing Big Data to Reduce Risk of High Consequence Decisions in Com...
Operationalizing Big Data to Reduce Risk of High Consequence Decisions in Com...
 
Integrated petrophysical parameters and petrographic analysis characterizing ...
Integrated petrophysical parameters and petrographic analysis characterizing ...Integrated petrophysical parameters and petrographic analysis characterizing ...
Integrated petrophysical parameters and petrographic analysis characterizing ...
 
Petrophysics More Important Than Ever
Petrophysics   More Important Than EverPetrophysics   More Important Than Ever
Petrophysics More Important Than Ever
 
Session 1 log-analysis
Session 1 log-analysisSession 1 log-analysis
Session 1 log-analysis
 
Basic well log interpretation
Basic well log interpretationBasic well log interpretation
Basic well log interpretation
 
Determinstic petrophysics factsheet 2017
Determinstic petrophysics factsheet 2017Determinstic petrophysics factsheet 2017
Determinstic petrophysics factsheet 2017
 
MICP QC & Interpretation Workflow
MICP QC & Interpretation WorkflowMICP QC & Interpretation Workflow
MICP QC & Interpretation Workflow
 
U5. El turismo, ocio y entretenimiento
U5. El turismo, ocio y entretenimientoU5. El turismo, ocio y entretenimiento
U5. El turismo, ocio y entretenimiento
 
SPWLA-2015-GGGG
SPWLA-2015-GGGGSPWLA-2015-GGGG
SPWLA-2015-GGGG
 
Overview of Experimental works conducted in this work
Overview of Experimental works conducted in this workOverview of Experimental works conducted in this work
Overview of Experimental works conducted in this work
 
BE&GG, Agnis Noviani Noor, Hapzi Ali, Business Ethics & Good Governance ; Ph...
BE&GG, Agnis Noviani Noor, Hapzi Ali, Business Ethics & Good Governance  ; Ph...BE&GG, Agnis Noviani Noor, Hapzi Ali, Business Ethics & Good Governance  ; Ph...
BE&GG, Agnis Noviani Noor, Hapzi Ali, Business Ethics & Good Governance ; Ph...
 
Lecture 23 april29 static correction
Lecture 23 april29 static correctionLecture 23 april29 static correction
Lecture 23 april29 static correction
 
E&P data management: Implementing data standards
E&P data management: Implementing data standardsE&P data management: Implementing data standards
E&P data management: Implementing data standards
 
A 5-step methodology for complex E&P data management
A 5-step methodology for complex E&P data managementA 5-step methodology for complex E&P data management
A 5-step methodology for complex E&P data management
 
Top 10 Data Science Practitioner Pitfalls
Top 10 Data Science Practitioner PitfallsTop 10 Data Science Practitioner Pitfalls
Top 10 Data Science Practitioner Pitfalls
 
Satelites Artificiales
Satelites ArtificialesSatelites Artificiales
Satelites Artificiales
 
WesternGeco presentation - Seismic Data Processing
WesternGeco presentation - Seismic Data ProcessingWesternGeco presentation - Seismic Data Processing
WesternGeco presentation - Seismic Data Processing
 
Правила дорожные знать каждому положено
Правила дорожные знать каждому положеноПравила дорожные знать каждому положено
Правила дорожные знать каждому положено
 

Similar to Petrophysics and Big Data by Elephant Scale training and consultin

Designing the Next Generation Data Lake
Designing the Next Generation Data LakeDesigning the Next Generation Data Lake
Designing the Next Generation Data Lake
Robert Chong
 
Northwestern 20181004 v9
Northwestern 20181004 v9Northwestern 20181004 v9
Northwestern 20181004 v9
ISSIP
 
Machine Learning on Big Data with HADOOP
Machine Learning on Big Data with HADOOPMachine Learning on Big Data with HADOOP
Machine Learning on Big Data with HADOOP
EPAM Systems
 
Intel 20180608 v2
Intel 20180608 v2Intel 20180608 v2
Intel 20180608 v2
ISSIP
 
Future of ai 20190612 v1
Future of ai 20190612 v1Future of ai 20190612 v1
Future of ai 20190612 v1
ISSIP
 
Big Data - A Real Life Revolution
Big Data - A Real Life RevolutionBig Data - A Real Life Revolution
Big Data - A Real Life Revolution
Capgemini
 
What you need to know to start an AI company?
What you need to know to start an AI company?What you need to know to start an AI company?
What you need to know to start an AI company?
Mo Patel
 
IBM Big Data Analytics Concepts and Use Cases
IBM Big Data Analytics Concepts and Use CasesIBM Big Data Analytics Concepts and Use Cases
IBM Big Data Analytics Concepts and Use Cases
Tony Pearson
 
DataRobot - 머신러닝 자동화 플랫폼
DataRobot - 머신러닝 자동화 플랫폼DataRobot - 머신러닝 자동화 플랫폼
DataRobot - 머신러닝 자동화 플랫폼
Sutaek Kim
 
Smart Data - The Foundation for Better Business Outcomes
Smart Data - The Foundation for Better Business OutcomesSmart Data - The Foundation for Better Business Outcomes
Smart Data - The Foundation for Better Business Outcomes
DATAVERSITY
 
Introducing Gradient
Introducing Gradient Introducing Gradient
Introducing Gradient
Remco Frijling
 
2018-11-05 Intro to AI
2018-11-05 Intro to AI2018-11-05 Intro to AI
2018-11-05 Intro to AI
Jeff Boleman, M.S.C.S.
 
The future of FinTech product using pervasive Machine Learning automation - A...
The future of FinTech product using pervasive Machine Learning automation - A...The future of FinTech product using pervasive Machine Learning automation - A...
The future of FinTech product using pervasive Machine Learning automation - A...
Shift Conference
 
Denmark future of ai 20180927 v8
Denmark future of ai 20180927 v8Denmark future of ai 20180927 v8
Denmark future of ai 20180927 v8
ISSIP
 
Ypo 20190131 v1
Ypo 20190131 v1 Ypo 20190131 v1
Ypo 20190131 v1
ISSIP
 
Introduction to Machine Learning on Mobile: Mobile Week SF
Introduction to Machine Learning on Mobile: Mobile Week SFIntroduction to Machine Learning on Mobile: Mobile Week SF
Introduction to Machine Learning on Mobile: Mobile Week SF
Amazon Web Services
 
New way to learn Machine Learning with AWS DeepLens & Daniel ZivKovic
New way to learn Machine Learning with AWS DeepLens & Daniel ZivKovicNew way to learn Machine Learning with AWS DeepLens & Daniel ZivKovic
New way to learn Machine Learning with AWS DeepLens & Daniel ZivKovic
Daniel Zivkovic
 
Fraunhofer IVV - Industrie 4.0 - Revolution durch maschinelles lernen - 180924
Fraunhofer IVV - Industrie 4.0 - Revolution durch maschinelles lernen - 180924Fraunhofer IVV - Industrie 4.0 - Revolution durch maschinelles lernen - 180924
Fraunhofer IVV - Industrie 4.0 - Revolution durch maschinelles lernen - 180924
Peter Seeberg
 
Solve for X with AI: a VC view of the Machine Learning & AI landscape
Solve for X with AI: a VC view of the Machine Learning & AI landscapeSolve for X with AI: a VC view of the Machine Learning & AI landscape
Solve for X with AI: a VC view of the Machine Learning & AI landscape
Ed Fernandez
 
End To End Machine Learning With Google Cloud
End To End Machine Learning With Google Cloud End To End Machine Learning With Google Cloud
End To End Machine Learning With Google Cloud
Tu Pham
 

Similar to Petrophysics and Big Data by Elephant Scale training and consultin (20)

Designing the Next Generation Data Lake
Designing the Next Generation Data LakeDesigning the Next Generation Data Lake
Designing the Next Generation Data Lake
 
Northwestern 20181004 v9
Northwestern 20181004 v9Northwestern 20181004 v9
Northwestern 20181004 v9
 
Machine Learning on Big Data with HADOOP
Machine Learning on Big Data with HADOOPMachine Learning on Big Data with HADOOP
Machine Learning on Big Data with HADOOP
 
Intel 20180608 v2
Intel 20180608 v2Intel 20180608 v2
Intel 20180608 v2
 
Future of ai 20190612 v1
Future of ai 20190612 v1Future of ai 20190612 v1
Future of ai 20190612 v1
 
Big Data - A Real Life Revolution
Big Data - A Real Life RevolutionBig Data - A Real Life Revolution
Big Data - A Real Life Revolution
 
What you need to know to start an AI company?
What you need to know to start an AI company?What you need to know to start an AI company?
What you need to know to start an AI company?
 
IBM Big Data Analytics Concepts and Use Cases
IBM Big Data Analytics Concepts and Use CasesIBM Big Data Analytics Concepts and Use Cases
IBM Big Data Analytics Concepts and Use Cases
 
DataRobot - 머신러닝 자동화 플랫폼
DataRobot - 머신러닝 자동화 플랫폼DataRobot - 머신러닝 자동화 플랫폼
DataRobot - 머신러닝 자동화 플랫폼
 
Smart Data - The Foundation for Better Business Outcomes
Smart Data - The Foundation for Better Business OutcomesSmart Data - The Foundation for Better Business Outcomes
Smart Data - The Foundation for Better Business Outcomes
 
Introducing Gradient
Introducing Gradient Introducing Gradient
Introducing Gradient
 
2018-11-05 Intro to AI
2018-11-05 Intro to AI2018-11-05 Intro to AI
2018-11-05 Intro to AI
 
The future of FinTech product using pervasive Machine Learning automation - A...
The future of FinTech product using pervasive Machine Learning automation - A...The future of FinTech product using pervasive Machine Learning automation - A...
The future of FinTech product using pervasive Machine Learning automation - A...
 
Denmark future of ai 20180927 v8
Denmark future of ai 20180927 v8Denmark future of ai 20180927 v8
Denmark future of ai 20180927 v8
 
Ypo 20190131 v1
Ypo 20190131 v1 Ypo 20190131 v1
Ypo 20190131 v1
 
Introduction to Machine Learning on Mobile: Mobile Week SF
Introduction to Machine Learning on Mobile: Mobile Week SFIntroduction to Machine Learning on Mobile: Mobile Week SF
Introduction to Machine Learning on Mobile: Mobile Week SF
 
New way to learn Machine Learning with AWS DeepLens & Daniel ZivKovic
New way to learn Machine Learning with AWS DeepLens & Daniel ZivKovicNew way to learn Machine Learning with AWS DeepLens & Daniel ZivKovic
New way to learn Machine Learning with AWS DeepLens & Daniel ZivKovic
 
Fraunhofer IVV - Industrie 4.0 - Revolution durch maschinelles lernen - 180924
Fraunhofer IVV - Industrie 4.0 - Revolution durch maschinelles lernen - 180924Fraunhofer IVV - Industrie 4.0 - Revolution durch maschinelles lernen - 180924
Fraunhofer IVV - Industrie 4.0 - Revolution durch maschinelles lernen - 180924
 
Solve for X with AI: a VC view of the Machine Learning & AI landscape
Solve for X with AI: a VC view of the Machine Learning & AI landscapeSolve for X with AI: a VC view of the Machine Learning & AI landscape
Solve for X with AI: a VC view of the Machine Learning & AI landscape
 
End To End Machine Learning With Google Cloud
End To End Machine Learning With Google Cloud End To End Machine Learning With Google Cloud
End To End Machine Learning With Google Cloud
 

More from elephantscale

AI for Kids
AI for KidsAI for Kids
AI for Kids
elephantscale
 
How to obtain the Cloudera Data Engineer Certification
How to obtain the Cloudera Data Engineer CertificationHow to obtain the Cloudera Data Engineer Certification
How to obtain the Cloudera Data Engineer Certification
elephantscale
 
Building a Big Data Team
Building a Big Data TeamBuilding a Big Data Team
Building a Big Data Team
elephantscale
 
Changing the game with cloud dw
Changing the game with cloud dwChanging the game with cloud dw
Changing the game with cloud dw
elephantscale
 
Oil & Gas Big Data use cases
Oil & Gas Big Data use casesOil & Gas Big Data use cases
Oil & Gas Big Data use cases
elephantscale
 
Machine Learning with Spark
Machine Learning with SparkMachine Learning with Spark
Machine Learning with Spark
elephantscale
 
Reference architecture for Internet Of Things
Reference architecture for Internet Of ThingsReference architecture for Internet Of Things
Reference architecture for Internet Of Things
elephantscale
 
Hadoop to spark_v2
Hadoop to spark_v2Hadoop to spark_v2
Hadoop to spark_v2
elephantscale
 

More from elephantscale (8)

AI for Kids
AI for KidsAI for Kids
AI for Kids
 
How to obtain the Cloudera Data Engineer Certification
How to obtain the Cloudera Data Engineer CertificationHow to obtain the Cloudera Data Engineer Certification
How to obtain the Cloudera Data Engineer Certification
 
Building a Big Data Team
Building a Big Data TeamBuilding a Big Data Team
Building a Big Data Team
 
Changing the game with cloud dw
Changing the game with cloud dwChanging the game with cloud dw
Changing the game with cloud dw
 
Oil & Gas Big Data use cases
Oil & Gas Big Data use casesOil & Gas Big Data use cases
Oil & Gas Big Data use cases
 
Machine Learning with Spark
Machine Learning with SparkMachine Learning with Spark
Machine Learning with Spark
 
Reference architecture for Internet Of Things
Reference architecture for Internet Of ThingsReference architecture for Internet Of Things
Reference architecture for Internet Of Things
 
Hadoop to spark_v2
Hadoop to spark_v2Hadoop to spark_v2
Hadoop to spark_v2
 

Recently uploaded

When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
Thijs Feryn
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
Paul Groth
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
Elena Simperl
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
DianaGray10
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Product School
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
ODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User Group
CatarinaPereira64715
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
DianaGray10
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Inflectra
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Jeffrey Haguewood
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Product School
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Ramesh Iyer
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
Frank van Harmelen
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
91mobiles
 

Recently uploaded (20)

When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
ODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User Group
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 

Petrophysics and Big Data by Elephant Scale training and consultin

  • 1. Petrophysics and Big Data Presented at Annual SPWLA show in Houston, TX Dec. 6, 2016
  • 2. Presentation Overview  Part 1 – Cloud and Big Data in Petrophysics  Part 2 – How we teach this at Elephant Scale Copyright © 2016 Elephant Scale. All rights reserved. 2
  • 3. Motivation  Born out of last meeting of SPWLA in 2015  In cooperation with Antaeus  Chapter in “Guide to Big Data Applications” published Q1 of 2017 Copyright © 2016 Elephant Scale. All rights reserved. 3
  • 4. Cloud and Big Data in Petrophysics Cloud and Big Data in Petrophysics How we teach Big Data at Elephant Scale
  • 5. (c) ElephantScale.com 2016. All rights reserved. 5 Data as oil replacement?
  • 6. Challenges of technologies and Big Data  Technology is becoming a differentiator  Data is becoming a differentiator  O&G needs an overhaul  ”If it ain’t broke don’t fix it” – may not work anymore 6Copyright © 2016 Elephant Scale. All rights reserved.
  • 7. Predictions (for what they are worth  )  Oil and oil-service companies will become – more of technology companies  Companies like Antaeus will show the way – (Pierre Jean is my good friend)  Knowledge and learning are paramount – (We do the teaching/training) 7Copyright © 2016 Elephant Scale. All rights reserved.
  • 8. Terms and pre-requisites  Big Data – More than can be stored on on computer – But also 3V (Volume, Variety, Velocity)  Cloud – NOT delivery through internet – YES – computing resources with unlimited scalability – Better name: elastic cloud (Price, Performance, Security)  Browser delivery – Ubiquitous, but not in O&G (Standard UI, Security)  O&G specific – Wi-Fi may be unavailable/intermittent/sub-par 8Copyright © 2016 Elephant Scale. All rights reserved.
  • 9. Advantages  Unlimited, centralized storage  Modern technologies – Not seen in O&G but well developed at Google, Facebook, etc.  Machine Learning as the killer app for Big Data  Why did AI fail for O&G in the 1980’s? – Technology not deep enough – Outside consultants not knowledgeable in O&G  This should change through education – Side benefit – next slide 9Copyright © 2016 Elephant Scale. All rights reserved.
  • 10. Side benefit of AI – being popular at parties 10(c) ElephantScale.com 2016. All rights reserved.
  • 11. What’s going on in Houston 11Copyright © 2016 Elephant Scale. All rights reserved.
  • 12. How we teach Big Data at Elephant Scale Cloud and Big Data in Petrophysics How we teach Big Data at Elephant Scale
  • 13. What’s there to learn? 1. How to store your data for archiving 2. How to use the data in real-time 3. How to learn from your data 4. What is deep learning 5. How to do it better in the cloud 13Copyright © 2016 Elephant Scale. All rights reserved.
  • 14. How to store your data  Hadoop – Storage – Processing – Ecosystem • Hive, Pig, etc.  Benefits – Centralized storage – Perfect online archiving  Courses for – Developers – Administrators – Business analysts – Architects 14Copyright © 2016 Elephant Scale. All rights reserved.
  • 15. How to process your data in real-time  NoSQL – Scalable to billions of rows and millions of columns – Good for incomplete real-world data – Extremely fast reads and writes without lockups  Benefit – Perfect log/header store – Flexible data format  Courses – Developers/admins – NoSQL data modelers 15Copyright © 2016 Elephant Scale. All rights reserved.
  • 16. How to learn from your data  Machine learning tools 16Copyright © 2016 Elephant Scale. All rights reserved.
  • 17. Machine learning and AI  Machine Learning "is an algorithm that learns from data"  Usually improves its performance with more data.  Uses statistical / mathematical techniques to build a model from observed data rather than relying on explicit instructions  “More data usually beats better algorithms” – Anant Rajaraman said it first (?) • Amazon Retail Platform (25% US transactions) • WalmartLabs/Kosmix • Etc. 17
  • 18.  What is deep learning? – Neural networks with more than one hidden layer  Rebranded neural net with some twists   Reemerging due to cluster computing and GPU  Steps towards Artificial Intelligence (AI)  Examples (all world titles) – Facebook Deep Face – Google Translate – Google DeepMind playing GO game – IBM Deep Blue winning Jeopardy Latest: Deep Learning 18 (c) Elephant Scale.co m 2016. All rights reserved
  • 19.  Modeled loosely after the human brain  Designed to recognize patterns  Input comes from sensory data – machine perception – labeling – clustering raw input  Recognized patterns – Numerical – Contained in vectors – Translated from real-world data Images, Sound, Text, Time series  Popular in 80s  Fell out of favor in 90s in 2000s as statistical based methods yielded better results  Came back with a vengeance Neural Networks 19
  • 21. Our publications  Hadoop illuminated book  HBase Design Patterns book  O’Reilly Data Analytics course (c) ElephantScale.com 2016. All rights reserved. 21
  • 22. Our credentials 22Copyright © 2016 Elephant Scale. All rights reserved. • Thousands of students • Dozens of clients/channels • A large variety of course • Experts who do and teach
  • 23. Our courses (www.elephantscale.com) 23Copyright © 2016 Elephant Scale. All rights reserved.

Editor's Notes

  1. 1
  2. 2
  3. 3
  4. 4
  5. 12
  6. 17
  7. https://www.quora.com/What-is-the-difference-between-deep-learning-and-usual-machine-learning https://www.wired.com/2016/06/deep-learning-isnt-dangerous-magic-genie-just-math/ https://en.wikipedia.org/wiki/AlphaGo Image: https://en.wikipedia.org/wiki/Go_(game)#/media/File:FloorGoban.JPG
  8. 21