SlideShare a Scribd company logo
Our big data lake strategy
will deliver digital insights
using cloud technology
Today, lots of companies are releasing press releases saying things like this.
Dear data
Tell me what to do
However, they might be secretly hoping for something more like this.
“Don’t give me facts to think through. Don’t give me options. Just tell me my next best
action.”
? ? ? ? ?
? ? ? ? ?
? ? ? ? ?
? ? ? ? ?
? ? ? ? ?
Tell me what to dos Data Scientists
Eek!
These expectations are likely to be dashed, because of the imbalance between the
number of questions we hope will be automagically answered, and the number of
data scientists we have, who can combine business knowledge with an understanding
of what our data can and can’t do.
Market & operational knowledge
drove
business process
which created
data
Old model : data as by-product
As we’ve moved from this model ...
Data
drives
market and operational decisions
which creates
business processes
New model : data as oracle
… to this model (aka being ‘data driven’) ...
Market and operational
knowledge
Data (internal and
external)
Business
process
Insight
Business Case
Business Case
… we’ve struggled to find a middle ground that’s combines knowledge and data to
improve or create business processes - and the results are measured to support
doing more (or less) of something.
Human
capital
Analytic
models
Business
process
Insight
Business Case
Business Case
If we flip the terms here, it becomes clearer that there are things that are known to the
business but not the data, and vice versa.
Where insight is operationalised
To the
business
Known
Human
capital
Human
capital +
Analytic
models
Unknown
Analytic
models
Unknown Known
To the data
Most of the excitement we hear in the data analytics world is about the opportunities
in the bottom right square in this quadrant.
Insight opportunities
To the
business
Known
Knowledge,
ideas,
dogma, etc
Validation
Optimisation
Prediction
Unknown
Ideas and
data not yet
created /
realised
Answers
waiting to
be found
Unknown Known
To the data
The idea of the next big discovery is why lots of firms fund exploratory data science
safaris in the hope of uncovering hidden value.
Validation Do or do not
Optimisation Make ‘doing’ better
Prediction What may happen
Insight opportunities
But there are plenty of opportunities on more solid ground, which we shouldn’t ignore.
Opportunity cost
Advantage from insight
Costofinsight
No
thanks
Yes
please
Not only are we likely to find that they’re cheaper to obtain, and more valuable in the
long run.
Opportunity cost
Advantage from insight
Costofinsight Unavoidably
inevitable
But also, they’re less prone to involve high costs over long periods of time, which is
the equivalent of betting everything on 21, spinning the roulette wheel and only
getting lucky occasionally.
Optimisation example
To the
business
Known
Combine
this ...
… with
this ...
Unknown
… to explore
this.
Unknown Known
To the data
Maybe, (just maybe) there’s a path to extract ‘value waiting to happen’ from data in a
safer way than ‘big bang’ gambles.
Optimisation example
To the
business
Known
We have X
people ...
… achieving
this.
Unknown
How could
we add
more value
in less time?
Unknown Known
To the data
Which can also give us a chance at unlocking the value that ‘big data analytics’
marketing is promising.
A structure for insight
Question ?
Missions
Result
Action Action
Situation Situation Situation
Recipes
--- --- --- --- --- --- --- --- ---
--- --- --- --- --- ---
--- --- ---
Run books
Here’s what that model may look like.
We start with a high value question.
Then we’ll structure a set of missions that think through business knowledge and data
components of a question. For example, if we’re looking for ‘prediction’ … what’s our
situation; what actions could we take to change it; then what result(s) would that lead
to?
By formalising our approach to solving this problem, we set up a relationship between
a mission and the relevant data, models and techniques used to complete it.
By formalising these ‘recipes’ and their ingredients we commoditise the interrogation
of data that’s selected for a mission. And to stretch the cooking analogy, we also avoid
relying on expert chefs (data scientists) for everything; instead we write a cookbook.
The end result is a ‘run book’ for business process, which anyone can turn to, to
understand: what problems we’re solving; how; and with what result?
Analytic
models
Business
process
Insight
Business Case
Business Case
?
Human
capital
Question Missions + Recipes Run Books
If we overlay this with our model from earlier, this is what we end up with, which
shows the feedback loop from Run Books back into missions and recipes … and
perhaps even the questions we started with.
Scope Where did we look?
Was that the right place?
Info What did we get?
Is it the right thing?
Coverage How complete is it?
Is that enough to decide?
Accuracy and Precision
We can now make our decisioning clear to all sides about how a request to ‘tell me
what to do’ has been thought through.
And we can invite ideas from the people involved in asking and answering the
question, to make sure the value of the answer (aka: ‘Here’s what you should do’) is
as clear as possible.
All models are wrong
Some are useful
As George Box once said, all models are wrong, some are useful.
If you’ve any ideas on how I could make this model less wrong, please let me know!

More Related Content

What's hot

KETL Quick guide to data analytics
KETL Quick guide to data analytics KETL Quick guide to data analytics
KETL Quick guide to data analytics
KETL Limited
 
Giovanni Lanzani GoDataDriven
Giovanni Lanzani GoDataDrivenGiovanni Lanzani GoDataDriven
Giovanni Lanzani GoDataDriven
BigDataExpo
 
CRISP-DM: a data science project methodology
CRISP-DM: a data science project methodologyCRISP-DM: a data science project methodology
CRISP-DM: a data science project methodology
Sergey Shelpuk
 
1000 grandy using our laptop
1000 grandy using our laptop1000 grandy using our laptop
1000 grandy using our laptop
Rising Media, Inc.
 
IBM Watson Analytics
IBM Watson AnalyticsIBM Watson Analytics
IBM Watson Analytics
Luca Rago
 
The analytics-stack-guidebook
The analytics-stack-guidebookThe analytics-stack-guidebook
The analytics-stack-guidebook
Ashish Tiwari
 
Il ruolo dei dati nella trasformazione digitale - SAS italy
Il ruolo dei dati nella trasformazione digitale - SAS italyIl ruolo dei dati nella trasformazione digitale - SAS italy
Il ruolo dei dati nella trasformazione digitale - SAS italy
SAS Italy
 
Ml in a day v 1.1
Ml in a day v 1.1Ml in a day v 1.1
Ml in a day v 1.1
CCG
 
How to succeed at data without even trying!
How to succeed at data without even trying!How to succeed at data without even trying!
How to succeed at data without even trying!
Dylan
 
Moving Big Data to Big Value
Moving Big Data to Big ValueMoving Big Data to Big Value
Moving Big Data to Big Value
Coert Du Plessis (杜康)
 
Stop searching for that elusive data scientist
Stop searching for that elusive data scientistStop searching for that elusive data scientist
Stop searching for that elusive data scientist
Parul Verma
 
How to think like a data scientist
How to think like a data scientistHow to think like a data scientist
How to think like a data scientist
Raminder Singh
 
Max Shron, Thinking with Data at the NYC Data Science Meetup
Max Shron, Thinking with Data at the NYC Data Science MeetupMax Shron, Thinking with Data at the NYC Data Science Meetup
Max Shron, Thinking with Data at the NYC Data Science Meetup
mortardata
 
Intelligence Discovery
Intelligence DiscoveryIntelligence Discovery
Intelligence Discovery
tyler frieling
 
How to start thinking like a data scientist
How to start thinking like a data scientistHow to start thinking like a data scientist
How to start thinking like a data scientist
Nishant Kumar
 
A strategy for security data analytics - SIRACon 2016
A strategy for security data analytics - SIRACon 2016A strategy for security data analytics - SIRACon 2016
A strategy for security data analytics - SIRACon 2016
Jon Hawes
 
ClickZ Live: Smart Analytics
ClickZ Live: Smart AnalyticsClickZ Live: Smart Analytics
ClickZ Live: Smart Analytics
Kristin Low
 
Machine learning101 v1.2
Machine learning101 v1.2Machine learning101 v1.2
Machine learning101 v1.2
CCG
 
How Big Data identifies early indicators of Mental Stress
How Big Data identifies early indicators of Mental StressHow Big Data identifies early indicators of Mental Stress
How Big Data identifies early indicators of Mental Stress
Coert Du Plessis (杜康)
 

What's hot (20)

KETL Quick guide to data analytics
KETL Quick guide to data analytics KETL Quick guide to data analytics
KETL Quick guide to data analytics
 
Giovanni Lanzani GoDataDriven
Giovanni Lanzani GoDataDrivenGiovanni Lanzani GoDataDriven
Giovanni Lanzani GoDataDriven
 
CRISP-DM: a data science project methodology
CRISP-DM: a data science project methodologyCRISP-DM: a data science project methodology
CRISP-DM: a data science project methodology
 
1000 grandy using our laptop
1000 grandy using our laptop1000 grandy using our laptop
1000 grandy using our laptop
 
IBM Watson Analytics
IBM Watson AnalyticsIBM Watson Analytics
IBM Watson Analytics
 
The analytics-stack-guidebook
The analytics-stack-guidebookThe analytics-stack-guidebook
The analytics-stack-guidebook
 
Il ruolo dei dati nella trasformazione digitale - SAS italy
Il ruolo dei dati nella trasformazione digitale - SAS italyIl ruolo dei dati nella trasformazione digitale - SAS italy
Il ruolo dei dati nella trasformazione digitale - SAS italy
 
Ml in a day v 1.1
Ml in a day v 1.1Ml in a day v 1.1
Ml in a day v 1.1
 
How to succeed at data without even trying!
How to succeed at data without even trying!How to succeed at data without even trying!
How to succeed at data without even trying!
 
Moving Big Data to Big Value
Moving Big Data to Big ValueMoving Big Data to Big Value
Moving Big Data to Big Value
 
Stop searching for that elusive data scientist
Stop searching for that elusive data scientistStop searching for that elusive data scientist
Stop searching for that elusive data scientist
 
How to think like a data scientist
How to think like a data scientistHow to think like a data scientist
How to think like a data scientist
 
Max Shron, Thinking with Data at the NYC Data Science Meetup
Max Shron, Thinking with Data at the NYC Data Science MeetupMax Shron, Thinking with Data at the NYC Data Science Meetup
Max Shron, Thinking with Data at the NYC Data Science Meetup
 
Intelligence Discovery
Intelligence DiscoveryIntelligence Discovery
Intelligence Discovery
 
How to start thinking like a data scientist
How to start thinking like a data scientistHow to start thinking like a data scientist
How to start thinking like a data scientist
 
A strategy for security data analytics - SIRACon 2016
A strategy for security data analytics - SIRACon 2016A strategy for security data analytics - SIRACon 2016
A strategy for security data analytics - SIRACon 2016
 
ClickZ Live: Smart Analytics
ClickZ Live: Smart AnalyticsClickZ Live: Smart Analytics
ClickZ Live: Smart Analytics
 
Ytl03375 usen
Ytl03375 usenYtl03375 usen
Ytl03375 usen
 
Machine learning101 v1.2
Machine learning101 v1.2Machine learning101 v1.2
Machine learning101 v1.2
 
How Big Data identifies early indicators of Mental Stress
How Big Data identifies early indicators of Mental StressHow Big Data identifies early indicators of Mental Stress
How Big Data identifies early indicators of Mental Stress
 

Similar to Lightning talk on the future of analytics - CloudCamp London, 2016

Training Taster: Leading the way to become a data-driven organization
Training Taster: Leading the way to become a data-driven organizationTraining Taster: Leading the way to become a data-driven organization
Training Taster: Leading the way to become a data-driven organization
GoDataDriven
 
Data analytics for the mid-market: myth vs. reality
Data analytics for the mid-market: myth vs. realityData analytics for the mid-market: myth vs. reality
Data analytics for the mid-market: myth vs. reality
Deloitte Canada
 
Be a Top Notch PM Using Data Science by Farfetch Product Leader
Be a Top Notch PM Using Data Science by Farfetch Product LeaderBe a Top Notch PM Using Data Science by Farfetch Product Leader
Be a Top Notch PM Using Data Science by Farfetch Product Leader
Product School
 
Big Data : a 360° Overview
Big Data : a 360° Overview Big Data : a 360° Overview
Big Data : a 360° Overview
Juvénal CHOKOGOUE
 
Data Analytics Integration in Organizations
Data Analytics Integration in OrganizationsData Analytics Integration in Organizations
Data Analytics Integration in Organizations
Kavika Roy
 
Big Data: Evolution? Game Changer? Definitely
Big Data: Evolution? Game Changer? DefinitelyBig Data: Evolution? Game Changer? Definitely
Big Data: Evolution? Game Changer? Definitely
EMC
 
Giving Organisations new capabilities to ask the right business questions 1.7
Giving Organisations new capabilities to ask the right business questions 1.7Giving Organisations new capabilities to ask the right business questions 1.7
Giving Organisations new capabilities to ask the right business questions 1.7
OReillyStrata
 
Design and Data Processes  Unified -  3rd Corner View
Design and Data Processes  Unified -  3rd Corner ViewDesign and Data Processes  Unified -  3rd Corner View
Design and Data Processes  Unified -  3rd Corner View
Julian Jordan
 
Come flying on Divergence Airways with Mike Biggs -"We always land"
Come flying on Divergence Airways with Mike Biggs -"We always land"Come flying on Divergence Airways with Mike Biggs -"We always land"
Come flying on Divergence Airways with Mike Biggs -"We always land"
Mike Biggs GAICD
 
NYC Data Driven Business Meetup - 2.7.17
NYC Data Driven Business Meetup - 2.7.17NYC Data Driven Business Meetup - 2.7.17
NYC Data Driven Business Meetup - 2.7.17
Karl Pawlewicz
 
Yo. big data. understanding data science in the era of big data.
Yo. big data. understanding data science in the era of big data.Yo. big data. understanding data science in the era of big data.
Yo. big data. understanding data science in the era of big data.
Natalino Busa
 
Data mining techniques and dss
Data mining techniques and dssData mining techniques and dss
Data mining techniques and dssNiyitegekabilly
 
Simplified Forecasting masterclass CPA Australia Congress 2016 udpate
Simplified Forecasting masterclass CPA Australia Congress 2016 udpateSimplified Forecasting masterclass CPA Australia Congress 2016 udpate
Simplified Forecasting masterclass CPA Australia Congress 2016 udpate
Tim Richardson
 
Data Science - Reality Check
Data Science - Reality CheckData Science - Reality Check
Data Science - Reality Check
Syahrul Hamdani
 
Embracing data science
Embracing data scienceEmbracing data science
Embracing data science
Vipul Kalamkar
 
AI x Design_Haverinen 2023.pdf
AI x Design_Haverinen 2023.pdfAI x Design_Haverinen 2023.pdf
AI x Design_Haverinen 2023.pdf
Anna E. Haverinen
 
SoDA Analytics deck
SoDA Analytics deckSoDA Analytics deck
SoDA Analytics deck
Jon Gibs
 
Narrative analytics white paper
Narrative analytics white paperNarrative analytics white paper
Narrative analytics white paper
Eric Espinosa
 
Industrializing Data Science: Transform into an End-to-End, Analytics-Oriente...
Industrializing Data Science: Transform into an End-to-End, Analytics-Oriente...Industrializing Data Science: Transform into an End-to-End, Analytics-Oriente...
Industrializing Data Science: Transform into an End-to-End, Analytics-Oriente...
Dana Gardner
 
Einstein Analytics Prediction Builder
Einstein Analytics Prediction BuilderEinstein Analytics Prediction Builder
Einstein Analytics Prediction Builder
rikkehovgaard
 

Similar to Lightning talk on the future of analytics - CloudCamp London, 2016 (20)

Training Taster: Leading the way to become a data-driven organization
Training Taster: Leading the way to become a data-driven organizationTraining Taster: Leading the way to become a data-driven organization
Training Taster: Leading the way to become a data-driven organization
 
Data analytics for the mid-market: myth vs. reality
Data analytics for the mid-market: myth vs. realityData analytics for the mid-market: myth vs. reality
Data analytics for the mid-market: myth vs. reality
 
Be a Top Notch PM Using Data Science by Farfetch Product Leader
Be a Top Notch PM Using Data Science by Farfetch Product LeaderBe a Top Notch PM Using Data Science by Farfetch Product Leader
Be a Top Notch PM Using Data Science by Farfetch Product Leader
 
Big Data : a 360° Overview
Big Data : a 360° Overview Big Data : a 360° Overview
Big Data : a 360° Overview
 
Data Analytics Integration in Organizations
Data Analytics Integration in OrganizationsData Analytics Integration in Organizations
Data Analytics Integration in Organizations
 
Big Data: Evolution? Game Changer? Definitely
Big Data: Evolution? Game Changer? DefinitelyBig Data: Evolution? Game Changer? Definitely
Big Data: Evolution? Game Changer? Definitely
 
Giving Organisations new capabilities to ask the right business questions 1.7
Giving Organisations new capabilities to ask the right business questions 1.7Giving Organisations new capabilities to ask the right business questions 1.7
Giving Organisations new capabilities to ask the right business questions 1.7
 
Design and Data Processes  Unified -  3rd Corner View
Design and Data Processes  Unified -  3rd Corner ViewDesign and Data Processes  Unified -  3rd Corner View
Design and Data Processes  Unified -  3rd Corner View
 
Come flying on Divergence Airways with Mike Biggs -"We always land"
Come flying on Divergence Airways with Mike Biggs -"We always land"Come flying on Divergence Airways with Mike Biggs -"We always land"
Come flying on Divergence Airways with Mike Biggs -"We always land"
 
NYC Data Driven Business Meetup - 2.7.17
NYC Data Driven Business Meetup - 2.7.17NYC Data Driven Business Meetup - 2.7.17
NYC Data Driven Business Meetup - 2.7.17
 
Yo. big data. understanding data science in the era of big data.
Yo. big data. understanding data science in the era of big data.Yo. big data. understanding data science in the era of big data.
Yo. big data. understanding data science in the era of big data.
 
Data mining techniques and dss
Data mining techniques and dssData mining techniques and dss
Data mining techniques and dss
 
Simplified Forecasting masterclass CPA Australia Congress 2016 udpate
Simplified Forecasting masterclass CPA Australia Congress 2016 udpateSimplified Forecasting masterclass CPA Australia Congress 2016 udpate
Simplified Forecasting masterclass CPA Australia Congress 2016 udpate
 
Data Science - Reality Check
Data Science - Reality CheckData Science - Reality Check
Data Science - Reality Check
 
Embracing data science
Embracing data scienceEmbracing data science
Embracing data science
 
AI x Design_Haverinen 2023.pdf
AI x Design_Haverinen 2023.pdfAI x Design_Haverinen 2023.pdf
AI x Design_Haverinen 2023.pdf
 
SoDA Analytics deck
SoDA Analytics deckSoDA Analytics deck
SoDA Analytics deck
 
Narrative analytics white paper
Narrative analytics white paperNarrative analytics white paper
Narrative analytics white paper
 
Industrializing Data Science: Transform into an End-to-End, Analytics-Oriente...
Industrializing Data Science: Transform into an End-to-End, Analytics-Oriente...Industrializing Data Science: Transform into an End-to-End, Analytics-Oriente...
Industrializing Data Science: Transform into an End-to-End, Analytics-Oriente...
 
Einstein Analytics Prediction Builder
Einstein Analytics Prediction BuilderEinstein Analytics Prediction Builder
Einstein Analytics Prediction Builder
 

Recently uploaded

Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
g2nightmarescribd
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
Product School
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Product School
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
BookNet Canada
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Tobias Schneck
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
Thijs Feryn
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
KatiaHIMEUR1
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
Dorra BARTAGUIZ
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
Product School
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 

Recently uploaded (20)

Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 

Lightning talk on the future of analytics - CloudCamp London, 2016

  • 1. Our big data lake strategy will deliver digital insights using cloud technology Today, lots of companies are releasing press releases saying things like this.
  • 2. Dear data Tell me what to do However, they might be secretly hoping for something more like this. “Don’t give me facts to think through. Don’t give me options. Just tell me my next best action.”
  • 3. ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? Tell me what to dos Data Scientists Eek! These expectations are likely to be dashed, because of the imbalance between the number of questions we hope will be automagically answered, and the number of data scientists we have, who can combine business knowledge with an understanding of what our data can and can’t do.
  • 4. Market & operational knowledge drove business process which created data Old model : data as by-product As we’ve moved from this model ...
  • 5. Data drives market and operational decisions which creates business processes New model : data as oracle … to this model (aka being ‘data driven’) ...
  • 6. Market and operational knowledge Data (internal and external) Business process Insight Business Case Business Case … we’ve struggled to find a middle ground that’s combines knowledge and data to improve or create business processes - and the results are measured to support doing more (or less) of something.
  • 7. Human capital Analytic models Business process Insight Business Case Business Case If we flip the terms here, it becomes clearer that there are things that are known to the business but not the data, and vice versa.
  • 8. Where insight is operationalised To the business Known Human capital Human capital + Analytic models Unknown Analytic models Unknown Known To the data Most of the excitement we hear in the data analytics world is about the opportunities in the bottom right square in this quadrant.
  • 9. Insight opportunities To the business Known Knowledge, ideas, dogma, etc Validation Optimisation Prediction Unknown Ideas and data not yet created / realised Answers waiting to be found Unknown Known To the data The idea of the next big discovery is why lots of firms fund exploratory data science safaris in the hope of uncovering hidden value.
  • 10. Validation Do or do not Optimisation Make ‘doing’ better Prediction What may happen Insight opportunities But there are plenty of opportunities on more solid ground, which we shouldn’t ignore.
  • 11. Opportunity cost Advantage from insight Costofinsight No thanks Yes please Not only are we likely to find that they’re cheaper to obtain, and more valuable in the long run.
  • 12. Opportunity cost Advantage from insight Costofinsight Unavoidably inevitable But also, they’re less prone to involve high costs over long periods of time, which is the equivalent of betting everything on 21, spinning the roulette wheel and only getting lucky occasionally.
  • 13. Optimisation example To the business Known Combine this ... … with this ... Unknown … to explore this. Unknown Known To the data Maybe, (just maybe) there’s a path to extract ‘value waiting to happen’ from data in a safer way than ‘big bang’ gambles.
  • 14. Optimisation example To the business Known We have X people ... … achieving this. Unknown How could we add more value in less time? Unknown Known To the data Which can also give us a chance at unlocking the value that ‘big data analytics’ marketing is promising.
  • 15. A structure for insight Question ? Missions Result Action Action Situation Situation Situation Recipes --- --- --- --- --- --- --- --- --- --- --- --- --- --- --- --- --- --- Run books Here’s what that model may look like. We start with a high value question. Then we’ll structure a set of missions that think through business knowledge and data components of a question. For example, if we’re looking for ‘prediction’ … what’s our situation; what actions could we take to change it; then what result(s) would that lead to? By formalising our approach to solving this problem, we set up a relationship between a mission and the relevant data, models and techniques used to complete it. By formalising these ‘recipes’ and their ingredients we commoditise the interrogation of data that’s selected for a mission. And to stretch the cooking analogy, we also avoid relying on expert chefs (data scientists) for everything; instead we write a cookbook. The end result is a ‘run book’ for business process, which anyone can turn to, to understand: what problems we’re solving; how; and with what result?
  • 16. Analytic models Business process Insight Business Case Business Case ? Human capital Question Missions + Recipes Run Books If we overlay this with our model from earlier, this is what we end up with, which shows the feedback loop from Run Books back into missions and recipes … and perhaps even the questions we started with.
  • 17. Scope Where did we look? Was that the right place? Info What did we get? Is it the right thing? Coverage How complete is it? Is that enough to decide? Accuracy and Precision We can now make our decisioning clear to all sides about how a request to ‘tell me what to do’ has been thought through. And we can invite ideas from the people involved in asking and answering the question, to make sure the value of the answer (aka: ‘Here’s what you should do’) is as clear as possible.
  • 18. All models are wrong Some are useful As George Box once said, all models are wrong, some are useful. If you’ve any ideas on how I could make this model less wrong, please let me know!