3. Big Data and the Future of Analytics
Presented by: John-Paul Della Putta
4. Our Agenda for Today
Evolving Analytics
From 1.0 to 3.0
4
The Rise of Big Data
What it is, how it can benefit you
Big Data Technology
What it is, what you need to know
Using Big Data & Analytics?
Becoming analytics driven
Enhancing your Analytics
Introducing KPI Pulse
The Future
Some Predictions
8. Analytics 1.0
Good old fashioned reporting & BI
8
Descriptive analytics
Generally backward facing and showing what’s
happened and why
Often there’s a considerable lag between
event and insight
Traditional BI and Reporting – still relevant
today and won’t be going away soon
9. Analytics 2.0
The Rise of Big Data
9
Looking at much larger, broader data sets, often un-structured data
Emergence of new technologies which deal with large volumes of often un structured data
Rise of the Data Scientist
11. Analytics 3.0
Closing the loop
11
= Traditional Analytics
+ Big Data Technology
+ (possibly Big Data)
+ Prescribed Action
12. Example – Remote Gas Well Maintenance
What action will be taken automatically?
12
13. Lower Costs
13
Railroad sensor notices that a
wheel is too hot and sends a
signal to stop the train
A team is sent to perform repairs
Possible derailment is avoided
16. Descriptive
Summarise and describe
what’s happened in the past
Predictive
Predict what’s likely to
happen in the future
Prescriptive
Determine actions to take
and make the future happen
17. Recommended for You
An example of operational analytics
17
Redshift is Amazon’s Hadoop as a service
32. The Irony of Big Data
The Questions are Simple
32
Is this person a good credit risk?
Is this movie worth watching?
Is this too much to pay for this property?
34. Hadoop
Key attributes
34
Open source (cost effective)
Stores data in 3 places (no backup)
Not a database, a file system (no loading)
Suitable for large amounts of unstructured data
Scalable – Can be distributed over many computers
(Yahoo has a 42,000 node implementation)
36. Better Decisions
36
Performance and market value.
We find that DDD is associated
with a 5 – 6% increase in their
output and productivity, beyond
what can be explained by
traditional inputs and IT
5 – 6% Increase
60. So what did you learn?
60
If you were paying attention…
Analytics is changing
Moving from descriptive analytics
through Predictive to Prescriptive.
Big Data has 3V’s
Big Data is different data and It’s
being used everywhere. You might
end up renting it.
KPI Pulse
You can get real time analytics
pushed out to your users’ mobile
phones
Hadoop isn’t a DB
It’s not a database, it’s a
filesystem and it’s complex.
You can use it without building it
The techo’s will say that there’s more than just 3 V’s, which is true, but knowing these 3V’s is an excellent starting point.
MIT did a study on how data-driven-decision based businesses performed compared to standard businesses .
Much of the information was from Andrew McAfee – he’s got some good information about how technology is changing business.
Where it came from –
A project manager using QlikView said to me, I don’t want to analyse the data – I just want to know where there’s a problem or who I should call.