There are as many views and definitions of Data Mining as there are people working in and on the topic. Confusion reigns and people ask; what is it; why do we need it; and isn’t it just Data Mining rebranded? In this slide deck and presentation we set the scene an highlight the differences and need for Data Mining in order to give a framework for case studies and future projects. So - why do we need it? The economic, industrial, commercial, social, political and sustainability problems we face cannot be successfully addressed using the management techniques and models largely inherited from the Industrial Revolution. The world no longer appears infinite in resources, slow paced, linear and stable. We now see the limitations; feel the impact of rapid change; and we can conceptualize the non-linear and unstable nature of it all! We are also starting to comprehend the scale and the need for machine assistance. Modeling our situation ! Sophisticated computer models for weather systems are now complemented by ecological, economic, conflict and resource modeling of varying depth and accuracy. However, the key is always the accuracy and coverage of the primary data. We started with modest databases and data mining, but they mostly proved inadequate, and we are now amassing vast databases on every aspect of life - people, planet and machines. This ‘BIG DATA’ explosion demands a rethink of how, what, and where we gather data; the way we analyze and model; and the way we make decisions. So - what is the big difference? Data Mining was limited, planer, simple, linear and constrained to a few relationships amongst people: what they did, where they went, who they knew and so on. In contrast; Big Data is unbounded, spans all peoples and machines in all domains and activities with application to every aspect of life, business, industry, government and sustainability etc. It also takes into account the non-linear nature of relationships and events. “Big Data is an almost unconscious outcome of the desire and need to sustain all peoples on a rapidly smaller looking planet”

1. Big - Data - Mining
The differences, gains and application areas
Peter Cochrane
cochrane.org.uk
ca-global.org
COCHRANE
a s s o c i a t e s
Thursday, 31 January 13

2. Data Mining Big Data
A close The big
up view picture
Lots of detail Lots of relationships
Thursday, 31 January 13

3. What about
the data in the Data
Information ?
Mining
What the information is
comprised of, and all the
related data...or vice versa !
Thursday, 31 January 13

4. How people are related
Mining
Data
in a limited number of
slow moving fields Thursday, 31 January 13

5. But what
about the
W hy ? Big Data
Where are the commonalities,
relationships, and causalities
hidden in the bigger picture ?
Thursday, 31 January 13

6. B i g Who ? ..do they work for
..do they know
Data ..employ
+++
Why ?
..are these people meeting
...do they buy the same xxx
...wear the same yyy
...eat the same zzz
++++
...binds them together
What ? ...are they doing/planning
...do they have in common
+++
Thursday, 31 January 13

7. Superficially they may look the same, but they are not !
What are the differences and why is this important ?
Head Teacher Fraudster High Net Worth
Solvent Investor
1078653271
Thursday, 31 January 13

8. Superficially they may look the same, but they are not !
What are the differences and why is this important ?
Head Teacher Fraudster High Net Worth
Solvent Investor
1078653271
DoB Family Friends Food
SAME Town Funding Society Music
Home Education Opportunity Clothing
Thursday, 31 January 13

9. Superficially they may look the same, but they are not !
What are the differences and why is this important ?
Head Teacher Fraudster High Net Worth
Solvent Investor
1078653271
Morals Wealth Fears
DIFFERENT Desires Banking Hopes
Relationships
Ambitions Purchases
DoB Family Friends Food
SAME Town Funding Society Music
Home Education Opportunity Clothing
Thursday, 31 January 13

10. Superficially they may look the same, but they are not !
What are the differences and why is this important ?
Head Teacher Fraudster High Net Worth
Solvent Investor
1078653271
Morals Wealth Fears
DIFFERENT Desires Banking Hopes
Relationships
Ambitions Purchases
Why ? DoB happens next and where is this going ?
What
Family Friends Food
SAME Town Funding Society Music
Home Education Opportunity Clothing
Thursday, 31 January 13

11. Big Data Defining what links, associations,
relate all these people and their
friends and families
turns out to be complex
and dynamic in
hy p e r s p a c e . . . wa y
beyond any human
capacity to fathom
Thursday, 31 January 13

12. Big Data
It is about joining the
dots, plotting the
relationships, seeing the
sensitivities, understanding
cause and effect
Thursday, 31 January 13

13. Big Data ...is all about the
sociology of
people, things,
and machines !
Thursday, 31 January 13

14. Big Data
Essentially
evolving
global
long
term
live
Thursday, 31 January 13

15. Vital ?
Why
this all So
very
is
po
Im nt
rta
Thursday, 31 January 13

16. sensors
It anu fac ture
M Supply
is In s urant e
c
about the em
en
c e
na
g
e n Production
sustainability
Ma
e f
D ity el
Sec ur T r av re
of societies C a
dealing with finite
e il $$$ Logis
ta Com
resources, growth R m
tics
erce
and change Law He alth
& Green
Order Sustaina
bility
Thursday, 31 January 13

17. Where you are ?
Your mobile device Where you have been ?
knows more and more Where you are likely to be going to ?
Who you have met ?
about you day by day ! Who you are going to meet ?
Who you call ?
Who calls you ?
Who you TXT - IM - Link ?
All your contacts
All your urls
All you passwords
What you are doing now ?
What have you done in the past ?
What games you play ?
What apps you use ?
What music you listen to...?
What you watch...?
What you read...?
++++++++++
Thursday, 31 January 13

18. Axiom: Our future
products, processes and
services will demand greater
embedded intelligence and
communication in order to
affect material and energy
efficiencies...
Thursday, 31 January 13

19. Smart:
• cars
• food
• tools
• offices
• homes
• clothing
• appliances
• consumables
Thursday, 31 January 13

20. But Why ??
Thursday, 31 January 13

21. All our old management methods,
modelingButunderstanding has
and Why ??
Thursday, 31 January 13
run out of steam !

22. The
only game
i n t ow n t h a t
might work for us
Computer modeling, iteration
and war gaming in a n-dimensional
space at speed where the data input and
base assumptions are no longer constants, or
indeed, linear as we have happily assumed in the past!
Thursday, 31 January 13

23. And
that
needs
Data
lots and
lots of
Data
Thursday, 31 January 13

24. Some of the biggest
challenges ahead
are social and
analytical...and we How do we,
are largely flying blind
and every
society
benefit
whilst we
transit to
sustainable
models and
new ways of
...and we appear to . living ? .
have no choice !
Thursday, 31 January 13

25. Big Data
Appears to be
our only choice
if we are to
progress and
prosper
Thursday, 31 January 13

26. ca-global.org
cochrane.org.uk
Thank You
COCHRANE
a s s o c i a t e s
Thursday, 31 January 13