Big Data in Context     Data-intensive challenges: what’s hot and what’s hype?                                         The...
Topics       Data, data everywhere …       The concept of value density – defining ‘Big        Data’       The emerging...
What level of growth are you seeing in the following      types of data within your organisation?                         ...
In what form is your organisation’s most valuable or      critical data held (i.e. your crown jewels in      information t...
Considered overall, to what degree does your      organisation exploit its information assets for analysis      and decisi...
Do you make use of high volume streams or feeds of    data from external sources?                                       Ye...
The concept of value density – Big Data today                                       Low value density        High value de...
The three Vs of Big Data                                                     High physical                                ...
Introducing ……                                       9Copyright 2011 Freeform Dynamics Ltd
Source: The Register http://www.theregister.co.uk/2011/11/09/hadoop_kernel_distro/                                        ...
Zooming out        Distributed data               • For executing parallel distributed data analysis on                   ...
How much are the following used in your organisation      today, and how will the level of use change over the next 3     ...
How much do you agree or disagree with the      following statements?                                                     ...
A less prescriptive approach to analytics                Prescriptive                   Non-prescriptive            Tradit...
Blending approaches                                                              Traditional          Exploratory         ...
Do you see cloud based services helping with any of      the following in relation to more advanced      storage, access a...
Issues around rhetoric and perception                                                             0%        20%       40% ...
More practical challenges                                                           0%          20%      40%      60%     ...
In conclusion       Data volumes will continue to increase       New architectures and technologies have an        impor...
Contact      Martha Bennett      VP, Head of Strategy      Freeform Dynamics Ltd      11 The Willows      New Milton, Hamp...
Appendix: Survey Demographics                                       21Copyright 2011 Freeform Dynamics Ltd
What is the size of your organisation?                           NA - Responding                       More than 50,000   ...
What industry sector does your organisation operate in?                                                                   ...
Sample by region                                 Rest of                                 World                            ...
Contact      Martha Bennett      VP, Head of Strategy      Freeform Dynamics Ltd      11 The Willows      New Milton, Hamp...
Upcoming SlideShare
Loading in...5
×

Big Data in Context

801

Published on

Published in: Technology, Business
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
801
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
51
Comments
0
Likes
3
Embeds 0
No embeds

No notes for slide

Big Data in Context

  1. 1. Big Data in Context Data-intensive challenges: what’s hot and what’s hype? The Register: Intel Academy 22nd November 2011 Martha Bennett VP, Head of Strategy Freeform Dynamics Ltd www.freeformdynamics.comCopyright 2011 Freeform Dynamics Ltd
  2. 2. Topics  Data, data everywhere …  The concept of value density – defining ‘Big Data’  The emerging ‘Big Data’ ecosystem  A blended future  Opportunities and challenges 2Copyright 2011 Freeform Dynamics Ltd
  3. 3. What level of growth are you seeing in the following types of data within your organisation? 0% 20% 40% 60% 80% 100% Structured data (e.g. tabular data in RDBMSs) Unstructured data (e.g. documents, messages, multi-media, etc) 5 Extremely high growth 4 3 2 1 No growth Unsure Online survey of Register readers, 122 respondents, first half of November 2011Copyright 2011 Freeform Dynamics Ltd
  4. 4. In what form is your organisation’s most valuable or critical data held (i.e. your crown jewels in information terms)? 0% 20% 40% 60% Exclusively in structured format Mostly in structured format Equal split Mostly in unstructured format Exclusively in unstructured format (No responses) Online survey of Register readers, 122 respondents, first half of November 2011Copyright 2011 Freeform Dynamics Ltd
  5. 5. Considered overall, to what degree does your organisation exploit its information assets for analysis and decision making purposes? 0% 20% 40% 60% 80% 100% Structured data Unstructured data 5 Fully 4 3 2 1-Poorly Unsure Online survey of Register readers, 122 respondents, first half of November 2011Copyright 2011 Freeform Dynamics Ltd
  6. 6. Do you make use of high volume streams or feeds of data from external sources? Yes, extensively 14% Yes, in some Unsure areas 11% 22% No, and dont No, but expect expect this to this to become a change requirement 33% 20%Online survey of Register readers, 122 respondents, first half of November 2011Copyright 2011 Freeform Dynamics Ltd
  7. 7. The concept of value density – Big Data today Low value density High value density Traditional BI and data Structured Structured warehousing BIG DATA Traditional search and Unstructured Unstructured document management Low value density High value density 7Copyright 2011 Freeform Dynamics Ltd
  8. 8. The three Vs of Big Data High physical Volume volumes with low Rule of thumb value density Generally think of Big Data Different sources and Variety formats or information when two of these three apply Rapid rate of data Velocity movement, generation or acquisition 8Copyright 2011 Freeform Dynamics Ltd
  9. 9. Introducing …… 9Copyright 2011 Freeform Dynamics Ltd
  10. 10. Source: The Register http://www.theregister.co.uk/2011/11/09/hadoop_kernel_distro/ 10Copyright 2011 Freeform Dynamics Ltd
  11. 11. Zooming out Distributed data • For executing parallel distributed data analysis on scale-out storage architectures analytics Distributed • For implementing fast distributed object storage and indexing and retrieval on scale-out storage architectures (including the so called ‘No SQL’ approach) search Scale-out • Storage systems able to scale linearly through adding software, processing and storage elements storage integrated into standard building blocks under the architectures control of a common management layer 11Copyright 2011 Freeform Dynamics Ltd
  12. 12. How much are the following used in your organisation today, and how will the level of use change over the next 3 years? CURRENT LEVEL OF USE CHANGE IN NEXT 3 YEARS 0% 20% 40% 60% 80% 100% -60% -30% 0% 30% 60% Legacy databases & file systems General purpose RDBMS High performance RDBMS OLAP multi-dimensional database In memory databases Specialist WORM databases Stream processing engines Scale-out storage architectures Distributed indexing and search Distributed data analytics engines 5 Extensive use 4 3 2 Lower Higher Online survey of Register readers, 122 respondents, first half of November 2011Copyright 2011 Freeform Dynamics Ltd
  13. 13. How much do you agree or disagree with the following statements? 0% 20% 40% 60% 80% 100% Developments in advanced storage, access and analytics are allowing us to tackle problems today that were either too hard or too expensive to deal with in the past Developments in advanced storage, access and analytics are allowing us to take different and better approaches to tackling some key business requirements 5-Totally agree 4 3 2 1-Totally disagree Unsure Online survey of Register readers, 122 respondents, first half of November 2011Copyright 2011 Freeform Dynamics Ltd
  14. 14. A less prescriptive approach to analytics Prescriptive Non-prescriptive Traditional schema- Exploratory approach based analysis based in which you don’t on pre-defined know what you are structures, reports, hy looking for until you potheses, etc find it.  Both analytical paradigms have their place 14Copyright 2011 Freeform Dynamics Ltd
  15. 15. Blending approaches Traditional Exploratory Structured data ‘Big Data’ derivative data set warehousing style analysis environment  Big data feeding traditional BI systems  But it can also go the other way 15Copyright 2011 Freeform Dynamics Ltd
  16. 16. Do you see cloud based services helping with any of the following in relation to more advanced storage, access and analytical solutions? 0% 20% 40% 60% 80% 100% Rapid and cost effective setup and disposal of environment for familiarisation, training, experimenting and piloting Access to high-end configurations for production systems that would not be cost effective to install on premise Rapid and cost effective setup and disposal of environment for dealing with transient needs within the business Removing concerns about scalability, e.g. running out of capacity for handling large data sets and heavy processing loads Big benefit Some benefit No benefit Dont know N/A - cloud not for us at all Online survey of Register readers, 122 respondents, first half of November 2011Copyright 2011 Freeform Dynamics Ltd
  17. 17. Issues around rhetoric and perception 0% 20% 40% 60% 80% 100% Regardless of substance and reality of emerging technologies and techniques, the term ‘big data’ is currently being over-hyped by IT vendors in an unhelpful way The emergence of advanced storage, access and analytics solutions means the end of the traditional RDBMS 5-Totally agree 4 3 2 1-Totally disagree Unsure Online survey of Register readers, 122 respondents, first half of November 2011Copyright 2011 Freeform Dynamics Ltd
  18. 18. More practical challenges 0% 20% 40% 60% 80% 100% Vendors and consulting firms are well geared up to providing us with the support and services we need to take advanced storage, access and analytics on board effectively Database vendors are well geared up to support their customers with appropriate licensing and commercial arrangements as data related needs continue to evolve and become more demanding 5-Totally agree 4 3 2 1-Totally disagree Unsure Online survey of Register readers, 122 respondents, first half of November 2011Copyright 2011 Freeform Dynamics Ltd
  19. 19. In conclusion  Data volumes will continue to increase  New architectures and technologies have an important role  Key challenges Lack of skills Security Risk of ‘standards’ proliferation  It’s not about “or”, it’s about “and” 19Copyright 2011 Freeform Dynamics Ltd
  20. 20. Contact Martha Bennett VP, Head of Strategy Freeform Dynamics Ltd 11 The Willows New Milton, Hampshire BH25 7BE Mobile +44 7944 663344 martha@freeformdynamics.com Twitter: @martha_bennett www.freeformdynamics.com 20Copyright 2011 Freeform Dynamics Ltd
  21. 21. Appendix: Survey Demographics 21Copyright 2011 Freeform Dynamics Ltd
  22. 22. What is the size of your organisation? NA - Responding More than 50,000 based on employees experience with 12% multiple clients of varying sizes 16% 5,000 to 50,000 employees 17% Under 50 employees 14% 250 to 5,000 50 to 250 employees employees 25% 16% Online survey of Register readers, 122 respondents, first half of November 2011Copyright 2011 Freeform Dynamics Ltd
  23. 23. What industry sector does your organisation operate in? 0% 10% 20% Financial services Professional services High tech Media/entertainment (inc film, gaming, etc) Research and/or educational establishment Medical / health care Telecommunications Central government Travel and transport Aerospace and defence Local government Energy Retail/distribution Architecture, engineering or construction Other NA - working with multiple clients across a number of industries Online survey of Register readers, 122 respondents, first half of November 2011Copyright 2011 Freeform Dynamics Ltd
  24. 24. Sample by region Rest of World 12% UK 55% USA 16% Rest of Europe 17% Online survey of Register readers, 122 respondents, first half of November 2011Copyright 2011 Freeform Dynamics Ltd
  25. 25. Contact Martha Bennett VP, Head of Strategy Freeform Dynamics Ltd 11 The Willows New Milton, Hampshire BH25 7BE Mobile +44 7944 663344 martha@freeformdynamics.com Twitter: @martha_bennett www.freeformdynamics.com 25Copyright 2011 Freeform Dynamics Ltd
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×