BIG DATA TRENDS11/15/2012David FeinleibTHE BIG DATA GROUP   THEBIGDATAGROUP.COM
WHAT IS BIG DATA?THEBIGDATAGROUP.COM
THEBIGDATAGROUP.COM
THEBIGDATAGROUP.COM
+THEBIGDATAGROUP.COM
Outline      1) Landscape - Number of Big Data         Companies and Categories Is Growing      2) Basic Stats - Consumer ...
BASIC STATS - BIG DATA MARKET ROBUST, CONSUMER SCALE FUELING TECH ADOPTION METADATA GROUPTHEBIGDATAGROUP.COM              ...
Apps            Vertical              Ad/Media                 Business      Analytics and                                ...
MARKET GROWTH METADATA GROUPTHEBIGDATAGROUP.COM                      9
Big Data Overall Revenue $5.1B in ’11                   Vendors With Big Data Revenues Over $100M        IBM       Intel  ...
Big Data Pure-Play Revenue $468M in ’11THEBIGDATAGROUP.COM                        11
Big Data Overall Revenue $53.4B By 2017Billions                                      Source: Wikibon  THEBIGDATAGROUP.COM ...
DATA GROWTH METADATA GROUPTHEBIGDATAGROUP.COM                      13
Facebook at 1B Users in Oct ’12              1000               750  UsersIn Millions               500               250 ...
Twitter at 400M Tweets Per Day in Jun ’12          400          300 TweetsPer Day In 200 Millions          100            ...
94% Corporate Data Growth Y/Y         Area                            Growth Rate         Database systems                ...
Big Data: By The Numbers      •   Walmart handles 1M transactions per hour      •   Google processes 24PB of data per day ...
Worldwide Data Growth at 7.9EB / Yr in ‘15            8000            6000 Exabytes            4000            2000       ...
Bandwidth of Our SensesTHEBIGDATAGROUP.COM       Source: Hans Norretranders
Data Sensed Per Year      0.04 EB                     7,910 EB                      200,000X                              ...
THE BIG DATA CYCLE METADATA GROUPTHEBIGDATAGROUP.COM                      21
As Efficiency Increases, So Does Consumption                                 Source: CloudynTHEBIGDATAGROUP.COM            ...
The Big Data Cycle 1 Consumer scale and 1) speed requirements have introduced new technologies that have increased the effi...
6 Insights From Facebook’sFormer Head Of Big Data                       Analytics on 900M users            25PB of compres...
BIG DATA TRANSFORMING BUSINESS METADATA GROUPTHEBIGDATAGROUP.COM                                  25
Transformation of Retail            THEN...             NOW...                           Data driven pricing and          ...
Transformation of Online Marketing                     THEN...                         NOW...                             ...
Transformation of IT         THEN...                     NOW...           Log files       Operational intelligenceTHEBIGDAT...
Transformation of Customer Service         THEN...                NOW...           Unhappy                              Cu...
Transformation of Billing          THEN...              NOW...        Manual coding       Intelligent codingTHEBIGDATAGROU...
Transformation Of Fraud Management          THEN...            NOW...        Credit databases     Social profilesTHEBIGDATA...
Transformation Of Operations Management            THEN...          NOW...                             Automated          ...
Transformation of Law Enforcement            THEN...           NOW...                             Crime hotspot           ...
Transformation of Medical Research           THEN...              NOW...           Keyword                                ...
Transformation of Fitness            THEN...            NOW...               Manual                                 Goals ...
TOP 8 LAWS OF BIG DATA METADATA GROUPTHEBIGDATAGROUP.COM                          36
BIG DATA LAW #1        The faster you analyze your data,        the greater its predictive value.        Companies are mov...
BIG DATA LAW #2        Maintain one copy of your data, not        dozens. The more you copy and move your        data, the...
BIG DATA LAW #3        Use more diverse data, not just        more data. More diverse data leads to        greater insight...
BIG DATA LAW #4        Data has value far beyond what you        originally anticipate. Don’t throw it        away.THEBIGD...
BIG DATA LAW #5        Plan for exponential growth. The        number of photos, emails, and IMs while        large, is li...
BIG DATA LAW #6        Solve a real pain point. Don’t think of        Big Data as a stand-alone new, shiny,        technol...
BIG DATA LAW #7        Put data and humans together to        get the most insight. More data alone        isn’t sufficient...
BIG DATA LAW #8        Big Data is transforming business        the same way IT did. Those that fail to        leverage th...
D2: DATA + DESIGN METADATA GROUPTHEBIGDATAGROUP.COM                      45
Data Informs Design             “The racing technology on the yachts competing for              the America’s Cup will be ...
Design Informs Data               “Visualization is a form of knowledge compression”                                 - Dav...
Big Data Versus RomanceTHEBIGDATAGROUP.COM
SUMMARY METADATA GROUPTHEBIGDATAGROUP.COM                      49
Big Data White Space      1) Visualization - cloud, mobile, collaboration      2) Big Data Apps - verticals      3) Trend ...
Summary      1) Consumer company speed and scale requirements driving         efficiencies in Big Data storage and analytic...
Contact        David Feinleib        dave@thebigdatagroup.comTHEBIGDATAGROUP.COM                52
Upcoming SlideShare
Loading in...5
×

Big Data Trends

66,850

Published on

A presentation on Big Data Trends. Covers market growth, industry transformation, the 3 I's of Big Data, and the 8 Laws of Big Data.

Published in: Technology, Business
9 Comments
232 Likes
Statistics
Notes
No Downloads
Views
Total Views
66,850
On Slideshare
0
From Embeds
0
Number of Embeds
85
Actions
Shares
0
Downloads
4,354
Comments
9
Likes
232
Embeds 0
No embeds

No notes for slide
  • \n
  • \n
  • \n
  • The amount of detail is so impressive you might think this requires an elaborate and expensive set of monitoring gear. \n
  • But unbelievably this can all be captured using a low cost off the shelf device combined with the online Garmin connect software. This truly epitomizes Big Data.\n
  • \n
  • \n
  • http://www.bigdatalandscape.com\n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • Big Data Trends

    1. 1. BIG DATA TRENDS11/15/2012David FeinleibTHE BIG DATA GROUP THEBIGDATAGROUP.COM
    2. 2. WHAT IS BIG DATA?THEBIGDATAGROUP.COM
    3. 3. THEBIGDATAGROUP.COM
    4. 4. THEBIGDATAGROUP.COM
    5. 5. +THEBIGDATAGROUP.COM
    6. 6. Outline 1) Landscape - Number of Big Data Companies and Categories Is Growing 2) Basic Stats - Consumer Scale Driving Big Data Transformation 3) Transformation - Many Industries 4) Top 8 Laws Of Big Data 5) Big Data WhitespaceTHEBIGDATAGROUP.COM 6
    7. 7. BASIC STATS - BIG DATA MARKET ROBUST, CONSUMER SCALE FUELING TECH ADOPTION METADATA GROUPTHEBIGDATAGROUP.COM 7
    8. 8. Apps Vertical Ad/Media Business Analytics and Intelligence Visualization Operational Intelligence Data As A Service Infrastructure Analytics Operational As A Service Structured DB Technologies 8Copyright © 2012 Dave Feinleib dave@thebigdatagroup.com bigdatalandscape.com
    9. 9. MARKET GROWTH METADATA GROUPTHEBIGDATAGROUP.COM 9
    10. 10. Big Data Overall Revenue $5.1B in ’11 Vendors With Big Data Revenues Over $100M IBM Intel HP Fujitsu Accenture CSC Dell Seagate EMC Teradata Amazon SAS Capgemini Hitachi 0 250 500 750 1000 Source: WikibonTHEBIGDATAGROUP.COM 10
    11. 11. Big Data Pure-Play Revenue $468M in ’11THEBIGDATAGROUP.COM 11
    12. 12. Big Data Overall Revenue $53.4B By 2017Billions Source: Wikibon THEBIGDATAGROUP.COM 12
    13. 13. DATA GROWTH METADATA GROUPTHEBIGDATAGROUP.COM 13
    14. 14. Facebook at 1B Users in Oct ’12 1000 750 UsersIn Millions 500 250 Source: Benphoster.com 0 Dec 04 Apr 07 Jan 09 Jul 09 Feb 10 Jan 11 Sep 11 Oct 12 THEBIGDATAGROUP.COM 14
    15. 15. Twitter at 400M Tweets Per Day in Jun ’12 400 300 TweetsPer Day In 200 Millions 100 Source: Twitter blog and news reports 0 Jan 07 Jan 08 Oct 09 Sep 10 Jun 11 Oct 11 Jun 12 THEBIGDATAGROUP.COM 15
    16. 16. 94% Corporate Data Growth Y/Y Area Growth Rate Database systems 97% Overall corporate data 94% Data of average organization 50% Source: ForresterTHEBIGDATAGROUP.COM 16
    17. 17. Big Data: By The Numbers • Walmart handles 1M transactions per hour • Google processes 24PB of data per day • AT&T transfers 30PB of data per day • 90 trillion emails are sent per year • World of Warcraft uses 1.3PB of storageTHEBIGDATAGROUP.COM
    18. 18. Worldwide Data Growth at 7.9EB / Yr in ‘15 8000 6000 Exabytes 4000 2000 0 2005 2010 2015 Source: IDC, EMC. 1EB = 1 Billion GB.THEBIGDATAGROUP.COM
    19. 19. Bandwidth of Our SensesTHEBIGDATAGROUP.COM Source: Hans Norretranders
    20. 20. Data Sensed Per Year 0.04 EB 7,910 EB 200,000X 1EB = 1 Billion GBTHEBIGDATAGROUP.COM
    21. 21. THE BIG DATA CYCLE METADATA GROUPTHEBIGDATAGROUP.COM 21
    22. 22. As Efficiency Increases, So Does Consumption Source: CloudynTHEBIGDATAGROUP.COM 22
    23. 23. The Big Data Cycle 1 Consumer scale and 1) speed requirements have introduced new technologies that have increased the efficiency of 22) This increased efficiency is leading to adoption of Big using Big Data Data across a wide variety of industries 33) This results in the generation and consumption of more dataTHEBIGDATAGROUP.COM 23
    24. 24. 6 Insights From Facebook’sFormer Head Of Big Data Analytics on 900M users 25PB of compressed data - 125PB uncompressed 1) “What data to store” => “What can we do with more data” 2) Simplify data analytics for end users 3) More users means analytics systems have to be more robust 4) Social networking works for Big Data 5) No single infrastructure can solve all Big Data problems 6) Building software is hard; running a service is even harderTHEBIGDATAGROUP.COM 24
    25. 25. BIG DATA TRANSFORMING BUSINESS METADATA GROUPTHEBIGDATAGROUP.COM 25
    26. 26. Transformation of Retail THEN... NOW... Data driven pricing and Sales recommendationsTHEBIGDATAGROUP.COM Image: webdesignerdepot.com 26
    27. 27. Transformation of Online Marketing THEN... NOW... Marketing and Sales Leads RecommendationsCompany First Last Oppty Created Acme Fred Langan $250K 6/08/12 BigCo Tom Jones $100K 6/17/12 Campaign DealCo Jan Sedor $50K 7/01/12 RecommendationsStor Works Liza Grear $750K 7/14/12RF Group Carl Tomer $47K 7/18/12THEBIGDATAGROUP.COM 27
    28. 28. Transformation of IT THEN... NOW... Log files Operational intelligenceTHEBIGDATAGROUP.COM Image: blog.getsocialize.com/2012/location-showcase 28
    29. 29. Transformation of Customer Service THEN... NOW... Unhappy Customer insight customersTHEBIGDATAGROUP.COM Chart: Zendesk 29
    30. 30. Transformation of Billing THEN... NOW... Manual coding Intelligent codingTHEBIGDATAGROUP.COM 30
    31. 31. Transformation Of Fraud Management THEN... NOW... Credit databases Social profilesTHEBIGDATAGROUP.COM 31
    32. 32. Transformation Of Operations Management THEN... NOW... Automated Operations? operationsTHEBIGDATAGROUP.COM Images: Jalopnik.com, SFPark 32
    33. 33. Transformation of Law Enforcement THEN... NOW... Crime hotspot Gut instinct predictionTHEBIGDATAGROUP.COM Images: Fanpop.com, paleo.sscnet.ucla.edu 33
    34. 34. Transformation of Medical Research THEN... NOW... Keyword Relevance searchesTHEBIGDATAGROUP.COM Images: PubMed, Atigeo 34
    35. 35. Transformation of Fitness THEN... NOW... Manual Goals + tracking measurement Walk 45 minutes Smoothie Lift weights 20 minutesTHEBIGDATAGROUP.COM Image: Store.Nike.com 35
    36. 36. TOP 8 LAWS OF BIG DATA METADATA GROUPTHEBIGDATAGROUP.COM 36
    37. 37. BIG DATA LAW #1 The faster you analyze your data, the greater its predictive value. Companies are moving away from batch processing to real-time to gain competitive advantage.THEBIGDATAGROUP.COM 37
    38. 38. BIG DATA LAW #2 Maintain one copy of your data, not dozens. The more you copy and move your data, the less reliable it becomes (example: banking crisis).THEBIGDATAGROUP.COM 38
    39. 39. BIG DATA LAW #3 Use more diverse data, not just more data. More diverse data leads to greater insights. Combining multiple data sources can lead to the most interesting insights of all.THEBIGDATAGROUP.COM 39
    40. 40. BIG DATA LAW #4 Data has value far beyond what you originally anticipate. Don’t throw it away.THEBIGDATAGROUP.COM 40
    41. 41. BIG DATA LAW #5 Plan for exponential growth. The number of photos, emails, and IMs while large, is limited by the number of people. Networked “sensor” data from mobile phones, GPS, and other devices is much larger.THEBIGDATAGROUP.COM 41
    42. 42. BIG DATA LAW #6 Solve a real pain point. Don’t think of Big Data as a stand-alone new, shiny, technology. Think about your core business problems and how to solve them by analyzing Big Data.THEBIGDATAGROUP.COM 42
    43. 43. BIG DATA LAW #7 Put data and humans together to get the most insight. More data alone isn’t sufficient. Look for ways to broaden the use of data across your organization.THEBIGDATAGROUP.COM 43
    44. 44. BIG DATA LAW #8 Big Data is transforming business the same way IT did. Those that fail to leverage the numerous internal and external data sources available will be leapfrogged by new entrants.THEBIGDATAGROUP.COM 44
    45. 45. D2: DATA + DESIGN METADATA GROUPTHEBIGDATAGROUP.COM 45
    46. 46. Data Informs Design “The racing technology on the yachts competing for the America’s Cup will be the most advanced ever” - The Wall Street Journal MarketWatchTHEBIGDATAGROUP.COM
    47. 47. Design Informs Data “Visualization is a form of knowledge compression” - David McCandlessTHEBIGDATAGROUP.COM
    48. 48. Big Data Versus RomanceTHEBIGDATAGROUP.COM
    49. 49. SUMMARY METADATA GROUPTHEBIGDATAGROUP.COM 49
    50. 50. Big Data White Space 1) Visualization - cloud, mobile, collaboration 2) Big Data Apps - verticals 3) Trend analysis across multiple data sources 4) Consumer behavior 5) Public data for scoring 6) New information / data service businessesTHEBIGDATAGROUP.COM 50
    51. 51. Summary 1) Consumer company speed and scale requirements driving efficiencies in Big Data storage and analytics 2) Quantity of machine data vastly increasing (examples: networked sensor data from mobile phones and GPS devices) 3) Move away from batch to real-time 4) Cloud services opening Big Data to all 5) New and broader number of data sources being meshed together 6) Big Data Apps (BDAs) means using Big Data is faster and easierTHEBIGDATAGROUP.COM 51
    52. 52. Contact David Feinleib dave@thebigdatagroup.comTHEBIGDATAGROUP.COM 52
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×