Big Data Trends

David Feinleib
David FeinleibDavid Feinleib at Content Analytics
BIG DATA TRENDS



11/15/2012
David Feinleib




THE BIG DATA GROUP   THEBIGDATAGROUP.COM
WHAT IS BIG DATA?




THEBIGDATAGROUP.COM
THEBIGDATAGROUP.COM
THEBIGDATAGROUP.COM
+




THEBIGDATAGROUP.COM
Outline



      1) Landscape - Number of Big Data
         Companies and Categories Is Growing
      2) Basic Stats - Consumer Scale Driving Big
         Data Transformation
      3) Transformation - Many Industries
      4) Top 8 Laws Of Big Data
      5) Big Data Whitespace

THEBIGDATAGROUP.COM                                 6
BASIC STATS - BIG DATA MARKET ROBUST,
 CONSUMER SCALE FUELING TECH ADOPTION




 METADATA GROUP
THEBIGDATAGROUP.COM
                                         7
Apps
            Vertical              Ad/Media                 Business      Analytics and
                                                         Intelligence    Visualization

     Operational Intelligence




                    Data As A Service


                                          Infrastructure
           Analytics             Operational            As A Service    Structured DB




                                          Technologies
                                                   8
Copyright © 2012 Dave Feinleib          dave@thebigdatagroup.com             bigdatalandscape.com
MARKET GROWTH




 METADATA GROUP
THEBIGDATAGROUP.COM
                      9
Big Data Overall Revenue $5.1B in ’11

                   Vendors With Big Data Revenues Over $100M

        IBM
       Intel
         HP
     Fujitsu
  Accenture
       CSC
        Dell
    Seagate
       EMC
   Teradata
   Amazon
        SAS
  Capgemini
     Hitachi
               0        250          500           750            1000
                                                         Source: Wikibon

THEBIGDATAGROUP.COM                                                        10
Big Data Pure-Play Revenue $468M in ’11




THEBIGDATAGROUP.COM                        11
Big Data Overall Revenue $53.4B By 2017




Billions




                                      Source: Wikibon

  THEBIGDATAGROUP.COM                                   12
DATA GROWTH




 METADATA GROUP
THEBIGDATAGROUP.COM
                      13
Facebook at 1B Users in Oct ’12

              1000



               750

  Users
In Millions
               500



               250


                                                                  Source: Benphoster.com
                0
                Dec 04   Apr 07   Jan 09   Jul 09   Feb 10   Jan 11    Sep 11      Oct 12


 THEBIGDATAGROUP.COM                                                                        14
Twitter at 400M Tweets Per Day in Jun ’12

          400



          300


 Tweets
Per Day In 200
 Millions


          100



                                                Source: Twitter blog and news reports
            0
            Jan 07   Jan 08   Oct 09   Sep 10      Jun 11        Oct 11          Jun 12

  THEBIGDATAGROUP.COM                                                                     15
94% Corporate Data Growth Y/Y



         Area                            Growth Rate

         Database systems                    97%

         Overall corporate data              94%

          Data of average organization       50%

                                               Source: Forrester




THEBIGDATAGROUP.COM                                                16
Big Data: By The Numbers




      •   Walmart handles 1M transactions per hour
      •   Google processes 24PB of data per day
      •   AT&T transfers 30PB of data per day
      •   90 trillion emails are sent per year
      •   World of Warcraft uses 1.3PB of storage


THEBIGDATAGROUP.COM
Worldwide Data Growth at 7.9EB / Yr in ‘15

            8000



            6000
 Exabytes




            4000



            2000



               0
                   2005   2010                    2015
                                 Source: IDC, EMC. 1EB = 1 Billion GB.

THEBIGDATAGROUP.COM
Bandwidth of Our Senses




THEBIGDATAGROUP.COM       Source: Hans Norretranders
Data Sensed Per Year


      0.04 EB                     7,910 EB



                      200,000X




                                 1EB = 1 Billion GB
THEBIGDATAGROUP.COM
THE BIG DATA CYCLE




 METADATA GROUP
THEBIGDATAGROUP.COM
                      21
As Efficiency Increases, So Does Consumption




                                 Source: Cloudyn


THEBIGDATAGROUP.COM                                22
The Big Data Cycle


 1 Consumer scale and
 1)
 speed requirements have
 introduced new
 technologies that have
 increased the efficiency of
                                            22) This increased efficiency
                                             is leading to adoption of Big
 using Big Data
                                             Data across a wide variety
                                             of industries

                        33) This results in the
                         generation and
                         consumption of more
                         data

THEBIGDATAGROUP.COM                                                     23
6 Insights From Facebook’s
Former Head Of Big Data
                       Analytics on 900M users
            25PB of compressed data - 125PB uncompressed




     1) “What data to store” => “What can we do with more data”
     2) Simplify data analytics for end users
     3) More users means analytics systems have to be more robust
     4) Social networking works for Big Data
     5) No single infrastructure can solve all Big Data problems
     6) Building software is hard; running a service is even harder



THEBIGDATAGROUP.COM                                                   24
BIG DATA TRANSFORMING BUSINESS




 METADATA GROUP
THEBIGDATAGROUP.COM
                                  25
Transformation of Retail

            THEN...             NOW...
                           Data driven pricing and
               Sales
                             recommendations




THEBIGDATAGROUP.COM                   Image: webdesignerdepot.com   26
Transformation of Online Marketing

                     THEN...                         NOW...
                                                 Marketing and Sales
                      Leads
                                                 Recommendations

Company      First    Last     Oppty   Created


  Acme       Fred     Langan   $250K   6/08/12
  BigCo      Tom      Jones    $100K   6/17/12
                                                     Campaign
 DealCo       Jan     Sedor    $50K    7/01/12
                                                  Recommendations
Stor Works   Liza     Grear    $750K   7/14/12

RF Group     Carl     Tomer    $47K    7/18/12




THEBIGDATAGROUP.COM                                                    27
Transformation of IT

         THEN...                     NOW...
           Log files       Operational intelligence




THEBIGDATAGROUP.COM    Image: blog.getsocialize.com/2012/location-showcase   28
Transformation of Customer Service

         THEN...                NOW...
           Unhappy
                              Customer insight
          customers




THEBIGDATAGROUP.COM                        Chart: Zendesk   29
Transformation of Billing

          THEN...              NOW...
        Manual coding       Intelligent coding




THEBIGDATAGROUP.COM                              30
Transformation Of Fraud Management

          THEN...            NOW...
        Credit databases     Social profiles




THEBIGDATAGROUP.COM                           31
Transformation Of Operations Management

            THEN...          NOW...
                             Automated
            Operations?
                             operations




THEBIGDATAGROUP.COM           Images: Jalopnik.com, SFPark   32
Transformation of Law Enforcement

            THEN...           NOW...
                             Crime hotspot
            Gut instinct
                               prediction




THEBIGDATAGROUP.COM            Images: Fanpop.com, paleo.sscnet.ucla.edu   33
Transformation of Medical Research

           THEN...              NOW...
           Keyword
                                Relevance
           searches




THEBIGDATAGROUP.COM                  Images: PubMed, Atigeo   34
Transformation of Fitness

            THEN...            NOW...
               Manual
                                 Goals +
              tracking
                               measurement



     Walk 45 minutes
     Smoothie
     Lift weights 20 minutes




THEBIGDATAGROUP.COM               Image: Store.Nike.com   35
TOP 8 LAWS OF BIG DATA




 METADATA GROUP
THEBIGDATAGROUP.COM
                          36
BIG DATA LAW #1



        The faster you analyze your data,
        the greater its predictive value.
        Companies are moving away from batch
        processing to real-time to gain competitive
        advantage.




THEBIGDATAGROUP.COM                                   37
BIG DATA LAW #2




        Maintain one copy of your data, not
        dozens. The more you copy and move your
        data, the less reliable it becomes (example:
        banking crisis).




THEBIGDATAGROUP.COM                                    38
BIG DATA LAW #3




        Use more diverse data, not just
        more data. More diverse data leads to
        greater insights. Combining multiple data
        sources can lead to the most interesting
        insights of all.



THEBIGDATAGROUP.COM                                 39
BIG DATA LAW #4




        Data has value far beyond what you
        originally anticipate. Don’t throw it
        away.




THEBIGDATAGROUP.COM                             40
BIG DATA LAW #5



        Plan for exponential growth. The
        number of photos, emails, and IMs while
        large, is limited by the number of people.
        Networked “sensor” data from mobile
        phones, GPS, and other devices is much
        larger.



THEBIGDATAGROUP.COM                                  41
BIG DATA LAW #6



        Solve a real pain point. Don’t think of
        Big Data as a stand-alone new, shiny,
        technology. Think about your core business
        problems and how to solve them by
        analyzing Big Data.




THEBIGDATAGROUP.COM                                  42
BIG DATA LAW #7




        Put data and humans together to
        get the most insight. More data alone
        isn’t sufficient. Look for ways to broaden the
        use of data across your organization.




THEBIGDATAGROUP.COM                                     43
BIG DATA LAW #8




        Big Data is transforming business
        the same way IT did. Those that fail to
        leverage the numerous internal and external
        data sources available will be leapfrogged by
        new entrants.




THEBIGDATAGROUP.COM                                     44
D2: DATA + DESIGN




 METADATA GROUP
THEBIGDATAGROUP.COM
                      45
Data Informs Design




             “The racing technology on the yachts competing for
              the America’s Cup will be the most advanced ever”
                      - The Wall Street Journal MarketWatch

THEBIGDATAGROUP.COM
Design Informs Data




               “Visualization is a form of knowledge compression”
                                 - David McCandless


THEBIGDATAGROUP.COM
Big Data Versus Romance




THEBIGDATAGROUP.COM
SUMMARY




 METADATA GROUP
THEBIGDATAGROUP.COM
                      49
Big Data White Space



      1) Visualization - cloud, mobile, collaboration
      2) Big Data Apps - verticals
      3) Trend analysis across multiple data sources
      4) Consumer behavior
      5) Public data for scoring
      6) New information / data service businesses

THEBIGDATAGROUP.COM                                     50
Summary


      1) Consumer company speed and scale requirements driving
         efficiencies in Big Data storage and analytics

      2) Quantity of machine data vastly increasing (examples:
         networked sensor data from mobile phones and GPS devices)

      3) Move away from batch to real-time

      4) Cloud services opening Big Data to all

      5) New and broader number of data sources being meshed
         together

      6) Big Data Apps (BDAs) means using Big Data is faster and
         easier

THEBIGDATAGROUP.COM                                                  51
Contact




        David Feinleib
        dave@thebigdatagroup.com




THEBIGDATAGROUP.COM                52
1 of 52

Recommended

Big Data Analytics by
Big Data AnalyticsBig Data Analytics
Big Data AnalyticsGhulam Imaduddin
35.1K views52 slides
Big Data Trends by
Big Data TrendsBig Data Trends
Big Data TrendsCollabor8now Ltd
5.8K views16 slides
Big data by
Big dataBig data
Big dataAmi Redwan Haq
4.2K views31 slides
Big Data ppt by
Big Data pptBig Data ppt
Big Data pptVivek Gautam
1.6K views31 slides
Big Data by
Big DataBig Data
Big DataSeminar Links
8.6K views16 slides
Big data analytics by
Big data analyticsBig data analytics
Big data analyticsVikram Nandini
6.7K views46 slides

More Related Content

What's hot

What is big data? by
What is big data?What is big data?
What is big data?David Wellman
184.4K views54 slides
Three Big Data Case Studies by
Three Big Data Case StudiesThree Big Data Case Studies
Three Big Data Case StudiesAtidan Technologies Pvt Ltd (India)
7K views17 slides
Data Analytics For Beginners | Introduction To Data Analytics | Data Analytic... by
Data Analytics For Beginners | Introduction To Data Analytics | Data Analytic...Data Analytics For Beginners | Introduction To Data Analytics | Data Analytic...
Data Analytics For Beginners | Introduction To Data Analytics | Data Analytic...Edureka!
6.1K views34 slides
Tableau Presentation by
Tableau PresentationTableau Presentation
Tableau PresentationAndrea Bissoli
45.7K views43 slides
Big data ppt by
Big data pptBig data ppt
Big data pptDeepika ParthaSarathy
6.1K views34 slides
Big data by
Big dataBig data
Big dataFACTS Computer Software L.L.C
2.7K views20 slides

What's hot(20)

What is big data? by David Wellman
What is big data?What is big data?
What is big data?
David Wellman184.4K views
Data Analytics For Beginners | Introduction To Data Analytics | Data Analytic... by Edureka!
Data Analytics For Beginners | Introduction To Data Analytics | Data Analytic...Data Analytics For Beginners | Introduction To Data Analytics | Data Analytic...
Data Analytics For Beginners | Introduction To Data Analytics | Data Analytic...
Edureka!6.1K views
Big data ppt by Shweta Sahu
Big data pptBig data ppt
Big data ppt
Shweta Sahu10.7K views
Big data introduction by Chirag Ahuja
Big data introductionBig data introduction
Big data introduction
Chirag Ahuja1.3K views
Presentation on Big Data Analytics by S P Sajjan
Presentation on Big Data AnalyticsPresentation on Big Data Analytics
Presentation on Big Data Analytics
S P Sajjan11.6K views
Data analytics introduction by amiyadash
Data analytics introductionData analytics introduction
Data analytics introduction
amiyadash197 views
Big Data Characteristics And Process PowerPoint Presentation Slides by SlideTeam
Big Data Characteristics And Process PowerPoint Presentation SlidesBig Data Characteristics And Process PowerPoint Presentation Slides
Big Data Characteristics And Process PowerPoint Presentation Slides
SlideTeam764 views
Introduction to Data Analytics by Utkarsh Sharma
Introduction to Data AnalyticsIntroduction to Data Analytics
Introduction to Data Analytics
Utkarsh Sharma947 views
Presentation About Big Data (DBMS) by SiamAhmed16
Presentation About Big Data (DBMS)Presentation About Big Data (DBMS)
Presentation About Big Data (DBMS)
SiamAhmed161.4K views
Big Data Architecture by Guido Schmutz
Big Data ArchitectureBig Data Architecture
Big Data Architecture
Guido Schmutz25.2K views

Similar to Big Data Trends

Big Data Trends - WorldFuture 2015 Conference by
Big Data Trends - WorldFuture 2015 ConferenceBig Data Trends - WorldFuture 2015 Conference
Big Data Trends - WorldFuture 2015 ConferenceDavid Feinleib
4.2K views56 slides
Big Data: Industry trends and key players by
Big Data: Industry trends and key playersBig Data: Industry trends and key players
Big Data: Industry trends and key playersCM Research
20.3K views25 slides
Big data PPT prepared by Hritika Raj (Shivalik college of engg.) by
Big data PPT prepared by Hritika Raj (Shivalik college of engg.)Big data PPT prepared by Hritika Raj (Shivalik college of engg.)
Big data PPT prepared by Hritika Raj (Shivalik college of engg.)Hritika Raj
1.2K views25 slides
bigdata.pptx by
bigdata.pptxbigdata.pptx
bigdata.pptxKammetaJoshna
10 views25 slides
Big data Analytics by
Big data Analytics Big data Analytics
Big data Analytics Guduru Lakshmi Kiranmai
5.5K views28 slides
big-data-8722-m8RQ3h1.pptx by
big-data-8722-m8RQ3h1.pptxbig-data-8722-m8RQ3h1.pptx
big-data-8722-m8RQ3h1.pptxVaishnavGhadge1
6 views31 slides

Similar to Big Data Trends(20)

Big Data Trends - WorldFuture 2015 Conference by David Feinleib
Big Data Trends - WorldFuture 2015 ConferenceBig Data Trends - WorldFuture 2015 Conference
Big Data Trends - WorldFuture 2015 Conference
David Feinleib4.2K views
Big Data: Industry trends and key players by CM Research
Big Data: Industry trends and key playersBig Data: Industry trends and key players
Big Data: Industry trends and key players
CM Research20.3K views
Big data PPT prepared by Hritika Raj (Shivalik college of engg.) by Hritika Raj
Big data PPT prepared by Hritika Raj (Shivalik college of engg.)Big data PPT prepared by Hritika Raj (Shivalik college of engg.)
Big data PPT prepared by Hritika Raj (Shivalik college of engg.)
Hritika Raj1.2K views
Big Data By Vijay Bhaskar Semwal by IIIT Allahabad
Big Data By Vijay Bhaskar SemwalBig Data By Vijay Bhaskar Semwal
Big Data By Vijay Bhaskar Semwal
IIIT Allahabad2.7K views
Big data using Public Cloud by IMC Institute
Big data using Public CloudBig data using Public Cloud
Big data using Public Cloud
IMC Institute4.7K views
Our big data by uthrarajan
Our big dataOur big data
Our big data
uthrarajan612 views
Big data Presentation by Aswadmehar
Big data PresentationBig data Presentation
Big data Presentation
Aswadmehar1.1K views
10 technical trends that will dramatically change our daily lives by 2025 by Jon Nordmark
10 technical trends that will dramatically change our daily lives by 202510 technical trends that will dramatically change our daily lives by 2025
10 technical trends that will dramatically change our daily lives by 2025
Jon Nordmark174 views
10 dynamics that will change the market by 2025 by Iterate.ai
10 dynamics that will change the market by 202510 dynamics that will change the market by 2025
10 dynamics that will change the market by 2025
Iterate.ai 194 views
Konceptuelt overblik over Big Data, Flemming Bagger, IBM by IBM Danmark
Konceptuelt overblik over Big Data, Flemming Bagger, IBMKonceptuelt overblik over Big Data, Flemming Bagger, IBM
Konceptuelt overblik over Big Data, Flemming Bagger, IBM
IBM Danmark803 views
Integra: Summiting the Mountain of Big Data (Infographic) by Jessica Legg
Integra: Summiting the Mountain of Big Data (Infographic)Integra: Summiting the Mountain of Big Data (Infographic)
Integra: Summiting the Mountain of Big Data (Infographic)
Jessica Legg636 views
BIG DATA & DATA ANALYTICS by NAGARAJAGIDDE
BIG  DATA & DATA  ANALYTICSBIG  DATA & DATA  ANALYTICS
BIG DATA & DATA ANALYTICS
NAGARAJAGIDDE382 views

Recently uploaded

Special_edition_innovator_2023.pdf by
Special_edition_innovator_2023.pdfSpecial_edition_innovator_2023.pdf
Special_edition_innovator_2023.pdfWillDavies22
16 views6 slides
Igniting Next Level Productivity with AI-Infused Data Integration Workflows by
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Safe Software
225 views86 slides
Vertical User Stories by
Vertical User StoriesVertical User Stories
Vertical User StoriesMoisés Armani Ramírez
11 views16 slides
Kyo - Functional Scala 2023.pdf by
Kyo - Functional Scala 2023.pdfKyo - Functional Scala 2023.pdf
Kyo - Functional Scala 2023.pdfFlavio W. Brasil
165 views92 slides
Java Platform Approach 1.0 - Picnic Meetup by
Java Platform Approach 1.0 - Picnic MeetupJava Platform Approach 1.0 - Picnic Meetup
Java Platform Approach 1.0 - Picnic MeetupRick Ossendrijver
25 views39 slides
AMAZON PRODUCT RESEARCH.pdf by
AMAZON PRODUCT RESEARCH.pdfAMAZON PRODUCT RESEARCH.pdf
AMAZON PRODUCT RESEARCH.pdfJerikkLaureta
15 views13 slides

Recently uploaded(20)

Special_edition_innovator_2023.pdf by WillDavies22
Special_edition_innovator_2023.pdfSpecial_edition_innovator_2023.pdf
Special_edition_innovator_2023.pdf
WillDavies2216 views
Igniting Next Level Productivity with AI-Infused Data Integration Workflows by Safe Software
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Safe Software225 views
AMAZON PRODUCT RESEARCH.pdf by JerikkLaureta
AMAZON PRODUCT RESEARCH.pdfAMAZON PRODUCT RESEARCH.pdf
AMAZON PRODUCT RESEARCH.pdf
JerikkLaureta15 views
1st parposal presentation.pptx by i238212
1st parposal presentation.pptx1st parposal presentation.pptx
1st parposal presentation.pptx
i2382129 views
Transcript: The Details of Description Techniques tips and tangents on altern... by BookNet Canada
Transcript: The Details of Description Techniques tips and tangents on altern...Transcript: The Details of Description Techniques tips and tangents on altern...
Transcript: The Details of Description Techniques tips and tangents on altern...
BookNet Canada130 views
Case Study Copenhagen Energy and Business Central.pdf by Aitana
Case Study Copenhagen Energy and Business Central.pdfCase Study Copenhagen Energy and Business Central.pdf
Case Study Copenhagen Energy and Business Central.pdf
Aitana12 views
Spesifikasi Lengkap ASUS Vivobook Go 14 by Dot Semarang
Spesifikasi Lengkap ASUS Vivobook Go 14Spesifikasi Lengkap ASUS Vivobook Go 14
Spesifikasi Lengkap ASUS Vivobook Go 14
Dot Semarang35 views
handbook for web 3 adoption.pdf by Liveplex
handbook for web 3 adoption.pdfhandbook for web 3 adoption.pdf
handbook for web 3 adoption.pdf
Liveplex19 views
HTTP headers that make your website go faster - devs.gent November 2023 by Thijs Feryn
HTTP headers that make your website go faster - devs.gent November 2023HTTP headers that make your website go faster - devs.gent November 2023
HTTP headers that make your website go faster - devs.gent November 2023
Thijs Feryn19 views
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N... by James Anderson
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...
James Anderson33 views
PharoJS - Zürich Smalltalk Group Meetup November 2023 by Noury Bouraqadi
PharoJS - Zürich Smalltalk Group Meetup November 2023PharoJS - Zürich Smalltalk Group Meetup November 2023
PharoJS - Zürich Smalltalk Group Meetup November 2023
Noury Bouraqadi120 views
STPI OctaNE CoE Brochure.pdf by madhurjyapb
STPI OctaNE CoE Brochure.pdfSTPI OctaNE CoE Brochure.pdf
STPI OctaNE CoE Brochure.pdf
madhurjyapb12 views
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive by Network Automation Forum
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLiveAutomating a World-Class Technology Conference; Behind the Scenes of CiscoLive
Automating a World-Class Technology Conference; Behind the Scenes of CiscoLive
Web Dev - 1 PPT.pdf by gdsczhcet
Web Dev - 1 PPT.pdfWeb Dev - 1 PPT.pdf
Web Dev - 1 PPT.pdf
gdsczhcet55 views
Attacking IoT Devices from a Web Perspective - Linux Day by Simone Onofri
Attacking IoT Devices from a Web Perspective - Linux Day Attacking IoT Devices from a Web Perspective - Linux Day
Attacking IoT Devices from a Web Perspective - Linux Day
Simone Onofri15 views

Big Data Trends

  • 1. BIG DATA TRENDS 11/15/2012 David Feinleib THE BIG DATA GROUP THEBIGDATAGROUP.COM
  • 2. WHAT IS BIG DATA? THEBIGDATAGROUP.COM
  • 6. Outline 1) Landscape - Number of Big Data Companies and Categories Is Growing 2) Basic Stats - Consumer Scale Driving Big Data Transformation 3) Transformation - Many Industries 4) Top 8 Laws Of Big Data 5) Big Data Whitespace THEBIGDATAGROUP.COM 6
  • 7. BASIC STATS - BIG DATA MARKET ROBUST, CONSUMER SCALE FUELING TECH ADOPTION METADATA GROUP THEBIGDATAGROUP.COM 7
  • 8. Apps Vertical Ad/Media Business Analytics and Intelligence Visualization Operational Intelligence Data As A Service Infrastructure Analytics Operational As A Service Structured DB Technologies 8 Copyright © 2012 Dave Feinleib dave@thebigdatagroup.com bigdatalandscape.com
  • 9. MARKET GROWTH METADATA GROUP THEBIGDATAGROUP.COM 9
  • 10. Big Data Overall Revenue $5.1B in ’11 Vendors With Big Data Revenues Over $100M IBM Intel HP Fujitsu Accenture CSC Dell Seagate EMC Teradata Amazon SAS Capgemini Hitachi 0 250 500 750 1000 Source: Wikibon THEBIGDATAGROUP.COM 10
  • 11. Big Data Pure-Play Revenue $468M in ’11 THEBIGDATAGROUP.COM 11
  • 12. Big Data Overall Revenue $53.4B By 2017 Billions Source: Wikibon THEBIGDATAGROUP.COM 12
  • 13. DATA GROWTH METADATA GROUP THEBIGDATAGROUP.COM 13
  • 14. Facebook at 1B Users in Oct ’12 1000 750 Users In Millions 500 250 Source: Benphoster.com 0 Dec 04 Apr 07 Jan 09 Jul 09 Feb 10 Jan 11 Sep 11 Oct 12 THEBIGDATAGROUP.COM 14
  • 15. Twitter at 400M Tweets Per Day in Jun ’12 400 300 Tweets Per Day In 200 Millions 100 Source: Twitter blog and news reports 0 Jan 07 Jan 08 Oct 09 Sep 10 Jun 11 Oct 11 Jun 12 THEBIGDATAGROUP.COM 15
  • 16. 94% Corporate Data Growth Y/Y Area Growth Rate Database systems 97% Overall corporate data 94% Data of average organization 50% Source: Forrester THEBIGDATAGROUP.COM 16
  • 17. Big Data: By The Numbers • Walmart handles 1M transactions per hour • Google processes 24PB of data per day • AT&T transfers 30PB of data per day • 90 trillion emails are sent per year • World of Warcraft uses 1.3PB of storage THEBIGDATAGROUP.COM
  • 18. Worldwide Data Growth at 7.9EB / Yr in ‘15 8000 6000 Exabytes 4000 2000 0 2005 2010 2015 Source: IDC, EMC. 1EB = 1 Billion GB. THEBIGDATAGROUP.COM
  • 19. Bandwidth of Our Senses THEBIGDATAGROUP.COM Source: Hans Norretranders
  • 20. Data Sensed Per Year 0.04 EB 7,910 EB 200,000X 1EB = 1 Billion GB THEBIGDATAGROUP.COM
  • 21. THE BIG DATA CYCLE METADATA GROUP THEBIGDATAGROUP.COM 21
  • 22. As Efficiency Increases, So Does Consumption Source: Cloudyn THEBIGDATAGROUP.COM 22
  • 23. The Big Data Cycle 1 Consumer scale and 1) speed requirements have introduced new technologies that have increased the efficiency of 22) This increased efficiency is leading to adoption of Big using Big Data Data across a wide variety of industries 33) This results in the generation and consumption of more data THEBIGDATAGROUP.COM 23
  • 24. 6 Insights From Facebook’s Former Head Of Big Data Analytics on 900M users 25PB of compressed data - 125PB uncompressed 1) “What data to store” => “What can we do with more data” 2) Simplify data analytics for end users 3) More users means analytics systems have to be more robust 4) Social networking works for Big Data 5) No single infrastructure can solve all Big Data problems 6) Building software is hard; running a service is even harder THEBIGDATAGROUP.COM 24
  • 25. BIG DATA TRANSFORMING BUSINESS METADATA GROUP THEBIGDATAGROUP.COM 25
  • 26. Transformation of Retail THEN... NOW... Data driven pricing and Sales recommendations THEBIGDATAGROUP.COM Image: webdesignerdepot.com 26
  • 27. Transformation of Online Marketing THEN... NOW... Marketing and Sales Leads Recommendations Company First Last Oppty Created Acme Fred Langan $250K 6/08/12 BigCo Tom Jones $100K 6/17/12 Campaign DealCo Jan Sedor $50K 7/01/12 Recommendations Stor Works Liza Grear $750K 7/14/12 RF Group Carl Tomer $47K 7/18/12 THEBIGDATAGROUP.COM 27
  • 28. Transformation of IT THEN... NOW... Log files Operational intelligence THEBIGDATAGROUP.COM Image: blog.getsocialize.com/2012/location-showcase 28
  • 29. Transformation of Customer Service THEN... NOW... Unhappy Customer insight customers THEBIGDATAGROUP.COM Chart: Zendesk 29
  • 30. Transformation of Billing THEN... NOW... Manual coding Intelligent coding THEBIGDATAGROUP.COM 30
  • 31. Transformation Of Fraud Management THEN... NOW... Credit databases Social profiles THEBIGDATAGROUP.COM 31
  • 32. Transformation Of Operations Management THEN... NOW... Automated Operations? operations THEBIGDATAGROUP.COM Images: Jalopnik.com, SFPark 32
  • 33. Transformation of Law Enforcement THEN... NOW... Crime hotspot Gut instinct prediction THEBIGDATAGROUP.COM Images: Fanpop.com, paleo.sscnet.ucla.edu 33
  • 34. Transformation of Medical Research THEN... NOW... Keyword Relevance searches THEBIGDATAGROUP.COM Images: PubMed, Atigeo 34
  • 35. Transformation of Fitness THEN... NOW... Manual Goals + tracking measurement Walk 45 minutes Smoothie Lift weights 20 minutes THEBIGDATAGROUP.COM Image: Store.Nike.com 35
  • 36. TOP 8 LAWS OF BIG DATA METADATA GROUP THEBIGDATAGROUP.COM 36
  • 37. BIG DATA LAW #1 The faster you analyze your data, the greater its predictive value. Companies are moving away from batch processing to real-time to gain competitive advantage. THEBIGDATAGROUP.COM 37
  • 38. BIG DATA LAW #2 Maintain one copy of your data, not dozens. The more you copy and move your data, the less reliable it becomes (example: banking crisis). THEBIGDATAGROUP.COM 38
  • 39. BIG DATA LAW #3 Use more diverse data, not just more data. More diverse data leads to greater insights. Combining multiple data sources can lead to the most interesting insights of all. THEBIGDATAGROUP.COM 39
  • 40. BIG DATA LAW #4 Data has value far beyond what you originally anticipate. Don’t throw it away. THEBIGDATAGROUP.COM 40
  • 41. BIG DATA LAW #5 Plan for exponential growth. The number of photos, emails, and IMs while large, is limited by the number of people. Networked “sensor” data from mobile phones, GPS, and other devices is much larger. THEBIGDATAGROUP.COM 41
  • 42. BIG DATA LAW #6 Solve a real pain point. Don’t think of Big Data as a stand-alone new, shiny, technology. Think about your core business problems and how to solve them by analyzing Big Data. THEBIGDATAGROUP.COM 42
  • 43. BIG DATA LAW #7 Put data and humans together to get the most insight. More data alone isn’t sufficient. Look for ways to broaden the use of data across your organization. THEBIGDATAGROUP.COM 43
  • 44. BIG DATA LAW #8 Big Data is transforming business the same way IT did. Those that fail to leverage the numerous internal and external data sources available will be leapfrogged by new entrants. THEBIGDATAGROUP.COM 44
  • 45. D2: DATA + DESIGN METADATA GROUP THEBIGDATAGROUP.COM 45
  • 46. Data Informs Design “The racing technology on the yachts competing for the America’s Cup will be the most advanced ever” - The Wall Street Journal MarketWatch THEBIGDATAGROUP.COM
  • 47. Design Informs Data “Visualization is a form of knowledge compression” - David McCandless THEBIGDATAGROUP.COM
  • 48. Big Data Versus Romance THEBIGDATAGROUP.COM
  • 50. Big Data White Space 1) Visualization - cloud, mobile, collaboration 2) Big Data Apps - verticals 3) Trend analysis across multiple data sources 4) Consumer behavior 5) Public data for scoring 6) New information / data service businesses THEBIGDATAGROUP.COM 50
  • 51. Summary 1) Consumer company speed and scale requirements driving efficiencies in Big Data storage and analytics 2) Quantity of machine data vastly increasing (examples: networked sensor data from mobile phones and GPS devices) 3) Move away from batch to real-time 4) Cloud services opening Big Data to all 5) New and broader number of data sources being meshed together 6) Big Data Apps (BDAs) means using Big Data is faster and easier THEBIGDATAGROUP.COM 51
  • 52. Contact David Feinleib dave@thebigdatagroup.com THEBIGDATAGROUP.COM 52

Editor's Notes

  1. \n
  2. \n
  3. \n
  4. The amount of detail is so impressive you might think this requires an elaborate and expensive set of monitoring gear. \n
  5. But unbelievably this can all be captured using a low cost off the shelf device combined with the online Garmin connect software. This truly epitomizes Big Data.\n
  6. \n
  7. \n
  8. http://www.bigdatalandscape.com\n
  9. \n
  10. \n
  11. \n
  12. \n
  13. \n
  14. \n
  15. \n
  16. \n
  17. \n
  18. \n
  19. \n
  20. \n
  21. \n
  22. \n
  23. \n
  24. \n
  25. \n
  26. \n
  27. \n
  28. \n
  29. \n
  30. \n
  31. \n
  32. \n
  33. \n
  34. \n
  35. \n
  36. \n
  37. \n
  38. \n
  39. \n
  40. \n
  41. \n
  42. \n
  43. \n
  44. \n
  45. \n
  46. \n
  47. \n
  48. \n
  49. \n
  50. \n
  51. \n
  52. \n