Big Data Wonderland: Two Views on the Big Data Revolution
Upcoming SlideShare
Loading in...5
×
 

Big Data Wonderland: Two Views on the Big Data Revolution

on

  • 956 views

To kick off the Big Data for Enterprise IT Day, we present two views of big data. Is it truly something new, or just an evolution of what we have already? Join us for an interesting and entertaining ...

To kick off the Big Data for Enterprise IT Day, we present two views of big data. Is it truly something new, or just an evolution of what we have already? Join us for an interesting and entertaining talk that will help frame your thinking on big data. We take on the roles of former bosses: the techno-lustful and the luddite, and debate the key talking points put forth in the market.

An earlier video of this talk can be seen at http://www.youtube.com/watch?v=qnHHOWz5uvM

Statistics

Views

Total Views
956
Views on SlideShare
947
Embed Views
9

Actions

Likes
2
Downloads
25
Comments
0

1 Embed 9

https://twitter.com 9

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

CC Attribution-NonCommercial-NoDerivs LicenseCC Attribution-NonCommercial-NoDerivs LicenseCC Attribution-NonCommercial-NoDerivs License

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Big Data Wonderland: Two Views on the Big Data Revolution Big Data Wonderland: Two Views on the Big Data Revolution Presentation Transcript

  • Big Data Wonderland:Two Views on the Big Data RevolutionMark MadsenThird Nature, Inc.mark@thirdnature.net@markmadsenMarc DemarestNoumenal, Inc.marc@noumenal.comStrata Santa ClaraFebruary 2013
  • 2 Third Nature, Inc. || Noumenal, Inc.PreambleTwenty Years On• We came up together in this industryin the early 1990s, as pointy-headedadvocates of star schema design,trained by the deity himself, RalphKimball• Back then, it was a simplerworld...big iron, big DBMS, hand-coded ETL, star schema, athousand rinky-dink query tools• Mostly, conversation wasdominated by ETL and schemadesign• “There will never be a decisionaldatabase larger than 10 GB...”St. RalphOur Alma Mater
  • 3 Third Nature, Inc. || Noumenal, Inc.PreambleTwenty Years On• Twenty years on, we find ourselveswith opposing view on what is eitherthe biggest con, or the biggest sea-change, in our data warehousingodyssey• Question: Is the big data revolutionbig, or a revolution?• Question: do we have to change? andif so, how?• Not a round table. A slugfest....Demarest asShana Alexander?Madsen asJack Kilpatrick?
  • 4 Third Nature, Inc. || Noumenal, Inc.Regular Programming Is SuspendedDemarest Madsen
  • 5 Third Nature, Inc. || Noumenal, Inc.CompromiseDemarest MadsenYou take the blue pill.The story ends, youwake up in your bedand believe whateveryou want to believe.You take the red pill,you stay in Wonderland,and I show you howdeep the rabbit holegoes.Remember, all I amoffering is the truth:nothing more.
  • 6 Third Nature, Inc. || Noumenal, Inc.The Issues1. Data As A Factor of ProductionRED BLUEAmen.This change has beenin process for morethan a decade. Socialmedia leads the way,but we’re all affected.
  • 7 Third Nature, Inc. || Noumenal, Inc.The Issues1. Data As A Factor of ProductionRED BLUEAmen.This change has beenin process for morethan a decade. Socialmedia leads the way,but we’re all affected.Hype.For most companies,data remains anasset, but not a factorin the production of itsproducts or services.
  • 8 Third Nature, Inc. || Noumenal, Inc.The Issues2. The Reality of Big DataRED BLUEFew companiestransformed.No quantification ofbenefits, right now.Leverage? Maybe.
  • 9 Third Nature, Inc. || Noumenal, Inc.The Issues2. The Reality of Big DataRED BLUENo company escapes.Text, social, sensors,streaming -- theinstrumentation of thereal world transformscompany decision-making processes.Few companiestransformed.No quantification ofbenefits, right now.Leverage? Maybe.
  • 10 Third Nature, Inc. || Noumenal, Inc.The Issues3. Merchant DBMSsRED BLUEIncreasingly irrelevant.We’ve been over-structured and under-resourced for 20years.CSV is still theinternational standard.
  • 11 Third Nature, Inc. || Noumenal, Inc.The Issues3. Merchant DBMSsRED BLUEIncreasingly irrelevant.We’ve been over-structured and under-resourced for 20years.CSV is still theinternational standard.Will rise to thechallenge.Any worthwhileinnovation will beabsorbed by themerchant DBMSplayers.
  • 12 Third Nature, Inc. || Noumenal, Inc.The Issues4. Query, Reporting & Dashboarding ToolsRED BLUEWill rise to thechallenge.We have twogenerations ofanalysts trained tofeed using these tools.
  • 13 Third Nature, Inc. || Noumenal, Inc.The Issues4. Query, Reporting & Dashboarding ToolsRED BLUEIneffective, now and inthe future.Can’t do real-time,can’t visualize largedata sets, can’tsupport discovery andexploration.Will rise to thechallenge.We have twogenerations ofanalysts trained tofeed using these tools.
  • 14 Third Nature, Inc. || Noumenal, Inc.The Issues5. The Commodity Hardware Revolution & Radical Scale-OutRED BLUEThe new topology.Cheap compute,unintelligent direct-attach storage andfree comms makelarge scale-out gridsthe future.
  • 15 Third Nature, Inc. || Noumenal, Inc.The Issues5. The Commodity Hardware Revolution & Radical Scale-OutRED BLUEThe new topology.Cheap compute,unintelligent direct-attach storage andfree comms makelarge scale-out gridsthe future.The current topologyis alive and well.These commoditybuilding blocks are,after all, just SMPplatforms.
  • 16 Third Nature, Inc. || Noumenal, Inc.The Issues6. Structured Query LanguageRED BLUETried-and-True.Powerful, expressivelanguage for complexanalytical problems.That’s why the noSQLvendors reinvent it allthe time.
  • 17 Third Nature, Inc. || Noumenal, Inc.The Issues6. Structured Query LanguageRED BLUEToast.Too complex, too hardto code, too hard todebug. A way ofensuring dependencyon merchant DBMSs.Tried-and-True.Powerful, expressivelanguage for complexanalytical problems.That’s why the noSQLvendors reinvent it allthe time.
  • 18 Third Nature, Inc. || Noumenal, Inc.The Issues7. New Programming ModelsRED BLUESay hello to Pig.New analyticalproblems (decisioning,discovery, exploration)require newlanguages, new toolsand new programmingmodels.
  • 19 Third Nature, Inc. || Noumenal, Inc.The Issues7. New Programming ModelsRED BLUESay hello to Pig.New analyticalproblems (decisioning,discovery, exploration)require newlanguages, new toolsand new programmingmodels.Say hello to Java.Open source doesn’tmean free. Or easy.The skills gap here ishuge. And there arefew truly newanalytical problems.
  • 20 Third Nature, Inc. || Noumenal, Inc.The Issues8. Conventional DW ArchitectureRED BLUEPerfectly viable.No need to changeanything. Some newtechnologies may playroles in the existingarchitecture, but we’regood to go, generally.
  • 21 Third Nature, Inc. || Noumenal, Inc.The Issues8. Conventional DW ArchitectureRED BLUEA relic.Overly complex.Difficult to implement.Controlled by thesupply side of themarket, anyway.Perfectly viable.No need to changeanything. Some newtechnologies may playroles in the existingarchitecture, but we’regood to go, generally.
  • 22 Third Nature, Inc. || Noumenal, Inc.The Issues9. The CloudRED BLUEWe all go there.Most of the interestingdata is there; it’s moreeffective to move ourdata, and ouranalyses, to where thedata is, already.
  • 23 Third Nature, Inc. || Noumenal, Inc.The Issues9. The CloudRED BLUEWe all go there.Most of the interestingdata is there; it’s moreeffective to move ourdata, and ouranalyses, to where thedata is, already.Don’t go there.Public cloud securityis an oxymoron.Your inside-the-firewallapps remain the coreinformation asset.
  • 24 Third Nature, Inc. || Noumenal, Inc.The Issues10. New TechnologiesRED BLUEDistract Us.We’ve already seenwhat best-of-breedgives us: a circus.
  • 25 Third Nature, Inc. || Noumenal, Inc.The Issues10. New TechnologiesRED BLUESave Us.Best of breedintegration led by in-house designers insback, with avengeance.Distract Us.We’ve already seenwhat best-of-breedgives us: a circus.
  • 26 Third Nature, Inc. || Noumenal, Inc.What We Really Think1. Data As A Factor of Production2. The Reality of Big Data3. Merchant DBMSs4. Query, Reporting & Dashboarding Tools5. The Commodity Hardware Revolution6. Structured Query Language7. New Programming Models8. Conventional DW Architecture9. The Cloud10. New Technologies