Create Your Big Data Vision and Hadoop-ify Your Data Warehouse
Upcoming SlideShare
Loading in...5
×
 

Like this? Share it with your network

Share

Create Your Big Data Vision and Hadoop-ify Your Data Warehouse

on

  • 1,547 views

Join The Wikibon Project’s Big Data Analyst, Jeff Kelly and EMC’s Enterprise Information Management CTO for an engaging discussion on big data use cases and new technologies. These thought leaders ...

Join The Wikibon Project’s Big Data Analyst, Jeff Kelly and EMC’s Enterprise Information Management CTO for an engaging discussion on big data use cases and new technologies. These thought leaders will provide practical advice on how you can ensure your big data analytics initiative is focused on the business opportunities that provide the optimal trade-off between business benefit and implementation feasibility. Once you’ve selected the best place for big data, create an architecture that will ensure the successful deployment of technologies such as Hadoop and MPP databases.

Statistics

Views

Total Views
1,547
Views on SlideShare
1,538
Embed Views
9

Actions

Likes
2
Downloads
115
Comments
1

2 Embeds 9

http://www.linkedin.com 8
https://twitter.com 1

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Create Your Big Data Vision and Hadoop-ify Your Data Warehouse Presentation Transcript

  • 1. 1© Copyright 2013 EMC Corporation. All rights reserved.Create Your Big DataVision And Hadoop-ifyYour Data WarehouseJeff Kelly, Big Data AnalystThe Wikibon ProjectBill Schmarzo, CTOEIMA Practice, EMC ProfessionalServices
  • 2. 2© Copyright 2013 EMC Corporation. All rights reserved.Agenda Current Market Observations The Big Data Business Maturity Indexand How to Identify Your Best Use Case Get Started With Hadoop and Other NewTechnologies What Should You Look For in a Vendor? Q&A
  • 3. 3© Copyright 2013 EMC Corporation. All rights reserved.Current MarketObservationsJeff Kelly
  • 4. 4© Copyright 2013 EMC Corporation. All rights reserved.Big Data Market Size2012$11.4b2013$18.2b2017$48b 59% Growth Y-o-Y 2011 to2012 Forecast 60%+ Growth in2013 31% CAGR Forecast 2012through 20172014$28b2015$37.9b2016$43.7bSource: Wikibon Big Data Vendor Revenue and Market Forecast, 2012-2017
  • 5. 5© Copyright 2013 EMC Corporation. All rights reserved.Big Data Market Segmentation, 2012Services Leading the WayProfessionalServices$3,784m34%Cloud and SaaS$608m5%0,0%0, 0%0, 0%0, 0% 0, 0%Pro. ServicesComputeStorageNetworkingDatabaseApplicationsData mgt.Cloudn = $11,400m
  • 6. 6© Copyright 2013 EMC Corporation. All rights reserved.Big Data Growth Drivers Continued Investment by Web Pioneers and Three Letter Agencies Google alone spent $1b+ on infrastructure in Q4 2012 “Everything we do is a Big Data problem.” – Jay Parikh, VP of Engineering, Facebook CIA CTO Ira Hunt: Our mission is to “collect everything and hang on to it forever” Increased Awareness and Investments ByLarge Enterprises Beyond the Web Retailers like Sears leveraging Big Data for priceoptimization Financial services firms, including JPMC, MorganStanley and BoA, conduct fraud analysis, riskprofiling and more Pharmaceutical including Bristol Myers Squibbmakers use Big Data to support drug development
  • 7. 7© Copyright 2013 EMC Corporation. All rights reserved.Big Data Growth Drivers, Cont. Increasingly Sophisticated Professional Services Professional services building on experience of assisting earlyadopters Some (but not all) are vendor and product agnostic Focusing on identifying use cases, improving communication, andleveraging existing assets Technology Maturation Open source community and vendorsmaking Hadoop enterprise-ready, easier touse Better integration between Big Data andexisting IT infrastructure Extending Big Data accessibility to businessusers via BI and data visualization tools.ConsultingTraining &EducationsIntegration
  • 8. 8© Copyright 2013 EMC Corporation. All rights reserved.Big Data Growth Inhibitors Lack of Data Scientists and Big DataPractitioners Big Data Technology Still Complex, Difficult toManage/Use Organizational Resistance to Data-DrivenDecision Making Confusion Due to Vendor Marketing and “BigData Washing”Big Data [Your Product Name Here]
  • 9. 9© Copyright 2013 EMC Corporation. All rights reserved.Identify Your Best BigData Use CaseBill SchmarzoCTO, EIM&A PracticeEMC Consulting
  • 10. 10© Copyright 2013 EMC Corporation. All rights reserved.BusinessMetamorphosisDataMonetizationBusinessOptimizationBusinessInsightsBusinessMonitoringBig Data Business ModelMaturation IndexMeasures the degree to which theorganization has integrated big dataand advanced analytics into theirbusiness
  • 11. 11© Copyright 2013 EMC Corporation. All rights reserved.Get Started With Hadoop And OtherNew Technologies#1) Increase Data Platform Performance With MPP Platform#2) Embrace Hadoop To Create Next Gen ODS/Data Staging#3) Leverage Hadoop To Create New Unstructured Data Metrics#4) Extend Data Warehouse Via Data Virtualization#5) Deploy In-database Analytics To Accelerate Analytics
  • 12. 12© Copyright 2013 EMC Corporation. All rights reserved.• Massively Parallel Processing(MPP), scale-out architecturesprovide cost effective optionsfor managing and analyzingmassive volumes of structuredand unstructured data• MPP data warehouses providelinear scalability on generalpurpose, commodity systems#1) Increase Data Platform Performance With MPP
  • 13. 13© Copyright 2013 EMC Corporation. All rights reserved.HadoopDataStore Analytics EnvironmentData Preparationand EnrichmentALL data fedinto HadoopData StoreEDWETLAnalyticSandboxBI Environment• Production• Predictable load• SLA-drive• Standard tools• Exploratory, Ad Hoc• Unpredictable load• Experimentation• Best tool for the job#2) Embrace Hadoop To Create Next Gen ODSFeeds production BI and EnterpriseData Warehouse environment and high-velocity Analytics Sandbox
  • 14. 14© Copyright 2013 EMC Corporation. All rights reserved.#3) Leverage Hadoop To Create New MetricsLeverage HDFS to provide a single platform that supports your traditional SQL-based BI environment plus your growing unstructured data needs at scaleHDFSHBasePig, Hive,MahoutMap ReduceSqoop FlumeResourceManagement& WorkflowYarnZookeeperApachePivotal HDConfigure,Deploy,Monitor,ManageCommandCenterHadoop Virtualization (HVE)DataLoaderXtensionFrameworkCatalogServicesQueryOptimizerDynamic PipeliningANSI SQL + AnalyticsHAWQ – AdvancedDatabase Services
  • 15. 15© Copyright 2013 EMC Corporation. All rights reserved.How To Get Started…AnalyticsOperationalizationIdentify current state, determine requiredstate and conduct gap analysis to developanalytics implementation roadmapAnalyticsLabDeploy analytics sandboxto quantify the businesscaseVisionWorkshopIdentify big dataanalytics businessuse casesRepeat the process foridentified business cases
  • 16. 16© Copyright 2013 EMC Corporation. All rights reserved.What Should You LookFor in a Vendor?Jeff Kelly
  • 17. 17© Copyright 2013 EMC Corporation. All rights reserved.Advice For Selecting Big Data Vendors Balance short-term goals with long-term vision Objectives are: Quick, demonstrable ROI Sustainable Big Data practice Don’t get hung up on “speeds and feeds” or feature-by-feature comparisons Focus on substance, flexibility, commitment and experience
  • 18. 18© Copyright 2013 EMC Corporation. All rights reserved.Selecting Big Data Vendors, Cont. Evaluate products portfolios based on Ability to monetize existing and future data assets Ability to integrate with and compliment existing data managementtechnology Accessibility to power users and business users alike (depending on usecase) Ability to apply information governance and security best practices Select service providers with track records of assistingenterprises adopt data-driven culture as well as technology
  • 19. 19© Copyright 2013 EMC Corporation. All rights reserved.To type a question via WebEx, click on the Q&A tabPlease select “Ask: All Panelists”to ensure your questions reach us. Thank you!Questions and Answers
  • 20. 20© Copyright 2013 EMC Corporation. All rights reserved.Learn More… See us at…– EMC World, May 5-9 www.emc.world.com Contact Jeff Kelly– Email: jeff.kelly@wikibon.org– LinkedIn: http://www.linkedin.com/in/jeffreyfkelly/– Twitter: @jeffreyfkelly– Research: http://www.wikibon.org/bigdata Contact Bill Schmarzo– Email: william.schmarzo@emc.com– Twitter: @schmarzo– Blogs: Big Data Business Model Maturity ChartMost Excellent Big Data Strategy DocumentHow We Teach Customers to Use Big Data
  • 21. 21© Copyright 2013 EMC Corporation. All rights reserved.THANK YOU