Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
© Hortonworks Inc. 2013. Confidential and Proprietary.
Hadoop in LondonJuly 9, 2013
Herb Cunitz
Hortonworks President
@hcu...
© Hortonworks Inc. 2013. Confidential and Proprietary.
Why is Hadoop Important?
We Believe that
More than Half the
World's...
By 2015, Organizations that
Build a Modern Information
Management System Will
Outperform their Peers
Financially by 20 Per...
© Hortonworks Inc. 2013. Confidential and Proprietary.
New Sources
(sentiment, clickstream, geo, sensor, …)
Traditional Da...
© Hortonworks Inc. 2013. Confidential and Proprietary.
PressuredTraditional Data Architecture
Source: IDC
New Sources
(sen...
© Hortonworks Inc. 2013. Confidential and Proprietary.
New Sources
(sentiment, clickstream, geo, sensor, …)
Modern Data Ar...
© Hortonworks Inc. 2013. Confidential and Proprietary.
Agile “Data Lake” Solution Architecture
Capture All Data Process & ...
© Hortonworks Inc. 2013. Confidential and Proprietary.
BATCH INTERACTIVE STREAMING GRAPH IN-MEMORY HPC MPIONLINE OTHER…
Ke...
© Hortonworks Inc. 2013. Confidential and Proprietary.
Applications Run Natively IN Hadoop
BATCH
MapReduce
INTERACTIVE
Tez...
© Hortonworks Inc. 2013. Confidential and Proprietary.
2.0 Architected for the
Broad Enterprise
Hadoop 2.0 Key Highlights
...
© Hortonworks Inc. 2013. Confidential and Proprietary.
Making Hadoop Enterprise Ready
OS/VM Cloud Appliance
Enterprise Had...
© Hortonworks Inc. 2013. Confidential and Proprietary.
SQL-IN-Hadoop with Apache Hive
Stinger Initiative
Focus Areas
Make ...
© 2013 Forrester Research, Inc. Reproduction Prohibited 13
© 2013 Forrester Research, Inc. Reproduction Prohibited 14
© Hortonworks Inc. 2013. Confidential and Proprietary.
Innovate
Participate
Integrate
Many Communities Must Work As One
Op...
© Hortonworks Inc. 2013. Confidential and Proprietary.
Ecosystem Completes the Puzzle
Data Systems
Applications, Business ...
© Hortonworks Inc. 2013. Confidential and Proprietary.
Hadoop Wave ONE: Web-scale Batch Apps
time
relative%
customers
Cust...
© Hortonworks Inc. 2013. Confidential and Proprietary.
Customers want
solutions & convenience
Customers want
technology & ...
© Hortonworks Inc. 2013. Confidential and Proprietary.
Hortonworks – We Do Hadoop
Open Source
Community
Partner
Ecosystem
...
© Hortonworks Inc. 2013
Thank You
Page 20
Upcoming SlideShare
Loading in …5
×

Demystify Big Data Breakfast Briefing: Herb Cunitz, Hortonworks

1,648 views

Published on

Demystify Big Data Breakfast Briefing, 9th July London - Herb Cunitz Hortonworks

Published in: Technology
  • If you just broke up with your Ex, you have to follow these steps to get him back or risk ruining your chances.  http://t.cn/R50e5nn
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

Demystify Big Data Breakfast Briefing: Herb Cunitz, Hortonworks

  1. 1. © Hortonworks Inc. 2013. Confidential and Proprietary. Hadoop in LondonJuly 9, 2013 Herb Cunitz Hortonworks President @hcunitz Page 1
  2. 2. © Hortonworks Inc. 2013. Confidential and Proprietary. Why is Hadoop Important? We Believe that More than Half the World's Data Will Be Processed by Apache Hadoop.
  3. 3. By 2015, Organizations that Build a Modern Information Management System Will Outperform their Peers Financially by 20 Percent. – Gartner, Mark Beyer, “Information Management in the 21st Century”
  4. 4. © Hortonworks Inc. 2013. Confidential and Proprietary. New Sources (sentiment, clickstream, geo, sensor, …) Traditional Data ArchitectureAPPLICATIONSDATASYSTEMS TRADITIONAL REPOS RDBMS EDW MPP DATASOURCES OLTP, POS SYSTEMS Business Analytics Custom Applications Packaged Applications Pressured TRADITIONAL REPOS RDBMS EDW MPP OPERATIONAL TOOLS MANAGE & MONITOR DEV & DATA TOOLS BUILD & TEST Traditional Sources (RDBMS, OLTP, OLAP)
  5. 5. © Hortonworks Inc. 2013. Confidential and Proprietary. PressuredTraditional Data Architecture Source: IDC New Sources (sentiment, clickstream, geo, sensor, …) 2.8 ZB in 2012 85% from New Data Types 15x Machine Data by 2020 40 ZB by 2020
  6. 6. © Hortonworks Inc. 2013. Confidential and Proprietary. New Sources (sentiment, clickstream, geo, sensor, …) Modern Data Architecture EnabledAPPLICATIONSDATASYSTEMSDATASOURCES OLTP, POS SYSTEMS Business Analytics Custom Applications Packaged Applications TRADITIONAL REPOS RDBMS EDW MPP Traditional Sources (RDBMS, OLTP, OLAP) MANAGE & MONITOR OPERATIONAL TOOLS BUILD & TEST DEV & DATA TOOLS ENTERPRISE HADOOP PLATFORM
  7. 7. © Hortonworks Inc. 2013. Confidential and Proprietary. Agile “Data Lake” Solution Architecture Capture All Data Process & Structure1 2 Distribute Results3 Feedback & Retain4 Dashboards, Re ports, Visualizati on, … Web, Mobile, CRM, ERP, Point of sale Business Transactions & Interactions Business Intelligence & Analytics Classic Data Integration & ETL Logs & Text Data Sentiment Data Structured DB Data Clickstream Data Geo & Tracking Data Sensor & Machine Data Enterprise Hadoop Platform
  8. 8. © Hortonworks Inc. 2013. Confidential and Proprietary. BATCH INTERACTIVE STREAMING GRAPH IN-MEMORY HPC MPIONLINE OTHER… Key Requirement of a “Data Lake” Store ALL DATA in one place… …and Interact with that data in MULTIPLE WAYS HDFS (Redundant, Reliable Storage)
  9. 9. © Hortonworks Inc. 2013. Confidential and Proprietary. Applications Run Natively IN Hadoop BATCH MapReduce INTERACTIVE Tez STREAMING Storm GRAPH Giraph IN-MEMORY Spark HPC MPI OpenMPI ONLINE HBase OTHER… ex. Search YARN Takes Hadoop Beyond Batch Applications run “IN” Hadoop versus “ON” Hadoop… …with Predictable Performance and Quality of Service HDFS2 (Redundant, Reliable Storage) YARN (Cluster Resource Management)
  10. 10. © Hortonworks Inc. 2013. Confidential and Proprietary. 2.0 Architected for the Broad Enterprise Hadoop 2.0 Key Highlights Rolling Upgrades Disaster Recovery Snapshots Full Stack HA Hive on Tez YARN HDP 2.0 Features Single Cluster, Many Workloads BATCH INTERACTIVE ONLINE STREAMING ZERO downtime Multi Data Center Point in time Recovery Reliability Interactive Query Mixed workloads Enterprise Requirements
  11. 11. © Hortonworks Inc. 2013. Confidential and Proprietary. Making Hadoop Enterprise Ready OS/VM Cloud Appliance Enterprise Hadoop Platform PLATFORM SERVICES Enterprise Readiness High Availability, Disaster Recovery,Security and Snapshots OPERATIONAL SERVICES Manage & Operate at Scale DATA SERVICES Store, Process and Access Data CORE Distributed Storage & Processing
  12. 12. © Hortonworks Inc. 2013. Confidential and Proprietary. SQL-IN-Hadoop with Apache Hive Stinger Initiative Focus Areas Make Hive 100X Faster Make Hive SQL Compliant HDFS2 YARN HIVE SQL MAP REDUCE Business Analytics Custom Apps TEZ
  13. 13. © 2013 Forrester Research, Inc. Reproduction Prohibited 13
  14. 14. © 2013 Forrester Research, Inc. Reproduction Prohibited 14
  15. 15. © Hortonworks Inc. 2013. Confidential and Proprietary. Innovate Participate Integrate Many Communities Must Work As One Open Source End Users Vendors
  16. 16. © Hortonworks Inc. 2013. Confidential and Proprietary. Ecosystem Completes the Puzzle Data Systems Applications, Business Tools, & Dev Tools Infrastructure & Systems Management
  17. 17. © Hortonworks Inc. 2013. Confidential and Proprietary. Hadoop Wave ONE: Web-scale Batch Apps time relative% customers Customers want solutions & convenience Customers want technology & performance Source: Geoffrey Moore - Crossing the Chasm 2006 to 2012 Web-Scale Batch Applications Innovators, technology enthusiasts Early adopters, visionaries Early majority, pragmatists Late majority, conservatives Laggards, Skeptics TheCHASM
  18. 18. © Hortonworks Inc. 2013. Confidential and Proprietary. Customers want solutions & convenience Customers want technology & performance Hadoop Wave TWO: Broad Enterprise Apps time relative% customers Source: Geoffrey Moore - Crossing the Chasm Innovators, technology enthusiasts Early adopters, visionaries Early majority, pragmatists Late majority, conservatives Laggards, Skeptics TheCHASM 2013 & Beyond Batch, Interactive, Online, Streaming, etc., etc.
  19. 19. © Hortonworks Inc. 2013. Confidential and Proprietary. Hortonworks – We Do Hadoop Open Source Community Partner Ecosystem Commercial Adoption
  20. 20. © Hortonworks Inc. 2013 Thank You Page 20

×