2013 05 Oracle big_dataapplianceoverview
Upcoming SlideShare
Loading in...5
×
 

2013 05 Oracle big_dataapplianceoverview

on

  • 561 views

This presentation gives a detailed overview of Oracle's Big Data Appliance, Hadoop, NoSQL Database and Big Data Connectors.

This presentation gives a detailed overview of Oracle's Big Data Appliance, Hadoop, NoSQL Database and Big Data Connectors.

Statistics

Views

Total Views
561
Views on SlideShare
561
Embed Views
0

Actions

Likes
0
Downloads
34
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

2013 05 Oracle big_dataapplianceoverview 2013 05 Oracle big_dataapplianceoverview Presentation Transcript

  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.1Big DataJean-Pierre DijcksTeam Lead – Big Data Product Management
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.2Agenda Big Data Implementation Patterns Big Data Products Q&A
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.3Big Data Implementations
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.4Big Data Usage PatternETL and Batch Processing Workloads on HadoopIntegrateSQLSQLNoSQL• Scalable• Flexible• CostEffectiveDW & BIAnalyticsWeb
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.5Ad-hocBig Data Usage PatternScale-out Information Discovery• Online• Scalable• Flexible• CostEffectiveData FactoryContinuous On-Demand
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.6Big Data Usage PatternExpand Data Warehouse with Granular Data StoreMartsData WarehouseΣ ΣBusinessIntelligenceArchiving• Online• Scalable• Flexible• CostEffectiveData Factory
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.7Big Data Usage PatternInstant Responses to Streaming Data based on Historical AnalysisData WarehouseBusinessIntelligence• Online• Scalable• Flexible• CostEffectiveData FactoryEvent DecisionsNoSQL
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.8Oracle Big Data SolutionStream Acquire – Organize – AnalyzeIn-DatabaseAnalyticsDataWarehouseOracleAdvancedAnalyticsOracleDatabaseOracle BIEnterprise EditionOracle Real-TimeDecisionsEndeca InformationDiscoveryDecideOracle EventProcessingApacheFlumeApplicationsOracleNoSQLDatabaseClouderaHadoopOracle RDistributionOracle Big DataConnectorsOracle DataIntegrator• Complete• Integrated• Scalable
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.9Big Data Products
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.10Big Data Appliance X3-2Sun Oracle X3-2L Servers with per server:• 2 * 8 Core Intel Xeon E5 Processors• 64 GB Memory• 36TB Disk spaceTotals per Full Rack:• 288 Processor Cores• 1152 GB of Memory• 648TB Available Disk space
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.11Big Data Appliance Software StackIntegrated Software: Oracle Linux 5.8 with UEK Cloudera CDH 4.2 & Cloudera Manager 4.5 Big Data Appliance Enterprise Manager Plug-In Oracle R DistributionAll integrated software is supported as part of Premier Support forSystems and Premier Support for Operating SystemsOptional Software: Oracle NoSQL Database 2.x Oracle Big Data Connectors 2.x
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.12BDA in Infrastructure as a Service Procurement option for H/W Low monthly fee spread outover 3 to 5 years Ownership of the systemstays with Oracle Applies to all EngineeredSystems BDA Full Racks onlyMonth
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.13Big Data Appliance Product Family Starter Rack is a fully cabled andconfigured for growth with 6 servers In-Rack Expansion delivers 6 servermodular expansion block Full Rack delivers optimal blend ofcapacity and expansion options Grow by adding rack – up to 18 rackswithout additional switches
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.14Big Data Appliance X3-2 Starter Rack 6 Nodes fully cabled in Starter Rack• 96 Intel® Xeon® E5 Processors• 384 GB total memory• 216TB total raw storage capacity 6 Nodes In-Rack Expansion added in-rack• 96 Intel® Xeon® E5 Processors• 384 GB total memory• 216TB total raw storage capacityStart and grow in increments of six servers
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.15Why Oracle Big Data Appliance? Beats DIY Clusters on:– Initial Cost and Time to Value– Performance and Scalability Pre-configured with leading Hadoop Distribution– Proven at large scale– Contributors across all components for better support Better Integration with your Oracle ecosystem with:– High-performance connectivity to Exadata– Unified analytics API (SQL, R, MapReduce etc.)– Single Enterprise Manager Framework
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.16Divide Full Rack BDA inmultiple clustersProvide more flexibleconfigurations forcustomersAutomatic reconfigurationwhen expanding theclusterFlexible Configurations6 Node Cluster12 Node ClusterExample Configuration
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.17Engineered for Quicker Time to Value at Lower Costhttp://www.oracle.com/us/corporate/analystreports/industries/esg-big-data-wp-1914112.pdfESG believes that a "buy" versus "do-it-yourself"approach will yield roughly one-third faster time-to-market benefit improvement...051015202530Oracle Big Data Appliance Build it yourselfTime to Market (Weeks)0100,000200,000300,000400,000500,000600,000700,000800,000Oracle Big Data Appliance Build it yourselfCost: Initial Infrastructure/Tasks[…] nearly 40% cost savings versus ITarchitecting, designing, procuring, configuring, and implementing its own big data infrastructure.
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.18Engineered for PerformanceCompared with a DIY Cluster0510Big DataApplianceDIY HadoopClusterTime(hours) Configured for exceptionalperformance on delivery 6x faster than custom 20-nodeHadoop cluster for large batchtransformation jobs Engineering done by Oracle andCloudera:– OS and File System Tuning– Java Virtual Machine Tuning– Hadoop Configuration and Setup6x
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.19Engineered by Oracle and ClouderaWhy Cloudera and Cloudera CDH? Proven Track Record with the largest Hadoop Installed Base Proven in large scale enterprise implementations Demonstrated Leadership in Hadoop Community– Breath and Depth across the Hadoop ecosystem and products– Fast evolution in critical features Managed Distribution– Components certified to work together and on Oracle Big Data Appliance inregular updates– Industry Leading Management Framework for Hadoop integrated withOracle Enterprise Manager
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.20Engineered by Oracle and Cloudera Cloudera’s Hadoop Knowledge Engineered into the system:– Master service lay-out designed for large clusters based onexperience with many large systems– Optimized data block size for MapReduce workloads– Optimized number of Map and Reduce slots fitting the systemcapacity– Optimized settings for a large number of Hadoop parameters Tested at Oracle and Cloudera on the same hardware/softwarestack as our customersMarket Leading Hadoop Distribution Pre-configured
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.21Engineered by Oracle and Cloudera Multi-Homing for Hadoop– To leverage BDA’s InfiniBand and 10GiGE network, Hadoop needed to be able tosupport multiple networks and IP addresses– Committed to Apache Hadoop by Cloudera Highly Available NameNode Solution– Remove dependency on a HA Filer to enable HA without required additionalhardware– Build a journaling based HA solution for NameNode with automatic fail-over System Administration– Tight integration between Oracle Enterprise Manager (Hardware and High-LevelSoftware Monitoring) and Cloudera Manager (Hadoop Details)Driving Enterprise Class Requirements for Hadoop
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.22Integrated Management FrameworkManagement Infrastructure combines EM and CMQuick view of Hardware and Software statusin Oracle Enterprise Manager
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.23Big Data ConnectorsOptimized integration of Hadoop with Oracle Databaseand Oracle Exadata• Oracle Loader for Hadoop• Oracle SQL Connector for Hadoop Distributed File System(HDFS)• Oracle Data Integrator Application Adapter for Hadoop• Oracle R Connector for Hadoop• Does not require Big Data Appliance – can be licensed for Hadooprunning on non-Oracle hardware
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.24Analyze Data across your Oracle SystemsSQL Analytics on ALL dataSQLHadoop Oracle DatabaseIB Expand the data pool foranalytics leveraging Hadoop Stream Hadoop resident datathrough Big Data Connectorsfor SQL processing Use the full power of OracleSQL on all data Or use Oracle Loader forHadoop to integrate data inOracle Database
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.25Analyze Data across your Oracle SystemsR Analytics on ALL dataRHadoop Oracle DatabaseIB Expand the data pool foranalytics leveraging Hadoop Improve scalability andperformance for R withoutchanges to your programs Dynamically leverage Hadoopthrough Big Data Connectorsto execute R analytics
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.26Oracle Data IntegratorSimplify Map ReduceOLH&OSCHOracleDataIntegrator Automatically generatesMapReduce code High performance loads intoData Warehouse leveragingboth OLH and OSCH Manages the process acrossplatforms
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.27Oracle NoSQL DatabaseScalable, Highly Available, Key-Value DatabaseApplicationStorage NodesDatacenter BStorage NodesDatacenter AApplicationNoSQL DB DriverApplicationNoSQL DB DriverApplication Simple Key-Value Data Model Horizontally Scalable Highly Available Simple administration ACID Transactions at scale Transparent load balancing Elastic Configuration Commercial grade software andsupport
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.28Oracle NoSQL Database Use CasesNoSQL DB DriverApplicationOracle EventProcessorEventStreamWeb Scale Transaction Processing• High velocity, High volume, High variety, Low information density data capture• Uses Hadoop and/or Data Warehouse for analytics• Applications: Web browsing, Web Retail, CDR processing, Sensor data captureLast Mile Content Delivery• Platform for real-time content delivery• Content & market segmentation Acquired and Analyzed in Hadoop & RDBMS• NoSQL provides low latency content lookup and delivery to end-customers• OEP rules perform low latency lookups to Oracle NoSQL DB for additional dataReal Time Event Processing• Real time events trigger rule execution in Oracle Event Processing• OEP rules perform low latency lookups to Oracle NoSQL DB for additional data• OEP actions are triggered• Applications: Medical Monitoring, Factory Automation, Oil & Gas, Geo-locationRule Action
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.29
  • Copyright © 2013, Oracle and/or its affiliates. All rights reserved.30