0
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.1Big DataJean-Pierre DijcksTeam Lead – Big Data Produc...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.2Agenda Big Data Implementation Patterns Big Data Pr...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.3Big Data Implementations
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.4Big Data Usage PatternETL and Batch Processing Worklo...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.5Ad-hocBig Data Usage PatternScale-out Information Dis...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.6Big Data Usage PatternExpand Data Warehouse with Gran...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.7Big Data Usage PatternInstant Responses to Streaming ...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.8Oracle Big Data SolutionStream Acquire – Organize – A...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.9Big Data Products
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.10Big Data Appliance X3-2Sun Oracle X3-2L Servers with...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.11Big Data Appliance Software StackIntegrated Software...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.12BDA in Infrastructure as a Service Procurement opti...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.13Big Data Appliance Product Family Starter Rack is a...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.14Big Data Appliance X3-2 Starter Rack 6 Nodes fully ...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.15Why Oracle Big Data Appliance? Beats DIY Clusters o...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.16Divide Full Rack BDA inmultiple clustersProvide more...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.17Engineered for Quicker Time to Value at Lower Costht...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.18Engineered for PerformanceCompared with a DIY Cluste...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.19Engineered by Oracle and ClouderaWhy Cloudera and Cl...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.20Engineered by Oracle and Cloudera Cloudera’s Hadoop...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.21Engineered by Oracle and Cloudera Multi-Homing for ...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.22Integrated Management FrameworkManagement Infrastruc...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.23Big Data ConnectorsOptimized integration of Hadoop w...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.24Analyze Data across your Oracle SystemsSQL Analytics...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.25Analyze Data across your Oracle SystemsR Analytics o...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.26Oracle Data IntegratorSimplify Map ReduceOLH&OSCHOra...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.27Oracle NoSQL DatabaseScalable, Highly Available, Key...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.28Oracle NoSQL Database Use CasesNoSQL DB DriverApplic...
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.29
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.30
Upcoming SlideShare
Loading in...5
×

2013 05 Oracle big_dataapplianceoverview

539

Published on

This presentation gives a detailed overview of Oracle's Big Data Appliance, Hadoop, NoSQL Database and Big Data Connectors.

Published in: Technology, Business
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
539
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
46
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Transcript of "2013 05 Oracle big_dataapplianceoverview"

  1. 1. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.1Big DataJean-Pierre DijcksTeam Lead – Big Data Product Management
  2. 2. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.2Agenda Big Data Implementation Patterns Big Data Products Q&A
  3. 3. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.3Big Data Implementations
  4. 4. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.4Big Data Usage PatternETL and Batch Processing Workloads on HadoopIntegrateSQLSQLNoSQL• Scalable• Flexible• CostEffectiveDW & BIAnalyticsWeb
  5. 5. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.5Ad-hocBig Data Usage PatternScale-out Information Discovery• Online• Scalable• Flexible• CostEffectiveData FactoryContinuous On-Demand
  6. 6. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.6Big Data Usage PatternExpand Data Warehouse with Granular Data StoreMartsData WarehouseΣ ΣBusinessIntelligenceArchiving• Online• Scalable• Flexible• CostEffectiveData Factory
  7. 7. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.7Big Data Usage PatternInstant Responses to Streaming Data based on Historical AnalysisData WarehouseBusinessIntelligence• Online• Scalable• Flexible• CostEffectiveData FactoryEvent DecisionsNoSQL
  8. 8. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.8Oracle Big Data SolutionStream Acquire – Organize – AnalyzeIn-DatabaseAnalyticsDataWarehouseOracleAdvancedAnalyticsOracleDatabaseOracle BIEnterprise EditionOracle Real-TimeDecisionsEndeca InformationDiscoveryDecideOracle EventProcessingApacheFlumeApplicationsOracleNoSQLDatabaseClouderaHadoopOracle RDistributionOracle Big DataConnectorsOracle DataIntegrator• Complete• Integrated• Scalable
  9. 9. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.9Big Data Products
  10. 10. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.10Big Data Appliance X3-2Sun Oracle X3-2L Servers with per server:• 2 * 8 Core Intel Xeon E5 Processors• 64 GB Memory• 36TB Disk spaceTotals per Full Rack:• 288 Processor Cores• 1152 GB of Memory• 648TB Available Disk space
  11. 11. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.11Big Data Appliance Software StackIntegrated Software: Oracle Linux 5.8 with UEK Cloudera CDH 4.2 & Cloudera Manager 4.5 Big Data Appliance Enterprise Manager Plug-In Oracle R DistributionAll integrated software is supported as part of Premier Support forSystems and Premier Support for Operating SystemsOptional Software: Oracle NoSQL Database 2.x Oracle Big Data Connectors 2.x
  12. 12. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.12BDA in Infrastructure as a Service Procurement option for H/W Low monthly fee spread outover 3 to 5 years Ownership of the systemstays with Oracle Applies to all EngineeredSystems BDA Full Racks onlyMonth
  13. 13. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.13Big Data Appliance Product Family Starter Rack is a fully cabled andconfigured for growth with 6 servers In-Rack Expansion delivers 6 servermodular expansion block Full Rack delivers optimal blend ofcapacity and expansion options Grow by adding rack – up to 18 rackswithout additional switches
  14. 14. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.14Big Data Appliance X3-2 Starter Rack 6 Nodes fully cabled in Starter Rack• 96 Intel® Xeon® E5 Processors• 384 GB total memory• 216TB total raw storage capacity 6 Nodes In-Rack Expansion added in-rack• 96 Intel® Xeon® E5 Processors• 384 GB total memory• 216TB total raw storage capacityStart and grow in increments of six servers
  15. 15. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.15Why Oracle Big Data Appliance? Beats DIY Clusters on:– Initial Cost and Time to Value– Performance and Scalability Pre-configured with leading Hadoop Distribution– Proven at large scale– Contributors across all components for better support Better Integration with your Oracle ecosystem with:– High-performance connectivity to Exadata– Unified analytics API (SQL, R, MapReduce etc.)– Single Enterprise Manager Framework
  16. 16. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.16Divide Full Rack BDA inmultiple clustersProvide more flexibleconfigurations forcustomersAutomatic reconfigurationwhen expanding theclusterFlexible Configurations6 Node Cluster12 Node ClusterExample Configuration
  17. 17. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.17Engineered for Quicker Time to Value at Lower Costhttp://www.oracle.com/us/corporate/analystreports/industries/esg-big-data-wp-1914112.pdfESG believes that a "buy" versus "do-it-yourself"approach will yield roughly one-third faster time-to-market benefit improvement...051015202530Oracle Big Data Appliance Build it yourselfTime to Market (Weeks)0100,000200,000300,000400,000500,000600,000700,000800,000Oracle Big Data Appliance Build it yourselfCost: Initial Infrastructure/Tasks[…] nearly 40% cost savings versus ITarchitecting, designing, procuring, configuring, and implementing its own big data infrastructure.
  18. 18. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.18Engineered for PerformanceCompared with a DIY Cluster0510Big DataApplianceDIY HadoopClusterTime(hours) Configured for exceptionalperformance on delivery 6x faster than custom 20-nodeHadoop cluster for large batchtransformation jobs Engineering done by Oracle andCloudera:– OS and File System Tuning– Java Virtual Machine Tuning– Hadoop Configuration and Setup6x
  19. 19. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.19Engineered by Oracle and ClouderaWhy Cloudera and Cloudera CDH? Proven Track Record with the largest Hadoop Installed Base Proven in large scale enterprise implementations Demonstrated Leadership in Hadoop Community– Breath and Depth across the Hadoop ecosystem and products– Fast evolution in critical features Managed Distribution– Components certified to work together and on Oracle Big Data Appliance inregular updates– Industry Leading Management Framework for Hadoop integrated withOracle Enterprise Manager
  20. 20. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.20Engineered by Oracle and Cloudera Cloudera’s Hadoop Knowledge Engineered into the system:– Master service lay-out designed for large clusters based onexperience with many large systems– Optimized data block size for MapReduce workloads– Optimized number of Map and Reduce slots fitting the systemcapacity– Optimized settings for a large number of Hadoop parameters Tested at Oracle and Cloudera on the same hardware/softwarestack as our customersMarket Leading Hadoop Distribution Pre-configured
  21. 21. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.21Engineered by Oracle and Cloudera Multi-Homing for Hadoop– To leverage BDA’s InfiniBand and 10GiGE network, Hadoop needed to be able tosupport multiple networks and IP addresses– Committed to Apache Hadoop by Cloudera Highly Available NameNode Solution– Remove dependency on a HA Filer to enable HA without required additionalhardware– Build a journaling based HA solution for NameNode with automatic fail-over System Administration– Tight integration between Oracle Enterprise Manager (Hardware and High-LevelSoftware Monitoring) and Cloudera Manager (Hadoop Details)Driving Enterprise Class Requirements for Hadoop
  22. 22. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.22Integrated Management FrameworkManagement Infrastructure combines EM and CMQuick view of Hardware and Software statusin Oracle Enterprise Manager
  23. 23. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.23Big Data ConnectorsOptimized integration of Hadoop with Oracle Databaseand Oracle Exadata• Oracle Loader for Hadoop• Oracle SQL Connector for Hadoop Distributed File System(HDFS)• Oracle Data Integrator Application Adapter for Hadoop• Oracle R Connector for Hadoop• Does not require Big Data Appliance – can be licensed for Hadooprunning on non-Oracle hardware
  24. 24. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.24Analyze Data across your Oracle SystemsSQL Analytics on ALL dataSQLHadoop Oracle DatabaseIB Expand the data pool foranalytics leveraging Hadoop Stream Hadoop resident datathrough Big Data Connectorsfor SQL processing Use the full power of OracleSQL on all data Or use Oracle Loader forHadoop to integrate data inOracle Database
  25. 25. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.25Analyze Data across your Oracle SystemsR Analytics on ALL dataRHadoop Oracle DatabaseIB Expand the data pool foranalytics leveraging Hadoop Improve scalability andperformance for R withoutchanges to your programs Dynamically leverage Hadoopthrough Big Data Connectorsto execute R analytics
  26. 26. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.26Oracle Data IntegratorSimplify Map ReduceOLH&OSCHOracleDataIntegrator Automatically generatesMapReduce code High performance loads intoData Warehouse leveragingboth OLH and OSCH Manages the process acrossplatforms
  27. 27. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.27Oracle NoSQL DatabaseScalable, Highly Available, Key-Value DatabaseApplicationStorage NodesDatacenter BStorage NodesDatacenter AApplicationNoSQL DB DriverApplicationNoSQL DB DriverApplication Simple Key-Value Data Model Horizontally Scalable Highly Available Simple administration ACID Transactions at scale Transparent load balancing Elastic Configuration Commercial grade software andsupport
  28. 28. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.28Oracle NoSQL Database Use CasesNoSQL DB DriverApplicationOracle EventProcessorEventStreamWeb Scale Transaction Processing• High velocity, High volume, High variety, Low information density data capture• Uses Hadoop and/or Data Warehouse for analytics• Applications: Web browsing, Web Retail, CDR processing, Sensor data captureLast Mile Content Delivery• Platform for real-time content delivery• Content & market segmentation Acquired and Analyzed in Hadoop & RDBMS• NoSQL provides low latency content lookup and delivery to end-customers• OEP rules perform low latency lookups to Oracle NoSQL DB for additional dataReal Time Event Processing• Real time events trigger rule execution in Oracle Event Processing• OEP rules perform low latency lookups to Oracle NoSQL DB for additional data• OEP actions are triggered• Applications: Medical Monitoring, Factory Automation, Oil & Gas, Geo-locationRule Action
  29. 29. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.29
  30. 30. Copyright © 2013, Oracle and/or its affiliates. All rights reserved.30
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×