• Save
Big Data: Business Opportunities, Requirements and Approach
Upcoming SlideShare
Loading in...5
×
 

Like this? Share it with your network

Share

Big Data: Business Opportunities, Requirements and Approach

on

  • 900 views

 

Statistics

Views

Total Views
900
Views on SlideShare
895
Embed Views
5

Actions

Likes
1
Downloads
0
Comments
0

1 Embed 5

https://www.enkitec.com 5

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Big Data: Business Opportunities, Requirements and Approach Presentation Transcript

  • 1. 1 | © 2012 Oracle Corporation |
  • 2. 2 | © 2012 Oracle Corporation |
  • 3. The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.3 | © 2012 Oracle Corporation |
  • 4. Oracle Exadata Database Machine4 | © 2012 Oracle Corporation |
  • 5. Oracle Strategy Open Systems Complete Stack • Complete • Vertical Integration • Open • Engineered Systems • Integrated • Best-in-Class5 | © 2012 Oracle Corporation |
  • 6. Engineered Systems I The FamilyExadata Exalogic Database Exalytics Big Data SPARCDatabase Elastic Cloud Appliance Appliance SuperClusterMachine • Expedited time to value • Reduced change management risk • Easier to manage and upgrade • One-stop support • Lower cost of ownership • Extreme performance and reliability 6 | © 2012 Oracle Corporation |
  • 7. Oracle Exadata Database Machine One architecture for… • Data Warehousing • OLTP • Database Consolidation Exadata is Oracle’s strategic database platform for ALL Oracle Database workloads7 | © 2012 Oracle Corporation |
  • 8. Proven Success Leading Brands Choose Exadata8 | © 2012 Oracle Corporation |
  • 9. Spectacular Customer Results “Softbank created a warehouse up to 8x faster while reducing costs 50%” — Keiichiro Shimizu, Softbank “Turkcell’s largest 250 TB DB is now only 27 TB with Exadata Compression” — Ferhat Sengonul, Turkcell ―Performance improved 17x with no changes to our application‖ — Jim Duffy, BNP Paribas9 | © 2012 Oracle Corporation |
  • 10. Exadata Customers with Oracle Applications10 | © 2012 Oracle Corporation |
  • 11. Exadata Customers with SAP Applications11 | © 2012 Oracle Corporation | Oracle Confidential and Proprietary Information
  • 12. Exadata Growth ―Exadata is the fastest growing product in Oracle’s history‖ - Oracle CEO, Larry Ellison12 | © 2012 Oracle Corporation |
  • 13. Oracle Exadata- What Customers Say13 | © 2012 Oracle Corporation | © 2012 Oracle Corporation
  • 14. 14 | © 2012 Oracle Corporation | © 2012 Oracle Corporation
  • 15. Exadata Architecture A complete system: compute, storage, networking • Database Grid – 8x 2-socket, or 2x 8-socket database servers – Oracle Linux or Solaris 11 – Oracle Database 11g, ASM, RAC – 10 Gb and 1Gb Ethernet (to data center) • Storage Grid – 14 Intel-based storage servers – Up to 504 terabytes raw disk per rack – 5.3 terabytes Flash storage per rack – Exadata Storage Server Software • InfiniBand Network – Internal unified connectivity ( 40 Gb/sec )17 | © 2012 Oracle Corporation |
  • 16. Complete Family of Database Machines Oracle Exadata X2-2 Oracle Exadata X2-8 2, 4, and 8 (12 core) database nodes 2 (80 core) database nodes - 4 TB DRAM Quarter Half Full, Multi-Rack Full-RackExadata models and configurations span the full range of enterprise Multi-Rack 18 database deployments | © 2012 Oracle Corporation |
  • 17. Scale to 8 Racks by Just Adding Cables 2368 Compute Cores 2.6 Petabytes Uncompressed Storage Supports Multiple Generations of Hardware19 | © 2012 Oracle Corporation |
  • 18. Exadata Storage Expansion Rack Big Data for Less • Expands storage capacity of existing Exadata Database Machines • Essentially DB Machine with DB Servers replaced by more Storage Servers • For Unbalanced Applications that need more space but not more compute – On-disk Backups of the Database Machine – Historical or Archive Data – File Data, LOBs, XML Data, DocumentsHalf the Price – Images, and other large unstructured dataper TB20 | © 2012 Oracle Corporation |
  • 19. Highly Optimized and Available • Custom systems do not achieve full performance – Component imbalance, misconfiguration, bottlenecks • Exadata is engineered and optimized end-to-end – DB libraries optimized with firmware, drivers, OS, network – Years of tuning – Warehouse queries need few or no indexes – Exadata storage has NO tuning knobs – Custom system do not achieve full availability • Complex inter-component failures modes not tested – Exadata handles all failure modes • Node failure, link failure, storage failure, switch failure, etc.22 | © 2012 Oracle Corporation |
  • 20. Runs Existing Applications Unchanged • Runs existing OLTP and DW applications – Full 30 years of Oracle DB capabilities – No Exadata certification required – Leverages Oracle ecosystem – skills, people, partners • Oracle database on next generation Grid platform • Works transparently even for most complex applications – Oracle E-business suite, PeopleSoft, Siebel, SAP23 | © 2012 Oracle Corporation |
  • 21. Keys to Speed and Cost Advantage Exadata Intelligent Exadata Hybrid Exadata Smart Storage Grid Columnar Compression Flash Cache 24 | © 2012 Oracle Corporation |Copyright © 2012, Oracle Corporation and/or its affiliates – 24 –
  • 22. Improve Query Performance 10x Exadata Smart Scans Data intensive processing runs in Exadata Storage Select sum(sales) where salesdate= ServersWhat were ’12-Aug-2012’…yesterday’s sales? Rows and columns filtered as data streams from disks Filter Sales for Aug 12 2012 10x reduction in data sent to DB servers is common Sum Scales-out linearly 26 | © 2012 Oracle Corporation |
  • 23. Extreme Performance for OLTP and DWExadata Smart Flash Cache Full rack has 5 TB of Smart Flash Cache Can process up to 1.5 million IOs per second Triples data scan rate27 | © 2012 Oracle Corporation | © 2011 Oracle Corporation
  • 24. Exadata SQL Data Throughput 75 Query Throughput Gigabytes per Second 25 13 50,000 1,500,000 (I/Os per 10 12 IOPS IOPS second) 9.3 6 NetApp 6080 IBM XIV G3 IBM DS8800 Hitachi USP V EMC VMAX Exadata Disk Exadata Flash 20K28 | © 2012 Oracle Corporation |
  • 25. Exadata Smart Flash Log Accelerate Transaction Response Times using Flash Transaction Response TimesDefault (on left)- Choppy response Smart Flash Log Enabled- High OutliersSmart Flash Log- 3x faster response- Much lower outliers • Automatic and Transparent • Better response time and more throughput • Uses almost no flash capacity (0.1% of capacity) 29 | © 2012 Oracle Corporation |
  • 26. Reduce Data Warehouse Storage RequirementsExadata Hybrid Columnar Compression Data stored by column and then compressed 10X Query mode for data warehousing tables – runs 15-50X faster due to Exadata offload Archival mode for old rarely accessed data30 | © 2012 Oracle Corporation | © 2011 Oracle Corporation
  • 27. Compression Benefits Multiply Across Stack Storage Array • 10x less Storage Compression Achieves a Fraction of Benefits • 10x better Disk Bandwidth • 10x more data in Flash Cache • 10x more data in Database DRAM CacheTest Dev DR • 10x smaller Test DB, Dev DB, DR DB • 10x smaller Backup 31 | © 2012 Oracle Corporation |
  • 28. Exadata Maximum Availability Architecture Real Primary Active Data Guard / Application GoldenGate Clusters ASM WAN RMAN / Fast Oracle Secure Recovery Area Backup Dev/Test Standby Comprehensive protection from failures Server – Storage – Network – Site – Corruptions Active Disaster Recovery: Real-time standby open for query offload Correction from human errors: database, table, row, transaction Online indexing and table redefinition Online patching and upgrades32 | © 2012 Oracle Corporation |
  • 29. Exadata Extreme Consolidation • Extreme Performance – Exadata excels at the inherently mixed and complex workloads of a consolidated environment – OLTP, DW, data mining, batch, reporting, loading, backups, files in the database • Large Memory – 2TB per node X2-8 enables large scale consolidation • Workload Management – I/O and CPU resource management isolate workloads Shrink data center costs, increase system utilization and promote application integration33 | © 2012 Oracle Corporation |
  • 30. Most Secure Database Machine • Moves decryption from software to hardware – Over 5x faster • Near zero overhead for fully encrypted database – Queries decrypt data at hundreds of Gigabytes/second • DB2, Teradata and Netezza do not have database managed encryption – Must code into every application module34 | © 2012 Oracle Corporation |
  • 31. P&G: DW and Mixed Workload Faster Storage SimplifiedBenefits Applications Savings Support 2 - 30X 3x – 10x“Performance with Exadata is much better, and getting an out-of-the-box solution dramatically reduced the time Compression and money to build and maintain our DW platform.” - Brian Beckman, DW Platform Manager, Procter & GambleBusiness Objectives Exadata V2 Exadata X2-2 Exadata X2-8 Exadata X2-2 Data Warehouse Data Warehouse Data Warehouse OLTP/Analytics• Improve stability and supportability Prod Non-Prod Prod DR Dev UAT Prod Non-Prod Prod Non-Prod• Lower costs• Boost performanceSolution Data Guard• 2010: Implement 1ST DW on V2• 2011: Move 2nd DW to X2-2, Move OLTP/Analytics to X2-2• 2012: Move 3rd DW to X2-8 • Trade/Mkt/POS Data • Shipments Data • Fin’l/Planning Data • Trade Fund Management 35 | © 2012 Oracle Corporation |
  • 32. U.S. Customs and Border Protection Faster Storage Maximum CostBenefits Applications Savings Availability Savings“Oracle Exadata has changed our strategic IT focus 10X speedup 1 Petabyte 99.95% 75% Cost from building systems to developing and Reduction supporting application services critical to the fulfillment of our national security mission.” 32 billion - Ken Ritchhart, Deputy Assistant Commissioner queries/day Replaced $$ SANBusiness Objectives Exadata V2 Exadata X2-2 Exadata X2-8 Primary/Standby Primary /Standby Primary/Standby• Reduce cost and complexity• Meet availability SLAs• Extreme scalability Data Guard Data Guard Data Guard• ConsolidationSolution 2010 2010 - 2011 2011 - 2012• 2010: Implement V2, X2-2• 2011: Add X2-2, X2-8 Automated Targeting Automated Export Passenger Enterprise Data• 2012: Add X2-8, Exalogic Systems Systems Systems Warehouse 37 | © 2012 Oracle Corporation |
  • 33. Garmin: OLTP Consolidation Faster 99.95% 4x User Data CenterBenefits Month End Reports Uptime Growth Cost Savings Up to 11X“Oracle Exadata helped us meet our challenges by enabling us to consolidate to a single footprint.” - Ed Link, Vice-President IT, GarminBusiness Objectives Pre-Exadata Exadata V2 Exadata V2 12 Prod Servers DB Consolidation Dev/Test/Local Standby• Add fault tolerance• Reduce costs via standardization 2012• Simplify support model Data Guard• Performance & Scalability • Oracle E-Business Suite High-CapacitySolution • Advanced Supply-Chain Exadata Storage• 2012: Consolidate 12 servers Planning Servers onto two Half-rack Exadata • Hyperion Reporting • 5 Prod • Archived • Tape backup V2 systems • Garmin Connect custom app Databases Data 38 | © 2012 Oracle Corporation |
  • 34. Oracle Beehive: Collaboration Capacity for Faster 100%Benefits Growth Response Uptime 5x – 60x“[Beehive] is our largest application in-house. It is Oracle’s largest backend database.” - Campbell Webb, Vice-President IT, OracleBusiness Objectives Exadata V1 Exadata X2-2 Exadata X2-2• Company-wide collaboration for Storage Servers Production Standby > 100K users Austin (Texas) Data Center Utah Data Center• CPU/ storage growth 3+ years• Improved response times 2011 Data Guard• Guarantee uptimeSolution • 96 V1 storage servers • 9 full-rack X2-2 • 9 full-rack X2-2• 2009: Move Beehive storage to • Post-Sun acquisition, • 2.3 Petabytes raw disk • Triple mirroring Exadata V1 storage CPU and disk • 48 TB flash • Disk backups/flashback enabled oversubscribed• 2011: Migrate to Exadata X2-2 • > 5,000 peak TPS • 100% uptime since go-live 40 | © 2012 Oracle Corporation |
  • 35. Enterprise Manager 12c Integrated H/W + S/W management for Exadata• Hardware view • Schematic of cells, compute nodes and switches • Hardware components alerts• Software/system view • Performance, availability, usage by databases, services, clusters • Software alerts db, cluster, ASM • Topology view of DB systems/clusters• Configuration view • Version summary of all components along with patch recommendations 41 | © 2012 Oracle Corporation |
  • 36. Oracle Platinum Services Highest Level of Service in the Industry • 24/7 Oracle Monitoring for Database, Middleware and Systems ̶ 5 Minute Fault Notification ̶ 15 Minute Restoration or Escalation to Development ̶ 30 Minute Joint Debugging with Development • Quarterly Patching • Requires Oracle Support Connectivity to Customer System • No Additional Cost43 | © 2012 Oracle Corporation |
  • 37. Maximize the Value of Enterprise Big Data Engineered Systems for Big DataACQUIRE ORGANIZE ANALYZE DECIDE 45 | © 2012 Oracle Corporation | © 2011 Oracle Corporation
  • 38. Oracle Exadata In-Memory Database Best I Disk, Flash, Memory Technology Size Cost/TB Throughput D-RAM Disks 336 TB 1 25 GB/sec HR Flash 5 TB 10x 50 GB/sec EDW DRAM 2 TB 100x 200 GB/secCRM ERP • Cost of Disk, IOs of Flash, Speed of DRAM Flash • All data stored on DISKSupply • Warm data cached in FLASHChain Data Mart • Hot data cached in DRAM • Optimal Price-Performance Disk46 | © 2012 Oracle Corporation |
  • 39. Exadata Evolution • Sparc SuperCluster • 3TB Disks State-of-the-Art, • Storage Expansion Rack Scale-out Hardware • X2-8 CPU Refresh • 2TB DRAM per node • X2-2 CPU Refresh • X2-8 64-core Servers • Smart Memory Scan • X2-2 CPU Refresh • Parallel Memory Affinity • 40 Gb InfiniBand • Enterprise Manager 12c • Exadata • PCI Flash Cards Introduced • Solaris x86 • Reverse Offload • Smart Flash Logging • Hardware DB Encryption Unique Software • Automatic Service Request Integration • Smart Flash Cache • Data Mining Offload • Storage Index • Smart Scan • Columnar Compression• InfiniBand Scaleout 2008 2009 2010 2011 2012 47 | © 2012 Oracle Corporation |
  • 40. Exadata Software Roadmap • Performance – In-memory optimized compression – Memory-to-memory Infiniband messaging – Flash for all writes – 10x more write I/O’s for write-heavy OLTP – Map-Reduce for customer big-data analytics • Better Private Cloud Consolidation – Database Platform for Oracle Public Cloud – Virtualization of database servers – Oracle Database 12c Pluggable Databases • Many Management and Robustness Improvements48 | © 2012 Oracle Corporation |
  • 41. The Exadata Difference Exadata DB Machine Custom Configuration Storage scans & filters data Storage just ships blocks Storage offloads DB* DB-unaware storage 168 CPU Flash caches relevant data No DB-aware flash managementcores in 40 Gb/sec network 8 – 10 Gb/sec networkstorage Pre-built for DB workload Assembled by customer Redundancy built-in Build-your-own HA Compression built-in Compression optional Workload mgmt built-in Workload mgmt optional * Backups, compression, decryption, data mining Exadata is not a general-purpose system, It’s a Database Machine49 | © 2012 Oracle Corporation |
  • 42. 51 | © 2012 Oracle Corporation |
  • 43. 52 | © 2012 Oracle Corporation |