Engineered Systems for Cloud - Cloud Odyssey session


Published on

Engineered Systems for Cloud - Cloud Odyssey session
Radosław Kut, WaldemarThiel Engineered Systems Competency Center

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Jakie exadata daje nam mozliwosci budowy chmury. jej wewnetrznej struktury elastycznosci i skalowalnosci dostosowania do wymagan jakie zostaly okreslone.
  • Conclusion – we are proposing one architecture – database cloud for every thing
  • A pluggable database is a set of database schemas that appears logically to users and applications as a separate database. But at the physical level, the multitenant container database has a database instance and database files, just as a non-CDB does. Nothing changes: neither the client code, nor the database objects. A CDB avoids redundancy of: Background processes Memory allocation Oracle metadata in several data dictionaries A CDB grouping several applications ends up with one instance, consequently one set of backgroundprocesses,oneSGAallocationandonedatadictionaryintheroot container, common for all PDBs, each PDB maintaining its own application data dictionary. When applications need to be patched or upgraded, the maintenance operation is performed only once on the CDB and consequently all applications are updated at the same time.
  • Conclusion – we are proposing one architecture – database cloud for every thing
  • IORMwrazz DBRM uzupełnieniemechanizmówzarządzaniazasobami.DBRM:Zarządzaniegrupamikonsumenckimi I planami- Instance Caging- AutoDOP
  • ASM scoped SecurityDatabase scoped security
  • What is Information Lifecycle Management, also referred to as ILM? It is a strategy for managing business data over its lifetime in order to reduce storage costs, improve data access within the database and adapt to regulatory requirements. ILM is the practice of applying policies for the effective management of information throughout its useful life ADO provide the ability to declare policies on different scope levels in the database: tablespace, object, and row-levels, automatically enforced by the ADO infrastructure. An ADO policy is a procedure that executes the registered operations for the requested object to get them to the required state transparently without any user intervention. Policies automate data movement between different tiers of storage within the database. They also compress at different levels for each tier, and mainly control when the data movement takes place. For example, when partition rows were not updated for three days, automatic compression based on policy is performed. This capability obviates the need for the application to make explicit schema changes
  • Consolidation: same workloads, less servers, smaller footprintHigher throughput: 50% less hardware for the same workload50% savings in datacenter operations (space, cooling, power, staff, etc.)Licensing savings: Improved application scalability and performance reduces the number of licensed processor cores per product by 50%Automation and Policy BasedLifecycle automations reduce maintenance time (ExaChk, ExaBR, etc.) Users activities are policy-driven, no need for IT to policeConsolidation: same workloads, less servers, smaller footprintReduces Data Centers costs by at least 35%Higher throughput means 50% less hardware for the same workloadReduce Hardware footprint 50%Substantial savings (50+%) due to reduction of space and other key data center metrics (cooling, power, staff, tools/mgmt SW)Licensing savings: Improved application scalability and performance reduces the number of licensed processor cores per product by 50%
  •  Exalogic enables Oracle Middleware products to use Sockets Direct Protocol (SDP) under the covers, rather than TCP-IP, to achieve lower latency communication over an InfiniBand networkMiddleware optimizations: Exalogic Software optimization (e.g. improved session replication, thread management, SDP Support, etc )
  • This figure depicts the Exalogic Elastic Cloud Software (EECS) version 2.0. It shows the Exabus I/O subsystem and Exabus integration within the WebLogic, Coherence and Tuxedo products. There products have been optimized to run on Exlaogic but are optional components.The Redboxes make up the core EECS software. Exalogic Control is the key component for IaaS operations. EM (Enterprise Manager) integrates with Exalogic Control for additional IaaS functionality.
  • Exalogic Control : Provides the IaaS for Exlaogic. IaaS enables providers to abstract out and enable allocation of computeResources, storage, network, etc, on demand through the use of Virtualization
  • Cloud management APIAccess to virtual infrastructure pools through IaaS APIs or EMOracle Enterprise Manager (EM12c) is a powerful tool that can be used to manage a large enterprise compute facility, looking after both the hardware and the software running. (apps to disk management) . For Exalogic there are several plugins (management packs) that enable it to create a powerful view onto the rack and monitor it from apps to disk. 
  • Oracle Virtual Assembly Builder is part of the Oracle Fusion Middleware product set which provides automated configuration and deployment for complex distributed software architectures, reducing total administrator effort and deployment time for multi-tier applications into virtualized environments. The main differentiator is the application aware virtualization (particularly for Oracle Middleware and database products). It uses the Oracle VM product set as the virtualization infrastructureTransformation of IT through Enterprise Cloud
  • For developersFor Dev flexibility: rapid development, customization, configuration..Tool used to capture configurations to create building blocks and wire together to create assemblyVirtualization needs to deliver on applications not just on virtualization layer
  • Once the Assembly Archive is available, it can be imported and deployed on Exalogic using EM 12c or OVAB deployerOVAB provides deployment plan and scalability features (increase # of VMs, more memory) to further customize and enhance the deployment
  • While Cloud Shared Services and Self-Service application sounds exciting, they also bring some challenges. As different tenants start sharing the same piece of platform or infrastructure, there needs to be accountability on the usage, else resources will get hogged.. Also, we need to acknowledge that the ease of Self-Service Provisioning in itself may lead to over-consumption of resources resulting in sprawl. To mitigate this, organizations often meter the usage and optionally chargeback [or show back] the tenants . Though an IT organization may not actually charge back its LOBs, this provides a transparent mechanism to budget resources and optimize the cloud platform on an ongoing basis.What we have in Enterprise manager 12c is a very sophisticated and flexible Metering and Chargeback mechanism where one can define models based on Fixed cost, Configuration (such as version, licenses) or utilization or a combination of these. We provide you the ability to meters resources at various levels – host/VM level, database and middleware. [Give one or two examples]. On the reporting side of things, we have integration with LDAP so that we can traverse the organizational hierarchy and generate the consumption report at various levels-individual, department, etc. The IT metrics can then be fed into a billing tool such as Oracle’s own Billing and revenue Management solution, should any organization want to generate a bill for the tenants/consumers. Enterprise Manager also provides a rich performance management database (PMDB – AWR, JVMD Repository) which provides you historical view cloud performance. This functionality in conjunction with metering and chargeback functionality enables you to manage, monitor and optimize cloud performance, capacity and costs.
  • Engineered Systems for Cloud - Cloud Odyssey session

    1. 1. Engineered Systems for Cloud Radosław Kut, Waldemar Thiel Engineered Systems Competency Center 1
    2. 2. Oracle Engineered Systems Exalytics Exalitycs In-Memory Machine Exadata Database Machine Exadata Exalogic Elastic Cloud Exalogic Virtual Compute ZFS Storage Virtual Appliance Appliance Database Appliance Database Applianace Appliance ZFS Storage SuperCluster Applianace Oracle Super Cluster 2
    3. 3. A Tipping Point to unleash Innovation Effort IT as a Service Automate & Optimize Consolidate Standardize Business & IT Benefits 3
    4. 4. Database Consolidation onto Private Clouds Exadata exclusive capability • Exadata Hardware • Oracle Grid Infrastructure • Oracle Real Application Cluster • Oracle Database 11gR2, 12c • Exadata Storage Software 4
    5. 5. Hardware Pools • • • • Allows mission critical databases to be deployed in the cloud Supports all of the database consolidation models we discussed. Provide all the isolation capabilities of a dedicated environment Hardware Pool Mission Critical Hardware Hardware Pool Pool Hardware Pool Shared Pool Mission Critical Shared Pool and the agility of a cloud 5
    6. 6. Hardware Pools • Provide the agility of a cloud • Supports on-demand pricing • Each Hardware Pool is a separate cluster • Grow and Shrink pools dynamically • Servers • Storage Cells Hardware Pool Hardware Hardware Pool Pool Hardware Pool 6
    7. 7. Database Consolidation onto Private Clouds Example Server 1 Grid 1 RAC1 DB1 DB2 Server 2 RAC2 DB3 Server 3 Server 4 DB4 PROD CRITICAL Server 5 Server 6 Hardware Pool Grid 2 PROD RAC1 DB1 DB2 DB3 DB4 DB5 Hardware Pool Server 1 Server 2 Server 3 Server 4 TEST/DEV Grid 4 RAC1 ONE NODE DB1 DB2 DB3 RAC2 ONE NODE Grid 3 DB1 DB2 DB3 RAC3 ONE NODE DB1 DB2 DB3 RAC1 DB1 DB4 DB5 DB2 Server 5 Server 6 DB3 PROD/QA RAC1 ONE NODE DB1 DB2 DB3 7
    8. 8. Extreme Schema Consolidation Consolidated Database Schemas • • • Simplified management Fewer Databases DDL applies to all tenants ERP1 ERP2 ERP3 Database Consolidated Database Schemas • • • • Simplified management Updates much easier Extreme scalability Efficient storage utilization BI BI BI Database Consolidated Database Schemas • • • Simpler to manage More flexible Extreme scalability CRM CRM CRM Database 8
    9. 9. Database 12c Multitenant 9
    10. 10. Exadata Unified Workload Transformation Single Machine for… • Data Warehousing • OLTP • Database Cloud OLTP with Analytics and Parallelism of Warehousing Warehousing with Interactivity, Availability, and Security of OLTP 10
    11. 11. Exadata Innovations • Hybrid Columnar Compression • Intelligent storage – Scale-out InfiniBand storage – Smart Scan query offload + + + • Smart PCI Flash Cache – Accelerates random I/O up to 30x – Triples data scan rate – 10x compression for warehouses – 15x compression for archives uncompressed Data remains compressed for scans and in Flash compress primary DB Benefits Cascade to Copies standby test dev backup 11
    12. 12. Exadata I/O Resource Management I/O Resource Manager Inside One Database Across Multiple Databases Mixed Workload Dueling Databases Cooperative Databases Intra-Database Resource Management Inter-Database Resource Management Category Resource Management 12
    13. 13. Exadata I/O Resource Management Mixed Workloads and Multi-Database Environment • Ensure different databases are allocated the correct relative amount of I/O bandwidth Database A Database B • Ensure different users and tasks within a database are allocated the correct relative amount of I/O bandwidth InfiniBand Switch/Network Exadata Cell Exadata Cell • Database A: 33% I/O resources • Database B: 67% I/O resources Exadata Cell • Database A: • Reporting: 60% of I/O resources • ETL: 40% of I/O resources • Database B: • Interactive: 30% of I/O resources • Batch: 70% of I/O resources 13
    14. 14. Secure Database Machine  Moves decryption from software to hardware – Over 5x faster  Near zero overhead for fully encrypted database  Queries decrypt data at hundreds of Gigabytes/second 14
    15. 15. Oracle Exalogic The Cloud Platform for Mission Critical Applications 16 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
    16. 16. Exalogic Elastic Cloud Components Exalogic Status Quo Applications & Middleware OS Virtualization & Cloud Management Compute Networking Storage Layer 17 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. X4-2
    17. 17. Exalogic X4-2 Converged Infrastructure Compute Power • 2 socket, 12-core, 2.7 GHz Intel Xeon Ivy Bridge / node • 256 GB of RAM (upgradable to 512 GB) • 720 cores in a Full Rack also available in 1/2,1/4,1/8 or multi-rack configurations • Redundant SSD, power, cooling, InfiniBand Internal I/O Fabric and Data Center Connectivity • 40 Gb/sec internal I/O backplane • 10 Gigabit Ethernet connectivity to datacenter Integrated Storage • Enterprise-class, integrated Network Attached Storage • ZFS Clustered for high availability • 80 TB SAS disk, 6.4 TB read cache, 292 GB write cache • Clones, snapshots, remote replication EL X4-2 18 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
    18. 18. Exalogic Architecture I Fault Tolerance  Dual Power Distribution Units (1+1)  Dual power supplies in each component (1+1)  N+1 cooling (fan) strategy  Redundant IB switches (1+1)  Dual HCA ports in every component (bonded, 1+1)  Redundant storage heads (1+1)  All SSD and HDD RAID 1+ 19 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
    19. 19. Exalogic | Driving TCO Down Consolidation • Same workloads, less servers, smaller footprint • Higher throughput 50% less hardware for the same • • Automation and Policy Based 20 Copyright © 2013 Oracle and/or its affiliates. All rights reserved. workload 50% savings in datacenter operations space, cooling, power, staff, etc. Licensing savings • Lifecycle automations reduce maintenance time: ExaChk, ExaBR, ExaPatch, ExaLogs, ExaMap, ExaDiscover • Users activities are policy-driven, no need for IT to police
    20. 20. Exalogic | Why is Performance Better? Middleware Optimizations •Exalogic Software optimization •Memory optimizations (RDMA and shared memory) •Integration with Exabus InfiniBand Fabric (Exabus): Eliminating I/O Bottlenecks • Direct communication between applications and between Exalogic and Exadata • Provides minimum latency and maximum throughput OVM Optimizations • SR-IOV for direct I/O path between the application and the network Application Optimizations and InMemory Modules 21 Copyright © 2013 Oracle and/or its affiliates. All rights reserved. • Further accelerated performance with Coherence and database cache
    21. 21. Exalogic | Control and Security App-to-Disk Management • Manageability: One tool for the entire system • End to end view makes it easier to spot issues and take care of them Role-Based Access • 3 Roles: Exalogic Admin (super user), Cloud Admin and Cloud User Policy based • Users activities are based on pre-defined policies set by the cloud administrator Multi-tenancy capabilities • Complete separation between applications and/or users • Software defined firewall enables isolation between tenants Monitoring, Metering and Chargeback 22 Copyright © 2013 Oracle and/or its affiliates. All rights reserved. • Usage metering for infrastructure resources: CPU, VMs, memory, storage, network bandwidth
    22. 22. Exalogic | High Levels of Efficiency and Agility Self-service Portal Rapid deployment of new applications • Developers and end users can provision their IT needs through a self-service portal, reducing waiting time from days to minutes • Deploying a multi-tier application with predefined assemblies • Pre-built, pre-tested VM Templates for Oracle applications Shorter development • Enables shorter time to market of new features/applications cycles with automation 23 Copyright © 2013 Oracle and/or its affiliates. All rights reserved.
    23. 23. Exalogic Overview | Architecture Improved Consolidation, Management, Performance FMW and Business Applications Coherence Tuxedo Exabus SDP API Exabus Java API Exabus RDMA API Exalogic Elastic Cloud Software 2.0 Exabus Exalogic Control Traffic Director Oracle VM Virtual Assembly Builder Enterprise Manager WebLogic EL X4-2 Exalogic Elastic Cloud X4-2 Hardware 24 Copyright © 2013 Oracle and/or its affiliates. All rights reserved.
    24. 24. Exalogic Overview | Virtualization & IaaS Virtualization, High Performance and Automation Combined! • Virtualization: OVM – Mission critical server virtualization – Optimized SR-IOV Performance • Secure segregation of traffic for specific VM guests • Traffic flows directly between guest VM and physical HCA port (near physical performance) Exalogic Control • Exalogic Control – Infrastructure-as-a-Service (IaaS) management – Manages users and compute resources – Fully integrated out-of-the-box – Integrates with Enterprise Manager (EM) 25 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Oracle VM
    25. 25. Exalogic Management I Cloud Management Using Exalogic Control: Exalogic X3-2 • Cloud Management API • Oracle Virtual Assembly Builder (OVAB) Studio/Assemblies • Full EM integration for application-to-disk management IaaS API 1 Exalogic Compute Nodes Assembly 2 Exalogic Control Appliance A Appliance C VM VM Appliance B VM VM OVAB Studio Assembly Assembly Administrator Assembly Appliance B Appliance A VM VM VM Appliance A VM VM VM VM VM Appliance C VM Appliance B VM VM 3 Appliance Appliance EM System and Cloud Administrators 26 Copyright © 2013 Oracle and/or its affiliates. All rights reserved. Appliance Appliance Appliance Appliance Exalogic Storage Appliance Appliance
    26. 26. Oracle VM Templates for Exalogic Download From Oracle E-Delivery; Deploy in Minutes 27 Copyright © 2013 Oracle and/or its affiliates. All rights reserved.
    27. 27. Application Deployment | IaaS++ (OVAB) Quickly configure and provision entire multi-tier application • Composing configurations of multi-tier applications Applications Middleware & DB Virtual Machines (Assembly) Middleware & DB Virtual Machines (Assembly) VMs Virtual IPs Network Storage • Capturing the configuration of existing software components and packaging them as self-contained software appliance (assembly) • Provision whole assemblies onto a pool of virtual and cloud resources with minimal user intervention • Addressing: – Developer complexity – Middleware administration complexity – Middleware QoS complexity 28 Copyright © 2013 Oracle and/or its affiliates. All rights reserved.
    28. 28. Assemblies: Standardization with Flexibility Capture Complete Application Topology Oracle Virtual Assembly Builder Studio Package Into Single Assembly Metadata 29 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
    29. 29. Automated Deployment and Configuration Assembly Enterprise Cloud Virtualized Deployment VM VM VM Exalogic Elastic Cloud VM Assembly deployed as collection of interconnected VM instances Metadata Oracle VM Resource Pool 30 Copyright © 2013 Oracle and/or its affiliates. All rights reserved. VM VM
    30. 30. Platinum Support for Exadata ORACLE PLATINUM SERVICES Complete. Integrated. Proactive.  24/7 support  Specialized Engineered Systems Support Team  2-hour onsite response to hardware issues1  New Updates and Upgrades for Database, Server, Storage, and OS software  My Oracle Support proactive support portal  "Phone home" automated service requests (ASR) High Availability. No Additional Cost.  Better support for the complete Oracle stack – Includes higher support levels for Database software  Proactive remote monitoring for faults  Industry leading service level response times: – – – 5 Minute Fault Notification 15 Minute Restoration or Escalation to Development 30 Minute Joint Debugging with Development  Oracle Engineers perform quarterly patching and updates Available for certified configurations on Exadata 31
    31. 31. Enterprise Manager 12c Integrated H/W + S/W management for Exadata  Hardware view • Schematic of cells, compute nodes and switches • Hardware components alerts  Software/system view • Performance, availability, usage by databases, services, clusters • Software alerts db, cluster, ASM • Topology view of DB systems/clusters  Configuration view • Version summary of all components along with patch recommendations 32
    32. 32. Metering and Chargeback  Statistics  Chargeback/Showback  Integration with Oracle Billing and Revenue Management  Optimization : performance,resources, QoS, costs… 33
    33. 33. 34