Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Meetup Oracle Database: 3 Analizar, Aconsejar, Automatizar… las nuevas funciones del DBA

233 views

Published on

Las nuevas arquitecturas, servicios y micro-servicios web, aplicaciones y apps, Bots, IoT, AI, etc., que demandan las organizaciones, necesitan cada vez más del talento y experiencia de los Administradores de Bases de Datos para dar consejos, sugerencias y respuestas que aporten un valor diferencial a los grupos de desarrollo y usuarios de negocio.
Te mostramos las claves del nuevo rol del DBA, que complementa la “A” de Administrar con: Analizar, Aconsejar, Automatizar y crear Arquitecturas eficientes y Autónomas para la gestión Avanzada de datos, colaborando con los desarrolladores y usuarios desde un conocimiento profundo de las base de datos.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Meetup Oracle Database: 3 Analizar, Aconsejar, Automatizar… las nuevas funciones del DBA

  1. 1. Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | Oracle Database 18c DBA’s new roles: Advisor, Analyst and Architect Guillermo Best Cloud Platform Presales Manager guillermo.best@oracle.com Stephane Duprat Cloud Platform Solution Architect stephane.duprat@oracle.com Rafael Prada Consultor Senior rafael.prada@avanttic.com
  2. 2. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | DBAs new roles: Oracle Confidential – Internal 2 ARCHITECT ADVISOR ANALYST AUTOMATION ARTIFICIAL INTELLIGENCE
  3. 3. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Autonomous Database and Oracle Database 18c 3 Autonomous Database Oracle Cloud Policy-driven Automation & Machine Learning today’s presentation
  4. 4. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Oracle Database 18c • First yearly release of the Oracle Database – Previously referred to as Oracle Database 12c Release 2 12.2.0.2 • Oracle Database 18c is aimed at providing incremental changes and a focus on stability • Now Available on Oracle Cloud and Engineered Systems with on-premises following some time after • “Release Schedule of Current Database Releases” MOS Doc 742060.1 Oracle Confidential – Internal 4
  5. 5. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Machine Learning and Advanced Analytics in 18c • Machine Learning Algorithms available since 9i Release 2 (2002) • New algorithms in 18 – Random Forests for Classification – Neural Networks for both classification and regression – Explicit Semantic Analysis ML algorithm extended to support classification – Time Series via Exponential Smoothing – CUR decomposition-based algorithm for attribute and row importance • New ability to export ML models to C and Java for applications deployment Oracle Confidential – Internal
  6. 6. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Oracle Database 12c Release 2 6 Marquee Features Massive Cost Savings and Cloud Agility with Multitenant Plus more features for better Performance, Availability, Security, Analytics, and Application Development Massive Web Applications with Sharding Massive Performance with Database In- Memory Oracle Confidential – Internal
  7. 7. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Oracle Database 12c “Under the Radar” Features 7 OnlineTableMove JSON Real Time Materialized Views IndexCompression Auto Generated Sequences Long Identifiers Online Tablespace Encryption Property Graph SQL Plan Management Enhancements TopNQueries Invisible Columns Longer Varchars Security Assessment Tool LiveSQL IndexUsageStats Application Continuity Auto List Partitioning Oracle Confidential – Internal Oracle REST Data Services
  8. 8. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Multitenant 8Oracle Confidential – Internal
  9. 9. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Multitenant • Container managed database virtualization • Manage Many as one • Patching, Backup, Security, Online Cloning, Online Relocation • Software as Service • Shared metadata, Data location transparency 9 Today Oracle Database 18c • Refreshable PDB Switchover • Transportable Backups • Snapshot Carousel • Faster Upgrades Oracle Confidential – Internal
  10. 10. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | • Virtualize databases into Container Database – Applications run unchanged • Lower Operational Expenses – Manage many Pluggable Databases (PDBs) as one • Lower Capital Expenses – More PDBs per server • More Agile – Fast provisioning, movement and cloning 10 Oracle Database 12c Multitenant Architecture ERP CRM DW Container Database
  11. 11. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Database as a Service Patching & Upgrades Apply changes once, all pluggable databases updated 11 GL OE AP Upgrade in-place 12.X 12.X 12.X12.1 12.1 12.1
  12. 12. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Database as a Service Patching & Upgrades Flexible choice when patching & upgrading databases 12 Original Container Database 12.1 GL OE AP GL OE Upgraded Container Database 12.x
  13. 13. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | PDB Hot Clone • PDB Hot Clone – Online test master instantiation CRM Oracle Cloud Pricing Retail On-Premises 13 Hot Clone Snap Clone Snap Clone CRM CRM Dev1 CRM Dev2 Developers Public
  14. 14. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Refreshable PDB • PDB Refresh – Incremental refresh of clone with latest data CRM Dev / Test Pricing Retail Production CRM Snap Clone Snap Clone CRM Dev1 CRM Dev2 Developers TIME Changes made to database Master Dev/Test version no longer in sync Only changes copied and applied Oracle Confidential – Internal
  15. 15. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Point-in-Time Recovery with Snapshot Carousel • ”Flashback” to Thursday 10:17am: 1. Restore Thursday midnight’s snapshot 2. Roll forward to 10:17am from archivelog – PDB will be “transactionally consistent” as of this time Carousel stores archive logs along with corresponding snapshot clones ThursdaySunday Monday Tuesday Wednesday Friday Saturday Archive Logs Oracle Confidential – Internal
  16. 16. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Point-in-Time Cloning with Snapshot Carousel • “Hot Clone” introduced with 12.2 • Basic hot clone is transactionally consistent with source PDB as of SCN at completion of statement alter pluggable database Hot_Clone open; • Snapshot Carousel enables hot clone to a specific point in time (or SCN) – Restore most recent snapshot from carousel – Roll forward to required point in time by performing recovery from corresponding archive log 16Oracle Confidential – Internal
  17. 17. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Central CDB Database Cloud Provisioning Framework Central CDB contains a catalog and PDB templates 1. Request to provision a BI PDB 2. Framework consults catalog to identify appropriate pod based on available capacity 3. Request forwarded to Pod 2 to provision PDB as clone of BI template Catalog of Pods BI RMAN Catalog Docs TBE PDB Templates Pod 1 Pod 3Pod 2 Pod # vs Max Load Pod 1 125/250 60% Pod 2 75 / 125 40% Pod 3 200 / 250 80% REST API Oracle Confidential – Internal
  18. 18. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 18 Mini Demo
  19. 19. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | In-Memory Column Store 19Oracle Confidential – Internal
  20. 20. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Cost of memory continues to decrease 20 Demand for real-time analytics continues to increase Non-volatile memory in development Evolution of In-Memory
  21. 21. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Breakthrough: Dual Format In-Memory Database • BOTH row and column in- memory formats for same table • Simultaneously active and transactionally consistent • Analytics & reporting use new in-memory Column format • OLTP uses proven row format 21 Memory Memory SALES SALES Row Format Column Format
  22. 22. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | In-Memory 18c Key Features • Automatic In-Memory Management • In-Memory For External Tables • In-Memory for Extreme Capacity NVRAM Memory • Many performance improvements: – In-Memory Dynamic Scans – In-Memory Optimized Arithmetic – Mixed workload performance improvements 22Oracle Confidential – Internal
  23. 23. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | • In-Memory tables and partitions automatically ranked using access Heat Map (introduced in 12c) • Hot data automatically chosen for In- Memory population • Colder In-Memory data automatically evicted • Useful for managed cloud services since no user intervention required 23 Automatic In-Memory Management Greater Automation and Reduced Administration for Cloud Services Sales_Q3 Sales_Q2 Sales_Q4 In-Memory Column Store Sales _Q1
  24. 24. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | eXtended Memory (XMEM) Support Use Non-Volatile Memory to Massively Extend Memory Capacity • In-Memory algorithms extended to use NVRAM as higher capacity but slower memory • Performance-critical tables placed in DRAM, capacity-critical tables stored in NVRAM. • XMEM allows a 3X bigger column store 24 DRAM Column Store XMEM Column Store Oracle Confidential – Internal
  25. 25. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Database In-Memory Performance Improvements Multiple Areas of Performance Improvements 25 • Enhanced Mixed Workload performance – Up to 2X Performance Improvement • Improved aggregation performance – Aggregation push-down to Exadata • Improved JSON Processing • Faster expression evaluation • Improved Join Processing • Improved Compression at Query High • TPCH Performance – 2X Faster Oracle Confidential – Internal
  26. 26. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | 26 • External Tables allow transparent access to data outside the DB • In-Memory For External Tables builds in-memory column cache of data outside the DB for ultra-fast analytics on external data • All In-Memory Optimizations apply – Vector processing, JSON expressions extend transparently to external data • Up to 100X faster In-memory External Tables RDBMS In-memory Database Tables External Data DB TABLES In-Memory For External Tables Fast Analytics on External Data Object Storage Files Hadoop Oracle Confidential – Internal
  27. 27. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 27 Mini Demo
  28. 28. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Development JSON & REST 28Oracle Confidential – Internal
  29. 29. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | • Application Express 5.1 • SQL Developer & SQLCl • Comprehensive Language support • PL/SQL, SQL , Python, Node.js, PHP, Java, C, .NET, REST • JSON • SODA API, SODA REST API • SQL Support • Improved JSON Support • Rolling patches for OJVM • Private Temporary Tables 29 Development Today Oracle Database 18c Oracle Confidential – Internal
  30. 30. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Oracle Database as a Document Store Flexible Schema development JSON JSON Via RESTful service Via Native APIs Data persisted in database In JSON SQL Data analyzed via SQL 30
  31. 31. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | JSON Enhancements • Generate large JSON documents from relational data – JSON generation extended to supports LOB’s • New SODA (Simple Oracle Document Access) drivers – OCI and PL/SQL now added, in additional to JSON and REST – Simple, non-relational (‘nosql-like’) API for accessing JSON data • New TREAT (<expression> AS JSON) operator – Dynamically declare operands to be handled as JSON data, enabling more seamless JSON optimizations • Extended key length for JSON search indexes – Raise the key length from 64 bytes to 255 bytes; enables faster search queries for JSON objects containing long key names. 31 Simpler development of JSON-centric applications using Oracle Database Oracle Confidential – Internal
  32. 32. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 32 Mini Demo
  33. 33. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Oracle Database Cloud Service Oracle REST Data Services  Available Standalone, Weblogic, Tomcat & Glassfish  Turns Database Service into an RESTFul API service  Fully provisioned and functional in all cloud editions  Available in 11g, 12c and 18c, no extra cost  Allows publishing of URI based access to Oracle database over REST  Results in JSON or CSV  Mapping of URI to SQL or PL/SQL  All HTML methods GET, PUT, POST, DELETE, PATCH  Oauth2 integration  Highly scalable, can use all feature of database 33
  34. 34. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Oracle REST Data Services ORDS powers the Schema Service, A Quick Detour • Provides data access consistent with modern App Dev frameworks • Mid tier application • Can map standard http(s) RESTful gets and posts to SQL • Can declaratively returns results in JSON format • JavaScript friendly • Can support high numbers of end users • Services • HTTP(s) relational data access • Oracle JSON collection based schema-less access • Oracle NoSQL access over HTTP • Oracle APEX mid-tier, web toolkit applications, mod_plsql replacement • Formally known as Oracle APEX Listener • Supported feature of the Oracle Database since 2010 • Ships with Oracle Database 12.1.0.2
  35. 35. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Oracle REST Data Services Serving JSON results from relational data Oracle Database URI HTTP(S) client Oracle REST Data Services Map and Bind SQL Transform SQL Result SetTransform to JSONJSON  Data stored in standard relational tables and columns  Oracle REST Data Services (ORDS) Developer defines URI<>SQL mapping  App Developer calls named URI over HTTP(S) gets and posts
  36. 36. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Oracle REST Data Services HTTP(s) API App-Dev with Relational Tables in Oracle Database { “custno”: 1001, “name”: “Scott King”, “address”: “500 Main street, Innovation CA”, “orders”: [ { “orderno”: 404, “orderdate”: “Feb 27, 2016”, “status”: “in process”} } } { “orderno”: 303, “orderdate”: “Feb 26, 2016”, “status”: “in process”} ] } JSON HTTP(s) https://myhost/myapp/hr/customerorders/1001 Oracle REST Data Services SQL ORDS maps standard URI requests to corresponding relational SQL (not schemaless): e.g. SQL SELECT from customers and orders table. ORDS also transforms the SQL results into JavaScript Object Notation (JSON), other formats include HTML, binary and CSV. Fully committed to supporting any and all standards required by Fusion / SaaS / FMW; we are actively engaged in the ongoing dialog. SQL result to JSON transformation URI Request or HTTP(s) post mapped to SQL request JDBC Connection Pool Oracle Database URI Module Template Context Root
  37. 37. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 37 Mini Demo
  38. 38. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Availability 38Oracle Confidential – Internal
  39. 39. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Availability • Comprehensive HA and disaster recovery functionality • Real Application Clusters, Active Data Guard, Recovery Appliance, • Application Continuity • Oracle Golden Gate for heterogeneous replication • Scale out and fault isolation with Oracle Database Sharding 39 Today Oracle Database 18c • Zero Impact Grid Infrastructure Patching • Sharded RAC • Logically partition data across instances in RAC • Sharded access for shard-aware applications and transparency for non-sharded applications • Sharding improvements • User Defined Sharding • Improved Cross Shard Query support Oracle Confidential – Internal
  40. 40. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Sharded RAC • Affinitizes shards to RAC instances – Requests that specify sharding key will be routed to the RAC instance that logically holds the shard – Affinity gives better cache utilization and reduced block pings across instances • Requests that don’t specify sharding key still work transparently • Gives Sharded Database performance with minimal application changes – Just add sharding key to the most performance intensive operations 40 Higher performance for shard-aware RAC applications Oracle RAC Database Instance 1 Partition P1 Instance 2 Partition P2 Instance 3 Partition P3 Oracle Confidential – Internal
  41. 41. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Application Continuity 41Oracle Confidential – Internal
  42. 42. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Unknown Transaction State • Database and infrastructure outages can cause in-flight work to be lost, leaving users and applications in-doubt • Often leads to  User pains  Duplicate submissions  Rebooting mid-tiers  Developer pains Leads to poor customer experiences
  43. 43. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Unknown Transaction State Application Servers Database Servers End User Current Situation Network Switches User selects product from application and purchases it from the web checkout User transaction arrives at application infrastructure. It makes it’s way through the application tiers and results in a database transaction being created
  44. 44. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Unknown Transaction State Application Servers Database Servers End User Current Situation Network Switches User transaction arrives at application infrastructure and makes it’s way through application tiers and results in a database transaction being created The transaction commits inside of the database and an acknowledgement begins it return journey A failure in the infrastructure on its return journey means the application server never receives an acknowledgment
  45. 45. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Unknown Transaction State Application Servers Database Servers End User Current Situation Network Switches The application is left in an unknown state. It returns an error to the user who may order the product for a second time resulting in them potentially being charged twice.
  46. 46. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | A Solution to the Problem • Transaction Guard: a reliable protocol and API that returns the outcome of the last transaction • Application Continuity: safely attempts to replay in-flight work following outages and planned operations. Two New Features
  47. 47. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Application Continuity Application Servers Database Servers End User A reliable replay of in flight work Network Switches User selects product from application and purchases it from the web checkout User transaction arrives at application infrastructure. It makes it’s way through the application tiers and results in a database transaction being created
  48. 48. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Application Continuity Application Servers Database Servers End User A reliable replay of in flight work Network Switches The infrastructure hosting the database fails just before the transaction is committed to the database.
  49. 49. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Application Continuity Application Servers Database Servers End User A reliable replay of in flight work Network Switches The jdbc driver detects the failure and checks with an available node in the cluster, using “Transaction Guard”, whether the transaction committed or needs to be replayed If the transaction needs to be replayed, “Application Continuity” will submit all of the inflight work to a surviving node in the cluster and perform a commit. This all happens transparently to the application
  50. 50. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Application Continuity Application Servers Database Servers End User A reliable replay of in flight work Network Switches The user receives confirmation that his order has been successfully completed.
  51. 51. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Application Continuity for Java and OCI transparent • If the Application –Uses J2EE or JPA that uses the standard JDBC API –Uses UCP or WebLogic Server and return connections to pool –Does not have external actions that cannot be replayed • Or use OCI client –Nothing to do
  52. 52. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 52 Mini Demo
  53. 53. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 53 Thanks!

×