Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Autonomous Data Warehouse

199 views

Published on

Prezentace z webináře
7.3.2019
Prezentoval: Patrik Plachý – Principal Sales Consultant Oracle

Published in: Technology
  • Be the first to comment

Autonomous Data Warehouse

  1. 1. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Step-by-Step Guide to Oracle Autonomous Data Warehouse Cloud Patrik Plachý Principal Sales Consultant
  2. 2. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, timing and price of any features or functionality described for Oracle's products may change and remains at the sole discretion of Oracle Corporation. Fees apply for new Database product offerings. Safe Harbor Statement 2
  3. 3. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Agenda Introduction to Autonomous Data Warehouse Cloud Getting started with Autonomous Data Warehouse Cloud 1 2
  4. 4. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Introduction to Autonomous Data Warehouse Cloud
  5. 5. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Autonomous Data Warehouse Cloud • Easy – Fully-managed, pre-configured and optimized for DW workloads – Simply load data and run • No need to define indexes, create partitions, etc. • Fast – Based on Exadata technology • Elastic – Instant scaling of compute or storage with no downtime
  6. 6. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Fully-managed • Oracle automates end-to-end management of the data warehouse – Provisioning new databases – Growing/shrinking storage and/or compute – Patching and upgrades – Backup and recovery • Full lifecycle managed using the service console – Alternatively, can be managed via command-line interface or REST API
  7. 7. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Automated Tuning • “Load and go” – Define tables, load data, run queries • No tuning required • No special database expertise required • No need to worry about tablespaces, partitioning, compression, in-memory, indexes, parallel execution – Fast performance out of the box with zero tuning – Simple web-based monitoring console – Built-in resource-management plans Confidential
  8. 8. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Fully-elastic • Size the DW to the exact compute and storage required – Not constrained by fixed building blocks, no predefined shapes • Scale the DW on demand – Independently scale compute or storage – Resizing occurs instantly, fully online • Shut off idle compute to save money – Restart instantly
  9. 9. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Full Support of DW Ecosystem • Autonomous Data Warehouse Cloud supports : – Existing tools, running on-premises or in the cloud • Third-party BI tools • Third-party data-integration tools • Oracle BI and data-integration tools: BIEE, ODI, etc – Oracle cloud services: Analytics Cloud Service, Golden Gate Cloud Service, Integration Cloud Service, and others – Connectivity via SQL*Net, JDBC, ODBC
  10. 10. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential Autonomous Data Warehouse Cloud: Architecture Oracle Exadata Cloud Service Oracle Database Cloud Service Express Cloud Service Data Warehouse Services (EDWs, DW, departmental marts and sandboxes) Autonomous Data Warehouse Cloud Service Console Built-in Access Tools Oracle ML Service Management DW Database SQL Developer Developer Tools Data Integration Services Oracle Data Integration Platform Cloud 3rd Party DI on Oracle Cloud Compute 3rd Party DI On-premises
  11. 11. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Getting Started with Autonomous Data Warehouse Cloud Provisioning a database
  12. 12. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Getting Started with Autonomous Data Warehouse Cloud • Provisioning requires only 4 simple questions: – Database name? – How many CPU’s? – How many TB’s? – Admin password? • New service created in seconds (regardless of size) – Database is open and ready for connections
  13. 13. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Demo Provisioning a database
  14. 14. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 14
  15. 15. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 15
  16. 16. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
  17. 17. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
  18. 18. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
  19. 19. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
  20. 20. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
  21. 21. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
  22. 22. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
  23. 23. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
  24. 24. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
  25. 25. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
  26. 26. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
  27. 27. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
  28. 28. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
  29. 29. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
  30. 30. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
  31. 31. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
  32. 32. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
  33. 33. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
  34. 34. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Getting Started with Autonomous Data Warehouse Cloud Connecting to the database
  35. 35. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Connecting to the Database • Securely connect using credential wallets via SQL*Net, JDBC, ODBC • Wallet can be downloaded from – The Cloud Console – The Database Service Console – Using REST APIs
  36. 36. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Demo Downloading the credential wallet
  37. 37. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
  38. 38. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
  39. 39. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
  40. 40. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 40Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 39
  41. 41. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 41Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 39
  42. 42. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 42
  43. 43. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 43
  44. 44. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 44
  45. 45. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 45
  46. 46. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 46
  47. 47. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 47
  48. 48. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 48
  49. 49. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Demo Connecting to the database using the wallet in SQL Developer
  50. 50. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 50Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 49Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 49
  51. 51. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 51Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 50Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 50
  52. 52. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 52
  53. 53. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 53
  54. 54. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 54
  55. 55. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 55
  56. 56. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 56
  57. 57. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 57
  58. 58. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 58
  59. 59. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Database Service Names • 3 pre-defined database services – Choice of performance and concurrency • HIGH – Highest resources, lowest concurrency – Queries run in parallel • MEDIUM – Less resources, higher concurrency – Queries run in parallel • LOW – Least resources, highest concurrency – Queries run serially No of concurrent queries Max idle time CPU shares HIGH 3 5 mins 4 MEDIUM 20 5 mins 2 LOW 32 1 hour 1 Example for a database with 16 OCPUs
  60. 60. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Getting Started with Autonomous Data Warehouse Cloud Creating users
  61. 61. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Simplified User Creation • Simplified user creation via the new database role – No need to specify anything except the password – DWROLE includes all necessary privileges for a DW developer/user create user sh identified by sh; grant dwrole to sh;
  62. 62. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Getting Started with Autonomous Data Warehouse Cloud Loading data
  63. 63. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Data Loading Options • Data loading via SQL*Net – Suitable for small volumes of data • SQL*Loader from local filesystem • ETL scripts that use DML to insert/update data • Data loading from Oracle Object Storage – Preferred technique for large volumes of data • Additionally enables data-sharing with other cloud services – Stage data in Oracle Object Storage, then load into the database using new PL/SQL APIs
  64. 64. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Loading Data from Object Stores • Source data from files on object stores for data loading – OCI Object Storage, OCI Object Storage Classic, AWS S3, or Microsoft Azure – Any supported ORACLE_LOADER file format – Roadmap: any Hadoop file format ADWC OBJECT STORES
  65. 65. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | New Cloud API to Access Object Stores, DBMS_CLOUD • New PL/SQL package for accessing files in object stores • No need to manually define external tables for loading files – Makes it easier to specify the format of the source data
  66. 66. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Loading Data from the Oracle Object Store • Define your credentials for the object store – Oracle Cloud Infrastructure Object Store username and Swift password required • Credential stored in the database schema once and used for accessing the object store for all loads begin dbms_cloud.create_credential( credential_name => 'OBJ_STORE_CRED', username => 'tenant1', password => ’password' ); end; /
  67. 67. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Loading Data from the Oracle Object Store • Load data directly into the target table without any intermediate steps • Data format in the source file easily specified as JSON begin dbms_cloud.copy_data( table_name =>'CHANNELS', credential_name =>'OBJ_STORE_CRED', file_uri_list =>'https://swiftobjectstorage.us-ashburn- 1.oraclecloud.com/v1/dwcsdemo/DEMO_DATA/chan_v3.dat', format => json_object('ignoremissingcolumns' value 'true', 'removequotes' value 'true') ); end; /
  68. 68. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Troubleshooting Loads • Load operations logged for troubleshooting and historical load tracking – New table user/dba_load_operations • Log and bad files accessible as tables select table_name,status,rows_loaded,logfile_table,badfile_table from user_load_operations; TABLE_NAME STATUS ROWS_LOADED LOGFILE_TABLE BADFILE_TABLE -------------------- --------- ----------- -------------------- -------------------- CHANNELS FAILED COPY$1_LOG COPY$1_BAD CHANNELS COMPLETED 5 COPY$2_LOG COPY$2_BAD
  69. 69. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Demo Loading data from the Oracle Object Store
  70. 70. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Getting Started with Autonomous Data Warehouse Cloud Querying data on object stores
  71. 71. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Querying Data on Object Stores • Directly query files residing on object stores without the need to load them first – OCI Object Storage, OCI Object Storage Classic, AWS S3 or Microsoft Azure – Any supported ORACLE_LOADER file format – Roadmap: any Hadoop file format ADWC OBJECT STORES SQL
  72. 72. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Querying Data on the Oracle Object Store • Define your credentials for the object store – Oracle Cloud Infrastructure Object Store username and Swift password required • Credential stored in the database schema once and used for accessing the object store for all queries • Call the dbms_cloud API for creating an external table on top of the source files
  73. 73. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Querying Data on the Oracle Object Store begin dbms_cloud.create_external_table( table_name =>'CHANNELS_EXT', credential_name =>'OBJ_STORE_CRED', file_uri_list => 'https://swiftobjectstorage.us-ashburn- 1.oraclecloud.com/v1/dwcsdemo/DEMO_DATA/chan_v3.dat', format => json_object('ignoremissingcolumns' value 'true', 'removequotes' value 'true'), column_list => 'CHANNEL_ID NUMBER, CHANNEL_DESC VARCHAR2(20), CHANNEL_CLASS VARCHAR2(20), CHANNEL_CLASS_ID NUMBER, CHANNEL_TOTAL VARCHAR2(13), CHANNEL_TOTAL_ID NUMBER' ); end; / select count(*) from channels_ext;
  74. 74. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Demo Querying data on the Oracle Object Store
  75. 75. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Getting Started with Autonomous Data Warehouse Cloud Web-Based SQL Worksheet and Notebooks
  76. 76. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Built-in SQL Worksheet and Notebook • Quickly start running queries with built-in web-based notebooks – No need to install a client query tool • Initially supports SQL and PL/SQL – More languages in the roadmap • Based on Apache Zeppelin
  77. 77. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Getting Started with Autonomous Data Warehouse Cloud Scaling your database
  78. 78. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Scaling Your Database • Scale your database on demand without tedious manual steps – Independently scale compute or storage – Resizing occurs instantly, fully online – Memory, IO bandwidth, concurrency scales linearly with CPU • Close your database to save money when not used – Restart instantly
  79. 79. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Demo Scaling your database
  80. 80. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
  81. 81. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
  82. 82. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
  83. 83. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 83
  84. 84. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 84
  85. 85. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 85
  86. 86. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 86
  87. 87. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 87
  88. 88. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 88
  89. 89. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 89
  90. 90. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 90
  91. 91. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Getting Started with Autonomous Data Warehouse Cloud Administration and monitoring
  92. 92. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Automated Database Configuration • init.ora parameters – Parameters optimized for DW workloads – Memory, parallelism, sessions configured based on number of CPUs – Users can modify a limited set of parameters, e.g. NLS settings • Tablespace management – Pre-defined data and temporary tablespaces – Users cannot create/modify tablespaces • Compression – All tables compressed using Hybrid Columnar Compression – Users cannot change compression method or disable compression
  93. 93. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Automated Database Configuration • Optimizer stats gathering – Stats gathered automatically during direct load operations – Users can gather stats manually if they want • Optimizer hints – Hints ignored by default – Users can enable hints explicitly • Result cache configuration – Result cache enabled by default for all queries
  94. 94. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Monitoring • Simplified monitoring using the web-based service console • Historical and real-time performance charts • Real-Time SQL Monitoring to monitor running and past SQL statements • Historical data load monitoring
  95. 95. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Demo Monitoring
  96. 96. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 96
  97. 97. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 97
  98. 98. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 98
  99. 99. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Confidential – Oracle Internal/Restricted/Highly Restricted 99
  100. 100. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Oracle Autonomous Warehouse Cloud Summary
  101. 101. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Key Use Cases for Autonomous Data Warehouse Cloud Confidential – Oracle Internal/Restricted/Highly Restricted Sandboxes for Data Scientists Data Lakes Data Marts / Warehouses Business Analytics Machine Learning Query Across All Data
  102. 102. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Autonomous Data Warehouse Cloud • Easy – Fully-managed, pre-configured and optimized for DW workloads – Simply load data and run • No need to define indexes, create partitions, etc. • Fast – Based on Exadata technology • Elastic – Instant scaling of compute or storage with no downtime

×