Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

AMIS Oracle OpenWorld en Code One Review 2018 - Pillar 1: Data

318 views

Published on

The annual review session by the AMIS team on their findings, interpretations and opinions regarding news, trends, announcements and roadmaps around Oracle's product portfolio.

Published in: Software
  • Be the first to comment

  • Be the first to like this

AMIS Oracle OpenWorld en Code One Review 2018 - Pillar 1: Data

  1. 1. Oracle OpenWorld & CodeOne Review Pillar 1: Data Data on OCI Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 1 Lucas Jellema, CTO of AMIS Fall 2018 #oowamis
  2. 2. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 2 OLTP
  3. 3. The Oracle Database • Managed Cloud offerings based on Open Source Datastores Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 350 Shades of Data 3
  4. 4. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 4
  5. 5. Quick Overview • Oracle Database 18c (18.3) available in the cloud and on premises • Now also as RPM install on Linux • Oracle Database 19c is in beta • Expected release “near end of calenda year (2018)” • Big feature: Automatic Index Creation • Autonomous Database Cloud services – live today • Autonomous Data Warehouse • Autonomous Transaction Processing Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 5
  6. 6. Cloud and Software Engineered to Work Together Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 6
  7. 7. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 7
  8. 8. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | What is the Autonomous Database Cloud? Autonomous Database = Database-Optimized Infrastructure as a Service Expanded Database Automation + + Policy-driven Workload Optimization and Machine Learning Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 8
  9. 9. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 9
  10. 10. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 10
  11. 11. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Oracle Autonomous Database Key Attributes Review of Oracle OpenWorld & CodeOne 2018 - #oowamis Goal - Eliminate human labor/opportunity for error Self-Driving Automates all database and infrastructure management, monitoring, tuning Self-Securing Protects from both external attacks and malicious internal users Self-Repairing Protects from all downtime including planned maintenance 11
  12. 12. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 12
  13. 13. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 13
  14. 14. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 14
  15. 15. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 15
  16. 16. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 16
  17. 17. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 17
  18. 18. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 18
  19. 19. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 19
  20. 20. Autonomous only for Database and Data Warehouse Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 20
  21. 21. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 21
  22. 22. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 22
  23. 23. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 23
  24. 24. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 24
  25. 25. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 25
  26. 26. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 26
  27. 27. SQL on Kafka • Oracle Database works with Kafka Topics as “external table” Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 27 • Publishing from Oracle Database to a Kafka Topic is on the roadmap for v2
  28. 28. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 28
  29. 29. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 29
  30. 30. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 30
  31. 31. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 31
  32. 32. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 32
  33. 33. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 33
  34. 34. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 34
  35. 35. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 35
  36. 36. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 36
  37. 37. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 37
  38. 38. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 38
  39. 39. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 39
  40. 40. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Self-Securing Autonomous Database Automated Patching & Upgrades Separation of Duties & Auditing Encrypted by Default At Rest & In Motion Robust Baseline Security Posture Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 40
  41. 41. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | • Very large Oracle customer with more than 15,000 databases – 4 quarterly patches per year – Average of 45 minutes per database to apply the patches (0.75 hours) – 4*.75*15,000 = 45,000 hours per year spent in patching* – 22 skilled DBAs required JUST to apply patches! * Does not include OS patches • SMB Oracle customer with 20 databases • 4 quarterly patches per year • Average of 45 minutes per database to apply the patches (0.75 hours) • 4*.75*20 = 60 hours per year spent on patching • More than a week just to keep up with patches! The high cost of patching Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 41
  42. 42. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | • of [database] cyberattacks are on databases that administrators have failed to patch for more than 9 months – Mark Hurd, CEO Oracle • cost to Experian of last year’s data breach, blamed on an unpatched vulnerability in Apache Struts The exorbitant cost of NOT patching Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 42
  43. 43. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | • Security patches applied every quarter – Patching can also occur off-cycle if a zero-day exploit is discovered • Patches are applied without application downtime – further reducing the cost of patching Autonomous Database Security – Patching is automatic Annual Patching costs: $0.00 Manpower required for patching: 0 Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 43
  44. 44. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | • Encryption for Data at Rest – Automatically configured – all application data is encrypted within the database – Database Backups are also encrypted • Encryption for Data in Motion – Automatically configured – all network access is encrypted to and from the database – Choice of two methods • Oracle Native Network Encryption • Transport Layer Security (TLS) v1.2 (default) Autonomous Database Security - Encryption at rest & in motion Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 44
  45. 45. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | • No access to the Database Node or File system • Service Administration (by Oracle) isolated from Database use and administration (service consumer) – Multi-Tenant – Database Vault • Database Vault Operations Control later this year Autonomous Database Separation of Duties Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 45
  46. 46. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | • Automation – Most Database Administration tasks fully automated – Zero human interaction reduces opportunities for human error • Service-appropriate Restrictions – Service Consumers not allowed to run many Oracle Database administrative commands and parameters – Remove the ability to inadvertently damage or impact performance Controlling Human Error Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 46
  47. 47. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 47
  48. 48. Database Multilingual Engine Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 48
  49. 49. Time for another Smile! Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 49
  50. 50. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 50
  51. 51. Oracle Database XE – eXpress Edition • Current version until very recently: XE 11gR2 • Available since October 2018: XE 18c, with yearly releases (19c, 20c, …) • All functionality of single instance Oracle Database Enterprise Edition plus Options • (including R, Databse Vault, Machine Learning, Spatial, Compression, Multi Tenant – for 3 PDBs, Partitioning) • Code and Data Compatible with other editions – including plug/unplug • Resource Limitations for 18c: • 2 CPUs • 2 GB of memory • 12 GB of disk space (using Compression effectively 40 GB of data) • No patches or support Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 51
  52. 52. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 52
  53. 53. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 53
  54. 54. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 54
  55. 55. From Data to Actionable Intelligence Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 55
  56. 56. Database 12, 18, 19 • Who is using Sharding? • China Telecom, Dyn DNS • Who is using Multitenant? • EBS not yet – but will take on 19c • ATP is based on 19c • Lacks some capabilities – enterprise R, file system or O/S access, stored java • ADWCS is 12.2 plus 18c plus 19c bits • Autonomous (cloud and on premises; evolution of features, no revolution): • Index Generation • NetSuite (and others) • Other features? • XE 18c Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 56
  57. 57. Reference Architecture for Data Driven organizations Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 57 OLTP IoT Social Analytics Cloud
  58. 58. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 58
  59. 59. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 59
  60. 60. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 60
  61. 61. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 61
  62. 62. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 62
  63. 63. Reference Architecture for Data Driven organizations Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 63 OLTP IoT Social Analytics Cloud
  64. 64. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 64
  65. 65. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 65
  66. 66. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 66
  67. 67. Reference Architecture for Data Driven organizations Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 67 OLTP IoT Social Analytics Cloud
  68. 68. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 68
  69. 69. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 69
  70. 70. Connect to More Data 70 Oracle Analytics Cloud • Analytics & Reporting • Data Visualization • Essbase Review of Oracle OpenWorld & CodeOne 2018 - #oowamis
  71. 71. Oracle Analytics Cloud Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 72
  72. 72. Scale your Analytics! 73 Oracle Analytics Cloud Autonomous Data Warehouse Cloud Data Integration Platform Cloud Big Data Cloud Review of Oracle OpenWorld & CodeOne 2018 - #oowamis
  73. 73. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 74
  74. 74. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 75
  75. 75. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 76
  76. 76. Data Prepare Recommendations Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 77 Transformation Examples Enrichment Examples
  77. 77. Data Flows for Extract-Prepare-Load (into Data Visualization Store) You can branch a data flow into multiple connections to downstream nodes, which creates multiple outputs from a data flow. For example, you can create a data flow from a sales transactions data set, then branch and save the data into multiple data sets based on the region of the sales transaction, such as west and east coast regions. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 78
  78. 78. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 79
  79. 79. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 80 Essbase EPM-PBCS EPM-EPBCS EPM-FCCS EPM-EPRCS EPM-FCCS-2 EPM-PCMCS EPM-TRCS EPM-EDM FA-ERP FA-CRM FA-Projects FA-Quota FA-Cost OAC Essbase OAC-DV Data Flow OAC Data Lake Exalytics On-Premise 11g On-Premise 12c OAC-DV write back, ML OAC-DV CXO Dashboard OAC-Essbase Partners Cubus, Dodeca Who Uses Essbase?
  80. 80. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 81 DV Integration: Visualization and Write-back • Create an Essbase Cube as a target of DV Data Flow • Load data into an Essbase Cube and quickly analyze it • Visualize Essbase cubes in DV • Perform “Write-back” to an Essbase Cube from the DV Interface
  81. 81. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |Copyright © 2017, Oracle and/or its affiliates. All rights reserved. 82 Data Science and Essbase and Oracle Data Studio What is a notebook in data science? The notebook interface addresses the inherent communication challenges in data science by leveraging a style of programming called Literate Programming. Literate Programming is a paradigm in which modular blocks of code are interwoven with blocks of supplementary context and explanation for that code • Reference: https://blog.modeanalytics.com/data-science-notebook- love-story/ Popular Notebooks • Jupyter and Apache Zeppelin Notebooks are browser plugins. Allows you to mix formatted text with Python or Java or SQL code Today, Data Scientists use Notebooks for their analysis using browser Data Studio from Oracle Labs • Oracle Data studio supports notebook and is now part of Essbase in OAC • We created Python packages that allows you to invoke Essbase API from Data Studio Notebook • Data Scientists -- from Essbase UI -- can now use Essbase cubes and their data in their notebooks for their analysis and share those notebooks with their colleagues • Oracle Data studio provides rich visualization capabilities which you can apply on top of Essbase data
  82. 82. Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Reference Architecture for Data Driven organizations Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 83 OLTP IoT Social Analytics Cloud
  83. 83. But wait – there is more… Autonomous Data Warehouse [Cloud] Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 84
  84. 84. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 85
  85. 85. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 86
  86. 86. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 87
  87. 87. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 88
  88. 88. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 89
  89. 89. Reference Architecture for Data Driven organizations Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 90 OLTP IoT Social Analytics Cloud
  90. 90. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 91 Spark SQL wins over Hive
  91. 91. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 92
  92. 92. DataScience.com – acquisition Spring 2018 Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 93
  93. 93. Collborative Notebooks & Curated Runtime Environments Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 94
  94. 94. Forrester Wave • On notebook-based predictive analytics and machine learning solutions Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 95 95/278
  95. 95. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 96
  96. 96. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 97 Enterprise Data consolidated in Cloud Data lakes • HDFS, Object storage SQL on Hadoop is not enough for B.I and business users Need fast visualization directly on datalakes Need open data management platforms ( Spark ) Fast Analytics on Data Lakes – Key Drivers
  97. 97. Review of Oracle OpenWorld & CodeOne 2018 - #oowamis 98
  98. 98. Define business dimensions, metrics, hierarchies and semantics Analytics, Visualization Data science/ML 99 What is SNAP? High Performance Indexer and Query Optimizer Legacy DW Financial ERP Sales CRM Social Data IoT Data Data Sources: Users:ManageModel Analyze & Visualize LOB Analysts Data Scientists Developers Confidential – Oracle Internal Spark SQL SNAP Engine Data Lake InMemorySNAPSegments Review of Oracle OpenWorld & CodeOne 2018 - #oowamis

×