Hyderabad Mar 2019 - Autonomous Database

Copyright © 2018, Oracle and/or its affiliates. All rights reserved.
Connor McDonald

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
2

3

4

5

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. |
Stuff
youtube bit.ly/youtube-connor
blog bit.ly/blog-connor
twitter bit.ly/twitter-connor
400+ posts mainly on database & development
250 technical videos, new uploads every week
rants and raves on tech and the world :-)

Copyright © 2018, Oracle and/or its affiliates. All rights reserved.
etc...
facebook bit.ly/facebook-connor
linkedin bit.ly/linkedin-connor
instagram bit.ly/instagram-connor
slideshare bit.ly/slideshare-connor

https://asktom.oracle.com

9https://asktom.oracle.com/officehours

200 hours of free access (so far)
10

18c - The Autonomous Database
Connor McDonald
Database Advocate

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | 12
18c - The Autonomous Database

"18c - the autonomous database"
13

12c, 13, 14, 15, 16, 17, 18c
14
?

18c = 12.2.0.2
15
MOS 2285040.1

No “FIRST” and “SECOND” releases anymore!

Fewer One-Off Patches!

3 Number Format
Year.Update.Revision

Version number reflects patch level!

A Release Update or Revision is only a patch,
not a database upgrade!

Patch: Oracle 18.2.1 ⇢ Oracle 18.6.0
opatch
Upgrade: Oracle 18.2.1 ⇢ Oracle 19.1.0
dbupgrade and DBUA

18.1.0
18.2.0
First
Update
18.1.1
First
Revision
security,
regression,
no functionality changes
no optimizer changes
security,
regression,
functional changes
optimizer changes

"18c - the autonomous database"
23

autonomous is a service
24

Autonomous
Database
= + +

so what is the big deal ?
26

trip down memory lane #1
27

who remembers these numbers ?
28

121
249
505
29

ORA-1631: max # extents 505 reached in table SCOTT.EMP
121 = 2k block size
249 = 4k block size

who thinks about extents anymore?
31

7.3 = unlimited extents
32
semi-automatic
uet$, fet$

8.1 = locally managed tablespaces
33
fully automatic
bitmap extents

34

create table SALES (
...
...
...
)
freelists 4
freelist groups 1

ASSM
36

automatic segment space management
37

automation =
38
"we know the implementation, and
it is being performed by the software
based on our rules"

automation ... towards autonomy
39

40

who remembers these parameters ?
41

ROLLBACK_SEGMENTS = (r0,r1,r2,r3,r4,r5,r6)
TRANSACTIONS_PER_ROLLBACK_SEGMENT = 20
CLEANUP_ROLLBACK_ENTRIES = 10
SYSTEM non-SYSTEM

who thinks about undo anymore?
43

9.0 = automatic undo
44
undo_tablespace =

but it's more than automation

SQL> select count(*) from dba_rollback_segs;
COUNT(*)
----------
????

segment count growth / reduction ...

... decided by the database

autonomy =
49
"we do not know the implementation,
we do not set the rules,
decisions by the software"

Oracle has been doing this for a while :-)

Oracle Database 10g and below
• Automatic Storage Management (ASM)
• Automatic Memory Management
• Automatic DB Diagnostic Monitor (ADDM)
• Automatic Workload Repository (AWR)
• Automatic Undo tablespaces
• Automatic Segment Space Management
• Automatic Statistics Gathering
• Automatic Standby Management (Broker)
• Automatic Query Rewrite
Oracle Database 11g, 12c
• Automatic SQL Tuning
• Automatic Workload Replay
• Automatic Capture of SQL Monitor
• Automatic Data Optimization
• Automatic Storage Indexes
• Automatic Columnar Cache
• Automatic Diagnostic Framework
• Automatic Refresh of Database Cloning
• Autonomous Health Framework

well ... sort of

databases ... are hard
transactional,
instantaneous response
standard reports,
fast response
end of day/week/month batch,
longer but capped window
ad hoc query,
arbitrary criteria/duration

all at the same time
transactional,
instantaneous response
standard reports,
fast response
end of day/week/month batch,
longer but capped window
ad hoc query,
arbitrary criteria/duration

so we started with "easy" :-)

data warehousing
usage commonality
flexible response times

Oracle Autonomous Database
Enterprise
OLTP
Data
Warehousing
Q1 2018 C4 2018
Data
Warehousing

autonomous objectives

1) easy
storage
quotas
indexing
partitioning
parallelism
compression
availability
etc
etc
load data
run queries

2) fast or faster
Exadata infrastructure
Enterprise edition

3) elastic

3) truly elastic
scale CPU & storage up, no outage
scale CPU down to save $

4) fully managed
backup / recovery
patching
upgrades
HA (99.95)

walkthrough

"5 easy steps"

creating your database
68
name
region
CPUs
storage

you're done!
69
admin user password

"demo"
70

connecting to your database
78

emphasis on security
79
SSL only
wallet

we can't see your data
80
Data Vault

single download
81
service console

"demo"
82

SQL Developer
87
native support

most tools
90
standard connectivty

C:temp>unzip -l credential.zip
Archive: credential.zip
Length Date Time Name
--------- ---------- ----- ----
0 04/06/2018 08:37
7045 04/06/2018 08:22 cwallet.sso
0 04/06/2018 08:37 cwallet.sso.lck
7000 04/06/2018 08:22 ewallet.p12
0 04/06/2018 08:37 ewallet.p12.lck
3182 04/06/2018 08:22 keystore.jks
132 11/06/2018 11:04 sqlnet.ora
334 04/06/2018 08:22 tnsnames.ora
3797 04/06/2018 08:22 truststore.jks
--------- -------
21490 9 files

sqlnet.ora
WALLET_LOCATION = (SOURCE = (METHOD = file)
(METHOD_DATA = (DIRECTORY="...")))
SSL_SERVER_DN_MATCH=yes
tnsnames.ora
DW = (description=
(address=(protocol=tcps)(port=1522)(host=...))
(connect_data=(service_name=...))
(security=(ssl_server_cert_dn="CN=..."))
)

JDBC more complicated
93

props.setProperty("oracle.net.ssl_server_dn_match" ,"true");
props.setProperty("javax.net.ssl.trustStore" ,"truststore.jks" );
props.setProperty("javax.net.ssl.trustStorePassword","blahblah" );
props.setProperty("javax.net.ssl.trustStoreType" ,"JKS" );
props.setProperty("javax.net.ssl.keyStore" ,"keystore.jks" );
props.setProperty("javax.net.ssl.keyStoreType" ,"JKS" );
props.setProperty("javax.net.ssl.keyStorePassword" ,"blahblah");
con =
DriverManager.getConnection(
"jdbc:oracle:thin:myuser/mypassword@tnsdetails",props);
use latest drivers!

database services
95
predefined

No of concurrent queries Max idle time CPU shares
HIGH 3 5 mins 4
MEDIUM 20 5 mins 2
LOW 32 1 hour 1
MY_DBNAME_
MY_DBNAME_
MY_DBNAME_

users for your database
98

SQL> create user MY_DATA identified by MY_PASSWORD;
SQL> grant DWROLE | CONNECT to MY_DATA;
You're done!

other privileges as per normal
100

loading your database
102

ADW
Object
Storage
SQL*Net

DBMS_CLOUD
104
focus on "1) easy"

loading from object store
105

1) credentials
106

begin
dbms_cloud.create_credential(
credential_name => 'OBJ_STORE_CRED',
username => 'connor',
password => 'password'
);
end;
/

2) load/transform to table
108

begin
dbms_cloud.copy_data(
table_name=>'CHANNELS',
credential_name=>'OBJ_STORE_CRED',
file_uri_list=>
'https://objectstorage..../DEMO_DATA/chan_v3.dat',
format=>
json_object('ignoremissingcolumns' value 'true',
'removequotes' value 'true')
);
end;

3) do the usual :-)
110

SQL> select table_name,
2 status,
3 rows_loaded,
4 logfile_table,
5 badfile_table
6 from user_load_operations;
TABLE_NAME STATUS ROWS_LOADED LOGFILE_TABLE BADFILE_TABLE
------------ ------- ------------ ------------- ---------------
CHANNELS FAILED COPY$1_LOG COPY$1_BAD
CHANNELS COMPLETED 5 COPY$2_LOG COPY$2_BAD

data pump option
112

begin
dbms_cloud.create_credential(
credential_name => 'OBJ_STORE_CRED',
username => 'connor',
password => 'password'
);
end;
/
impdp sh/sh@salesdb_low
directory=data_pump_dir
credential=OBJ_STORE_CRED
dumpfile=https://objectstorage.../dump/sh.dmp

querying your database
115

SQL> select *
2 from MY_TABLE
3 ...
"Well...duh"

but you can do more
117

ADWC
Object
Storage
SQL*Net

query before you load
119

external table on object store
120

begin
dbms_cloud.create_external_table(
table_name =>'CHANNELS_EXT',
credential_name =>'OBJ_STORE_CRED',
file_uri_list => 'https://...chan_v3.dat',
format =>
json_object('ignoremissingcolumns' value 'true',
'removequotes' value 'true'),
column_list => 'CHANNEL_ID NUMBER,
CHANNEL_DESC VARCHAR2(20),
CHANNEL_CLASS VARCHAR2(20),
CHANNEL_CLASS_ID NUMBER,
CHANNEL_TOTAL VARCHAR2(13),
CHANNEL_TOTAL_ID NUMBER'
);
end;
select count(*) from channels_ext;

recap
122
creation/connection
users
loaded
queried

We're done !!!
123

"Fast, unlimited data access is the
crack cocaine for data scientists"
- James Morle
124

"3) elasticity"
125

CPU increase ... anytime, no outage
126

SQL> show parameter cpu_count
NAME TYPE VALUE
------------------------------------ ----------- ---------------
cpu_count integer 1
SQL> show parameter cpu_count
NAME TYPE VALUE
------------------------------------ ----------- ---------------
cpu_count integer 2
SQL>

"Yeah...I know what that means"

You can scale to zero
134
service console
REST API

135
load yesterday's data
cpu = 2

136
unleash the dogs :-)
cpu = 8

all other times = zero CPU cost
137

"4) fully managed"
138

OS access
140
nope

SYSDBA access
141
nope

patching
142
automated
online* (AppCont)
gold image

encryption
143
mandatory

init.ora
144
all automatic
nls...
approx...
plsql...

tablespaces
145
nope

indexes
146
nope*

materialized views
147
nope

constraints
148
nope ... "yes"

compression
149
nope (HCC)

SQL> create table t
2 as select a.* from all_objects a,
3 ( select 1 from dual connect by level <= 100 );
Table created.
CREATE TABLE "ADMIN"."T"
( "OWNER" VARCHAR2(128) NOT NULL ENABLE,
"OBJECT_NAME" VARCHAR2(128) NOT NULL ENABLE,
...
...
"MODIFIED_VSNID" NUMBER
)
PCTFREE 1 PCTUSED 40
COLUMN STORE COMPRESS FOR QUERY HIGH
ROW LEVEL LOCKING
TABLESPACE "DATA"

partitioning
151
nope*

Maybe you're doing it wrong :-)
152

statistics
153
advanced direct mode
automatic or explicit

caching
154
result_cache
everything!

hints
155
can be enabled
ignored by default

backup / recovery
156
daily incremental
weekly full

backup / recovery
157
point-in-time nomination
(process is automatic)
(flashback possible)
60 days

migration
159
focus on easy
data pump
(tde, compression, etc)

SQL> create table T ( x int) tablespace system;
Table created.
SQL> insert into t values (1);
1 row created.
SQL> select tablespace_name
2 from dba_segments
3 where segment_name = 'T';
TABLESPACE_NAME
------------------------
DATA

monitoring
161
real time SQL monitoring
service console
(and REST)

from "easy" to "not so easy"
166

Oracle Autonomous Database
Enterprise
OLTP
Data
Warehousing
Q1 2018 CY 2018
Data
Warehousing

general purpose database
169

just a normal database?
171

based on 19c
172
critical features

talk about these later today ...

which brings us to ...
174

• Will my job go away?
• Will my job change?
• What is in it for me?

warning: pie graph !
176

72%
http://www.computerworld.com/article/2486278/it-management/how-to-balance-maintenance-and-it-innovation.html

think back to automatic undo ...
178

... did you lose your job ?
179
or just get more databases :-)

it is about business success
180

Data Modeling
Architecture,
Design

End-to-End Service
Level Management
Full stack availability

Data Security
Data classification,
Data life-cycle management

Application Tuning
SQL tuning,
Connection management

and ...

... stop focussing on the negatives

• Will my job go away?
• Will my job change?
• What is in it for me?

1) provisioning

the appeal of bypassing this!
189
Request for Provisioning of Resources

2) patching
after the CVE was published
- DB Maestro
Breaches
85%
security

patching = zugzwang for DBAs

"A player who has no move that
does not worsen his position is
said to be in 'zugzwang'"

3) problem detection

ORAchk
Cluster Verification Utility
Cluster Health Monitor
Cluster Trace File Analyzer
etc
Autonomous Health Framework

4) control ...

... can be a bad thing :-)

wrap up

the appeal of "set and forget"
199

2TB for 3500 compute hours
200
https://cloud.oracle.com/try-autonomous-database

Stay in touch !
youtube bit.ly/youtube-connor
blog bit.ly/blog-connor
twitter bit.ly/twitter-connor

Hyderabad Mar 2019 - Autonomous Database

More Related Content

What's hot

Similar to Hyderabad Mar 2019 - Autonomous Database

More from Connor McDonald

Recently uploaded

Hyderabad Mar 2019 - Autonomous Database

Editor's Notes