Information Life Cycle Management avec Oracle 12c Présentation faite lors du Swiss Data Forum du 24 novembre 2015 à Lausanne

1. BASEL BERN BRUGG DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. GENEVA
HAMBURG COPENHAGEN LAUSANNE MUNICH STUTTGART VIENNA ZURICH
Oracle 12c
Emiliano Fusaglia
Principal Consultant LS-IMS
Information Lifecycle Management

2. Agenda
2 11/26/2015
1. Introduction to ILM
Data Explosion
ILM Definition
ILM Challenger
Existing ILM Solutions
Overview Oracle 12c ILM
2. Oracle 12c ILM
Heat Map
Automatic Data Optimization
Oracle 12c ILM

3. Oracle 12c ILM3 11/26/2015
Introduction to ILM

4. Data Explosion
4 11/26/2015
Where did the data explosion come
from?
Longer data retention driven by business
need and new law enforcement.
The more and more customer data
becomes valuable and saved on CRM,
ERP, DWH and Big Data systems.
IoT
Current trend shows that data doubles
every 18 months!
Oracle 12c ILM

5. Information Lifecycle Management - Definition
5 11/26/2015
What does Information Lifecycle Management mean?
Information Lifecycle Management (ILM) refers to a wide-ranging set of strategies for
administering storage systems on computing devices.
ILM comprises the policies, processes, practices, and tools used to align the
business value of information with the most appropriate and cost effective IT
infrastructure from the time information is conceived through its final disposition
Oracle 12c ILM

6. Information Lifecycle Management - Challenger
6 11/26/2015 Oracle 12c ILM

7. Information Lifecycle Management - Challenger
7 11/26/2015
More Data to
manage
without
additional cost
Define ILM
processes
Compress Data
without
impacting
performance
Distribute the
data on multi-
tiers devices
Oracle 12c ILM

8. Existing ILM solutions
8 11/26/2015
Application consolidation
Data compression
Storage Tiering
Offline Archives
Data Retention/Deletion
Which are the existing ILM solutions?
Increase data density but probably not enough.
Efficient, but can penalize the performance.
Difficult for the Storage to identify the correct data to move.
To query offline data can become highly inefficient.
Loss of historical information.
Oracle 12c ILM

9. 9 11/26/2015
Oracle 12c ILM
Oracle 12c ILM

10. Review of what was already possible in Oracle 11g
10 11/26/2015
Source: Oracle Corporation ILM Webpage
Oracle 12c ILM

11. Overview Oracle 12c ILM
11 11/26/2015
Source: Oracle Corporation ILM Webpage
Oracle 12c ILM

12. Overview Oracle 12c ILM
12 11/26/2015
Data
Classification
Rules for data
movement and
compression
ILM
Automatization
Oracle 12c ILM

13. Oracle 12c ILM
13 11/26/2015
Heat Map
Asynchronously analyze the I/O issued on
the database, and resource efficiently (<5%
cost) it maintains the Data Heat Map.
Recognize application I/O requests from
system I/O requests
Can collect statistics at database,
tablespace, segment and row level.
Automatic Data Optimization (ADO)
Part of the Advanced Compression Option.
Permits to define the data lifecycle policies
using SQL and PL/SQL functions.
Supports automated compression and
storage tiering.
Automated solution which enforces the
defined policies .
Oracle 12c ILM rely on the following components:
Oracle 12c ILM

14. Oracle 12c ILM: Heat Map
14 11/26/2015
Enable Hot/Cold data classification :
PL/SQL API for querying Heat Map statistics:
ALTER SYSTEM SET HEAT_MAP = ON;
ALTER SESSION SET HEAT_MAP = ON;
SELECT tablespace_name, min_writetime, min_ftstime
FROM
table(dbms_heat_map.tablespace_heat_map('EXAMPLE'))
Oracle 12c ILM

15. Oracle 12c ILM: Heat Map on Enterprise Manager
15 11/26/2015
Hot Data Warm Data Cold Data
Oracle 12c ILM

16. Oracle 12c ILM: Automatic Data Optimization (ADO)
16 11/26/2015
010100001111010
101010100001010
101001000010101
010010101010101
001010001111010
1010101101
0100110110111010010101001010
1010101010101010101010101010
1010101010101010101010101010
1010101010101010101001
1010100110100101010
1010100101010101010101010101
0100111010010101010010101010
101001101010101
1100101010100101001100101010
1010100101100110101010100101
0101010101011010010101010010
1
0101010101011010101001010101010101010101010010
1010100101001010101001010100101011010110101001
1010101111110010101001000000000000111111011111
1111111010100101000010100010100100110011111101
0001010010010100000010011111110101011111111100
1000001010001010010100101001010010101101111101
0101001001010101001011110101011111110101010010
1010100101001111111111101010010101010000000000
1010101000101010100101010101011101010100101010
1010010101010010101010101010101010101010101010
1010010100101010101010101010101010101010100101
0101010101010101010101010101010101010101010101
0100101010101010101010101010101011111101000000
1101010101110101010100101010101010100101010010
1010101000101010100101010101011101010100101010
1010010101010010101010101010101010101010101010
1010010100101010101010101010101010101010100101
0101010101010101010101010101010101010101010101
0100101010101010101010101010101011111101000000
Hot Data Warm Data Cold Data
Advanced Row
Compression 3x
ADO & Data Compression
*Columnar Query
Compression 10x
*Columnar Archive
Compression 15x
*Columnar Compression available on Exadata and other Oracle Storage (ZFS, Pillar, etc..) only.
Oracle 12c ILM

17. Automatic Data Optimization
Add compression and tiering policies to tables
Oldest Data Most Recent Data
Policy 1
Policy 1
Policy 2
Policy 2
Compress Partitions with Advanced Compression if they
haven’t been modified in 30 days
Compress Partitions with Hybrid Columnar Compression if
they haven’t been modified from in 180 days
Oracle 12c ILM

18. Automatic Data Optimization
A heat map tracks the activity of segments and blocks
Oldest Data Most Recent Data
Policy 1
Policy 1
Policy 2
Policy 2
Oracle 12c ILM

19. Automatic Data Optimization
Policies are automatically applied to tables
Oldest Data Most Recent Data
Policy 1
Policy 1
Policy 2
Policy 2
If after 30 days partitions haven’t be
modified they will be compressed using
advanced row compression
Oracle 12c ILM

20. Automatic Data Optimization
Policies are automatically applied to tables
Oldest Data Most Recent Data
Policy 1
Policy 1
Policy 2
Policy 2
After 180 days of no modification, the
oldest partition is identified to be
compressed using Hybrid Columnar
compression
Oracle 12c ILM

21. Automatic Data Optimization
Policies are automatically applied to tables
Oldest Data Most Recent Data
Policy 1
Policy 1
Policy 2
Policy 2
Oracle 12c ILM

22. Automatic Data Optimization
Reduce storage footprint, read compressed data faster
Oldest Data Most Recent Data
Policy 1
Policy 1
Policy 2
Policy 2
Oracle 12c ILM

23. Automatic Data Optimization
Automatically tier data to lower cost storage
Oldest Data Most Recent Data
Policy 1
Policy 1
Policy 2
Policy 2
Policy 3
Policy 3
If the tablespace is nearly full then compress the
oldest partition with Archive Hybrid Columar
Compression and move it to Tier 2 Storage
Oracle 12c ILM

24. Automatic Data Optimization
Compress data over it’s lifecycle
Oldest Data Most Recent Data
No Compression
Advanced Row
Compression
Hybrid Columnar
Query
Compression
Hybrid Columnar
Archive
Compression
3X
Compression
OLTP
10X
Compression
Reporting
15X
Compression
Compliance
Oracle 12c ILM

25. Oracle 12c ILM: Automatic Data Optimization (ADO)
25 11/26/2015
COMPRESS BASIC (alias Batch Compression)
COMPRESS ADVANCED (alias OLTP Compression)
CREATE TABLE sales (prod_id NUMBER NOT NULL,
cust_id NUMBER NOT NULL,
...)
PARTITION BY RANGE (time_id) (
PARTITION sales_2012 VALUES LESS THAN(TO_DATE(...))
ROW STORE COMPRESS BASIC,
PARTITION sales_2013 VALUES LESS THAN (MAXVALUE)
ROW STORE COMPRESS ADVANCED
);
ADO & Data Compression
Oracle 12c ILM

26. Oracle 12c ILM: Automatic Data Optimization (ADO)
26 11/26/2015
Add row-level compression policy after 14 days of no modifications
COMPRESS ADVANCED (alias OLTP Compression)
ADO & Data Compression
ALTER TABLE emp
ILM ADD POLICY ROW STORE COMPRESS ADVANCED ROW AFTER 14 DAYS
OF NO MODIFICATION;
ALTER TABLE sales MODIFY PARTITION sales_2011
ILM ADD POLICY COMPRESS FOR ARCHIVE HIGH SEGMENT AFTER 6
MONTHS OF NO ACCESS;
Add segment-level compression policy after 6 months of no modifications
Oracle 12c ILM

27. Oracle 12c ILM: Automatic Data Optimization (ADO)
27 11/26/2015
ADO & Storage Tiering
2009 2010 2011 2012 2013 2014
Current
Year
Sales Table
Partitioned by Year
High End
SSD Disks
Mid-Tier Storage DisksLow End Storage Disks
$ $$ $$$$
Oracle 12c ILM

28. Oracle 12c ILM: Automatic Data Optimization (ADO)
28 11/26/2015
Add Storage tier policy
ADO & Storage Tiering
ALTER TABLE sales MODIFY PARTITION sales_2011
ILM ADD POLICY TIER TO low_end_tablespace;
ALTER TABLE sales MODIFY PARTITION sales_2015
ILM ADD POLICY TIER TO high_end_tablespace;
The partition movement occurs when the source tablespace has reached a capacity threshold.
The threshold for activating tiering policies is based on two parameters: TBS PERCENT USED
and TBS PERCENT FREE, which are controlled by the DBMS_ILM_ADMIN package, (default
values 85% and 25%).
Oracle 12c ILM

29. Oracle 12c ILM - Summary
29 11/26/2015
All ILM features are Application Transparent.
Heat Map statistics provide fine grained I/O classification.
ADO policies permit to automate data movement and compression.
Support to complex business rules for data archiving actions.
Oracle Advanced Compression option is required.
Oracle 12c ILM

30. Emiliano Fusaglia
Principal Consultant
Tel. +41-79-909 7213
Emiliano.Fusaglia@trivadis.com
11/26/201530 Oracle 12c ILM