In Memory Option on Exadata von Konrad Haefeli an Doag 2014

1. 2014 © Trivadis
BASEL BERN BRUGG LAUSANNE ZUERICH DUESSELDORF FRANKFURT A.M. FREIBURG I.BR. HAMBURG MUNICH STUTTGART VIENNA
ExadatawithIn-Memory Option –thebestofall ?!?
Konrad HÄFELISenior Solution ManagerInfrastructure Engineering
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
1

2. 2014 © Trivadis
Trivadis ist führend bei der IT-Beratung, der Systemintegration, dem Solution-Engineering undder Erbringung von IT-Services mit Fokussierung auf und Technologien im D-A-CH-Raum.
Unsere Leistungen erbringen wir aus den strategischen Geschäftsfeldern: Trivadis Services übernimmt den korrespondierenden BetriebIhrer IT Systeme.
Unser Unternehmen
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
B E T R I E B
2

3. 2014 © Trivadis
Mit über 600 IT-und Fachexperten bei Ihnen vor Ort
3
12 Trivadis Niederlassungen mitüber 600 Mitarbeitenden
200 Service Level Agreements
Mehr als 4'000 Trainingsteilnehmer
Forschungs-und Entwicklungs- budget: CHF 5.0 Mio. / EUR 4.0 Mio.
Finanziell unabhängig undnachhaltig profitabel
Erfahrung aus mehr als 1'900 Projekten pro Jahr bei über 800 Kunden
Stand 12/2013HamburgDüsseldorfFrankfurtFreiburgMünchenWienBaselZürichBernLausanne
3Stuttgart
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
3
Brugg

4. 2014 © Trivadis
In Memory Option on Exadata - the best of all?!?
Trivadisan der DOAGEbene 3 -gleich neben der RolltreppeWir freuen uns auf Ihren Besuch. Denn mit Trivadisgewinnen Sie immer.
DOAG-Konferenz 2014
4

5. 2014 © Trivadis
A yearagoDOAG 2013…
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
5

6. 2014 © Trivadis
Chose anothertopic… Flash Cache
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
6

7. 2014 © Trivadis
… finalyin July2014
Previews…
Betas Versions
Announcments: 10th ofJune
Releasing22nd ofJuly
12.1.0.2 fullrelease
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
7

8. 2014 © Trivadis
It’san option, isitworthit?
On a normal Database Server?
Hopefully, ifrequirementsaccordingly…
But whataboutExadataDatabase Machine?
Are the«expensive» Storage Server Feature
Smart Scan
Flash Cache
a benefitforIMCS (In Memory ColumnStore) ?
Resp. viceversa?
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
8

9. 2014 © Trivadis
AGENDA
1.ExadataFeature
2.In-Memory Overview
3.In-Memory Configuration
4.In-Memory Management
5.In-Memory with ExadataTests
6.Conclusion
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
9

10. 2014 © Trivadis
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
ExadataFeature
10

11. 2014 © Trivadis
ArchitectureFeatures Overview
11
Source: Oracle Corporation
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
Smart Scan Capabilities
PredicateFiltering
ColumnFiltering
JoinProcessing
Scans on encryptedData
Scans on compressedData
Create Tablespace – Storage Server formatsblocks
Backup andRecovery –I/O forincrementalBackup ismuchmoreefficient, onlychangedBlocks arereturnedtoServer

12. 2014 © Trivadis
ExadataHybrid ColumnarCompression(HCC)
12
A compression unit is a logical structure spanning multiple DB blocks
Each row is self-contained within a compression unit
Data is organized by column during data load
Each column is compressed separately
Smart Scan is supported
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?

13. 2014 © Trivadis
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
In-Memory Overview
13

14. 2014 © Trivadis
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
14
ColumnarStorage: ExampleforColumnorientation

15. 2014 © Trivadis
In-Memory Option –What is it ?
Oracle Databases traditionally stores Data in Row Format
Oracle Database In-Memory Option uses an In-Memory Column Store
A new memory component in the SGA called In-Memory Area
Data are stored in column format in the In-Memory Column Store (IMCS)
Both Memory Structure (Buffer Cache and IMCS) will be populated
Dual Format Architecture does not double the Memory requirement
The Optimizer is fully aware about the In-Memory Column Store
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
15
Source: Oracle

16. 2014 © Trivadis
In-Memory Option –Database Tiering
With the In-Memory Area not all data must fit in Memory
Less performance sensitive can reside on lower cost Disk
IM Option acts transparently against the applications
On Exadataacts on the top of all existing Storage tiers
It is also fully compatible with the new Multitenant architecture
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
16
Source: Oracle

17. 2014 © Trivadis
In-Memory Option –SIMD
In-Memory Column Store are scanned with SIMD Vector Processing
SIMD = Single Instruction Multiple Data
SIMD Processing are evaluated in a single CPU Instruction
IM Column Store are specifically designed to maximize the number of column entries that can be loaded into Vector Registers
Theoretically Scan of billions of rows per second are possible
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
17

18. 2014 © Trivadis
Summary: Oracle Database In-Memory
Extreme Performance: Analytics & OLTP
Extreme Scale-Out & Scale-Up
Extreme Availability
Extreme Simplicity
Powering the Real-Time Enterprise
All In-Memory Benefits With No Application Changes
In Memory Option on Exadata - the best of all?!?
DOAG-Konferenz 2014
18

19. 2014 © Trivadis
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
In-Memory Configuration
19

20. 2014 © Trivadis
In-Memory Option –The way to use it…
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
20
On Exadatathere are some prerequisites…
Storage Server
Min. 12.1.1.1.0*
RDBMS
12.1.0.2
Database Server
Min. 12.1.1.1.0
GridInfrastructure
12.1.0.2
* FullOffloadSupport for12.1.x RDBMS

21. 2014 © Trivadis
In-Memory Option –Configuration
Configuration is very simple
The Initializations ParametersINMEMORY_SIZE controls the In- Memory Area
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
21
SQL> alter system set inmemory_size=16G scope=spfilesid=‘*’;
SQL> select * from v$sga;
NAME VALUE CON_ID
---------------------------------------------
Fixed Size 5304248 0
Variable Size 11274289224 0
Database Buffers 108716359680 0
Redo Buffers 263131136 0
In-Memory Area 17179869184 0

22. 2014 © Trivadis
In-Memory Option –Configuration
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
22
InitializationParameter
Comment
inmemory_clause_default
enables you to specify a defaultIn-Memory Column Store (IM column store) clausefor new tables and materialized views
inmemory_force
allows you to specify whether tables and materialized view that are specified as INMEMORY are populatedinto the In-Memory Column Store or not
inmemory_max_populate_servers
specifies the maximum number of background populaserverste
inmemory_query
INMEMORY_QUERY is used to enable or disable in-memory queries for the entire database at the session or system level
inmemory_size
INMEMORY_SIZE sets the sizeof the In- Memory Column Store (IM column store) on a database instance
inmemory_trickle_repopulate_servers_percent
limitsthe maximum number of background populate servers used for In-Memory Column Store (IM column store) repopulation
optimizer_inmemory_aware
enables or disables all of the optimizer cost modelenhancements for in-memory

23. 2014 © Trivadis
In-Memory Option –Configuration
Tables or Tablespace must be enabled to use IM ColumnnStore
Depending on configuration the IMCS will be populated
Activation at Tablespace and Table Level
At Table Level configuration for compression and priority are possible
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
23

24. 2014 © Trivadis
In-Memory Option –Configuration
Compression Types
Priority Levels
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
24
PriorityLevel
Description
Critical
Objectsare populated immediately
High
Objects are populatedafter all critical objects are populated, if remains space
Medium
Objects are populatedafter all critical and high objects are populated, if remains space
Low
Objects are populatedafter all critical, high and medium objects are populated, if remains space
None
Objects arepopulated only after they are scanned
CompressionType
Description
No Compress
No Compression
Memcompressfor DML
Compression optimized for DML
Memcompressfor Query Low
Compressionoptimized for Query (default)
Memcompressfor Query High
Compression optimizedfor Query and Space saving
Memcompressfor CapacityLow
Compressionoptimized with orientation towards Space saving
Memcompressfor CapacityHigh
Compressionoptimized for Space saving

25. 2014 © Trivadis
In-Memory Option –Configuration
Activation at Tablespace Level
At Table Level configuration for compression and priority are possible
memcompressfor query low and priority none are the default settings
Table activation with compression and priority settings
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
25
SQL> alter tablespaceSOE inmemory;
SQL> alter table orders inmemory;
SQL> alter table orders inmemorymemcompressfor query low priority critical;

26. 2014 © Trivadis
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
In-Memory Management
26

27. 2014 © Trivadis
In-Memory Option –Licensing
License is need for using the In-Memory Option
~ 18000 €/ per Processor
The Option is installed with the RDBMS Installation, however not activated
Bug 19308780 –Wrong Feature Tracking, fixed in PSU October 2014
Very “lovely” discussion between Maria Colgan(Oracle IM Option Product Manager) and Kevin Closson(“independent” Oracle/Exadataspecialist) 
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
27

28. 2014 © Trivadis
In-Memory Option –Management
Few v$ Views are in place for In-Memory Column Store management
Not all v$ Views are documented (only red ones)
New IM Memory Option PL/SQL Package
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
28
SQL> descdbms_inmemory
..
PROCEDURE DISABLEFASTSTART
PROCEDURE ENABLEFASTSTART
PROCEDURE POPULATE
PROCEDURE REPOPULATE
SQL> select table_namefrom dictwhere table_namelike 'V$IM_%'; TABLE_NAME------------------------------
V$IM_COLUMN_LEVELV$IM_COL_CUV$IM_HEADERV$IM_SEGMENTSV$IM_SEGMENTS_DETAILV$IM_SEG_EXT_MAPV$IM_SMU_CHUNKV$IM_SMU_HEADV$IM_TBS_EXT_MAPV$IM_USER_SEGMENTS
OnlyV$ Views in redaredocumented
OnlyProcedurein redaredocumented

29. 2014 © Trivadis
In-Memory Option –Management
New dba_/all_/user_ views attribute are been implemented
Monitoring of In-Memory Segment
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
29
SQL> descuser_tables
Name Null? Type
-----------------------------------------------------------------------------
TABLE_NAME NOT NULL VARCHAR2(128)
.
INMEMORY VARCHAR2(8)
INMEMORY_PRIORITY VARCHAR2(8)
INMEMORY_DISTRIBUTE VARCHAR2(15)
INMEMORY_COMPRESSION VARCHAR2(17)
INMEMORY_DUPLICATE VARCHAR2(13
SQL> select owner, segment_name, segment_type, inmemory_size, bytes_not_populated, populate_statusfrom v$im_segments;
OWNER SEGMENT_NAME SEGMENT_TYPE INMEMORY_SIZE BYTES_NOT_POPULATED POPULATE_
--------------------------------------------------------------------------------
EXA IM2 TABLE 1179648 0 COMPLETED
EXA IM4 TABLE 8519680 0 COMPLETED

30. 2014 © Trivadis
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
In-Memory with ExadataTests
30

31. 2014 © Trivadis
147 MioRows, 10GB
IM isfactor10 fasterthenjusBuffercache
First populationofIM datafactor4 fasterwithoffloading
80% offloadefficiency
DedicatedQuery
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
31
SQL> SELECT SUM(amount_sold) FROM sales;
Cell
offload_processing
FALSE
TRUE
CACHE
FALSE
TRUE
INMEMORY_QUERY
DISABLE
DISABLE
DISABLE
ENABLE
ENABLE
Elapsedtime
56.82
13.51
1.17
0.13
013
Factor
1
4
48
437
437

32. 2014 © Trivadis
DedicatedQuery
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
32
SQL> SELECT t.time_id,
TO_CHAR(SUM(amount_sold), '9,999,999,999') AS sales,
TO_CHAR(AVG(SUM(amount_sold))
over(ORDER BY t.time_idrange BETWEEN INTERVAL '2' DAY
preceding AND INTERVAL '2' DAY following), '9,999,999,999')
AS centered_5_day_avg
FROM sales s, times t
WHERE s.time_id= t.time_id
GROUP BY t.time_id
ORDER BY t.time_id;
Cell
offload_processing
FALSE
TRUE
CACHE
FALSE
TRUE
INMEMORY_QUERY
DISABLE
DISABLE
DISABLE
ENABLE
ENABLE
Elapsedtime
01:30.14
29.49
05.95
05.49
05.48
Factor
1
3
15
16
16

33. 2014 © Trivadis
In-Memory Option –ExadataTest Enviroment
Eighth Rack (2 DB Server –256 Gb RAM, 3 Storage Server)
Swingbench(charbench) used as Benchmarking Tool (2 Min)
OLTP Profile with 100 concurrent Users
-60/40% Read/Write ratio
DSS Profile with 16 concurrent Users
-100/0% Read/Write ratio (Rollup and Cube Function)
In-Memory Area with 16G Memory (SGA 128GB)
All Columns of involved Tables (full Schema) are stored in the IM Column Store (~ 10GB) and populated
Duplicate Feature intended for RAC Environment was not used
This Feature should be considered in HA or Scalability Environments
Our first steps in this way, was not so encouraging in terms of scalability DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
33

34. 2014 © Trivadis
In-Memory Option –Test Cases
1.Smart Scan off, no In-Memory
2.Smart Scan on, no In-Memory
3.Smart Scan off, In-Memory compression “for DML”
4.Smart Scan on, In-Memory compression “for DML”
5.Smart Scan on, In-Memory compression “for query low”
6.Smart Scan on, In-Memory compression “for query high”
7.Smart Scan on, In-Memory compression “for capacity low”
8.Smart Scan on, In-Memory compression “for capacity high”
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
34

35. 2014 © Trivadis
In-Memory Option –Test Results OLTP
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
35
Total completed Transaction
0
20000
40000
60000
80000
100000
120000
140000
160000
180000
Total Completed Transaction

36. 2014 © Trivadis
In-Memory Option –Test Results OLTP
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
36
Average CPU Utilization
0
10
20
30
40
50
60
70
80
90
Avg User CPU
Avg Sys CPU
CPU Usage

37. 2014 © Trivadis
Total completed Transaction
0
20000
40000
60000
80000
100000
120000
140000
160000
180000
0
10
20
30
40
50
60
70
80
90
In-Memory Option –Test Results OLTP
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
37

38. 2014 © Trivadis
In-Memory Option –Test Results DSS
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
38
Total completed Transaction (Reports)
0
20
40
60
80
100
120
Total Completed Transactions

39. 2014 © Trivadis
In-Memory Option –Test Results DSS
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
39
Average CPU Utilization
0
10
20
30
40
50
60
Avg User CPU
Avg Sys CPU
CPU Usage

40. 2014 © Trivadis
0
20
40
60
80
100
120
0
10
20
30
40
50
60
In-Memory Option –Test Results DSS
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
40
Total completed Transaction (Reports)

41. 2014 © Trivadis
In-Memory Option on Exadata–Result discussion
OLTP
factor12 :-o
Nooffloadingdue tonodirectpathfunctionality
All in cachewithhigh CPU load
40% readprofitofIMCS
OLTP lessCPU withIMCS due toSIMD benefit
DSS
NoOffloading/NoIMCS asfast but a lotofCPU BufferCache
Offloading, asfast but lessCPU workdonein Storage Server
IMCS 25% plus work, lessCPU
The datasetandressourcesarenot in a goodbalancetotest
Much moredataneeded
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
41

42. 2014 © Trivadis
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
Conclusion
42

43. 2014 © Trivadis
ExadataDatabase Machineworksfine
Oracle IMCS Option worksfine
Testingandinterpretationisnot trivial
The optioncosts50% ofEE coreprice
A seriousevaluationisneeded
PoCtofind thebestofall, unlessyouneeda:
In-Memory Option on Exadata–Conclusion
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
43

44. 2014 © Trivadis
Questions and answers ...
BASEL BERN BRUGG LAUSANNE ZUERICH DUESSELDORF FRANKFURT A.M. FREIBURG I.BR. HAMBURG MUNICH STUTTGART VIENNA
Konrad HÄFELI
Tel: +41 58 459 59 69
konrad.haefeli@trivadis.com
DOAG-Konferenz 2014
In Memory Option on Exadata - the best of all?!?
44