This document discusses techniques for optimizing data loading and unloading performance in Oracle databases. It describes how to use external tables with compression and parallelism to load data very quickly at over 300 MB/s. For unloading, it recommends using parallel table functions and compression to achieve similar high speeds. Various monitoring tools are also covered, including OS-level tools like vmstat and iostat as well as database-level tools like AWR and SQL Monitor reports. Live demonstrations are provided of loading and unloading 1 TB of data and using monitoring reports to analyze query performance.

1. <Insert Picture Here>
Oracle Exadata Extreme Performance
Real World Database Performance
Kaiyao Huang
© 2011 Oracle Corporation

2. About Me
• 工作于Oracle Real World Database Performance Group
• 关键词: 高性能, 高可扩展性, Exadata
• 微博: http://www.weibo.com/kaiyaohuang
• 博客: http://www.os2ora.com
• 电子邮件：kaiyao.huang@gmail.com
• 电话： 186-649-33229/黄凯耀

3. Agenda
• Data Loading
• Data Unloading
• Performance Monitoring

4. Data Loading
What is it look like?
• Methods Available?
• imp?
• Data Pump?
• SQL * Loader?
• RMAN?
• External Table?
• Others?
• Expected Speed?
• CPU-bound or IO-bound?

5. Architecture

6. Data Loading
IO Requirement
• 1 Terabyte per hour
• 17 GByte/minute
• 291 MByte/s
• With compressed source data
• 1057 Gbyte Text Files  136 Gbyte GZIP Files
• 2.3 GByte/minute
• 40 MByte/s

7. Data Loading
CPU/Memory Requirement
• Data loading is CPU/Memory Constrained
• Raw is the cheapest
• Timestamp is the most expensive
• One SQL*Loader will use one copy of in-memory meta data

8. Data Loading
Compress the Data
• Use preprocessor in external table definition

9. Data Loading
External Table
External Table
create table et_target Definition
(
column definition list ... Reference the
) Mount Point
organization external
(type oracle_loader Uncompress
default directory SPEEDY_FILESYSTEM the data
preprocessor exec_file_dir: 'zcat' options '-c’
characterset 'ZHS16GBK’
The Characterset
badfile ERROR_DUMP: ’FAST_LOAD.bad’
must match the
logfile ERROR_DUMP: ’FAST_LOAD.log’
Characterset of the
(
file column mapping list ...
Files
) Note Compressed
location Files
(file_1.gz, file_2.gz, file_3.gz, file_4.gz )
reject limit 1000 Parallel should
parallel 4 match the
/ number of Files

10. Data Loading
How to Use
alter session enable parallel dml;
alter table target parallel;
alter table et_target parallel;
insert /*+ append */ into target
select * from et_target;

11. Data Loading
Live Demo
• Load 1 TB data
TABLE SIZE OF SOURCE DATA NUMBER OF RECORDS
• Transactions • 52 GByte • 461M
• Payments • 54 GByte • 461M
• Line Items • 936 Gbyte • 6945M
• Total • 1042 GByte • 7867M

12. Agenda
• Data Loading
• Data Unloading
• Performance Monitoring

13. Data Unloading
What is it look like?
• Methods Available?
• exp?
• Data Pump?
• sqlplus spool?
• RMAN?
• sqluldr2 by anysql.net?
• Others?
• Expected Speed?
• CPU-bound or IO-bound?

14. Architecture

15. Data Unloading
Parallel Table Function

16. Data Unloading
IO Requirement
• 1 Terabyte per hour
• 17 GByte/minute
• 291 MByte/s
• With compressed target data
• 1057 Gbyte Text Files  136 Gbyte GZIP Files
• 2.3 GByte/minute
• 40 MByte/s

17. Data Unloading
CPU Requirement
• Data unloading is CPU Constrained
• Raw is the cheapest
• Timestamp is the most expensive

18. Data Unloading
Compress the Data
• Use FIFO Pipe file to compress the data

19. Data Unloading
Live Demo
• Unload 1 TB data
TABLE SIZE OF SOURCE DATA NUMBER OF RECORDS
• Transactions • 52 GByte • 461M
• Payments • 54 GByte • 461M
• Line Items • 936 Gbyte • 6945M
• Total • 1042 GByte • 7867M

20. Agenda
• Data Loading
• Data Unloading
• Performance Monitoring

21. Performance Monitoring
OS Real-Time Monitoring
• vmstat?
• iostat?
• top?
• sar?
• netstat?
• collectl?

22. Architecture of collectl

23. mon
cluster-wide collectl

24. Performance Monitoring
DB Monitoring
• v$session?
• v$sysstat?
• statspack?
• AWR?
• ADDM?
• SQL Monitor Report?

25. Performance Monitoring
SQL Monitor Report
• 第一次执行的SQL Monitor Report
• 第二次执行的SQL Monitor Report

26. Live Example
INSERT /*+ APPEND */
INTO
T_D
SELECT
*
FROM
T_A a
,T_B b
,T_C c
WHERE a.id = b.id
AND b.number = c.number
;

27. Live Example

28. Live Example

29. Reference
• 史上最快，最具可扩展性的文本导出方法: http://www.os2ora.com/the-fastest-
data-unload-method/
• 史上最快，最具可扩展性的文本导入方法: http://www.os2ora.com/the-fastest-
data-load-method-best-practice/
• Linux操作系统资源监控工具重点推荐 — collectl: http://www.os2ora.com/linux-
performance-monitoring-tool-recommend-collectl/
• Oracle监控工具概览: http://www.os2ora.com/oracle-monitoring-tool-summary-
and-recommend/
• 测试: 一个SQL Monitor Report的具体例子: http://www.os2ora.com/test-sql-
monitor-report-example/
• 利用SQL Monitor Report对SQL进行诊断与调优: http://www.os2ora.com/use-
sql-monitor-report-to-tune-and-diagnose-sql/

31. PX Architecture

32. PX topics…
• Degree of Parallelism
• PX Distribution
• PX Statement Queuing
• Hash Partition
• Partition-Wise Join