Oracle 11g New Features Out-of-the-Box by Alex Gorbachev (from Sydney Oracle Meetup #5)

1. Oracle 11g New Features Out-of-the-Box Alex Gorbachev, Christo Kutrovsky Sydney Oracle Meetup, 1 June 2009

2. Who is that talking? • Vice President, East Asia Pacific • The Pythian Group - leading provider of 24x7 database management services and consulting • Blogger • http://pythian.com/blogs/alexgorbachev • Twitter • @alexgorbachev • Conference presenter • OOW, UKOUG, Hotsos, AUSOUG, COLLABORATE, ... © The Pythian Group

3. Agenda • ASM - the missing pieces • RMAN - easier then ever • Standby DBs - usability • Productivity boosters • Performance manageability • Security - out of the box ©The Pythian Group Company Confidential

4. Evolution ©The Pythian Group Company Confidential

5. Evolution • A lots of areas have been polished • Bug fix - 10g Release 3? ©The Pythian Group Company Confidential

6. Evolution • A lots of areas have been polished • Bug fix - 10g Release 3? • Developer’s feedback taken into account ©The Pythian Group Company Confidential

7. Evolution • A lots of areas have been polished • Bug fix - 10g Release 3? • Developer’s feedback taken into account • DBA feedback taken into account • Production engineers managing real data-centers ©The Pythian Group Company Confidential

8. Automatic Storage Management ©The Pythian Group Company Confidential

9. Automatic Storage Management ©The Pythian Group Company Confidential

10. ASM diskgroup compatibility • Default SQL> select name, compatibility, database_compatibility from v$asm_diskgroup; NAME COMPATIBIL DATABASE_C ---- ---------- ---------- DG1 10.1.0.0.0 10.1.0.0.0 • New features SQL> ALTER DISKGROUP dg1 SET ATTRIBUTE 'compatible.asm'='11.1'; Diskgroup altered. SQL> ALTER DISKGROUP dg1 SET ATTRIBUTE 'compatible.rdbms'='11.1'; Diskgroup altered. SQL> select name, compatibility, database_compatibility from v$asm_diskgroup; NAME COMPATIBIL DATABASE_C ---- ---------- ---------- DG1 11.1.0.0.0 11.1.0.0.0 ©The Pythian Group Company Confidential 6

11. ASM - rolling updates for RAC ALTER SYSTEM START ROLLING MIGRATION TO 11.2.0.0.0; • Limited services from ASM • Normal database operation • No diskgroup configuration changes • Mount / unmount diskgroups ALTER SYSTEM STOP ROLLING MIGRATION; ©The Pythian Group Company Confidential

12. ASM - variable AU size • Allocation Unit - 1/2/4/.../64 MB • 10g - 1MB (_asm_ausize) • Data sits closer together and can be read in bigger chunks • Can improve sequential IO • Reduces striping over SAN striped LUN’s • Configuring Oracle ASM hidden parameters for EVA8000, HP Knowledge Brief • Reduces SGA for metadata for large files • 11g - can be done per diskgroup ©The Pythian Group Company Confidential

13. ASM - variable extent size • 10g • 1 extent = 1 AU 1 TB = 1+ mil. extents  11g  1-20,000 extents 1 1MB AU: extent = 1 AU 1 TB = 53,572 extents  20,001 - 40,000 1 64MB AU: extent = 8 AU’s 1 TB = 16,384 extents  40,001 - ... 1 100 TB = 66,788 extents extent = 64 AU’s ©The Pythian Group Company Confidential 9

14. ASM - recovery from failures • Fast Mirror Resync • OFFLINE disks • disk_repair_time attribute • ASM extent change tracking • Suitable for transient failures and maintenance • Fast Rebalancing in restricted mount • Rebalancing => many lock/unlock extent map • Restrict mode rebalancing => no locks • Restricted mounted DG => service outage ©The Pythian Group Company Confidential

15. ASM - Preferred Mirror Read • For extended clusters • Storage mirrored across 2 or 3 datacenters • 10g • Read is first done on primary extent • 11g • Preferred read failure groups (to local disks) • asm_preferred_read_failure_groups in init.ora ©The Pythian Group Company Confidential

16. ASM - asmcmd • “cp” command • ASM <=> OS or ASM <=> ASM • Remote <=> local isntance • Does it work??? + slow • du command like on Unix • lsdsk - list disks (like lsdg for diskgroups) • remap - repairs blocks • md_backup / md_restore - for metadata • asmcmd -p - current directory in prompt ©The Pythian Group Company Confidential

17. R-MAN ©The Pythian Group Company Confidential

20. RMAN - backup performance • CONFIGURE COMPRESSION ALGORITHM ‘type’; • zlib - faster (11g, Advanced Compression) • Bzip2 - smaller (default, 10g) • BACKUP ... SECTION SIZE • single file parallel backup / restore • max 256 sections per file • Undo tablespace backup optimization • Committed undo not backed up • UNDO_RETENTION can be accounted for ©The Pythian Group Company Confidential 14

21. RMAN - usability (1) • Archival backup • makes backups not part of retention policy • archivelogs are only to make backup consistent • KEEP UNTIL / KEEP FOREVER • used in BACKUP and CHANGE • Archivelog deletion policy • applied/shipped on standby • DB_UNIQUE_NAME • remote configure for another DB ©The Pythian Group Company Confidential 15

22. RMAN - usability (2) • Substitution variables • Like SET UNTIL &TIMESTAMP; • Backup read only TTS • No need to read write after TTS import ©The Pythian Group Company Confidential 16

23. RMAN - Data Recovery Advisor • RMAN> list failure; • missing files • corrupted files or blocks • RMAN> advise failure; • RMAN> repair failure [preview]; • RMAN> change failure; ©The Pythian Group Company Confidential

24. RMAN - list failure RMAN> LIST FAILURE; List of Database Failures ========================= Failure ID Priority Status Time Detected Summary ---------- -------- --------- ------------- ------- 142 HIGH OPEN 23-APR-07 One or more non-system datafiles are missing 101 HIGH OPEN 23-APR-07 Datafile 1: '/disk1/ oradata/prod/system01.dbf' contains one or more corrupt blocks ©The Pythian Group Company Confidential

25. RMAN - duplicate • FROM ACTIVE DATABASE • PASSWORD FILE • TO RESTORE POINT • SPFILE • PARAMETER_VALUE_CONVERT • SET parameter=value • TABLESPACE <list> • allows for some tablespaces to be duplicated • No need for standby controlfile backup ©The Pythian Group Company Confidential

26. Data Guard & Physical Standby ©The Pythian Group Company Confidential

29. Standby - different platforms • Different CPU architectures • SPARC <=> x86 • Operating Systems • Linux <=> Windows • “Bitness” • 32 bit <=> 64 bit ©The Pythian Group Company Confidential 21

30. Standby - more uses for DR site • Active Data Guard - Real-time Query • Open read only while redo apply is active • No impact on RTO • Snapshot standby database • Read write and still accepting logs • RPO is not impacted, only RTO • ALTER DATABASE CONVERT TO SNAPSHOT STANDBY; • ALTER DATABASE CONVERT TO PHYSICAL STANDBY; ©The Pythian Group Company Confidential

31. Standby - easier to manage • RMAN re-instantiate datafile over network rman target sys@standby auxiliary sys@prod BACKUP AS COPY DATAFILE 2 AUXILIARY FORMAT ‘...’; • On the fly compression for gap resolution • Redo transport response time histogram • NET_TIMEOUT based on V$REDO_DEST_RESP_HISTOGRAM • DB_UNIQUE_NAME • Better RMAN support • Sync between primary and standby ©The Pythian Group Company Confidential

32. Standby - off-host backups • Persistent configuration • Block change tracking • Fast incremental backups • Backups associated with primary database • Simplified restore • Controlfile backup on standby ©The Pythian Group Company Confidential

33. Manageability & Productivity ©The Pythian Group Company Confidential

34. Manageability & Productivity ©The Pythian Group Company Confidential

35. Read Only table • Read only tables now available • ALTER TABLE x READ ONLY; • ALTER TABLE x READ WRITE; • Simple, insignificant, but needed ©The Pythian Group Company Confidential

36. Invisible indexes • Can you drop a large index? • ALTER INDEX should_i_drop INVISIBLE; • Do you need a new index? • CREATE INDEX do_i_need INVISIBLE; • ALTER SESSION SET optimizer_use_invisible_indexes=t rue • USER_ ALL_ DBA_INDEXES.VISIBILITY ©The Pythian Group Company Confidential

37. Not null with default • Not null columns with default value are maintained in dictionary • No space taken • Instant add • Existing columns are NOT converted • What about indexes on the columns? ©The Pythian Group Company Confidential

38. DDL can now wait • All DDLs can wait • ddl_lock_timeout (default 0) • alter session set ddl_lock_timeout=5; • create index on busy_table… • 0 ... 1,000,000 seconds ©The Pythian Group Company Confidential

39. Virtual columns CREATE TABLE users ( display_name VARCHAR2(30), name AS (UPPER(display_name))); • Simplify SELECT’s • Easy to maintain • Simplify physical data re-design • Partition on virtual columns • Index virtual columns • CBO collects statistics ©The Pythian Group Company Confidential 30

40. Virtual columns for data integrity SQL> create unique index users_uk on users(name); Index created. SQL> insert into users (display_name) values ('Alex'); 1 row created. SQL> insert into users (display_name) values ('ALEX'); insert into users (display_name) values ('ALEX') * ERROR at line 1: ORA-00001: unique constraint (SYS.USERS_UK) violated ©The Pythian Group Company Confidential 31

41. PL/SQL - sequence in variable • 10g • SELECT seq.NEXTVAL INTO my_var FROM DUAL; • 11g • my_var := seq.NEXTVAL; ©The Pythian Group Company Confidential

42. Performance ©The Pythian Group Company Confidential 33

44. Statistics granularity • 10g • DBMS_STATS.SET_PARAM • 11g • SET_GLOBAL_PREFS • SET_DATABASE_PREFS • SET_SCHEMA_PREFS • SET_TABLE_PREFS ©The Pythian Group Company Confidential 34

45. Non-published statistics • Gather table stats without applying DBMS_STATS.SET_SCHEMA_PREFS (’scott’,’publish’,’false’); ALTER SESSION SET optimizer_pending_statistics = TRUE; DBMS_STATS.PUBLISH_PENDING_STATS(...); ©The Pythian Group Company Confidential

46. Variable stale percent • 10g - fixed 10% • 11g variable with 10% default DBMS_STATS.SET_SCHEMA_PREFS (’scott’,’stale_percent’,’25’); ©The Pythian Group Company Confidential 36

47. Incremental statistics gathering • Gather stats on partitioned tables by scanning only changed partitions • SET_SCHEMA_STATS • incremental - true • estimate_percent - auto_sample_size • granularity - auto ©The Pythian Group Company Confidential 37

48. AUTO_SAMPLE_SIZE • Doesn’t just set estimate percent • Changes statistics gathering algorithm • Some statistics gather as precise as with 100% • See Wolfgang Brightling’s paper • Active Statistics ©The Pythian Group Company Confidential 38

50. Real Time SQL Monitor • Much, much better then v$session_long_ops • SQL is parallel or 5+ seconds of CPU or IO • v$sql_monitor • v$sql_plan_monitor • *limited* stats (number of starts and output rows) • elapsed time and etc can be derived by joining with v$sql_monitor and v $active_session_history • Updated near real time - every second or so • Kept at least for a minute after completion ©The Pythian Group Company Confidential

51. Data Pump - obscure & compress • Sensitive columns in export dump • per column REMAP_DATA=schema.tbl.col:schema.package.function • Compress metadata and data • Advanced Compression option ALL DATA_ONLY METADATA_ONLY NONE ©The Pythian Group Company Confidential

55. Security - passwords • New built in password check function • See utlpwdmg.sql • Password expiration in DEFAULT profile • Case-sensitive passwords • sec_case_sensitive_logon=true (init.ora) • DB upgrade / user import keep passwords • DBA_USERS.PASSWORD_VERSIONS • orapwd ignorecase=yes/no • Warning: db links to case-sensitive 11g ©The Pythian Group Company Confidential

56. Security - audit by default • AUDIT_TRAIL = DB ALTER ANY PROCEDURE CREATE EXTERNAL JOB ALTER ANY TABLE CREATE PUBLIC DATABASE LINK ALTER DATABASE CREATE SESSION ALTER PROFILE CREATE USER AUDIT ROLE BY ACCESS DROP ANY PROCEDURE ALTER SYSTEM DROP ANY TABLE ALTER USER DROP PROFILE AUDIT SYSTEM DROP USER AUDIT SYSTEM BY ACCESS EXEMPT ACCESS POLICY CREATE ANY LIBRARY GRANT ANY OBJECT PRIVILEGE CREATE ANY JOB GRANT ANY PRIVILEGE CREATE ANY PROCEDURE GRANT ANY ROLE CREATE ANY TABLE ©The Pythian Group Company Confidential 45

57. Security - other enhancements • Tablespace encryption • All blocks are encrypted • No need to search for columns • TDE feature (Advanced Security option) • Enterprise Manager enhancement • Only DB Control is available ©The Pythian Group Company Confidential

58. Security - Data Pump • ENCRYPTION ALL DATA_ONLY ENCRYPTED_COLUMNS_ONLY METADATA_ONLY NONE • ENCRYPTION_ALGORITHM AES128 AES192 AES256 • ENCRYPTION_MODE DUAL PASSWORD TRANSPARENT • ENCRYPTION_PASSWORD ©The Pythian Group Company Confidential 47

59. Q&A Thank you! gorbachev@pythian.com http://pythian.com/blogs/alexgorbachev http://twitter.com/alexgorbachev ©The Pythian Group Company Confidential 48