1. Ultimate Exadata IO monitoring
Flash, HardDisk , & Write back cache
overhead
Presented by:
Karl Arao
1

2. whoami
Karl Arao
• Senior Technical Consultant @ Enkitec
• Performance and Capacity Planning Enthusiast
7 years DBA experience
Oracle ACE, OCP-DBA, RHCE, OakTable
Blog: karlarao.wordpress.com
Wiki: karlarao.tiddlyspot.com
Twitter: @karlarao
www.enkitec.com 2

3. www.enkitec.com 3
200+
3
Booth #501
Moscone
South

4. Agenda
• Performance scenario
• WBFC
• Different ways to Monitoring IO
• AWR IO data
• Correlate up to the workload and sqlstats data – feedback loop
• Cell data - cell_iops.sh
• Scaling it!
www.enkitec.com 4

5. www.enkitec.com 5

6. The workload
www.enkitec.com 6

7. Performance page
www.enkitec.com 7

8. OEM12c storage grid perf
www.enkitec.com 8

9. WBFC
www.enkitec.com 9
http://goo.gl/2WCmw

10. www.enkitec.com 10
Write-Through Write-Back

11. www.enkitec.com 11

12. www.enkitec.com 12

13. www.enkitec.com 13

14. www.enkitec.com 14

15. Tableau demo on
AWR IOPS and Workload data
www.enkitec.com 15

16. Different views of IO performance with AWR data
http://goo.gl/i660CZ
SECTION 1: USER IO wait class and cell single block reads latency with curve fitting
SECTION 2: Small IOPS vs Large IOPS
SECTION 3: Flash vs HD IOPS
SECTION 4: Flash vs HD IOPS with read/write breakdown
SECTION 5: IO throughput read/write MB/s
SECTION 6: Drill down on smart scans affecting cell single block latency on 24hour
period
www.enkitec.com 16

17. www.enkitec.com 17
Measuring the effect of IORM on latency

18. www.enkitec.com 18

19. www.enkitec.com 19
IORM BASIC IORM AUTO IORM
LOW
LATENCY

20. Tableau demo on
Cell data - cell_iops.sh
www.enkitec.com 20

21. www.enkitec.com 21

22. How do you scale?
www.enkitec.com 22

23. Metric Extensions + BIP
www.enkitec.com 23

24. www.enkitec.com 24
DB and CELL IOPS/MBs comparison:
1)Create metric extensions for DB and CELL
2)Create the model
3)Graph it in Tableau and BIP
4)Schedule the email of final reports/visualization

25. www.enkitec.com 25

26. www.enkitec.com 26
Reference band for HardDisk IOPS capacity
Check the _OTHER_DATABASE_ IOPS and compare with AWR and CELL
numbers for WBFC destage & flash cache metadata operations overhead

27. www.enkitec.com 27

28. Workload AAS by day per node
www.enkitec.com 28

29. Summary
• WBFC
• Different ways to Monitoring IO
• AWR IO data
• Correlate up to the workload and sqlstats data – feedback loop
• Cell data - cell_iops.sh
• Scaling it with Metric Extensions and BIP
www.enkitec.com 29

30. References
• WBFC patent http://goo.gl/2WCmw
• AWR scripts and cell_iops.sh
http://karlarao.wordpress.com/scripts-resources/
• SQL Developer ready AWR scripts http://goo.gl/ocv5b
• Different views of IO performance with AWR data http://goo.gl/i660CZ
www.enkitec.com 30

31. Questions?
karlarao.wordpress.com
karlarao.tiddlyspot.com
@karlarao
www.enkitec.com 31
karl.arao@enkitec.com