PostgreSQL Portland Performance Practice Project - Database Test 2 Series Overview

4,673 views
4,565 views

Published on

Introduction to the Portland State University Computer Science Department sponsored speaker series about Database Test 2 (DBT-2).

Published in: Technology
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
4,673
On SlideShare
0
From Embeds
0
Number of Embeds
14
Actions
Shares
0
Downloads
77
Comments
0
Likes
3
Embeds 0
No embeds

No notes for slide

PostgreSQL Portland Performance Practice Project - Database Test 2 Series Overview

  1. 1. PostgreSQL Portland Performance Practice Project Database Test 2 (DBT-2) Series Overview Mark Wong markwkm@postgresql.org Portland State University January 8, 2009
  2. 2. Acknowledgments We are here because of generous equipment donations from IBM and HP, and hosting from Command Prompt, Inc. Presentation facilities provided by the Computer Science Department, Portland State University.
  3. 3. Agenda Introductions ◮ What will be covered in this series ◮
  4. 4. Introductions Name. ◮ What size database do you work with? (size, rows, etc.) ◮ What you would like to get out of this. ◮ / ~~~/ . o O ( I am an elephant. ) ,----( oo ) / / /| ( |( ^ / / | || | | -quot; ;’-. ‘;-. ) ’---.. > ‘-. .-’ ‘’. . o O ( I am a dolphin. ) / .-’-. , o ---) ‘ ‘’------/ .’----‘‘‘ ‘
  5. 5. In a Nutshell This Is This is Not PostgreSQL on Linux How to publish a benchmark ◮ ◮ an OLTP workload Data Warehousing ◮ ◮ Tuning examples ;’-. ◮ ‘;-. ) ’---.. Analyzing system stats ◮ > ‘-. .-’ ‘’. / .-’-. , o ---) ~~~/ / ‘ ‘’------/ .’----‘‘‘ ,----( oo ) ‘ / / /| ( |( ^ / | / || | | -quot;
  6. 6. Topics (High Level View) Know your system ◮ Hardware ◮ Operating system ◮ Database management system ◮ Know your workload ◮ Know your data ◮ Testing ◮ Analysis ◮ Repeat ◮
  7. 7. Know My System Apple Power Mac G5 (Driver System) 2 x Dual 2.5GHz G5 ◮ 4GB RAM ◮ HP ProLiant DL380 G5 (Database System) 2 x Quad Core Xeon(R) E5405 2.00GHz ◮ 32GB RAM ◮ Smart Array P800 HBA ◮ 8 x 72GB SAS 15,000 RPM Hard Drives ◮ HP MSA70 (Database System) 25 x 72GB SAS 15,000 RPM Hard Drives ◮ More Details: ◮ http://wiki.postgresql.org/wiki/HP_ProLiant_DL380_G5_Tuning_Guide#Hardware_Details
  8. 8. Know My Workload These transactions include entering and delivering orders, recording payments, checking the status of orders, and monitoring the level of stock at the warehouses.1 DBT-2, an OLTP workload ◮ How the workload is driven ◮ Database schema ◮ Detailed description of the 5 transactions ◮ Web: http://osdldbt.sourceforge.net/ ◮ Source Repository (git): http://git.postgresql.org/?p=~markwkm/dbt2.git ◮ 1 http://www.tpc.org/tpcc/
  9. 9. Know My Data 100GB of raw text data ◮ Rows ◮ 285,006,837 order lines ◮ 100,000,000 stock ◮ 30,000,000 customers ◮ 30,000,000 orders ◮ 9,000,000 new orders ◮ 100,000 items ◮ 1,000 warehouses ◮ 10 districts ◮
  10. 10. DBT-2 Test Kit Builds the database ◮ Executes the workload ◮ Collects system statistics ◮ Operating system stats ◮ Database stats ◮ ~~~/ . o O ( This is a hard to use kit. ) / ,----( oo ) / / /| ( |( ^ / | / || | | -quot;
  11. 11. Tuning Exercises PostgreSQL GUC (Global User Configuration) Values ◮ Operating System Parameters ◮ Physical Database Design ◮
  12. 12. Analyze Your Workload Database statistics ◮ Table statistics ◮ Index statistics ◮ Query plans ◮ System statistics ◮ iopp (custom i/o stats per process tool for Linux) ◮ iostat ◮ mpstat ◮ sar ◮ vmstat ◮
  13. 13. Materials Are Freely Available PDF http://www.slideshare.net/markwkm ◮ LTEX Beamer (source) A ◮ http://git.postgresql.org/?p=~markwkm/performance-tuning.git
  14. 14. Feedback ~~~/ . o O ( Comments? ) / ,----( oo ) / / /| ( |( ^ / | / || | | -quot;
  15. 15. Time and Location When: 2nd Thursday of the month Location: Portland State University Room: FAB 86-01 (Fourth Avenue Building) Map: http://www.pdx.edu/map.html
  16. 16. Coming up next time. . . DBT-2 background and history. ~~~/ . o O ( Thank you! ) / ,----( oo ) / / /| ( |( ^ / | / || | | -quot;
  17. 17. Acknowledgements Haley Jane Wakenshaw ~~~/ / ,----( oo ) / / /| ( |( ^ / | / || | | -quot; Joan G. Stark ASCII Art - http://www.ascii-art.com ;’-. ‘;-. ) ’---.. > ‘-. .-’ ‘’. / .-’-. , o ---) ‘ ‘’------/ .’----‘‘‘ ‘
  18. 18. License This work is licensed under a Creative Commons Attribution 3.0 Unported License. To view a copy of this license, (a) visit http://creativecommons.org/licenses/by/3.0/us/; or, (b) send a letter to Creative Commons, 171 2nd Street, Suite 300, San Francisco, California, 94105, USA.

×