PostgreSQL Portland Performance Practice Project - Database Test 2 Series Overview

PostgreSQL Portland Performance Practice Project Database Test 2 (DBT-2) Series Overview Mark Wong markwkm@postgresql.org Portland State University January 8, 2009

Acknowledgments We are here because of generous equipment donations from IBM and HP, and hosting from Command Prompt, Inc. Presentation facilities provided by the Computer Science Department, Portland State University.

Agenda Introductions ◮ What will be covered in this series ◮

Introductions Name. ◮ What size database do you work with? (size, rows, etc.) ◮ What you would like to get out of this. ◮ / ~~~/ . o O ( I am an elephant. ) ,----( oo ) / / /| ( |( ^ / / | || | | -quot; ;’-. ‘;-. ) ’---.. > ‘-. .-’ ‘’. . o O ( I am a dolphin. ) / .-’-. , o ---) ‘ ‘’------/ .’----‘‘‘ ‘

In a Nutshell This Is This is Not PostgreSQL on Linux How to publish a benchmark ◮ ◮ an OLTP workload Data Warehousing ◮ ◮ Tuning examples ;’-. ◮ ‘;-. ) ’---.. Analyzing system stats ◮ > ‘-. .-’ ‘’. / .-’-. , o ---) ~~~/ / ‘ ‘’------/ .’----‘‘‘ ,----( oo ) ‘ / / /| ( |( ^ / | / || | | -quot;

Topics (High Level View) Know your system ◮ Hardware ◮ Operating system ◮ Database management system ◮ Know your workload ◮ Know your data ◮ Testing ◮ Analysis ◮ Repeat ◮

Know My System Apple Power Mac G5 (Driver System) 2 x Dual 2.5GHz G5 ◮ 4GB RAM ◮ HP ProLiant DL380 G5 (Database System) 2 x Quad Core Xeon(R) E5405 2.00GHz ◮ 32GB RAM ◮ Smart Array P800 HBA ◮ 8 x 72GB SAS 15,000 RPM Hard Drives ◮ HP MSA70 (Database System) 25 x 72GB SAS 15,000 RPM Hard Drives ◮ More Details: ◮ http://wiki.postgresql.org/wiki/HP_ProLiant_DL380_G5_Tuning_Guide#Hardware_Details

Know My Workload These transactions include entering and delivering orders, recording payments, checking the status of orders, and monitoring the level of stock at the warehouses.1 DBT-2, an OLTP workload ◮ How the workload is driven ◮ Database schema ◮ Detailed description of the 5 transactions ◮ Web: http://osdldbt.sourceforge.net/ ◮ Source Repository (git): http://git.postgresql.org/?p=~markwkm/dbt2.git ◮ 1 http://www.tpc.org/tpcc/

Know My Data 100GB of raw text data ◮ Rows ◮ 285,006,837 order lines ◮ 100,000,000 stock ◮ 30,000,000 customers ◮ 30,000,000 orders ◮ 9,000,000 new orders ◮ 100,000 items ◮ 1,000 warehouses ◮ 10 districts ◮

DBT-2 Test Kit Builds the database ◮ Executes the workload ◮ Collects system statistics ◮ Operating system stats ◮ Database stats ◮ ~~~/ . o O ( This is a hard to use kit. ) / ,----( oo ) / / /| ( |( ^ / | / || | | -quot;

Tuning Exercises PostgreSQL GUC (Global User Conﬁguration) Values ◮ Operating System Parameters ◮ Physical Database Design ◮

Analyze Your Workload Database statistics ◮ Table statistics ◮ Index statistics ◮ Query plans ◮ System statistics ◮ iopp (custom i/o stats per process tool for Linux) ◮ iostat ◮ mpstat ◮ sar ◮ vmstat ◮

Materials Are Freely Available PDF http://www.slideshare.net/markwkm ◮ LTEX Beamer (source) A ◮ http://git.postgresql.org/?p=~markwkm/performance-tuning.git

Feedback ~~~/ . o O ( Comments? ) / ,----( oo ) / / /| ( |( ^ / | / || | | -quot;

Time and Location When: 2nd Thursday of the month Location: Portland State University Room: FAB 86-01 (Fourth Avenue Building) Map: http://www.pdx.edu/map.html

Coming up next time. . . DBT-2 background and history. ~~~/ . o O ( Thank you! ) / ,----( oo ) / / /| ( |( ^ / | / || | | -quot;

Acknowledgements Haley Jane Wakenshaw ~~~/ / ,----( oo ) / / /| ( |( ^ / | / || | | -quot; Joan G. Stark ASCII Art - http://www.ascii-art.com ;’-. ‘;-. ) ’---.. > ‘-. .-’ ‘’. / .-’-. , o ---) ‘ ‘’------/ .’----‘‘‘ ‘

License This work is licensed under a Creative Commons Attribution 3.0 Unported License. To view a copy of this license, (a) visit http://creativecommons.org/licenses/by/3.0/us/; or, (b) send a letter to Creative Commons, 171 2nd Street, Suite 300, San Francisco, California, 94105, USA.

PostgreSQL Portland Performance Practice Project - Database Test 2 Series Overview

by Mark Wong on Jan 08, 2009

Accessibility

Categories

Tags

Upload Details

Usage Rights

1 Embed 11

Statistics

PostgreSQL Portland Performance Practice Project - Database Test 2 Series Overview — Presentation Transcript