PostgreSQL Portland
Performance Practice Project
Database Test 2 (DBT-2)
Series Overview
Mark Wong
markwkm@postgresql.org
Portland State University
January 8, 2009

Acknowledgments
We are here because of generous equipment donations from IBM
and HP, and hosting from Command Prompt, Inc.
Presentation facilities provided by the Computer Science
Department, Portland State University.

Agenda
Introductions
◮
What will be covered in this series
◮

Introductions
Name.
◮
What size database do you work with? (size, rows, etc.)
◮
What you would like to get out of this.
◮
/ \\~~~/ \\ . o O ( I am an elephant. )
,----( oo )
\\
/ /
/| (\\ |(
^\\ / \\ /\\ |
|| | | -\"
;’-.
‘;-. ) ’---..
> ‘-. .-’ ‘’. . o O ( I am a dolphin. )
/ .-’-. , o ---)
‘ ‘’------/ .’----‘‘‘
‘

In a Nutshell
This Is This is Not
PostgreSQL on Linux How to publish a benchmark
◮ ◮
an OLTP workload Data Warehousing
◮ ◮
Tuning examples ;’-.
◮
‘;-. ) ’---..
Analyzing system stats
◮
> ‘-. .-’ ‘’.
/ .-’-. , o ---)
\\~~~/ \\
/
‘ ‘’------/ .’----‘‘‘
,----( oo )
‘
\\
/ /
/| (\\ |(
^\\ \\ /\\ |
/
|| | | -\"

Topics (High Level View)
Know your system
◮
Hardware
◮
Operating system
◮
Database management system
◮
Know your workload
◮
Know your data
◮
Testing
◮
Analysis
◮
Repeat
◮

Know My System
Apple Power Mac G5 (Driver System)
2 x Dual 2.5GHz G5
◮
4GB RAM
◮
HP ProLiant DL380 G5 (Database System)
2 x Quad Core Xeon(R) E5405 2.00GHz
◮
32GB RAM
◮
Smart Array P800 HBA
◮
8 x 72GB SAS 15,000 RPM Hard Drives
◮
HP MSA70 (Database System)
25 x 72GB SAS 15,000 RPM Hard Drives
◮
More Details:
◮ http://wiki.postgresql.org/wiki/HP_ProLiant_DL380_G5_Tuning_Guide#Hardware_Details

Know My Workload
These transactions include entering and delivering orders,
recording payments, checking the status of orders, and
monitoring the level of stock at the warehouses.1
DBT-2, an OLTP workload
◮
How the workload is driven
◮
Database schema
◮
Detailed description of the 5 transactions
◮
Web:
http://osdldbt.sourceforge.net/
◮
Source Repository (git):
http://git.postgresql.org/?p=~markwkm/dbt2.git
◮
1
http://www.tpc.org/tpcc/

Know My Data
100GB of raw text data
◮
Rows
◮
285,006,837 order lines
◮
100,000,000 stock
◮
30,000,000 customers
◮
30,000,000 orders
◮
9,000,000 new orders
◮
100,000 items
◮
1,000 warehouses
◮
10 districts
◮

DBT-2 Test Kit
Builds the database
◮
Executes the workload
◮
Collects system statistics
◮
Operating system stats
◮
Database stats
◮
\\~~~/ \\ . o O ( This is a hard to use kit. )
/
,----( oo )
\\
/ /
/| (\\ |(
^\\ \\ /\\ |
/
|| | | -\"

Tuning Exercises
PostgreSQL GUC (Global User Configuration) Values
◮
Operating System Parameters
◮
Physical Database Design
◮

Analyze Your Workload
Database statistics
◮
Table statistics
◮
Index statistics
◮
Query plans
◮
System statistics
◮
iopp (custom i/o stats per process tool for Linux)
◮
iostat
◮
mpstat
◮
sar
◮
vmstat
◮

Materials Are Freely Available
PDF
http://www.slideshare.net/markwkm
◮
LTEX Beamer (source)
A
◮ http://git.postgresql.org/?p=~markwkm/performance-tuning.git

Feedback
\\~~~/ \\ . o O ( Comments? )
/
,----( oo )
\\
/ /
/| (\\ |(
^\\ \\ /\\ |
/
|| | | -\"

Time and Location
When: 2nd Thursday of the month
Location: Portland State University
Room: FAB 86-01 (Fourth Avenue Building)
Map: http://www.pdx.edu/map.html

Coming up next time. . .
DBT-2 background and history.
\\~~~/ \\ . o O ( Thank you! )
/
,----( oo )
\\
/ /
/| (\\ |(
^\\ \\ /\\ |
/
|| | | -\"

Acknowledgements
Haley Jane Wakenshaw
\\~~~/ \\
/
,----( oo )
\\
/ /
/| (\\ |(
^\\ \\ /\\ |
/
|| | | -\"
Joan G. Stark
ASCII Art - http://www.ascii-art.com
;’-.
‘;-. ) ’---..
> ‘-. .-’ ‘’.
/ .-’-. , o ---)
‘ ‘’------/ .’----‘‘‘
‘

License
This work is licensed under a Creative Commons Attribution 3.0
Unported License. To view a copy of this license, (a) visit
http://creativecommons.org/licenses/by/3.0/us/; or, (b)
send a letter to Creative Commons, 171 2nd Street, Suite 300, San
Francisco, California, 94105, USA.