Fast track foundations getting serious about sequential io

Fast Track Foundations: Serious about Sequential I/O
James Rowland-Jones
&
Allan Mitchell

WTF is FAST TRACK?
Introduction

Blend of Hardware & Software

Predictable Performance
Balanced Configurations
CPU
Memory
Network
Storage

Targeted to the Data Warehouse Workload
Sequential Scanning of Data
Leads to fewer disks

Prescriptive
Best Practices
Recommendations
You don’t get to pick and choose!

WhY SQL 2008 Only?

SQL Server 2008 Enterprise...
...was the Data Warehousing release...
Compression
Star Joins
Few Outer Rows Parallelism
Partitioned Table Parallelism
Resource Governor
Improved Read Ahead

SQL 2008 Settings
Startup Parameters
T1117
E
Resource Governor
Reduce Max memory per session
Page Compression ON!

Windows 2008 Settings
Multipath I/O Feature is required
Lock Pages In Memory Enabled

Sequential vs RANDOM I/O
DEMO TIME:

Counters
Performance Counter
Avg. Disk Bytes / Read
Avg. Disk Sec / Read
Disk Read Bytes / Sec
Disk Reads / Sec
Meaning
Size of I/Os
Latency “Seek Time”
Throughput – MB/s
I/Os per second
DMVs
sys.dm_db_index_physical_file_stats
sys.dm_io_virtual_file_stats
sys.dm_io_pending_io_requests

Time to Take the Red Pill...

DB Design Considerations
Fast Track Thinking

Indexing
Think Index Light
NC Indexes aimed at low volume row lookups
Indexes are Expensive to maintain

Aggregation
Think Aggregation Light
Introduces Updates (fragmentation)
Removing aggs reduces maintenance

Partitioning
Partition Qualification
Data Management
P1
P4
P3
P2
P2

Fibre Switch
Conceptual View of Fast Track Hardware
SPA
FC1
RG1
RG2
RG9
LUN 01
LUN 03
LUN 17
(Logs)
4GB
4GB
LUN 02
LUN 04
FC2
4GB
1
2
5
6
4GB
SPARE
SPB
4GB
FC3
3
4
7
8
RG3
RG4
4GB
LUN 05
LUN 06
4GB
LUN 07
LUN 08
FC4
4GB
RAID 1
H
SPC
FC5
RG5
RG6
RG10
LUN 09
LUN 10
LUN 18
(Logs)
H
LUN 11
LUN 12
FC6
SPARE
SPD
FC7
8 Core 32 GB RAM Server
RG7
RG8
LUN 13
LUN 14
LUN 15
LUN 16
FC8

Fibre Switch
SP Port
650MB/s
SPA
FC1
RG1
RG2
RG9
Performance View of Fast Track Hardware
LUN 01
LUN 03
LUN 17
(Logs)
32GB
RAM
800mb/s
LUN 02
LUN 04
FC2
1
2
5
6
1 LUN =
125
MB/S
SPB
FC3
3
4
7
8
RG3
RG4
LUN 05
LUN 06
LUN 07
LUN 08
FC4
400mb/s
per port
FC Port
400 MB/S
800mb/s
H
SPC
FC5
RG5
RG6
RG10
LUN 09
LUN 10
LUN 18
(Logs)
H
LUN 11
LUN 12
FC6
SPD
FC7
200 mb/s per CPU core is central to Fast Track Architecture
RG7
RG8
LUN 13
LUN 14
LUN 15
LUN 16
FC8

Performance Summary

Capacity Summary

Database Layout
Live
FG1
Primary
Fi1
Fi2
Fi3
Fi4
Fi5
Fi6
Fi7
Live Log
Fi8
Fi1
Fi2
Fi3
Fi4
Fi5
Fi6
Fi7
Fi8
Fi1
Fi2
Fi3
Fi4
Fi5
Fi6
Fi7
Fi8
Fi0
Stage
FG1
Primary
Fi9
Fi10
Fi11
Fi12
Fi13
Fi14
Fi15
Fi16
Fi9
Fi10
Fi11
Fi12
Fi13
Fi14
Fi15
Stage Log
Fi16
Tempdb
Primary
Fi9
Fi10
Fi11
Fi12
Fi13
Fi14
Fi15
tempLog
Fi16
Fi0

Managing Fragmentation
The arch enemy of Sequential I/O

Fragmentation

File System Fragmentation
Pre-Allocate your Database files
Avoid O/S de-fraggers
They know not what they do...

Extent Fragmentation
Occurs Courtesy of
Concurrent DML
Updates
Deletes
Follow the guidelines!
Otherwise you’ll be re-loading the tables....

Index Fragmentation
Don’t use ALTER INDEX REORGANIZE
Do one of the following
ALTER INDEX REBUILD ... SORT_IN_TEMPDB = TRUE (MAXDOP 1)
INSERT ... SELECT into a new table

File Groups
Isolate Volatile Data
Create a separate Filegroup
One file per LUN to spread the I/O
Isolate Small / Dimension Tables
Stage Data in a Separate DB or File Group

DATA LOADING FOR SEQUENTIAL I/O
Over to Mitchell...

where Allan and Darren live

Conceptual View of Fast Track Hardware
Fibre Switch
SPA
FA1
LUN 01
LUN 03
LUN 17
(Logs)
4GB
4GB
LUN 02
LUN 04
FA2
4GB
1
2
5
6
4GB
SPARE
SPB
4GB
FA3
3
4
7
8
4GB
LUN 05
LUN 06
4GB
LUN 07
LUN 08
FA4
4GB
RAID 1
H
SPC
FA5
LUN 09
LUN 10
LUN 18
(Logs)
H
LUN 11
LUN 12
FA6
SPARE
SPD
FA7
8 Core 32 GB RAM Server
LUN 13
LUN 14
LUN 15
LUN 16
FA8

http://consultingblogs.emc.com	742
http://powerwindows.wordpress.com	302
http://www.slideshare.net	4
http://webcache.googleusercontent.com	2
url_unknown	2
http://windowtotheprivatecloud.com	1

Fast track foundations getting serious about sequential io

by jrowlandjones on Apr 25, 2010

Accessibility

Categories

Tags

Upload Details

Usage Rights

6 Embeds 1,053

Statistics

Fast track foundations getting serious about sequential io — Presentation Transcript