Stress testing using SQLIOSIM and SQLIO

9,007 views
8,638 views

Published on

Presented by Steve Verschaeve.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
9,007
On SlideShare
0
From Embeds
0
Number of Embeds
9
Actions
Shares
0
Downloads
275
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Stress testing using SQLIOSIM and SQLIO

  1. 1. Click to edit Master title style LiveMeeting: Stress Testing using SQLIOSIM and SQLIO Steve Verschaeve TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  2. 2. Click to edit Master title style Who am I? Blog.steveverschaeve.be steve@sqlug.be @sql_lazywriter TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  3. 3. Click to edit Master title style Agenda • SQLIOSIM & SQLIO – What is it? – What is it not? – Where can I find it? – What does it look like? – Demos – To remember TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  4. 4. Click to edit Master title style Part I SQLIOSIM TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  5. 5. Click to edit Master title style SQLIOSIM – What is it? • Developed by Bob Dorr (Microsoft) • Generates/simulates a SQL Server workload • To test reliability and integrity of disk systems • Read • Write • Checkpoint • Backup • Sort • Read-ahead • Shrink TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  6. 6. Click to edit Master title style SQLIOSIM - What is it not? • Is NOT an I/O performance tuning tool • “Dont consider SQLIOSim for performance benchmarking, instead use SQLIO Disk Subsystem Benchmark Tool” (Microsoft Customer Service and Support (CSS) SQL Support blog) TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  7. 7. Click to edit Master title styleI find it? SQLIOSIM – Where can • < SQL Server 2008: seperate download • >= SQL Server 2008(R2): BINN folder • SQLIOSIM Download TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  8. 8. Click to edit Master title style SQLIOSIM - Anatomy • SQLIOSIM.exe (Application) • SQLIOSIM.com (MS-DOS Application) • SQLIOSIM.cfg • SQLIOSIM.cfg.zip • SQLIOSIM.log • ErrorLog TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  9. 9. Click to edit Master title style SQLIOSIM.exe TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  10. 10. Click to edit Master title style SQLIOSIM.COM All settings and parameters explained in KB231619 TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  11. 11. Click to edit Master title style SQLIOSIM – Config TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  12. 12. SQLIOSIM – What does itClick to edit Master title style look like? • Demo 1: SQLIOSIM.exe • Demo 2: SQLIOSIM.com TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  13. 13. Click to edit Master title style SQLIOSIM – Parsing the results SQLIOSim Parser by Jens Suessmeyer & Jimmy May • Export to XML, CSV • Display Report TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  14. 14. Click to edit Master title style Templates SQLIOSIM – Configuration • Default.cfg.ini: common testing • Hwcache.cfg.ini: hardware cache behaviour • Nothrottle.cfg.ini: pushing the system and drivers at high queue levels • Seqwrites.cfg.ini: BCP and restore • Sparse.cfg.ini: DBCC and snapshots TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  15. 15. Click to edit Master title stylerunning on a production server? SQLIOSIM - What about • Might expose IO errors • Generates MDFx and LDFx files • When IO checksums occur in the error log TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  16. 16. Click to edit Master title style Part II SQLIO TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  17. 17. Click to edit Master title style SQLIO – What is it? • Determine I/O capacity of disk subsystem • Tested by different I/O types and sizes – Read/Write – Random/Sequential – Threads – Outstanding files – Block size TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  18. 18. Click to edit Master title style SQLIO – What is it not? • Not a simulation tool for I/O patterns • Not really a SQL Server tool TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  19. 19. Click to edit Master title style it? SQLIO – Where can I find • SQLIO Disk Subsystem Benchmark Tool: http://www.microsoft.com/en- us/download/details.aspx?id=20163 TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  20. 20. Click to edit Anatomy style SQLIO - Master title • SQLIO.exe Same Directory • Param.txt – c:testfile.dat 2 0x0 1000 • Size(testfile.dat) = (2 to 4) x SAN or disk cache TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  21. 21. Click to edit Master title Use SQLIO – Parameter style • Using a param file: sqlio -kW -s10 -fsequential -t8 -o8 -b8 –BH -LS -Fparam.txt Read/ Duration Sequential/ Threads Outstanding Block Hardware Latencies Parameter file Write Random Files Size Buffering from system Location & Name Test File • sqlio -kR -s10 -frandom –t8 –o8 -b8 -BH -LS -dC Testfile.dat TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  22. 22. Click to edit Master Test style SQLIO – Stress title Configuration Parameters TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  23. 23. Click to edit Master Test style SQLIO – Stress title Configuration Parameters • Batch file sqlio -kR -t1 -s120 -dC -o1 -fsequential -b8 -BH -LS Testfile.dat sqlio -kR -t1 -s120 -dC -o2 -fsequential -b8 -BH -LS Testfile.dat sqlio -kR -t1 -s120 -dC -o4 -fsequential -b8 -BH -LS Testfile.dat sqlio -kR -t1 -s120 -dC -o8 -fsequential -b8 -BH -LS Testfile.dat sqlio -kR -t1 -s120 -dC -o16 -fsequential -b8 -BH -LS Testfile.dat sqlio -kR -t2 -s120 -dC -o1 -fsequential -b64 -BH -LS Testfile.dat sqlio -kR -t2 -s120 -dC -o2 -fsequential -b64 -BH -LS Testfile.dat sqlio -kR -t2 -s120 -dC -o4 -fsequential -b64 -BH -LS Testfile.dat sqlio -kR -t2 -s120 -dC -o8 -fsequential -b64 -BH -LS Testfile.dat TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  24. 24. Click to edit Execution style SQLIO - Master title • Example • Batch file example C:Program Files (x86)SQLIOSQLIOStressTest.bat >Results.txt TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  25. 25. SQLIO – What does it lookClick to edit Master title style like? • Demo: SQLIO TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  26. 26. Click to edit Masterfile Example & Results SQLIO – Batch title style TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  27. 27. Click to edit Master title style SQLIO – The Results 2500 2000 1500 1000 Sum of Threads Sum of Block Size Sum of Outstanding Files 500 Sum of Avg Latency(ms) 0 0.71 0.79 0.95 1.09 1.13 1.19 1.20 1.21 1.23 40.44 41.66 41.86 41.91 42.70 43.42 43.48 43.55 43.91 44.65 45.10 45.49 45.83 46.01 46.28 48.70 Random Sequential Read Write TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  28. 28. Click to edit Master title style SQLIO – To Remember • More outstanding files = higher queue depth = higher throughput (until saturated) • Larger I/O sizes – higher latencies – Increased throughput (depends on hardware config) • Saturation = Lantency keeps rising while throughput is stable • Monitor saturation – Average Disk Queue Length (outstanding IOs) – Disk Reads/sec (IOs per sec) – Average Disk sec/read (latency) TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  29. 29. Click to edit Master title style SQLIO – To Remember • TempDB: High IOPS • Data: 8K or 64K random (read/write), High IOPS (4-10ms; >100ms = issue) • Log: High MB/sec (<2ms) • Backup: High MB/sec, sequential (read/write) TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  30. 30. Click to edit Master title style SQLIO – Tips from the field • Wait > 1 min between tests • First test = buidling the test file • Duration of test = 5 to 10 min • Keep batch file and results for future reference TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  31. 31. Click to edit Master title style SQLIOSIM - Important links • SQLIOSIM Download (Microsoft) • SQL Server 2000 I/O Basics (Microsoft) • SQL Server I/O Basics, Chapter 2 (Microsoft) • How to use the SQLIOSim utility to simulate SQL Server activity on a disk subsystem (Q231619) • Understanding SQLIOSIM output (Kevin Kline) • How It Works: SQLIOSim – Checksums (Microsoft) • SQLIOSIM Parser (Jens K. Suessmeyer & Jimmy May) TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  32. 32. Click to edit Master title style SQLIO – Important Links • Storage Performance Testing with SQLIO (Brent Ozar) • SAN Performance Tuning with SQLIO (SQL Server Pedia) • Parsing SQLIO Output to Excel Charts using Regex in PowerShell (Jonathan Kehayias) TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  33. 33. Click to edit Master title style Questions? Steve@sqlug.be TechNet goes virtual© Microsoft Corporation. All Rights Reserved.
  34. 34. Click to edit Master title style Thank you TechNet goes virtual© Microsoft Corporation. All Rights Reserved.

×