This document discusses workload generation, tracing and analysis of disk performance on three sample drives with varying input-output operations per second and data throughput. It also contains graphs showing the distribution of sequential read operations and data transfer by size of sequential run for a Swift benchmark storing 20MiB objects. Later, the document discusses disaggregated storage and introduces Seagate's Kinetic Open Storage platform as a new open storage solution that separates hardware and software. It provides an overview of the Kinetic device model and functional API for distributed object storage.

1. Tim Feldman
Technologist
Product Development
@timfoon
OpenStack Icehouse Design Summit
November 2013

2. Agenda
•
•
•
•

3. Workload Generation, Tracing and Analysis
•
–
»
»
–
»
•
•
–

4. Detailed look a 3 of 60 drives
disk
s2b1/sdn
(low)
s3b1/sdd
(ave)
s3b1/sdp
(high)
trace duration [minutes]
29.2
29.1
29.1
command rate [IOPS]
37.4
52.5
57.9
data transferred [GB]
20.8
23.6
25.9
data throughput [MB/s]
11.9
13.5
14.8

5. swift-bench 20-MiB objects
Sequential Run Counts and Data Transfer Counts by Sequential Run Size
100%
90%
80%
high seq'l run count
90% of the disk ops
move 1% of the data
med. seq'l run count
low seq'l run count
high data xfer count
60%
50%
40%
med. data xfer count
30%
low data xfer count
20%
10%
0.1
1
10
100
1000
Sequential Run Length [KiB]
10000
0%
100000
Cumulative Portion
70%

6. swift-bench 20-MiB objects
Sequential Run Counts and Data Transfer Counts by Sequential Run Size
100%
90%
80%
60%
high seq'l run count
med. seq'l run count
50%
low seq'l run count
high data xfer count
40%
med. data xfer count
30%
low data xfer count
20%
10%
0.1
1
10
100
1000
Sequential Run Length [KiB]
10000
0%
100000
Cumulative Portion
70%

7. When, where and how big

8. A new open storage platform

9. Disintermediated Hardware and Software

10. Disintermediate
•
–
•
–
•
–
–
•
–

11. Disaggregated Storage

12. Disaggregate
•
–
–
•
–
–
•
–

13. Seagate’s Kinetic Open Storage
Platform

14. SAS
•
•
•
versus
Kinetic Open Storage
•
•
•












15. Kinetic
Device
Functional
Model

16. Kinetic Open Storage API
•
–
•
–
–
»
»
Partition
Collection
Name
Chunk id

17. Kinetic Open Storage API
•
–
–
–
–

18. Kinetic Open Storage API
•
–
•
–
–
•
–
–

19. Kinetic Open Storage API
•
–
–
–
»
»
–
»

20. Kinetic Open Storage API
•
»
–
–
–
•
–
–
–
–
–

21. Kinetic Open Storage API
•
–
–
–
»
»
»
»

22. Kinetic-Swift In Action
•
»
»
•
»
»
»

23. Kinetic-Swift Topology

24. Kinetic Open Storage Platform