Does your choice of storage really matter in a Cassandra deployment? Intel and Datastax engineers will discuss results of recent performance testing on a variety of storage devices including classic spinning media, SATA SSD’s and NVMe SSD’s. Session will include an overview of the various storage types, and technology trends. Next we will discuss our recent testing and look at some preliminary results. Even if you are only at the early stages of considering a Cassandra deployment, fully understanding the impact storage choices have on your results can be critical to your projects success.

1. NVM Solutions Group
Frank Ober Al Tobey
NVM Solutions Group Performance Architect - DataStax

2. LegalDisclaimer
Information in this document is provided in connection with intel products. No license, express or implied, by
estoppel or otherwise, to any intellectual property rights is granted by this document. Except as provided in intel's
terms and conditions of sale for such products, intel assumes no liability whatsoever and intel disclaims any express
or implied warranty, relating to sale and/or use of intel products including liability or warranties relating to fitness for
a particular purpose, merchantability, or infringement of any patent, copyright or other intellectual property right.
A "mission critical application" is any application in which failure of the intel product could result, directly or
indirectly, in personal injury or death. Should you purchase or use intel's products for any such mission critical
application, you shall indemnify and hold intel and its subsidiaries, subcontractors and affiliates, and the directors,
officers, and employees of each, harmless against all claims costs, damages, and expenses and reasonable attorneys'
fees arising out of, directly or indirectly, any claim of product liability, personal injury, or death arising in any way out
of such mission critical application, whether or not intel or its subcontractor was negligent in the design, manufacture,
or warning of the intel product or any of its parts.
Intel may make changes to specifications and product descriptions at any time, without notice. Designers must not
rely on the absence or characteristics of any features or instructions marked "reserved" or "undefined". Intel reserves
these for future definition and shall have no responsibility whatsoever for conflicts or incompatibilities arising from
future changes to them. The information here is subject to change without notice. Do not finalize a design with this
information.
The products described in this document may contain design defects or errors known as errata which may cause the
product to deviate from published specifications. Current characterized errata are available on request.

3. NVM Solutions Group
Re-Architecting the Memory-Storage Hierarchy
with 3D XPoint™ Technology and 3D NAND
DDR
NAND SSD
Hard Disk Drives
3D XPoint
(NVMe SSD)
3D XPoint
(DIMM)
3D NAND SSD with TLC
3D NAND SSD
CPU

4. NVM Solutions Group
3DXpoint™TECHNOLOGYA new class of non-volatile memory Media
1Technology claims are based on comparisons of latency, density and write cycling metrics amongst memory technologies recorded on published specifications of in-market memory products
against internal Intel specifications
1000XfasterTHAN NAND1
1000XenduranceOF NAND1
10XdenserTHAN DRAM1
Nand-likedensitiesanddram-likespeeds

5. NVM Solutions Group
TheExplosionofDataRequires Technology To Perform Random Data Access, Low Queue Depth and
Cache Line Size Optimally
Many Industries Are Seeking the “Ideal Memory”
Financial Services Fraud Detection Online Advertising Scientific Research Gaming

6. NVM Solutions Group
Intel®ssds withintel®optane™technologyWill Come in Many Form Factors
M.2 U.2 2.5in Add-inCard
NVMeoptimizeslowlatencywithhighperformancestorage

7. NVM Solutions Group
NAND vs 3D XPoint™ Technology: SSD IOPS vs QD
Queue Depth
IOPS
NAND NVMe SSD
0 16 32 64 96 128 …256
Intel® Optane™ SSD
based on 3D XPoint™ Technology
Normal
operating
range
4k Random Read IOPS
Comparisons between memory technologies based on in-market product specifications and internal Intel specifications.
3D XPoint™ Technology Provides High IOPs and Full Bandwidth at Low Queue Depth

8. NVM Solutions Group
New Faster SSDs Emerge…Where will they be used?
Extend DRAM
In memory databases
Key value stores and MemCache use models
Goal is to lower TCO and execute larger datasets
Faster SSD as memory and storage
Real time analytics – and ever faster NoSQL
Fraud detection, ad bidding, real time decision making, trading
Cloud hosting – amazing QoS for better application SLAs
Ultra High Definition all professional video production
Caching
Cloud hosting, all flash array, SAN, tiered DB
Write buffer for RAID array

9. NVM Solutions Group

10. NVM Solutions Group
Intel® SSD DC P3700 Series
Performance
Intel® SSD DC P3600 Series Intel® SSD DC P3500 Series
800
GB
400
GB
1.6TB 2TB 800
GB
400
GB
1.6TB 2TB1.2TB 400
GB
2TB1.2TB
Endurance
10
DWPD
3
DWPD
0.3
DWPD
High Endurance
Technology
Mixed use Read
Intensive
Random 4k Read 450k IOPS
Random 4k Write 175k IOPS
Random 4k 70/30 R/W 265k IOPS
Sequential Read 2800 MB/s
Sequential Write 2000 MB/s
450k IOPS
56k IOPS
160k IOPS
2600 MB/s
1700 MB/s
450k IOPS
35k IOPS
85k IOPS
2500 MB/s
1700 MB/s

11. NVM Solutions Group
Workload
Random 4k Read Up to 85k IOPS
Random 4k Write Up to 45k IOPS
Random 4k 70/30 R/W Up to 63k IOPS
Sequential Read Up to 550 MB/s
Sequential Write Up to 520 MB/s
Avg Active R/W Power 2.6-3.1/4-6.9 W
Idle Power 600 mW
800
GB
1.2TB
2.5inx7mm
400
GB
200
GB
Intel® SSD DC S3710 Series
Delivering up to 25% more write performance than the Intel SSD DC S3700 Series
Performance Features
Power loss protection End-to-end data protection
AES 256b encryption
High Endurance Technology
20nm NAND – 10 DWPD
Consistently amazing
performance
Tests document performance of components on a particular test, in specific systems. Differences in hardware, software, or
configuration will affect actual performance. Configurations: Intel Core i7-3770K CPU @ 3.50GHz, 8GB of system memory, Windows1
Server 2012, IOMeter. Random performance is collected with 4 workers each with 32 QD. Average RMS Active write power measured
at max bandwidth. *Other names and brands may be claimed as the property of others.

12. NVM Solutions Group

13. NVM Solutions Group
Configuration of test machines
Intel Board S2600GZ – White Box - dual socket (current – 1 generation)
Intel CPU E5 2697 – v2 (12 true cores, 24 hardware threads) @ 2.8Ghz
Intel Ethernet Controller 82599ES 10Gb
Intel SSD DC P3700 800GB (NVMe)
Intel SSD DC S3710 800GB (SATA)
Non-Intel SAS HDD 7.2k RPM (SATA)
Using an older release and kernel to test NVMe, we sandbagged ourselves!
Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to
vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. For
more complete information visit http://www.intel.com/performance.

14. NVM Solutions Group 14
First try fio – holy cow!
NVMe on bm007 300k IOPS , almost no waits. SATA on bm022, HDD on bm024

15. NVM Solutions Group 15
dstat - fio rw 25/75 workload
1% CPU overhead, and PCIe bus is saturated

16. NVM Solutions Group 16
Cassandra stress on large objects across 3 nodes
NVMe reduces system overhead allowing Cassandra to get more done

17. NVM Solutions Group 17
Latency rw 25/75
50 us
130 us

18. NVM Solutions Group 18
Latency variation deep dive
NVMe SATA
The tighter and lower latency
means a more stable system overall.

19. NVM Solutions Group 19
Drive throughput matters. (50/50 rw)
NVMe can outclass SATA drives many times over, No HBA’s, no bus arbitration

20. NVM Solutions Group 20
NVMe driver on Linux (blog)
feature/kernel 3.3 3.6 3.9 3.10 3.12 3.14 3.15 3.16 3.19 4.0 4.1
high performance, NVMe 1.0
spec
√ √ √ √ √ √ √ √ √ √ √
Greater than 512byte LBA √ √ √ √ √ √ √ v √ √
Discard/TRIM √ √ √ √ √ √ √ √ √
Disk stats – iostat
BIO splitting
√ √ √ √ √ √ √ √
Power Management:
Suspend/Resume
√ √ √ √ √ √ √
Dynamic partitions
Surprise removal
Command Abort
√ √ √ √ √ √
Surprise removal
per-CPU and optimizations
√ √ √ √ √
trace events √ √ √ √
Block-mq, and hot-plug
finalization
√ √ √
Multipath NVMe √ √
DIF/DIX & Metadata, hot-cpu √
http://intel.ly/1F6zrdh

21. Thanks for attending…