At Red Hat Storage Day Minneapolis on 4/12/16, Intel's Dan Ferber presented on Intel storage components, benchmarks, and contributions as they relate to Ceph.
3. is Changing
Source: IDC – The Digital Universe of Opportunities: Rich Data and the Increasing Value of the Internet of Things - April 2014
Fromnow until 2020, the size ofthe digital
universe will aboutdouble everytwoyears
Information Growth*
2X
What we do with data ischanging, traditional
storage infrastructuredoesnot solve
tomorrow’sproblems
Complexity
ShiftingofIT servicesto cloud computing
and next-generationplatforms
Cloud
Emergence offlash storage and
software-defined environments
New Technologies
The World
4. Explosion
EVERY MINUTE EVERY DAY*
300 HOURS
VIDEO UPLOADED
TO YOUTUBE
51,000
APPS DOWNLOADED
204
MILLION E-MAILS
Source: TechSpartan.co.uk - 2013 vs 2015 In an Internet minute
48 HOURS
VIDEO UPLOADED
TO YOUTUBE
47,000
APPS DOWNLOADED
200
MILLIONE-MAILS
2013 2015
Information
5. TheImpactof
theCloud
Empowerment of the end-user
through cloud services
Emergence of new technologies
and architectures
Shifting the role of information
technology professionals
11. WhereDataisCreated
0
10
20
30
40
50
2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020
(ZB)
Unstructured Data Structured Data
Sources: IDC, 2011 Worldwide Enterprise Storage Systems 2011-2015 Forecast update
IDC, The Digital Universe Study In 2020 Forecasts
4.4ZB
44ZB
90%
10%
0%
20%
40%
60%
80%
100%
2012 2013 2014 2015 2016 2017 2018 2019 2020
% of Total Digital Universe
Emerging Markets Mature Markets
Sources: IDC,’s Digital Universe Study, 2014
USA, Canada, Western Europe,
Australia, NZ, and Japan
China, India, Mexico, Brazil,
and Russia
By 2020, about 90% of all data will be
unstructured, driven by Consumer Images,
Voice, and the Web
Emerging Markets will Surpass Mature
Markets before 2017 regarding data creation.
Data Creation by Type (ZB)
11
16. Latency: ~100x
Size of Data: ~1,000x 1000x faster than NAND
1000x higher endurance of NAND
10x denser than DRAM
Technology claims are based on comparisons of latency, density, and write cycling metrics amongst memory technologies recorded on published specifications of in-market memory
products against internal Intel specifications.
3DXpOINT™
TECHNOLOGY
New Class of
Non-Volatile Memory
17. 17
Intel®SolidStateDrives
“The only SSDs that never ever
gave me any issues like timeouts,
task aborts… are Intel DC S3700s”
From a post on ceph-devel*
Source:
http://ceph.com/r esources/maili ng-‐‑list-‐‑irc
18. 18
Intel’sroleinstorage
Advance theIndustry
OpenSource&Standards
BuildanOpenEcosystem
Intel®StorageBuilders
Endusersolutions
Cloud,Enterprise
IntelTechnologyLeadership
Storage Optimized CPU’s
Intel® Xeon® E5v4 2600 Platform
Intel® Xeon® Processor D-1500Platform
Storage Optimized Software
Intel® Intelligent AccelerationLibrary
Intel® Storage Performance Development Kit
Non-Volatile Memory
3D Xpoint™
Intel® Solid StateDrives for Datacenter
>7 Cloud storage solutions
architectures
70+ partners
Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such asSYSmark and MobileMark, are measured using specific
computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist
you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products.
helpingcustomerstoenableNextgen storage
Next gen solutions
architectures>26
>10 Enterprise storage solution
architectures
19.
20. 20
Intel Ceph Contribution Timeline
2014 2015 2016
* Right Edge of box indicates approximate release date
New Key/Value Store
Backend (rocksdb)
Giant* Hammer Infernalis Jewel
CRUSH Placement
Algorithm improvements
(straw2 bucket type)
BluestoreBackend
Optimizations for NVM
Bluestore SPDK
Optimizations
RADOS I/O Hinting
(35% better EC Write erformance)
Cache-tieringwith SSDs
(Write support)
PMStore
(NVM-optimized backend
based on libpmem)
RGW, Bluestore
Compression,Encryption
(w/ ISA-L, QAT backend)
VirtualStorageManager
(VSM)Open Sourced
CeTune
Open Sourced
ErasureCoding
support with ISA-L
Cache-tieringwith SSDs
(Read support)
Client-sideBlock Cache
(librbd)
21. Ceph@Intel–2016CephFocusAreas
21
Optimize for Intel® platforms, flash and networking
• Compression, Encryption hardware offloads (QAT & SOCs)
• PMStore (for 3D XPoint DIMMs)
• RBD caching and Cache tiering with NVM
• IA optimized storage libraries to reduce latency (ISA-L, SPDK)
Performance profiling, analysis and community contributions
• All flash workload profiling and latency analysis
• Streaming,Database and Analytics workload drivenoptimizations
Ceph enterprise usages and hardening
• Manageability (Virtual Storage Manager)
• Multi Data Center clustering (e.g., async mirroring)
End Customer POCs with focus on broad industry influence
• CDN,Cloud DVR,Video Surveillance, Ceph Cloud Services, AnalyticsPOCs
Ready to use IA, Intel NVM optimized systems & solutions from OEMs & ISVs
• Ready to use IA, Intel NVM optimized systems & solutions from OEMs & ISVs
• Intel system configurations, white papers,case studies
• Industry events coverage
Go to
Market
Intel® Storage
AccelerationLibrary
(Intel® ISA-L)
Intel® StoragePerformance
DevelopmentKit (SPDK)
Intel® Cache
Acceleration
Software (Intel® CAS)
Virtual StorageManager
Ce-Tune Ceph
Profiler
23. 23
4KRandomRead&WritePerformanceSummaryFirst Ceph cluster to break 1 Million 4K random IOPS
Software
and
workloads
used
in
performance
tests
may
have
been
optimized
for
performance
only
on
Intel
microprocessors.
Any
difference
in
system
hardware
or
software
design
or
configuration
may
affect
actual
performance.
See
configuration
slides
in
backup
for
details
on
software
configuration
and
test
benchmark
parameters.
Workload Pattern Max IOPS
4K 100% Random Reads (2TB Dataset)
1.35Million
4K 100% Random Reads (4.8TB Dataset)
1.15Million
4K 100% Random Writes (4.8TB Dataset)
200K
4K 70%/30% Read/Write OLTP Mix
(4.8TB Dataset) 452K
Source: Openstack Summit 2015: Accelerating Cassandraworkloadson ceph with all flashpcie ssds
24. Red Hat Ceph Reference Architecture Documents
24
25. MetaFormulaforCephDeployments
• Have a general understanding of the use cases you want to support with Ceph
• Understand the kind of performance or cost/performance you want to deliver
• Refer to a reference architecture resource to match your use case(s) with
known and measured reference architectures:
• http://www.redhat.com/en/resources/performance-and-sizing-guide-red-hat-
ceph-storage-qct-servers
• https://www.redhat.com/en/files/resources/en-rhst-cephstorage-supermicro-
INC0270868_v2_0715.pdf
• These documents have Ceph config, tuning and best practices guidance
• Additional help is available from Red Hat, including support and quick start
25