SlideShare a Scribd company logo
1
Ceph as Software-Define StorageCeph as Software-Define Storage
(SDS)(SDS)
AUT LinuxFest 2017AUT LinuxFest 2017
Mahmoud Shiri VaraminiMahmoud Shiri Varamini
(RHCSA-RHCE-ITILv3-Advance Bash Scripting)(RHCSA-RHCE-ITILv3-Advance Bash Scripting)
shirivaramini@gmail.comshirivaramini@gmail.com
Agenda
• Software Define Storage:The Future of StorageSoftware Define Storage:The Future of Storage
• RedHat Ceph Storage A platform for petabyte-scale storageRedHat Ceph Storage A platform for petabyte-scale storage
• Ceph Architecture and ComponentsCeph Architecture and Components
• Real World Red Hat Ceph StorageReal World Red Hat Ceph Storage
• ReferenceReference
• QuestionsQuestions
3
Software Define Storage:Software Define Storage:
The Future of StorageThe Future of Storage
What's data storage?(1)
●
data storage is the place where data is held in an electromagnetic or
optical or mechanical form for access by a computer processor.
What's data storage?(2)
Storage is used to describe the devices and data connected to the
computer through Input/Output (I/O) operations. hard disk and tape
systems and other forms of storage that don't include computer
memory and other in-computer storage.
Type of Storage(1)
●
File-level storage
●
Block-level storage
●
Object storage
Type of Storage(2)
●
Data model (structured vs unstructured)
●
Protocol (NFS,SMB,iSCSI,FC)
●
Type of access (locally,remote)
●
Access data (server,network,API)
●
Caching and meta data mechanism
●
Performance and Scability
●
Use case (physical,virtual,cloud)
●
Real world scenario
What Exactly is Software Defined
Storage?
●
Software-Defined Storage (SDS) separates the storage software
from the storage hardware.
●
a model that allows organizations to buy storage hardware systems
from multiple vendors that address specific use cases but have the
ability to operate, not just manage, them from a single interface.
Why consider software-defined storage
(SDS)?
●
Traditional data storage cannot overcome today’s challenges of scale,
integration and flexibility.
●
Simply adding storage capacity drives up costs for both storage and
management.
●
Manually managing across heterogeneous storage systems, silos
and clouds increases administrative overhead.
●
Cloud environments and analytics, mobile and social applications
require efficient, scalable solutions that deliver more value from
data.
software-defined storage pros
traditional storage model vs SDS model
Benefits of SDS
●
Bring your own hardware: take advantage of commodity prices.
●
Built-in “IT Deflation”: keep up with the increased demand for
storage.
●
Hardware independent: lives on beyond the life of the hardware.
●
Flexibility to scale: as much or as little as required.
●
Low ongoing costs: perpetual license followed by annual
maintenance.
●
Gain new features: just by upgrading the software.
●
Simplified management: compute and storage managed together.
Limitations of SDS
●
more components to manage (as software and hardware are
independent)
●
Solutions are typically less mature, hardened and sophisticated
than traditional storage arrays (they have not been around for as long)
●
May require more infrastructure to match the low latency and high
performance of a storage array (as it is a distributed architecture)
THE FUTURE OF STORAGE
15
RedHat Ceph StorageRedHat Ceph Storage
A platform for petabyte-scaleA platform for petabyte-scale
storagestorage
Red Hat Ceph Storage Overview
Ceph is an open source project, which provides software-defined,
unified storage solutions. Ceph is a distributed storage system which
is massively scalable and high-performing without any single point
of failure. From the roots, it has been designed to be highly scalable, up
to exabyte level and beyond while running on general-purpose
commodity hardware.
Ceph Releases
There are three to four stable releases a year:
●
Long Term Stable: until the next two LTS are published
●
Stable release until the next stable release is published
●
Development / testing release: no backports
x.0.z - development releases (for early testers and the brave at heart)
x.1.z - release candidates (for test clusters, brave users)
x.2.z - stable/bugfix releases (for users)
Red Hat Ceph Storage Use cases
Red Hat Ceph Storage is specifically designed for today’s modern
workloads_like OpenStack and data analytics—as well as rich media
and archival storage.it can adapt to growing cloud infrastructures,
serve as a massively scalable object storage system, simplify media
repositories, and simplify backup and recovery.
Red Hat Ceph Storage Use cases:
Cloud infrastructure
●
expected to react quickly to changing infrastructure demands—
that’s just the nature of today’s IT.
●
cloud infrastructure needs scale-out storage, and the best option for
that is Ceph. Red Hat Ceph Storage is tightly integrated with
OpenStack and scales with user needs.
Red Hat Ceph Storage Use cases:
Backup and recovery
●
Datacenters have been backing data up and recovering files for
decades.backup and recovery are still high among IT concerns.
●
Ceph Storage can replace tape libraries or expensive, proprietary
storage arrays. Deployed in cluster networks,Ceph Storage will run—
by default—a failure-recovery processes and replicate objects 3 times
over.
21
Ceph Architecture andCeph Architecture and
ComponentsComponents
Red Hat Ceph Storage
we will cover the following topics:
●
Ceph storage architecture
●
Ceph Reliable Autonomic Distributed Object Store (RADOS)
●
Ceph Object Storage Device (OSD)
●
Ceph monitors (MON)
●
librados
●
The Ceph block storage
●
Ceph Object Gateway
●
Ceph MDS and CephFS
Ceph storage architecture (1)
●
Ceph storage cluster is made up of several different software
daemons.
●
Each of these daemons takes care of unique Ceph functionalities
and adds values to its corresponding components and Each of
these daemons is separated from the others.
●
This is one of the things that keeps Ceph cluster storage costs down
when compared to an enterprise, proprietary black box storage
system.
Ceph storage architecture (2)
Reliable Autonomic Distributed Object
Store (RADOS)
●
is the foundation of the Ceph storage cluster.
●
Everything in Ceph is stored in the form of objects, and the RADOS
object store is responsible for storing these objects, irrespective of
their data type.
●
The RADOS layer makes sure that data always remains in a
consistent state and is reliable.
●
For data consistency, it performs data replication, failure detection,
and recovery, as well as data migration and rebalancing across
cluster nodes.
Object Storage Device (OSD)
●
As soon as your application issues a write operation to your Ceph
cluster, data gets stored in Ceph Object Storage Device (OSD) in
the form of objects.
●
Only component of a Ceph cluster where actual user data is stored
and the same data is retrieved when a client issues a read operation.
●
usually, one OSD daemon is tied to one physical disk of your
cluster.
●
the total number of physical disks in your Ceph cluster is the number of
OSD daemons working underneath to store user data to each physical
disk.
Ceph monitors (MONs)
●
track the health of the entire cluster by keeping a map of the cluster
state, which includes OSD, MON, PG, and CRUSH maps.
●
All the cluster nodes report to monitor nodes and share information
about every change in their state.
●
maintains a separate map of information for each component.
●
does not store actual data; this is the job of OSD
Librados
●
The librados library is a convenient way to get access to RADOS
with the support of the PHP, Ruby, Java, Python, C, and C++
programming languages.
●
provides a native interface to the Ceph storage cluster, RADOS,
and a base for other services such as RBD, RGW, as well as the
POSIX interface for CephFS.
●
librados API supports direct access to RADOS and enables you to
create your own interface to the Ceph storage cluster.
Ceph Block Device
●
known as RADOS block device (RBD), provides block storage,
which can be mapped, formatted, and mounted just like any other disk
to the server.
●
Ceph block device is equipped with enterprise storage features such
as thin provisioning and snapshots.
Ceph Object Gateway
●
also known as RADOS gateway (RGW), provides a RESTful API
interface, which is compatible with Amazon S3 (Simple Storage
Service) and OpenStack Object Storage API (Swift).
●
RGW also supports the multitenancy and OpenStack Keystone
authentication services.
Ceph Metadata Server (MDS)
●
keeps track of file hierarchy and stores metadata only for CephFS.
●
Manages metadata for a POSIX-compliant shared filesystem
●
File metadata (owner, timestamps, mode, etc.)
●
Stores metadata in RADOS
32
Real World Red Hat CephReal World Red Hat Ceph
StorageStorage
International Users
●
Many different individuals and organizations are making long-term
strategic bets on Ceph, and that number is growing every day!
According indeed.com , almost 620 jobs opportunity active on U.S.A
that 9.2% of them earn more than 125000$ per year!!
Red Hat Ceph storage specialist jobRed Hat Ceph storage specialist job
opportunity and Salaryopportunity and Salary
What Now?What Now?
To Learn More
37
ReferenceReference
Reference
●
●
https://www-03.ibm.com/systems/storage/software-defined-storage/
●
https://storageswiss.com/2016/04/14/what-exactly-is-software-defined-storage/
●
http://blog.snsltd.co.uk/what-are-the-pros-and-cons-of-software-defined-storage
/
●
https://www.redhat.com/en/technologies/storage/ceph
●
https://www.redhat.com/en/technologies/storage/ceph/use-cases
●
http://docs.ceph.com/docs/master/releases/
●
http://ceph.com/users/
●
http://docs.ceph.com/docs/master/
●
Learning ceph,Karan Singh,Published by Packt Publishing Ltd,2015
39
QuestionsQuestions

More Related Content

What's hot

Ceph and RocksDB
Ceph and RocksDBCeph and RocksDB
Ceph and RocksDB
Sage Weil
 
Storage 101: Rook and Ceph - Open Infrastructure Denver 2019
Storage 101: Rook and Ceph - Open Infrastructure Denver 2019Storage 101: Rook and Ceph - Open Infrastructure Denver 2019
Storage 101: Rook and Ceph - Open Infrastructure Denver 2019
Sean Cohen
 
Ceph RBD Update - June 2021
Ceph RBD Update - June 2021Ceph RBD Update - June 2021
Ceph RBD Update - June 2021
Ceph Community
 
Nick Fisk - low latency Ceph
Nick Fisk - low latency CephNick Fisk - low latency Ceph
Nick Fisk - low latency Ceph
ShapeBlue
 
Introduction into Ceph storage for OpenStack
Introduction into Ceph storage for OpenStackIntroduction into Ceph storage for OpenStack
Introduction into Ceph storage for OpenStack
OpenStack_Online
 
Ceph
CephCeph
Storage tiering and erasure coding in Ceph (SCaLE13x)
Storage tiering and erasure coding in Ceph (SCaLE13x)Storage tiering and erasure coding in Ceph (SCaLE13x)
Storage tiering and erasure coding in Ceph (SCaLE13x)
Sage Weil
 
Ceph Block Devices: A Deep Dive
Ceph Block Devices:  A Deep DiveCeph Block Devices:  A Deep Dive
Ceph Block Devices: A Deep Dive
Red_Hat_Storage
 
Ceph Month 2021: RADOS Update
Ceph Month 2021: RADOS UpdateCeph Month 2021: RADOS Update
Ceph Month 2021: RADOS Update
Ceph Community
 
What you need to know about ceph
What you need to know about cephWhat you need to know about ceph
What you need to know about ceph
Emma Haruka Iwao
 
Crimson: Ceph for the Age of NVMe and Persistent Memory
Crimson: Ceph for the Age of NVMe and Persistent MemoryCrimson: Ceph for the Age of NVMe and Persistent Memory
Crimson: Ceph for the Age of NVMe and Persistent Memory
ScyllaDB
 
BlueStore, A New Storage Backend for Ceph, One Year In
BlueStore, A New Storage Backend for Ceph, One Year InBlueStore, A New Storage Backend for Ceph, One Year In
BlueStore, A New Storage Backend for Ceph, One Year In
Sage Weil
 
[OpenStack Days Korea 2016] Track1 - All flash CEPH 구성 및 최적화
[OpenStack Days Korea 2016] Track1 - All flash CEPH 구성 및 최적화[OpenStack Days Korea 2016] Track1 - All flash CEPH 구성 및 최적화
[OpenStack Days Korea 2016] Track1 - All flash CEPH 구성 및 최적화
OpenStack Korea Community
 
BlueStore: a new, faster storage backend for Ceph
BlueStore: a new, faster storage backend for CephBlueStore: a new, faster storage backend for Ceph
BlueStore: a new, faster storage backend for Ceph
Sage Weil
 
Tutorial ceph-2
Tutorial ceph-2Tutorial ceph-2
Tutorial ceph-2
Tommy Lee
 
2021.02 new in Ceph Pacific Dashboard
2021.02 new in Ceph Pacific Dashboard2021.02 new in Ceph Pacific Dashboard
2021.02 new in Ceph Pacific Dashboard
Ceph Community
 
BlueStore: a new, faster storage backend for Ceph
BlueStore: a new, faster storage backend for CephBlueStore: a new, faster storage backend for Ceph
BlueStore: a new, faster storage backend for Ceph
Sage Weil
 
Ceph scale testing with 10 Billion Objects
Ceph scale testing with 10 Billion ObjectsCeph scale testing with 10 Billion Objects
Ceph scale testing with 10 Billion Objects
Karan Singh
 
Ceph Day Beijing - Ceph All-Flash Array Design Based on NUMA Architecture
Ceph Day Beijing - Ceph All-Flash Array Design Based on NUMA ArchitectureCeph Day Beijing - Ceph All-Flash Array Design Based on NUMA Architecture
Ceph Day Beijing - Ceph All-Flash Array Design Based on NUMA Architecture
Danielle Womboldt
 
Ceph Tech Talk: Ceph at DigitalOcean
Ceph Tech Talk: Ceph at DigitalOceanCeph Tech Talk: Ceph at DigitalOcean
Ceph Tech Talk: Ceph at DigitalOcean
Ceph Community
 

What's hot (20)

Ceph and RocksDB
Ceph and RocksDBCeph and RocksDB
Ceph and RocksDB
 
Storage 101: Rook and Ceph - Open Infrastructure Denver 2019
Storage 101: Rook and Ceph - Open Infrastructure Denver 2019Storage 101: Rook and Ceph - Open Infrastructure Denver 2019
Storage 101: Rook and Ceph - Open Infrastructure Denver 2019
 
Ceph RBD Update - June 2021
Ceph RBD Update - June 2021Ceph RBD Update - June 2021
Ceph RBD Update - June 2021
 
Nick Fisk - low latency Ceph
Nick Fisk - low latency CephNick Fisk - low latency Ceph
Nick Fisk - low latency Ceph
 
Introduction into Ceph storage for OpenStack
Introduction into Ceph storage for OpenStackIntroduction into Ceph storage for OpenStack
Introduction into Ceph storage for OpenStack
 
Ceph
CephCeph
Ceph
 
Storage tiering and erasure coding in Ceph (SCaLE13x)
Storage tiering and erasure coding in Ceph (SCaLE13x)Storage tiering and erasure coding in Ceph (SCaLE13x)
Storage tiering and erasure coding in Ceph (SCaLE13x)
 
Ceph Block Devices: A Deep Dive
Ceph Block Devices:  A Deep DiveCeph Block Devices:  A Deep Dive
Ceph Block Devices: A Deep Dive
 
Ceph Month 2021: RADOS Update
Ceph Month 2021: RADOS UpdateCeph Month 2021: RADOS Update
Ceph Month 2021: RADOS Update
 
What you need to know about ceph
What you need to know about cephWhat you need to know about ceph
What you need to know about ceph
 
Crimson: Ceph for the Age of NVMe and Persistent Memory
Crimson: Ceph for the Age of NVMe and Persistent MemoryCrimson: Ceph for the Age of NVMe and Persistent Memory
Crimson: Ceph for the Age of NVMe and Persistent Memory
 
BlueStore, A New Storage Backend for Ceph, One Year In
BlueStore, A New Storage Backend for Ceph, One Year InBlueStore, A New Storage Backend for Ceph, One Year In
BlueStore, A New Storage Backend for Ceph, One Year In
 
[OpenStack Days Korea 2016] Track1 - All flash CEPH 구성 및 최적화
[OpenStack Days Korea 2016] Track1 - All flash CEPH 구성 및 최적화[OpenStack Days Korea 2016] Track1 - All flash CEPH 구성 및 최적화
[OpenStack Days Korea 2016] Track1 - All flash CEPH 구성 및 최적화
 
BlueStore: a new, faster storage backend for Ceph
BlueStore: a new, faster storage backend for CephBlueStore: a new, faster storage backend for Ceph
BlueStore: a new, faster storage backend for Ceph
 
Tutorial ceph-2
Tutorial ceph-2Tutorial ceph-2
Tutorial ceph-2
 
2021.02 new in Ceph Pacific Dashboard
2021.02 new in Ceph Pacific Dashboard2021.02 new in Ceph Pacific Dashboard
2021.02 new in Ceph Pacific Dashboard
 
BlueStore: a new, faster storage backend for Ceph
BlueStore: a new, faster storage backend for CephBlueStore: a new, faster storage backend for Ceph
BlueStore: a new, faster storage backend for Ceph
 
Ceph scale testing with 10 Billion Objects
Ceph scale testing with 10 Billion ObjectsCeph scale testing with 10 Billion Objects
Ceph scale testing with 10 Billion Objects
 
Ceph Day Beijing - Ceph All-Flash Array Design Based on NUMA Architecture
Ceph Day Beijing - Ceph All-Flash Array Design Based on NUMA ArchitectureCeph Day Beijing - Ceph All-Flash Array Design Based on NUMA Architecture
Ceph Day Beijing - Ceph All-Flash Array Design Based on NUMA Architecture
 
Ceph Tech Talk: Ceph at DigitalOcean
Ceph Tech Talk: Ceph at DigitalOceanCeph Tech Talk: Ceph at DigitalOcean
Ceph Tech Talk: Ceph at DigitalOcean
 

Similar to Ceph as software define storage

Red Hat Storage 2014 - Product(s) Overview
Red Hat Storage 2014 - Product(s) OverviewRed Hat Storage 2014 - Product(s) Overview
Red Hat Storage 2014 - Product(s) Overview
Marcel Hergaarden
 
OSDC 2015: John Spray | The Ceph Storage System
OSDC 2015: John Spray | The Ceph Storage SystemOSDC 2015: John Spray | The Ceph Storage System
OSDC 2015: John Spray | The Ceph Storage System
NETWAYS
 
Red hat storage el almacenamiento disruptivo
Red hat storage el almacenamiento disruptivoRed hat storage el almacenamiento disruptivo
Red hat storage el almacenamiento disruptivo
Nextel S.A.
 
Red Hat Storage Day Boston - OpenStack + Ceph Storage
Red Hat Storage Day Boston - OpenStack + Ceph StorageRed Hat Storage Day Boston - OpenStack + Ceph Storage
Red Hat Storage Day Boston - OpenStack + Ceph Storage
Red_Hat_Storage
 
2015 open storage workshop ceph software defined storage
2015 open storage workshop   ceph software defined storage2015 open storage workshop   ceph software defined storage
2015 open storage workshop ceph software defined storage
Andrew Underwood
 
Red hat ceph storage customer presentation
Red hat ceph storage customer presentationRed hat ceph storage customer presentation
Red hat ceph storage customer presentation
Rodrigo Missiaggia
 
Peanut Butter and jelly: Mapping the deep Integration between Ceph and OpenStack
Peanut Butter and jelly: Mapping the deep Integration between Ceph and OpenStackPeanut Butter and jelly: Mapping the deep Integration between Ceph and OpenStack
Peanut Butter and jelly: Mapping the deep Integration between Ceph and OpenStack
Sean Cohen
 
A Look at the Future of Storage
A Look at the Future of StorageA Look at the Future of Storage
A Look at the Future of Storage
IT Brand Pulse
 
The IBM Data Engine for NoSQL on IBM Power Systems™
The IBM Data Engine for NoSQL on IBM Power Systems™The IBM Data Engine for NoSQL on IBM Power Systems™
The IBM Data Engine for NoSQL on IBM Power Systems™
IBM Power Systems
 
Gestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMF
Gestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMFGestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMF
Gestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMF
SUSE Italy
 
Scalable POSIX File Systems in the Cloud
Scalable POSIX File Systems in the CloudScalable POSIX File Systems in the Cloud
Scalable POSIX File Systems in the Cloud
Red_Hat_Storage
 
Ceph Day London 2014 - The current state of CephFS development
Ceph Day London 2014 - The current state of CephFS development Ceph Day London 2014 - The current state of CephFS development
Ceph Day London 2014 - The current state of CephFS development
Ceph Community
 
The Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red Hat
The Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red HatThe Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red Hat
The Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red Hat
OpenStack
 
End of RAID as we know it with Ceph Replication
End of RAID as we know it with Ceph ReplicationEnd of RAID as we know it with Ceph Replication
End of RAID as we know it with Ceph Replication
Ceph Community
 
Quick-and-Easy Deployment of a Ceph Storage Cluster
Quick-and-Easy Deployment of a Ceph Storage ClusterQuick-and-Easy Deployment of a Ceph Storage Cluster
Quick-and-Easy Deployment of a Ceph Storage Cluster
Patrick Quairoli
 
Red Hat Ceph Storage: Past, Present and Future
Red Hat Ceph Storage: Past, Present and FutureRed Hat Ceph Storage: Past, Present and Future
Red Hat Ceph Storage: Past, Present and Future
Red_Hat_Storage
 
Red Hat Storage Day LA - Persistent Storage for Linux Containers
Red Hat Storage Day LA - Persistent Storage for Linux Containers Red Hat Storage Day LA - Persistent Storage for Linux Containers
Red Hat Storage Day LA - Persistent Storage for Linux Containers
Red_Hat_Storage
 
VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...
VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...
VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...
VMworld
 
New Ceph capabilities and Reference Architectures
New Ceph capabilities and Reference ArchitecturesNew Ceph capabilities and Reference Architectures
New Ceph capabilities and Reference Architectures
Kamesh Pemmaraju
 
Software Defined Storage, Big Data and Ceph - What Is all the Fuss About?
Software Defined Storage, Big Data and Ceph - What Is all the Fuss About?Software Defined Storage, Big Data and Ceph - What Is all the Fuss About?
Software Defined Storage, Big Data and Ceph - What Is all the Fuss About?
Red_Hat_Storage
 

Similar to Ceph as software define storage (20)

Red Hat Storage 2014 - Product(s) Overview
Red Hat Storage 2014 - Product(s) OverviewRed Hat Storage 2014 - Product(s) Overview
Red Hat Storage 2014 - Product(s) Overview
 
OSDC 2015: John Spray | The Ceph Storage System
OSDC 2015: John Spray | The Ceph Storage SystemOSDC 2015: John Spray | The Ceph Storage System
OSDC 2015: John Spray | The Ceph Storage System
 
Red hat storage el almacenamiento disruptivo
Red hat storage el almacenamiento disruptivoRed hat storage el almacenamiento disruptivo
Red hat storage el almacenamiento disruptivo
 
Red Hat Storage Day Boston - OpenStack + Ceph Storage
Red Hat Storage Day Boston - OpenStack + Ceph StorageRed Hat Storage Day Boston - OpenStack + Ceph Storage
Red Hat Storage Day Boston - OpenStack + Ceph Storage
 
2015 open storage workshop ceph software defined storage
2015 open storage workshop   ceph software defined storage2015 open storage workshop   ceph software defined storage
2015 open storage workshop ceph software defined storage
 
Red hat ceph storage customer presentation
Red hat ceph storage customer presentationRed hat ceph storage customer presentation
Red hat ceph storage customer presentation
 
Peanut Butter and jelly: Mapping the deep Integration between Ceph and OpenStack
Peanut Butter and jelly: Mapping the deep Integration between Ceph and OpenStackPeanut Butter and jelly: Mapping the deep Integration between Ceph and OpenStack
Peanut Butter and jelly: Mapping the deep Integration between Ceph and OpenStack
 
A Look at the Future of Storage
A Look at the Future of StorageA Look at the Future of Storage
A Look at the Future of Storage
 
The IBM Data Engine for NoSQL on IBM Power Systems™
The IBM Data Engine for NoSQL on IBM Power Systems™The IBM Data Engine for NoSQL on IBM Power Systems™
The IBM Data Engine for NoSQL on IBM Power Systems™
 
Gestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMF
Gestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMFGestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMF
Gestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMF
 
Scalable POSIX File Systems in the Cloud
Scalable POSIX File Systems in the CloudScalable POSIX File Systems in the Cloud
Scalable POSIX File Systems in the Cloud
 
Ceph Day London 2014 - The current state of CephFS development
Ceph Day London 2014 - The current state of CephFS development Ceph Day London 2014 - The current state of CephFS development
Ceph Day London 2014 - The current state of CephFS development
 
The Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red Hat
The Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red HatThe Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red Hat
The Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red Hat
 
End of RAID as we know it with Ceph Replication
End of RAID as we know it with Ceph ReplicationEnd of RAID as we know it with Ceph Replication
End of RAID as we know it with Ceph Replication
 
Quick-and-Easy Deployment of a Ceph Storage Cluster
Quick-and-Easy Deployment of a Ceph Storage ClusterQuick-and-Easy Deployment of a Ceph Storage Cluster
Quick-and-Easy Deployment of a Ceph Storage Cluster
 
Red Hat Ceph Storage: Past, Present and Future
Red Hat Ceph Storage: Past, Present and FutureRed Hat Ceph Storage: Past, Present and Future
Red Hat Ceph Storage: Past, Present and Future
 
Red Hat Storage Day LA - Persistent Storage for Linux Containers
Red Hat Storage Day LA - Persistent Storage for Linux Containers Red Hat Storage Day LA - Persistent Storage for Linux Containers
Red Hat Storage Day LA - Persistent Storage for Linux Containers
 
VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...
VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...
VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...
 
New Ceph capabilities and Reference Architectures
New Ceph capabilities and Reference ArchitecturesNew Ceph capabilities and Reference Architectures
New Ceph capabilities and Reference Architectures
 
Software Defined Storage, Big Data and Ceph - What Is all the Fuss About?
Software Defined Storage, Big Data and Ceph - What Is all the Fuss About?Software Defined Storage, Big Data and Ceph - What Is all the Fuss About?
Software Defined Storage, Big Data and Ceph - What Is all the Fuss About?
 

Recently uploaded

Artificia Intellicence and XPath Extension Functions
Artificia Intellicence and XPath Extension FunctionsArtificia Intellicence and XPath Extension Functions
Artificia Intellicence and XPath Extension Functions
Octavian Nadolu
 
Using Xen Hypervisor for Functional Safety
Using Xen Hypervisor for Functional SafetyUsing Xen Hypervisor for Functional Safety
Using Xen Hypervisor for Functional Safety
Ayan Halder
 
LORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOM
LORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOMLORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOM
LORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOM
lorraineandreiamcidl
 
openEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain SecurityopenEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain Security
Shane Coughlan
 
May Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdfMay Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdf
Adele Miller
 
GreenCode-A-VSCode-Plugin--Dario-Jurisic
GreenCode-A-VSCode-Plugin--Dario-JurisicGreenCode-A-VSCode-Plugin--Dario-Jurisic
GreenCode-A-VSCode-Plugin--Dario-Jurisic
Green Software Development
 
Vitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke Java Microservices Resume.pdfVitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke
 
Cracking the code review at SpringIO 2024
Cracking the code review at SpringIO 2024Cracking the code review at SpringIO 2024
Cracking the code review at SpringIO 2024
Paco van Beckhoven
 
Quarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden ExtensionsQuarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden Extensions
Max Andersen
 
SWEBOK and Education at FUSE Okinawa 2024
SWEBOK and Education at FUSE Okinawa 2024SWEBOK and Education at FUSE Okinawa 2024
SWEBOK and Education at FUSE Okinawa 2024
Hironori Washizaki
 
Codeigniter VS Cakephp Which is Better for Web Development.pdf
Codeigniter VS Cakephp Which is Better for Web Development.pdfCodeigniter VS Cakephp Which is Better for Web Development.pdf
Codeigniter VS Cakephp Which is Better for Web Development.pdf
Semiosis Software Private Limited
 
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
mz5nrf0n
 
Hand Rolled Applicative User Validation Code Kata
Hand Rolled Applicative User ValidationCode KataHand Rolled Applicative User ValidationCode Kata
Hand Rolled Applicative User Validation Code Kata
Philip Schwarz
 
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of CodeA Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
Aftab Hussain
 
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteAI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
Google
 
Enterprise Resource Planning System in Telangana
Enterprise Resource Planning System in TelanganaEnterprise Resource Planning System in Telangana
Enterprise Resource Planning System in Telangana
NYGGS Automation Suite
 
APIs for Browser Automation (MoT Meetup 2024)
APIs for Browser Automation (MoT Meetup 2024)APIs for Browser Automation (MoT Meetup 2024)
APIs for Browser Automation (MoT Meetup 2024)
Boni García
 
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit ParisNeo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j
 
OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024
OpenMetadata
 
Mobile App Development Company In Noida | Drona Infotech
Mobile App Development Company In Noida | Drona InfotechMobile App Development Company In Noida | Drona Infotech
Mobile App Development Company In Noida | Drona Infotech
Drona Infotech
 

Recently uploaded (20)

Artificia Intellicence and XPath Extension Functions
Artificia Intellicence and XPath Extension FunctionsArtificia Intellicence and XPath Extension Functions
Artificia Intellicence and XPath Extension Functions
 
Using Xen Hypervisor for Functional Safety
Using Xen Hypervisor for Functional SafetyUsing Xen Hypervisor for Functional Safety
Using Xen Hypervisor for Functional Safety
 
LORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOM
LORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOMLORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOM
LORRAINE ANDREI_LEQUIGAN_HOW TO USE ZOOM
 
openEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain SecurityopenEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain Security
 
May Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdfMay Marketo Masterclass, London MUG May 22 2024.pdf
May Marketo Masterclass, London MUG May 22 2024.pdf
 
GreenCode-A-VSCode-Plugin--Dario-Jurisic
GreenCode-A-VSCode-Plugin--Dario-JurisicGreenCode-A-VSCode-Plugin--Dario-Jurisic
GreenCode-A-VSCode-Plugin--Dario-Jurisic
 
Vitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke Java Microservices Resume.pdfVitthal Shirke Java Microservices Resume.pdf
Vitthal Shirke Java Microservices Resume.pdf
 
Cracking the code review at SpringIO 2024
Cracking the code review at SpringIO 2024Cracking the code review at SpringIO 2024
Cracking the code review at SpringIO 2024
 
Quarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden ExtensionsQuarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden Extensions
 
SWEBOK and Education at FUSE Okinawa 2024
SWEBOK and Education at FUSE Okinawa 2024SWEBOK and Education at FUSE Okinawa 2024
SWEBOK and Education at FUSE Okinawa 2024
 
Codeigniter VS Cakephp Which is Better for Web Development.pdf
Codeigniter VS Cakephp Which is Better for Web Development.pdfCodeigniter VS Cakephp Which is Better for Web Development.pdf
Codeigniter VS Cakephp Which is Better for Web Development.pdf
 
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
原版定制美国纽约州立大学奥尔巴尼分校毕业证学位证书原版一模一样
 
Hand Rolled Applicative User Validation Code Kata
Hand Rolled Applicative User ValidationCode KataHand Rolled Applicative User ValidationCode Kata
Hand Rolled Applicative User Validation Code Kata
 
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of CodeA Study of Variable-Role-based Feature Enrichment in Neural Models of Code
A Study of Variable-Role-based Feature Enrichment in Neural Models of Code
 
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteAI Pilot Review: The World’s First Virtual Assistant Marketing Suite
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
 
Enterprise Resource Planning System in Telangana
Enterprise Resource Planning System in TelanganaEnterprise Resource Planning System in Telangana
Enterprise Resource Planning System in Telangana
 
APIs for Browser Automation (MoT Meetup 2024)
APIs for Browser Automation (MoT Meetup 2024)APIs for Browser Automation (MoT Meetup 2024)
APIs for Browser Automation (MoT Meetup 2024)
 
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit ParisNeo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
 
OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024
 
Mobile App Development Company In Noida | Drona Infotech
Mobile App Development Company In Noida | Drona InfotechMobile App Development Company In Noida | Drona Infotech
Mobile App Development Company In Noida | Drona Infotech
 

Ceph as software define storage

  • 1. 1 Ceph as Software-Define StorageCeph as Software-Define Storage (SDS)(SDS) AUT LinuxFest 2017AUT LinuxFest 2017 Mahmoud Shiri VaraminiMahmoud Shiri Varamini (RHCSA-RHCE-ITILv3-Advance Bash Scripting)(RHCSA-RHCE-ITILv3-Advance Bash Scripting) shirivaramini@gmail.comshirivaramini@gmail.com
  • 2. Agenda • Software Define Storage:The Future of StorageSoftware Define Storage:The Future of Storage • RedHat Ceph Storage A platform for petabyte-scale storageRedHat Ceph Storage A platform for petabyte-scale storage • Ceph Architecture and ComponentsCeph Architecture and Components • Real World Red Hat Ceph StorageReal World Red Hat Ceph Storage • ReferenceReference • QuestionsQuestions
  • 3. 3 Software Define Storage:Software Define Storage: The Future of StorageThe Future of Storage
  • 4. What's data storage?(1) ● data storage is the place where data is held in an electromagnetic or optical or mechanical form for access by a computer processor.
  • 5. What's data storage?(2) Storage is used to describe the devices and data connected to the computer through Input/Output (I/O) operations. hard disk and tape systems and other forms of storage that don't include computer memory and other in-computer storage.
  • 6. Type of Storage(1) ● File-level storage ● Block-level storage ● Object storage
  • 7. Type of Storage(2) ● Data model (structured vs unstructured) ● Protocol (NFS,SMB,iSCSI,FC) ● Type of access (locally,remote) ● Access data (server,network,API) ● Caching and meta data mechanism ● Performance and Scability ● Use case (physical,virtual,cloud) ● Real world scenario
  • 8. What Exactly is Software Defined Storage? ● Software-Defined Storage (SDS) separates the storage software from the storage hardware. ● a model that allows organizations to buy storage hardware systems from multiple vendors that address specific use cases but have the ability to operate, not just manage, them from a single interface.
  • 9. Why consider software-defined storage (SDS)? ● Traditional data storage cannot overcome today’s challenges of scale, integration and flexibility. ● Simply adding storage capacity drives up costs for both storage and management. ● Manually managing across heterogeneous storage systems, silos and clouds increases administrative overhead. ● Cloud environments and analytics, mobile and social applications require efficient, scalable solutions that deliver more value from data.
  • 12. Benefits of SDS ● Bring your own hardware: take advantage of commodity prices. ● Built-in “IT Deflation”: keep up with the increased demand for storage. ● Hardware independent: lives on beyond the life of the hardware. ● Flexibility to scale: as much or as little as required. ● Low ongoing costs: perpetual license followed by annual maintenance. ● Gain new features: just by upgrading the software. ● Simplified management: compute and storage managed together.
  • 13. Limitations of SDS ● more components to manage (as software and hardware are independent) ● Solutions are typically less mature, hardened and sophisticated than traditional storage arrays (they have not been around for as long) ● May require more infrastructure to match the low latency and high performance of a storage array (as it is a distributed architecture)
  • 14. THE FUTURE OF STORAGE
  • 15. 15 RedHat Ceph StorageRedHat Ceph Storage A platform for petabyte-scaleA platform for petabyte-scale storagestorage
  • 16. Red Hat Ceph Storage Overview Ceph is an open source project, which provides software-defined, unified storage solutions. Ceph is a distributed storage system which is massively scalable and high-performing without any single point of failure. From the roots, it has been designed to be highly scalable, up to exabyte level and beyond while running on general-purpose commodity hardware.
  • 17. Ceph Releases There are three to four stable releases a year: ● Long Term Stable: until the next two LTS are published ● Stable release until the next stable release is published ● Development / testing release: no backports x.0.z - development releases (for early testers and the brave at heart) x.1.z - release candidates (for test clusters, brave users) x.2.z - stable/bugfix releases (for users)
  • 18. Red Hat Ceph Storage Use cases Red Hat Ceph Storage is specifically designed for today’s modern workloads_like OpenStack and data analytics—as well as rich media and archival storage.it can adapt to growing cloud infrastructures, serve as a massively scalable object storage system, simplify media repositories, and simplify backup and recovery.
  • 19. Red Hat Ceph Storage Use cases: Cloud infrastructure ● expected to react quickly to changing infrastructure demands— that’s just the nature of today’s IT. ● cloud infrastructure needs scale-out storage, and the best option for that is Ceph. Red Hat Ceph Storage is tightly integrated with OpenStack and scales with user needs.
  • 20. Red Hat Ceph Storage Use cases: Backup and recovery ● Datacenters have been backing data up and recovering files for decades.backup and recovery are still high among IT concerns. ● Ceph Storage can replace tape libraries or expensive, proprietary storage arrays. Deployed in cluster networks,Ceph Storage will run— by default—a failure-recovery processes and replicate objects 3 times over.
  • 21. 21 Ceph Architecture andCeph Architecture and ComponentsComponents
  • 22. Red Hat Ceph Storage we will cover the following topics: ● Ceph storage architecture ● Ceph Reliable Autonomic Distributed Object Store (RADOS) ● Ceph Object Storage Device (OSD) ● Ceph monitors (MON) ● librados ● The Ceph block storage ● Ceph Object Gateway ● Ceph MDS and CephFS
  • 23. Ceph storage architecture (1) ● Ceph storage cluster is made up of several different software daemons. ● Each of these daemons takes care of unique Ceph functionalities and adds values to its corresponding components and Each of these daemons is separated from the others. ● This is one of the things that keeps Ceph cluster storage costs down when compared to an enterprise, proprietary black box storage system.
  • 25. Reliable Autonomic Distributed Object Store (RADOS) ● is the foundation of the Ceph storage cluster. ● Everything in Ceph is stored in the form of objects, and the RADOS object store is responsible for storing these objects, irrespective of their data type. ● The RADOS layer makes sure that data always remains in a consistent state and is reliable. ● For data consistency, it performs data replication, failure detection, and recovery, as well as data migration and rebalancing across cluster nodes.
  • 26. Object Storage Device (OSD) ● As soon as your application issues a write operation to your Ceph cluster, data gets stored in Ceph Object Storage Device (OSD) in the form of objects. ● Only component of a Ceph cluster where actual user data is stored and the same data is retrieved when a client issues a read operation. ● usually, one OSD daemon is tied to one physical disk of your cluster. ● the total number of physical disks in your Ceph cluster is the number of OSD daemons working underneath to store user data to each physical disk.
  • 27. Ceph monitors (MONs) ● track the health of the entire cluster by keeping a map of the cluster state, which includes OSD, MON, PG, and CRUSH maps. ● All the cluster nodes report to monitor nodes and share information about every change in their state. ● maintains a separate map of information for each component. ● does not store actual data; this is the job of OSD
  • 28. Librados ● The librados library is a convenient way to get access to RADOS with the support of the PHP, Ruby, Java, Python, C, and C++ programming languages. ● provides a native interface to the Ceph storage cluster, RADOS, and a base for other services such as RBD, RGW, as well as the POSIX interface for CephFS. ● librados API supports direct access to RADOS and enables you to create your own interface to the Ceph storage cluster.
  • 29. Ceph Block Device ● known as RADOS block device (RBD), provides block storage, which can be mapped, formatted, and mounted just like any other disk to the server. ● Ceph block device is equipped with enterprise storage features such as thin provisioning and snapshots.
  • 30. Ceph Object Gateway ● also known as RADOS gateway (RGW), provides a RESTful API interface, which is compatible with Amazon S3 (Simple Storage Service) and OpenStack Object Storage API (Swift). ● RGW also supports the multitenancy and OpenStack Keystone authentication services.
  • 31. Ceph Metadata Server (MDS) ● keeps track of file hierarchy and stores metadata only for CephFS. ● Manages metadata for a POSIX-compliant shared filesystem ● File metadata (owner, timestamps, mode, etc.) ● Stores metadata in RADOS
  • 32. 32 Real World Red Hat CephReal World Red Hat Ceph StorageStorage
  • 33. International Users ● Many different individuals and organizations are making long-term strategic bets on Ceph, and that number is growing every day!
  • 34. According indeed.com , almost 620 jobs opportunity active on U.S.A that 9.2% of them earn more than 125000$ per year!! Red Hat Ceph storage specialist jobRed Hat Ceph storage specialist job opportunity and Salaryopportunity and Salary