Uploaded byItalo Santos
Ceph - Desmistificando Software-Define Storage
Ceph is an open-source software-defined storage system that provides scalable and fault-tolerant storage. It uses a distributed object storage platform called RADOS for data reliability and redundancy. Ceph has several interfaces including RBD for block storage, CephFS for file storage, and RADOSGW for object storage. Ceph uses CRUSH to deterministically map data across clusters and placement groups to balance data and reduce data movement. When used with OpenStack, Ceph provides block storage volumes to instances through RBD and allows snapshotting and cloning of volumes for high availability.
More Related Content
Similar to Ceph - Desmistificando Software-Define Storage
Ceph - Desmistificando Software-Define Storage
- 1. TOTVS – Todosos direitos reservados 1 Ceph Desmistificando Software-Defined Storage Agosto 2017
- 2. 2 01 O que éSDS?
- 3. 3 Software-Defined Storage (SDS) Software-DefinedStorage Commodity Hardware Commodity Hardware Commodity Hardware Data Layer ApplicationsUsers Storage Pool
- 4.
- 5. 5 ONTAP Select Software-Defined StorageHyper-Converged Infrastructure
- 6.
- 7. 7 Ceph - DistributedStorage System • Multi-Protocolo • Escalável • Resiliente • Auto-Gerenciável • Tolerante à falha • Nenhum ponto único de falha
- 8. 8 Arquitetura RADOS A reliable, autonomous,distributed object store comprised of self-healing, LIBRADOS A library allowing apps to directly access RADOS, with support for C, C++, Java, RBD A reliable and fully-distributed block device, with a Linux kernel CEPH FS A POSIX-compliant distributed file system, with a Linux kernel RADOSGW A bucket-based REST gateway, APP APP HOST/VM CLIENT
- 9.
- 10. 10 OSDs • Um porDisco • Armazenamento • Replicação • Gerenciamento • Recovery • Rebalanceamento • Auto-Check DISK FS DISK DISK OSD DISK DISK OSD OSD OSD OSD FS FS FSFS btrfs xfs* ext4 MMM
- 11. 11 Monitors • Mapas • Cluster •Monitors • OSDs • Placement Groups • CRUSH • 3x por cluster M
- 12. 12 MDS - MetadataServer • Usado apenas com CephFS • Compatível com POSIX • Gerenciamento de Metadados • Hierarquia de Diretórios • Metadados de arquivos • 3x por cluster
- 13.
- 14. 14 CRUSH • Pseudo-random • Rápido •Deterministico • Uniforme • Reduz movimentação • Baseado em regras
- 15. 15 Algoritimo 10 10 0101 10 10 01 11 01 10 10 01 01 10 10 01 11 01 10 CRUSH(pg, cluster state, rule hash(object name) % num pg
- 16. 16 Algoritimo 10 10 0101 10 10 01 11 01 10 10 01 01 10 10 01 11 01 10 CRUSH(pg, cluster state, rule hash(object name) % num pg
- 17. 17 Algoritimo 10 10 0101 10 10 01 11 01 10 10 01 01 10 10 01 11 01 10 CRUSH(pg, cluster state, rule hash(object name) % num pg
- 18.
- 19. 19 Placement Groups • MapeamentoPGs to OSDs • Baixo uso de CPU • Menos cálculos • Menos metadados • Balanceamento Dinâmico
- 20. 20 Placement Groups • Definidoor pool • Balanceamento por Pool x OSDs • ~100 PGs por OSD • + PGs reduz carga por OSD
- 21. 21 Placement Groups -http://ceph.com/pgcalc/
- 22. 22 Placement Groups -http://ceph.com/pgcalc/
- 23. 23 Placement Groups -http://ceph.com/pgcalc/
- 24. 24 Pools Replicated Pool Erasure CodedPool Data Data Data Data Data CLIENTCLIENT D A T A DT AA • 3x copias (> Overhead) • Maior durabilidade • Recuperação mais rápida • Dado + Paridade (< Overhead) • Melhor custo benefício • Maior tempo de recuperação
- 25.
- 26. RADOS A reliable, autonomous,distributed object store comprised of self-healing, LIBRADOS A library allowing apps to directly access RADOS, with support for C, C++, Java, APP CEPH FS A POSIX-compliant distributed file system, with a Linux kernel CLIENT 26 Arquitetura RBD A reliable and fully-distributed block device, with a Linux kernel RADOSGW A bucket-based REST gateway, APP HOST/VM
- 27. RADOS A reliable, autonomous,distributed object store comprised of self-healing, LIBRADOS A library allowing apps to directly access RADOS, with support for C, C++, Java, APP CEPH FS A POSIX-compliant distributed file system, with a Linux kernel CLIENT 26 Arquitetura RBD A reliable and fully-distributed block device, with a Linux kernel RADOSGW A bucket-based REST gateway, APP HOST/VM
- 28. 27 RadosGW - RadosObject Gateway LIBRADOS RADOSGW APP socket (Autenticação Cephx) • Interface REST • Dados • Gerencimento • Amazon S3 • OpenStack Swift • Embedded WebServer • NFS (experimental)
- 29. 28 RBD - RadosBlock Device LIBRADOS socket (Autenticação Cephx) • Interface de Disco • Nativo no Kernel Linux • Thin-provisioned • Snapshot • Mirror • OpenStack LIBRBD HOST / VIRTUALIZATION VMDISK
- 30.
- 31. 30 RBD + OpenStack Fonte:http://ceph.com Glance CinderNova COW clone COW clone COW clone Ephemeral Disk Block Device
- 32. 31 RBD + OpenStack- Snapshot / Clone 0100 0 0 0 Snapshot Instant Copy VM-2 VM-3 VM-4 VM-5 0 VM… VM-1
- 33. 31 RBD + OpenStack- Snapshot / Clone 0100 0 0 0 Snapshot Instant Copy VM-2 VM-3 VM-4 VM-5 0 VM… VM-1 = 100
- 34. 31 RBD + OpenStack- Snapshot / Clone 0100 0 0 0 Snapshot Instant Copy VM-2 VM-3 VM-4 VM-5 0 VM… VM-1 = 100 5100 VM-2VM-1 CLIENT write write write write write
- 35. 31 RBD + OpenStack- Snapshot / Clone 0100 0 0 0 Snapshot Instant Copy VM-2 VM-3 VM-4 VM-5 0 VM… VM-1 = 100 5100 VM-2VM-1 CLIENT = 105 write write write write write
- 36.
- 37.
- 38. totvs.com @totvs blog.totvs.comcompany/totvs fluig.com 34 Obrigado Italo Santos Cloud -Infraestrutura Storage italo.ssantos@totvs.com.br #SOMOSTOTVERS