SlideShare a Scribd company logo
1 of 24
Download to read offline
Ceph and Storage
Management with openATTIC
Ceph Tech Talks
2016-06-23
Lenz Grimmer <lenz@openattic.org>
openATTIC – Our Vision
─ Develop an open source alternative to proprietary storage
management systems
─ „Traditional” unified storage (NAS/SAN)
─ Support Ceph for scale-out scenarios
─ Backed with commercial support and services
openATTIC – Notable Recent Changes
─ Removed Enterprise/Community Edition split
─ Now fully under the GPLv2
─ Removed requirement for CLA
─ DCA (Signed-off-by) is all that's needed
─ Public Jira Bug Tracker
─ Public Pull requests / code reviews on BitBucket
─ Development/Release Branch
─ Entire code base (Backend/WebUI/Test/Docs) in one branch
openATTIC – What Sets us Apart?
─ Focus on data center storage management
─ Support both SAN and NAS functionality without limitations
─ Fully Open Source (GPLv2)
─ No arbitrary functional restrictions
─ Low entrance barrier for adoption
─ Based on Linux / OSS tools
─ Multiple Linux distributions (Debian/Ubuntu/Red Hat/SUSE)
─ Well-established technology stack (e.g. drivers, hardware support)
─ Broad user base
─ Modern Web UI
─ RESTful API (Software-
Defined Storage)
─ Unified Storage
─ NAS (NFS, CIFS, HTTP)
─ SAN (iSCSI, Fibre Channel)
─ LVM, XFS, ZFS, Btrfs,
ext3/4
─ Volume mirroring (DRBD®)
─ Multi-node support
─ Monitoring (Nagios/Icinga)
built-in
─ Ceph management and
monitoring (WIP)
─ Development sponsored by
it-novum
openATTIC – Open Source Storage Management
─ Backend
─ Python (Django)
─ Django REST Framework
(RESTful API)
─ Linux tools for storage
management, e.g. LVM, LIO,
filesystem utilities, DRBD,
etc.
─ Nagios/Icinga & PNP4Nagios
(Monitoring and Graphing)
─ Web Frontend
─ AngularJS (JS framework)
─ Bootstrap (HTML, CSS, and
JS framework)
─ Uses REST API exclusively
─ Automated Test Suites
─ Python Unit Tests
─ REST Backend Tests
(Gatling)
─ WebUI Tests
(Protractor/Jasmine)
openATTIC – Components
openATTIC – High Level Architecture
openATTIC – Ceph Management Challenges
─ Managing and monitoring Ceph is complex
─ Many tools exist (e.g. Calamari, Intel VSM, ceph-dash)
─ Limited functionality, unclear roadmaps
─ Finding the best approach for managing Ceph
openATTIC – Ceph Management Goals
─ Create a management & monitoring GUI tool
─ A tool that administrators actually want to use
─ That scales without becoming overwhelming
─ Still should allow changes to be made elsewhere, without
becoming inconsistent
openATTIC – Ceph Management Implementation
─ Which Ceph Management API?
─ How to manage a distributed system?
─ How to monitor the cluster‘s health/performance?
─ How to perform remote management tasks?
─ How to monitor cluster nodes in a scalable way?
Django REST
Framework
Django Models
Client (GUI)
REST API
DB
(PostgreSQL)
nodb
Python librados / librbddjango.db.models
openATTIC – “NoDB” Django models
openATTIC – Current Ceph Development Status
─ “NoDB” backend architecture / framework in place
─ Create and map RBDs as block devices (volumes)
─ Pool Management Web UI (table view)
─ OSD Management Web UI (table view)
─ RBD Management Web UI (table view)
─ Monitor a cluster health and performance
─ CRUSH Map Editor
─ Support for managing multiple Ceph clusters
openATTIC – Ceph REST API Overview
openATTIC – Ceph Development Roadmap
─ Ceph Cluster Status Dashboard incl. Performance Graphs
─ Extend Pool Management
─ OSD Monitoring/Management
─ RBD Management/Monitoring
─ CephFS Management
─ RGW Management (users, buckets keys)
─ Deployment, remote configuration of Ceph nodes (via Salt)
─ Public Roadmap on the openATTIC Wiki to solicit
community feedback: http://bit.ly/28PCTWf
openATTIC – Storage Management Dashboard
openATTIC – Ceph Pool List
openATTIC – Ceph OSD List
openATTIC – Ceph CRUSH map editing
openATTIC – Volume Management
openATTIC – API Recorder
openATTIC – Attending SUSE Hackweek
─ June 24
th
– July 1st
─ https://hackweek.suse.com/
─ Pick open Jira issues
─ Join #openattic on Freenode
─ Submit your project
─ Have fun, learn new stuff
─ openATTIC Team will be in the SUSE HQ in Nuremberg
─ www.openattic.org
─ demo.openattic.org
─ blog.openattic.org
─ docs.openattic.org
─ bitbucket.org/openattic
─ tracker.openattic.org
─ @openATTIC
─ openATTIC
openATTIC – Resources
Questions / Discussion
Thank you!

More Related Content

Similar to openATTIC Ceph Management @ Ceph Tech Talks - 2016-06-23

Similar to openATTIC Ceph Management @ Ceph Tech Talks - 2016-06-23 (20)

Ceph and Storage Management with openATTIC, Ceph Tech Talks 2016-06-23
Ceph and Storage Management with openATTIC, Ceph Tech Talks 2016-06-23Ceph and Storage Management with openATTIC, Ceph Tech Talks 2016-06-23
Ceph and Storage Management with openATTIC, Ceph Tech Talks 2016-06-23
 
openATTIC & Ceph Management @ Suse Monthly Open Source Talks - 2016-06-07
openATTIC & Ceph Management @ Suse Monthly Open Source Talks - 2016-06-07openATTIC & Ceph Management @ Suse Monthly Open Source Talks - 2016-06-07
openATTIC & Ceph Management @ Suse Monthly Open Source Talks - 2016-06-07
 
Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07
Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07
Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07
 
Ceph and Storage Management with openATTIC - Ceph Day Munich - 2016-09-23
Ceph and Storage Management with openATTIC - Ceph Day Munich - 2016-09-23Ceph and Storage Management with openATTIC - Ceph Day Munich - 2016-09-23
Ceph and Storage Management with openATTIC - Ceph Day Munich - 2016-09-23
 
Ceph and Storage Management with openATTIC, openSUSE Conference 2016-06-23
Ceph and Storage Management with openATTIC, openSUSE Conference 2016-06-23Ceph and Storage Management with openATTIC, openSUSE Conference 2016-06-23
Ceph and Storage Management with openATTIC, openSUSE Conference 2016-06-23
 
Ceph and Storage Management with openATTIC - FrOSCon 2016-08-21
Ceph and Storage Management with openATTIC - FrOSCon 2016-08-21Ceph and Storage Management with openATTIC - FrOSCon 2016-08-21
Ceph and Storage Management with openATTIC - FrOSCon 2016-08-21
 
Storage Monitoring in openATTIC - Monitoring Workshop - 2016-09-07
Storage Monitoring in openATTIC - Monitoring Workshop - 2016-09-07Storage Monitoring in openATTIC - Monitoring Workshop - 2016-09-07
Storage Monitoring in openATTIC - Monitoring Workshop - 2016-09-07
 
Red Hat Storage Roadmap
Red Hat Storage RoadmapRed Hat Storage Roadmap
Red Hat Storage Roadmap
 
Red Hat Storage Roadmap
Red Hat Storage RoadmapRed Hat Storage Roadmap
Red Hat Storage Roadmap
 
Modern Web development and operations practices
Modern Web development and operations practicesModern Web development and operations practices
Modern Web development and operations practices
 
Openshift 3.10 & Container solutions for Blockchain, IoT and Data Science
Openshift 3.10 & Container solutions for Blockchain, IoT and Data ScienceOpenshift 3.10 & Container solutions for Blockchain, IoT and Data Science
Openshift 3.10 & Container solutions for Blockchain, IoT and Data Science
 
Free GitOps Workshop
Free GitOps WorkshopFree GitOps Workshop
Free GitOps Workshop
 
Cloudexpowest opensourcecloudcomputing-1by arun kumar
Cloudexpowest opensourcecloudcomputing-1by arun kumarCloudexpowest opensourcecloudcomputing-1by arun kumar
Cloudexpowest opensourcecloudcomputing-1by arun kumar
 
Cloudexpowest opensourcecloudcomputing-1by arun kumar
Cloudexpowest opensourcecloudcomputing-1by arun kumarCloudexpowest opensourcecloudcomputing-1by arun kumar
Cloudexpowest opensourcecloudcomputing-1by arun kumar
 
Ceph Day Bring Ceph To Enterprise
Ceph Day Bring Ceph To EnterpriseCeph Day Bring Ceph To Enterprise
Ceph Day Bring Ceph To Enterprise
 
Red Hat Gluster Storage, Container Storage and CephFS Plans
Red Hat Gluster Storage, Container Storage and CephFS PlansRed Hat Gluster Storage, Container Storage and CephFS Plans
Red Hat Gluster Storage, Container Storage and CephFS Plans
 
SUSE Container as a Service Platform
SUSE Container as a Service PlatformSUSE Container as a Service Platform
SUSE Container as a Service Platform
 
Ceph Day Taipei - Bring Ceph to Enterprise
Ceph Day Taipei - Bring Ceph to EnterpriseCeph Day Taipei - Bring Ceph to Enterprise
Ceph Day Taipei - Bring Ceph to Enterprise
 
Couchbase and Apache Spark
Couchbase and Apache SparkCouchbase and Apache Spark
Couchbase and Apache Spark
 
DevConf 2017 - Realistic Container Platform Simulations
DevConf 2017 - Realistic Container Platform SimulationsDevConf 2017 - Realistic Container Platform Simulations
DevConf 2017 - Realistic Container Platform Simulations
 

More from it-novum

130213 itn webcast_sap
130213 itn webcast_sap130213 itn webcast_sap
130213 itn webcast_sap
it-novum
 

More from it-novum (8)

Tweets und Aktienkurse? Wertvolle Erkenntnisse durch Data Blending gewinnen
Tweets und Aktienkurse? Wertvolle Erkenntnisse durch Data Blending gewinnenTweets und Aktienkurse? Wertvolle Erkenntnisse durch Data Blending gewinnen
Tweets und Aktienkurse? Wertvolle Erkenntnisse durch Data Blending gewinnen
 
Flexible storage management with Linux and openATTIC
Flexible storage management with Linux and openATTICFlexible storage management with Linux and openATTIC
Flexible storage management with Linux and openATTIC
 
The evolution of storage on Linux
The evolution of storage on Linux The evolution of storage on Linux
The evolution of storage on Linux
 
Closing the Storage gap - presentation from OpenStack Summit in Vancouver 2015
Closing the Storage gap - presentation from OpenStack Summit in Vancouver 2015Closing the Storage gap - presentation from OpenStack Summit in Vancouver 2015
Closing the Storage gap - presentation from OpenStack Summit in Vancouver 2015
 
Open Cloud Storage @ OpenStack Summit Paris
Open Cloud Storage @ OpenStack Summit ParisOpen Cloud Storage @ OpenStack Summit Paris
Open Cloud Storage @ OpenStack Summit Paris
 
OpenStack Day Italy: openATTC as an open storage platform for OpenStack
OpenStack Day Italy: openATTC as an open storage platform for OpenStackOpenStack Day Italy: openATTC as an open storage platform for OpenStack
OpenStack Day Italy: openATTC as an open storage platform for OpenStack
 
Building an open source cloud storage platform for OpenStack - openATTIC
Building an open source cloud storage platform for OpenStack - openATTICBuilding an open source cloud storage platform for OpenStack - openATTIC
Building an open source cloud storage platform for OpenStack - openATTIC
 
130213 itn webcast_sap
130213 itn webcast_sap130213 itn webcast_sap
130213 itn webcast_sap
 

Recently uploaded

“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
Muhammad Subhan
 
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider  Progress from Awareness to Implementation.pptxTales from a Passkey Provider  Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
FIDO Alliance
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
panagenda
 
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
FIDO Alliance
 
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxHarnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
FIDO Alliance
 

Recently uploaded (20)

“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
“Iamnobody89757” Understanding the Mysterious of Digital Identity.pdf
 
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider  Progress from Awareness to Implementation.pptxTales from a Passkey Provider  Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
 
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
 
Top 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development CompaniesTop 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development Companies
 
Introduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptxIntroduction to FIDO Authentication and Passkeys.pptx
Introduction to FIDO Authentication and Passkeys.pptx
 
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
JohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptxJohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptx
 
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxHarnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
 
Microsoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireMicrosoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - Questionnaire
 
AI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by Anitaraj
 
WebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceWebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM Performance
 
Introduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMIntroduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDM
 
Design Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptxDesign Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptx
 
UiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overviewUiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overview
 
WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024WebRTC and SIP not just audio and video @ OpenSIPS 2024
WebRTC and SIP not just audio and video @ OpenSIPS 2024
 
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
 
ERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage IntacctERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage Intacct
 
Google I/O Extended 2024 Warsaw
Google I/O Extended 2024 WarsawGoogle I/O Extended 2024 Warsaw
Google I/O Extended 2024 Warsaw
 

openATTIC Ceph Management @ Ceph Tech Talks - 2016-06-23

  • 1. Ceph and Storage Management with openATTIC Ceph Tech Talks 2016-06-23 Lenz Grimmer <lenz@openattic.org>
  • 2. openATTIC – Our Vision ─ Develop an open source alternative to proprietary storage management systems ─ „Traditional” unified storage (NAS/SAN) ─ Support Ceph for scale-out scenarios ─ Backed with commercial support and services
  • 3. openATTIC – Notable Recent Changes ─ Removed Enterprise/Community Edition split ─ Now fully under the GPLv2 ─ Removed requirement for CLA ─ DCA (Signed-off-by) is all that's needed ─ Public Jira Bug Tracker ─ Public Pull requests / code reviews on BitBucket ─ Development/Release Branch ─ Entire code base (Backend/WebUI/Test/Docs) in one branch
  • 4. openATTIC – What Sets us Apart? ─ Focus on data center storage management ─ Support both SAN and NAS functionality without limitations ─ Fully Open Source (GPLv2) ─ No arbitrary functional restrictions ─ Low entrance barrier for adoption ─ Based on Linux / OSS tools ─ Multiple Linux distributions (Debian/Ubuntu/Red Hat/SUSE) ─ Well-established technology stack (e.g. drivers, hardware support) ─ Broad user base
  • 5. ─ Modern Web UI ─ RESTful API (Software- Defined Storage) ─ Unified Storage ─ NAS (NFS, CIFS, HTTP) ─ SAN (iSCSI, Fibre Channel) ─ LVM, XFS, ZFS, Btrfs, ext3/4 ─ Volume mirroring (DRBD®) ─ Multi-node support ─ Monitoring (Nagios/Icinga) built-in ─ Ceph management and monitoring (WIP) ─ Development sponsored by it-novum openATTIC – Open Source Storage Management
  • 6. ─ Backend ─ Python (Django) ─ Django REST Framework (RESTful API) ─ Linux tools for storage management, e.g. LVM, LIO, filesystem utilities, DRBD, etc. ─ Nagios/Icinga & PNP4Nagios (Monitoring and Graphing) ─ Web Frontend ─ AngularJS (JS framework) ─ Bootstrap (HTML, CSS, and JS framework) ─ Uses REST API exclusively ─ Automated Test Suites ─ Python Unit Tests ─ REST Backend Tests (Gatling) ─ WebUI Tests (Protractor/Jasmine) openATTIC – Components
  • 7. openATTIC – High Level Architecture
  • 8. openATTIC – Ceph Management Challenges ─ Managing and monitoring Ceph is complex ─ Many tools exist (e.g. Calamari, Intel VSM, ceph-dash) ─ Limited functionality, unclear roadmaps ─ Finding the best approach for managing Ceph
  • 9. openATTIC – Ceph Management Goals ─ Create a management & monitoring GUI tool ─ A tool that administrators actually want to use ─ That scales without becoming overwhelming ─ Still should allow changes to be made elsewhere, without becoming inconsistent
  • 10. openATTIC – Ceph Management Implementation ─ Which Ceph Management API? ─ How to manage a distributed system? ─ How to monitor the cluster‘s health/performance? ─ How to perform remote management tasks? ─ How to monitor cluster nodes in a scalable way?
  • 11. Django REST Framework Django Models Client (GUI) REST API DB (PostgreSQL) nodb Python librados / librbddjango.db.models openATTIC – “NoDB” Django models
  • 12. openATTIC – Current Ceph Development Status ─ “NoDB” backend architecture / framework in place ─ Create and map RBDs as block devices (volumes) ─ Pool Management Web UI (table view) ─ OSD Management Web UI (table view) ─ RBD Management Web UI (table view) ─ Monitor a cluster health and performance ─ CRUSH Map Editor ─ Support for managing multiple Ceph clusters
  • 13. openATTIC – Ceph REST API Overview
  • 14. openATTIC – Ceph Development Roadmap ─ Ceph Cluster Status Dashboard incl. Performance Graphs ─ Extend Pool Management ─ OSD Monitoring/Management ─ RBD Management/Monitoring ─ CephFS Management ─ RGW Management (users, buckets keys) ─ Deployment, remote configuration of Ceph nodes (via Salt) ─ Public Roadmap on the openATTIC Wiki to solicit community feedback: http://bit.ly/28PCTWf
  • 15. openATTIC – Storage Management Dashboard
  • 16. openATTIC – Ceph Pool List
  • 17. openATTIC – Ceph OSD List
  • 18. openATTIC – Ceph CRUSH map editing
  • 19. openATTIC – Volume Management
  • 20. openATTIC – API Recorder
  • 21. openATTIC – Attending SUSE Hackweek ─ June 24 th – July 1st ─ https://hackweek.suse.com/ ─ Pick open Jira issues ─ Join #openattic on Freenode ─ Submit your project ─ Have fun, learn new stuff ─ openATTIC Team will be in the SUSE HQ in Nuremberg
  • 22. ─ www.openattic.org ─ demo.openattic.org ─ blog.openattic.org ─ docs.openattic.org ─ bitbucket.org/openattic ─ tracker.openattic.org ─ @openATTIC ─ openATTIC openATTIC – Resources