SlideShare a Scribd company logo
1 of 29
Download to read offline
Ceph and Storage Management
with openATTIC
SUSE Monthly Open Source Talks
2016-07-06
Lenz Grimmer <lenz@openattic.org>
2
openATTIC – Our Vision
─Develop an open source alternative to proprietary
storage management systems
─„Traditional” unified storage (NAS/SAN)
─Support Ceph for scale-out scenarios
─Backed with commercial support and services
3
openATTIC – Notable Recent Changes
─Removed Enterprise/Community Edition split
─Now fully under the GPLv2
─Removed requirement for CLA
─DCA (Signed-off-by) is all that's needed
─Public Jira Bug Tracker
─Public Pull requests / code reviews on BitBucket
─Development/Release Branch
─Entire code base (Backend/WebUI/Test/Docs) in one branch
4
openATTIC – What Sets us Apart?
─ Focus on data center storage management
─ Support both SAN and NAS functionality without limitations
─ Fully Open Source (GPLv2)
─ No arbitrary functional restrictions
─ Low entrance barrier for adoption
─ Based on Linux / OSS tools
─ Multiple Linux distributions (Debian/Ubuntu/Red Hat/SUSE)
─ Well-established technology stack (e.g. drivers, hardware support)
─ Broad user base
5
─Modern Web UI
─RESTful API (Software-
Defined Storage)
─Unified Storage
─NAS (NFS, CIFS, HTTP)
─SAN (iSCSI, Fibre Channel)
─LVM, XFS, ZFS, Btrfs,
ext3/4
─Volume mirroring (DRBD®)
─Multi-node support
─Monitoring (Nagios/Icinga)
built-in
─Ceph management and
monitoring (WIP)
─Development sponsored
by it-novum
openATTIC – Open Source Storage Management
6
─Backend
─Python (Django)
─Django REST Framework
(RESTful API)
─Linux tools for storage
management, e.g. LVM,
LIO, filesystem utilities,
DRBD, etc.
─Nagios/Icinga &
PNP4Nagios (Monitoring
and Graphing)
─Web Frontend
─AngularJS (JS framework)
─Bootstrap (HTML, CSS, and
JS framework)
─Uses REST API exclusively
─Automated Test Suites
─Python Unit Tests
─REST Backend Tests
(Gatling)
─WebUI Tests
(Protractor/Jasmine)
openATTIC – Components
7
openATTIC – High Level Architecture
8
openATTIC – Installation on SUSE Linux
─OBS Project filesystems:openATTIC
─Packages available for openSUSE Leap 42.1 & SLES12
─Thanks to Eric Jackson (swiftgist) for the support!
─Feedback is welcome!
9
openATTIC – Storage Development Roadmap
─ Add Disk and Storage Pool Management to the API & WebUI
─ Creating/Modifying LVM Volume Groups / MD RAID setups
─ Creating/Modifying Btrfs/ZFS Pools (incl. RAID setups)
─ Automatic discovery of disks/pools (via udev)
─ Monitoring Disk health (SMART)
─ Manage HW RAID controllers
─ Add volume mirroring support to the WebUI
─ Extend SAN functionality (more iSCSI/FC features)
─ Public Roadmap on the openATTIC Jira/Wiki to solicit
community feedback
10
openATTIC – Ceph Management Challenges
─Managing and monitoring Ceph is complex
─Many tools exist (e.g. Calamari, Intel VSM, ceph-dash)
─Limited functionality, unclear roadmaps
─Finding the best approach for managing Ceph
11
openATTIC – Ceph Management Goals
─Create a management & monitoring GUI tool
─A tool that administrators actually want to use
─That scales without becoming overwhelming
─Still should allow changes to be made elsewhere, without
becoming inconsistent
12
openATTIC – Ceph Management Implementation
─Which Ceph Management API?
─How to manage a distributed system?
─How to monitor the cluster‘s health/performance?
─How to perform remote management tasks?
─How to monitor cluster nodes in a scalable way?
13
Django REST Framework
Django Models
Client (GUI)
REST API
DB
(PostgreSQL)
nodb
Python librados / librbddjango.db.models
openATTIC – “NoDB” Django models
14
openATTIC – Current Ceph Development Status
─“NoDB” backend architecture / framework in place
─Create and map RBDs as block devices (volumes)
─Pool Management Web UI (table view)
─OSD Management Web UI (table view)
─RBD Management Web UI (table view)
─Monitor a cluster health and performance
─CRUSH Map Editor
─Support for managing multiple Ceph clusters
15
openATTIC – Attending SUSE Hackweek
─June 24th – July 1st
─https://hackweek.suse.com/
─openATTIC Team visited SUSE HQ in Nuremberg
─Implementation design decisions
─ Salt integration
─New features implemented
─ Ceph Monitoring Dashboard
─ Ceph RBD Management
16
openATTIC – Ceph Management REST API
https://wiki.openattic.org/display/OP/openATTIC+Ceph+REST+API+overview
17
openATTIC – Ceph Development Roadmap
─ Ceph Cluster Status Dashboard incl. Performance Graphs
─ Extend Pool Management
─ OSD Monitoring/Management
─ RBD Management/Monitoring
─ CephFS Management
─ RGW Management (users, buckets keys)
─ Deployment, remote configuration of Ceph nodes (via Salt)
─ Public Roadmap on the openATTIC Wiki to solicit community
feedback: http://bit.ly/28PCTWf
18
openATTIC – Storage Management Dashboard
19
openATTIC – Volume Management
20
openATTIC – API Recorder
21
openATTIC – Ceph Pool List
22
openATTIC – Ceph OSD List
23
openATTIC – Ceph RBD list
24
openATTIC – Create Ceph RBD
25
openATTIC – Ceph CRUSH map editing
26
─ www.openattic.org
─ demo.openattic.org
─ blog.openattic.org
─ docs.openattic.org
─bitbucket.org/openattic
─tracker.openattic.org
─@openATTIC
─openATTIC
openATTIC – Resources
SUSE CERTIFIED LINUX PROFESSIONAL ACADEMY
Technical Training for SUSE Linux Enterprise Server 12
No Cost Flexible 12-Week Online Training
This popular training model is for technical sales/engineering employees of
SUSE partners interested in learning to install and manage SUSE Linux
Enterprise Server 12 (SLES 12). Participation in our SUSE Academy also
offers no-cost exam vouchers for participants seeking SUSE certification.
Learn through self-study of the SLES 12 curriculum and weekly webinar
reviews with our field-experienced instructor.
Each Academy participant will need 5-7 hours per week to self-study the
SLES 12 course assignments, plus 1 hour each week to attend a webinar
review of the key concepts studied. Certification is not required to participate.
Contact your company’s Partner Executive to ask to be sponsored in our
next Academy.
28
Questions / Discussion
29
Thank you!

More Related Content

What's hot

What's hot (18)

Integrating gluster fs,_qemu_and_ovirt-vijay_bellur-linuxcon_eu_2013
Integrating gluster fs,_qemu_and_ovirt-vijay_bellur-linuxcon_eu_2013Integrating gluster fs,_qemu_and_ovirt-vijay_bellur-linuxcon_eu_2013
Integrating gluster fs,_qemu_and_ovirt-vijay_bellur-linuxcon_eu_2013
 
OSBConf 2015 | Scale out backups with bareos and gluster by niels de vos
OSBConf 2015 | Scale out backups with bareos and gluster by niels de vosOSBConf 2015 | Scale out backups with bareos and gluster by niels de vos
OSBConf 2015 | Scale out backups with bareos and gluster by niels de vos
 
Gluster d thread_synchronization_using_urcu_lca2016
Gluster d thread_synchronization_using_urcu_lca2016Gluster d thread_synchronization_using_urcu_lca2016
Gluster d thread_synchronization_using_urcu_lca2016
 
Ceph meetup montreal
Ceph meetup montrealCeph meetup montreal
Ceph meetup montreal
 
State of the_gluster_-_lceu
State of the_gluster_-_lceuState of the_gluster_-_lceu
State of the_gluster_-_lceu
 
Sdc 2012-challenges
Sdc 2012-challengesSdc 2012-challenges
Sdc 2012-challenges
 
Ceph Management and Monitoring with Dashboard v2 - Lenz Grimmer
Ceph Management and Monitoring with Dashboard v2 - Lenz GrimmerCeph Management and Monitoring with Dashboard v2 - Lenz Grimmer
Ceph Management and Monitoring with Dashboard v2 - Lenz Grimmer
 
Gluster for sysadmins
Gluster for sysadminsGluster for sysadmins
Gluster for sysadmins
 
20160401 guster-roadmap
20160401 guster-roadmap20160401 guster-roadmap
20160401 guster-roadmap
 
GlusterD 2.0 - Managing Distributed File System Using a Centralized Store
GlusterD 2.0 - Managing Distributed File System Using a Centralized StoreGlusterD 2.0 - Managing Distributed File System Using a Centralized Store
GlusterD 2.0 - Managing Distributed File System Using a Centralized Store
 
Developing apps and_integrating_with_gluster_fs_-_libgfapi
Developing apps and_integrating_with_gluster_fs_-_libgfapiDeveloping apps and_integrating_with_gluster_fs_-_libgfapi
Developing apps and_integrating_with_gluster_fs_-_libgfapi
 
Join the super_colony_-_feb2013
Join the super_colony_-_feb2013Join the super_colony_-_feb2013
Join the super_colony_-_feb2013
 
Gluster technical overview
Gluster technical overviewGluster technical overview
Gluster technical overview
 
Cncf meetup-rook
Cncf meetup-rookCncf meetup-rook
Cncf meetup-rook
 
Cncf meetup-rook
Cncf meetup-rookCncf meetup-rook
Cncf meetup-rook
 
Gluster intro-tdose
Gluster intro-tdoseGluster intro-tdose
Gluster intro-tdose
 
Accessing gluster ufo_-_eco_willson
Accessing gluster ufo_-_eco_willsonAccessing gluster ufo_-_eco_willson
Accessing gluster ufo_-_eco_willson
 
20160401 Gluster-roadmap
20160401 Gluster-roadmap20160401 Gluster-roadmap
20160401 Gluster-roadmap
 

Viewers also liked

OpenNebulaConf 2014 - Using Ceph to provide scalable storage for OpenNebula -...
OpenNebulaConf 2014 - Using Ceph to provide scalable storage for OpenNebula -...OpenNebulaConf 2014 - Using Ceph to provide scalable storage for OpenNebula -...
OpenNebulaConf 2014 - Using Ceph to provide scalable storage for OpenNebula -...
OpenNebula Project
 
Curso Sede Villena UA - Eventos, SMO y Monitorización
Curso Sede Villena UA - Eventos, SMO y Monitorización Curso Sede Villena UA - Eventos, SMO y Monitorización
Curso Sede Villena UA - Eventos, SMO y Monitorización
Lucía Molina
 
Business Case Numiq
Business Case NumiqBusiness Case Numiq
Business Case Numiq
Numiq
 
Presentazione going greentranslations generale inglese (1)
Presentazione going greentranslations generale inglese (1)Presentazione going greentranslations generale inglese (1)
Presentazione going greentranslations generale inglese (1)
john rogan
 
Cidadão completo 31
Cidadão completo 31Cidadão completo 31
Cidadão completo 31
aghipertexto
 
BUSINESS INTELLIGENCE 2008 2007
BUSINESS INTELLIGENCE 2008 2007BUSINESS INTELLIGENCE 2008 2007
BUSINESS INTELLIGENCE 2008 2007
LUCA GHEZZI
 

Viewers also liked (20)

OpenNebulaConf 2014 - Using Ceph to provide scalable storage for OpenNebula -...
OpenNebulaConf 2014 - Using Ceph to provide scalable storage for OpenNebula -...OpenNebulaConf 2014 - Using Ceph to provide scalable storage for OpenNebula -...
OpenNebulaConf 2014 - Using Ceph to provide scalable storage for OpenNebula -...
 
Curso Sede Villena UA - Eventos, SMO y Monitorización
Curso Sede Villena UA - Eventos, SMO y Monitorización Curso Sede Villena UA - Eventos, SMO y Monitorización
Curso Sede Villena UA - Eventos, SMO y Monitorización
 
Acuerdo gobierno-reformista-y-de-progreso-2016
Acuerdo gobierno-reformista-y-de-progreso-2016Acuerdo gobierno-reformista-y-de-progreso-2016
Acuerdo gobierno-reformista-y-de-progreso-2016
 
Redes sociais
Redes sociaisRedes sociais
Redes sociais
 
05042 0-16-038 ligia de jesús goez
05042 0-16-038 ligia de jesús goez05042 0-16-038 ligia de jesús goez
05042 0-16-038 ligia de jesús goez
 
La voz de los jovenes a traves de
La voz de los jovenes a traves deLa voz de los jovenes a traves de
La voz de los jovenes a traves de
 
Algoritmos de Insuficiencia Mitral
Algoritmos de Insuficiencia MitralAlgoritmos de Insuficiencia Mitral
Algoritmos de Insuficiencia Mitral
 
Business Case Numiq
Business Case NumiqBusiness Case Numiq
Business Case Numiq
 
Presentazione going greentranslations generale inglese (1)
Presentazione going greentranslations generale inglese (1)Presentazione going greentranslations generale inglese (1)
Presentazione going greentranslations generale inglese (1)
 
Cidadão completo 31
Cidadão completo 31Cidadão completo 31
Cidadão completo 31
 
Información Familias 2015-2016
Información Familias 2015-2016Información Familias 2015-2016
Información Familias 2015-2016
 
Technology Hill Marketing Web Design PowerPoint
Technology Hill Marketing Web Design PowerPointTechnology Hill Marketing Web Design PowerPoint
Technology Hill Marketing Web Design PowerPoint
 
Startupbootcamp Insurance 2015
Startupbootcamp Insurance 2015Startupbootcamp Insurance 2015
Startupbootcamp Insurance 2015
 
A Fonte Da Vida
A Fonte Da VidaA Fonte Da Vida
A Fonte Da Vida
 
Effect of rugby wheel chair design on ourput velocity and acceleration.
Effect of rugby wheel chair design on ourput velocity and acceleration.Effect of rugby wheel chair design on ourput velocity and acceleration.
Effect of rugby wheel chair design on ourput velocity and acceleration.
 
P paramixoviru [modo de compatibili
P  paramixoviru [modo de compatibiliP  paramixoviru [modo de compatibili
P paramixoviru [modo de compatibili
 
BUSINESS INTELLIGENCE 2008 2007
BUSINESS INTELLIGENCE 2008 2007BUSINESS INTELLIGENCE 2008 2007
BUSINESS INTELLIGENCE 2008 2007
 
2001 ega galderak: esapideak
2001 ega galderak: esapideak2001 ega galderak: esapideak
2001 ega galderak: esapideak
 
Oc short
Oc shortOc short
Oc short
 
Steve-oh-mg Creative Advertising Message Expression Case Study Samples
Steve-oh-mg Creative Advertising Message Expression Case Study SamplesSteve-oh-mg Creative Advertising Message Expression Case Study Samples
Steve-oh-mg Creative Advertising Message Expression Case Study Samples
 

Similar to openATTIC & Ceph Management @ Suse Monthly Open Source Talks - 2016-06-07

Citrix Synergy 2014 - Syn232 Building a Cloud Architecture and Self- Service ...
Citrix Synergy 2014 - Syn232 Building a Cloud Architecture and Self- Service ...Citrix Synergy 2014 - Syn232 Building a Cloud Architecture and Self- Service ...
Citrix Synergy 2014 - Syn232 Building a Cloud Architecture and Self- Service ...
Citrix
 

Similar to openATTIC & Ceph Management @ Suse Monthly Open Source Talks - 2016-06-07 (20)

openATTIC Ceph Management @ Ceph Tech Talks - 2016-06-23
openATTIC Ceph Management @ Ceph Tech Talks - 2016-06-23openATTIC Ceph Management @ Ceph Tech Talks - 2016-06-23
openATTIC Ceph Management @ Ceph Tech Talks - 2016-06-23
 
openATTIC Ceph Management @ OpenSuse Con - 2016-06-23
openATTIC Ceph Management @ OpenSuse Con - 2016-06-23openATTIC Ceph Management @ OpenSuse Con - 2016-06-23
openATTIC Ceph Management @ OpenSuse Con - 2016-06-23
 
Ceph and Storage Management in openATTIC - solutions.hamburg - 2016-09-09
Ceph and Storage Management in openATTIC - solutions.hamburg - 2016-09-09Ceph and Storage Management in openATTIC - solutions.hamburg - 2016-09-09
Ceph and Storage Management in openATTIC - solutions.hamburg - 2016-09-09
 
Ceph management and monitoring with openATTIC 3.x
Ceph management and monitoring with openATTIC 3.x Ceph management and monitoring with openATTIC 3.x
Ceph management and monitoring with openATTIC 3.x
 
Citrix Synergy 2014 - Syn232 Building a Cloud Architecture and Self- Service ...
Citrix Synergy 2014 - Syn232 Building a Cloud Architecture and Self- Service ...Citrix Synergy 2014 - Syn232 Building a Cloud Architecture and Self- Service ...
Citrix Synergy 2014 - Syn232 Building a Cloud Architecture and Self- Service ...
 
Ceph Day Bring Ceph To Enterprise
Ceph Day Bring Ceph To EnterpriseCeph Day Bring Ceph To Enterprise
Ceph Day Bring Ceph To Enterprise
 
Openshift 3.10 & Container solutions for Blockchain, IoT and Data Science
Openshift 3.10 & Container solutions for Blockchain, IoT and Data ScienceOpenshift 3.10 & Container solutions for Blockchain, IoT and Data Science
Openshift 3.10 & Container solutions for Blockchain, IoT and Data Science
 
Ceph Day Taipei - Bring Ceph to Enterprise
Ceph Day Taipei - Bring Ceph to EnterpriseCeph Day Taipei - Bring Ceph to Enterprise
Ceph Day Taipei - Bring Ceph to Enterprise
 
Uyuni, the solution to manage your Linux infrastructure
Uyuni, the solution to manage your Linux infrastructureUyuni, the solution to manage your Linux infrastructure
Uyuni, the solution to manage your Linux infrastructure
 
Cloudexpowest opensourcecloudcomputing-1by arun kumar
Cloudexpowest opensourcecloudcomputing-1by arun kumarCloudexpowest opensourcecloudcomputing-1by arun kumar
Cloudexpowest opensourcecloudcomputing-1by arun kumar
 
Cloudexpowest opensourcecloudcomputing-1by arun kumar
Cloudexpowest opensourcecloudcomputing-1by arun kumarCloudexpowest opensourcecloudcomputing-1by arun kumar
Cloudexpowest opensourcecloudcomputing-1by arun kumar
 
Openshift Enterprise
Openshift EnterpriseOpenshift Enterprise
Openshift Enterprise
 
Ose mod march11
Ose mod march11Ose mod march11
Ose mod march11
 
Uyuni: the solution to manage your Linux infrastructure (OpenFest 2020)
Uyuni: the solution to manage your Linux infrastructure (OpenFest 2020)Uyuni: the solution to manage your Linux infrastructure (OpenFest 2020)
Uyuni: the solution to manage your Linux infrastructure (OpenFest 2020)
 
DevConf 2017 - Realistic Container Platform Simulations
DevConf 2017 - Realistic Container Platform SimulationsDevConf 2017 - Realistic Container Platform Simulations
DevConf 2017 - Realistic Container Platform Simulations
 
Extending OpenShift Origin: Build Your Own Cartridge with Bill DeCoste of Red...
Extending OpenShift Origin: Build Your Own Cartridge with Bill DeCoste of Red...Extending OpenShift Origin: Build Your Own Cartridge with Bill DeCoste of Red...
Extending OpenShift Origin: Build Your Own Cartridge with Bill DeCoste of Red...
 
Securing DevOps
Securing DevOpsSecuring DevOps
Securing DevOps
 
Red Hat Storage Roadmap
Red Hat Storage RoadmapRed Hat Storage Roadmap
Red Hat Storage Roadmap
 
Red Hat Storage Roadmap
Red Hat Storage RoadmapRed Hat Storage Roadmap
Red Hat Storage Roadmap
 
Productos de SUSE basados en CaaSP
Productos de SUSE basados en CaaSPProductos de SUSE basados en CaaSP
Productos de SUSE basados en CaaSP
 

More from it-novum

130213 itn webcast_sap
130213 itn webcast_sap130213 itn webcast_sap
130213 itn webcast_sap
it-novum
 

More from it-novum (8)

Tweets und Aktienkurse? Wertvolle Erkenntnisse durch Data Blending gewinnen
Tweets und Aktienkurse? Wertvolle Erkenntnisse durch Data Blending gewinnenTweets und Aktienkurse? Wertvolle Erkenntnisse durch Data Blending gewinnen
Tweets und Aktienkurse? Wertvolle Erkenntnisse durch Data Blending gewinnen
 
Flexible storage management with Linux and openATTIC
Flexible storage management with Linux and openATTICFlexible storage management with Linux and openATTIC
Flexible storage management with Linux and openATTIC
 
The evolution of storage on Linux
The evolution of storage on Linux The evolution of storage on Linux
The evolution of storage on Linux
 
Closing the Storage gap - presentation from OpenStack Summit in Vancouver 2015
Closing the Storage gap - presentation from OpenStack Summit in Vancouver 2015Closing the Storage gap - presentation from OpenStack Summit in Vancouver 2015
Closing the Storage gap - presentation from OpenStack Summit in Vancouver 2015
 
Open Cloud Storage @ OpenStack Summit Paris
Open Cloud Storage @ OpenStack Summit ParisOpen Cloud Storage @ OpenStack Summit Paris
Open Cloud Storage @ OpenStack Summit Paris
 
OpenStack Day Italy: openATTC as an open storage platform for OpenStack
OpenStack Day Italy: openATTC as an open storage platform for OpenStackOpenStack Day Italy: openATTC as an open storage platform for OpenStack
OpenStack Day Italy: openATTC as an open storage platform for OpenStack
 
Building an open source cloud storage platform for OpenStack - openATTIC
Building an open source cloud storage platform for OpenStack - openATTICBuilding an open source cloud storage platform for OpenStack - openATTIC
Building an open source cloud storage platform for OpenStack - openATTIC
 
130213 itn webcast_sap
130213 itn webcast_sap130213 itn webcast_sap
130213 itn webcast_sap
 

Recently uploaded

TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc
 
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxHarnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
FIDO Alliance
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
panagenda
 

Recently uploaded (20)

Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
 
ERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage IntacctERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage Intacct
 
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
Observability Concepts EVERY Developer Should Know (DevOpsDays Seattle)
 
Where to Learn More About FDO _ Richard at FIDO Alliance.pdf
Where to Learn More About FDO _ Richard at FIDO Alliance.pdfWhere to Learn More About FDO _ Richard at FIDO Alliance.pdf
Where to Learn More About FDO _ Richard at FIDO Alliance.pdf
 
Top 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development CompaniesTop 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development Companies
 
Vector Search @ sw2con for slideshare.pptx
Vector Search @ sw2con for slideshare.pptxVector Search @ sw2con for slideshare.pptx
Vector Search @ sw2con for slideshare.pptx
 
Design and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data ScienceDesign and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data Science
 
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdfIntroduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
 
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsContinuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
 
Google I/O Extended 2024 Warsaw
Google I/O Extended 2024 WarsawGoogle I/O Extended 2024 Warsaw
Google I/O Extended 2024 Warsaw
 
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxHarnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
 
Generative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdfGenerative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdf
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
 
Intro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджераIntro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджера
 
Long journey of Ruby Standard library at RubyKaigi 2024
Long journey of Ruby Standard library at RubyKaigi 2024Long journey of Ruby Standard library at RubyKaigi 2024
Long journey of Ruby Standard library at RubyKaigi 2024
 
Overview of Hyperledger Foundation
Overview of Hyperledger FoundationOverview of Hyperledger Foundation
Overview of Hyperledger Foundation
 
Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024Extensible Python: Robustness through Addition - PyCon 2024
Extensible Python: Robustness through Addition - PyCon 2024
 
The Metaverse: Are We There Yet?
The  Metaverse:    Are   We  There  Yet?The  Metaverse:    Are   We  There  Yet?
The Metaverse: Are We There Yet?
 
How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfHow we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdf
 

openATTIC & Ceph Management @ Suse Monthly Open Source Talks - 2016-06-07

  • 1. Ceph and Storage Management with openATTIC SUSE Monthly Open Source Talks 2016-07-06 Lenz Grimmer <lenz@openattic.org>
  • 2. 2 openATTIC – Our Vision ─Develop an open source alternative to proprietary storage management systems ─„Traditional” unified storage (NAS/SAN) ─Support Ceph for scale-out scenarios ─Backed with commercial support and services
  • 3. 3 openATTIC – Notable Recent Changes ─Removed Enterprise/Community Edition split ─Now fully under the GPLv2 ─Removed requirement for CLA ─DCA (Signed-off-by) is all that's needed ─Public Jira Bug Tracker ─Public Pull requests / code reviews on BitBucket ─Development/Release Branch ─Entire code base (Backend/WebUI/Test/Docs) in one branch
  • 4. 4 openATTIC – What Sets us Apart? ─ Focus on data center storage management ─ Support both SAN and NAS functionality without limitations ─ Fully Open Source (GPLv2) ─ No arbitrary functional restrictions ─ Low entrance barrier for adoption ─ Based on Linux / OSS tools ─ Multiple Linux distributions (Debian/Ubuntu/Red Hat/SUSE) ─ Well-established technology stack (e.g. drivers, hardware support) ─ Broad user base
  • 5. 5 ─Modern Web UI ─RESTful API (Software- Defined Storage) ─Unified Storage ─NAS (NFS, CIFS, HTTP) ─SAN (iSCSI, Fibre Channel) ─LVM, XFS, ZFS, Btrfs, ext3/4 ─Volume mirroring (DRBD®) ─Multi-node support ─Monitoring (Nagios/Icinga) built-in ─Ceph management and monitoring (WIP) ─Development sponsored by it-novum openATTIC – Open Source Storage Management
  • 6. 6 ─Backend ─Python (Django) ─Django REST Framework (RESTful API) ─Linux tools for storage management, e.g. LVM, LIO, filesystem utilities, DRBD, etc. ─Nagios/Icinga & PNP4Nagios (Monitoring and Graphing) ─Web Frontend ─AngularJS (JS framework) ─Bootstrap (HTML, CSS, and JS framework) ─Uses REST API exclusively ─Automated Test Suites ─Python Unit Tests ─REST Backend Tests (Gatling) ─WebUI Tests (Protractor/Jasmine) openATTIC – Components
  • 7. 7 openATTIC – High Level Architecture
  • 8. 8 openATTIC – Installation on SUSE Linux ─OBS Project filesystems:openATTIC ─Packages available for openSUSE Leap 42.1 & SLES12 ─Thanks to Eric Jackson (swiftgist) for the support! ─Feedback is welcome!
  • 9. 9 openATTIC – Storage Development Roadmap ─ Add Disk and Storage Pool Management to the API & WebUI ─ Creating/Modifying LVM Volume Groups / MD RAID setups ─ Creating/Modifying Btrfs/ZFS Pools (incl. RAID setups) ─ Automatic discovery of disks/pools (via udev) ─ Monitoring Disk health (SMART) ─ Manage HW RAID controllers ─ Add volume mirroring support to the WebUI ─ Extend SAN functionality (more iSCSI/FC features) ─ Public Roadmap on the openATTIC Jira/Wiki to solicit community feedback
  • 10. 10 openATTIC – Ceph Management Challenges ─Managing and monitoring Ceph is complex ─Many tools exist (e.g. Calamari, Intel VSM, ceph-dash) ─Limited functionality, unclear roadmaps ─Finding the best approach for managing Ceph
  • 11. 11 openATTIC – Ceph Management Goals ─Create a management & monitoring GUI tool ─A tool that administrators actually want to use ─That scales without becoming overwhelming ─Still should allow changes to be made elsewhere, without becoming inconsistent
  • 12. 12 openATTIC – Ceph Management Implementation ─Which Ceph Management API? ─How to manage a distributed system? ─How to monitor the cluster‘s health/performance? ─How to perform remote management tasks? ─How to monitor cluster nodes in a scalable way?
  • 13. 13 Django REST Framework Django Models Client (GUI) REST API DB (PostgreSQL) nodb Python librados / librbddjango.db.models openATTIC – “NoDB” Django models
  • 14. 14 openATTIC – Current Ceph Development Status ─“NoDB” backend architecture / framework in place ─Create and map RBDs as block devices (volumes) ─Pool Management Web UI (table view) ─OSD Management Web UI (table view) ─RBD Management Web UI (table view) ─Monitor a cluster health and performance ─CRUSH Map Editor ─Support for managing multiple Ceph clusters
  • 15. 15 openATTIC – Attending SUSE Hackweek ─June 24th – July 1st ─https://hackweek.suse.com/ ─openATTIC Team visited SUSE HQ in Nuremberg ─Implementation design decisions ─ Salt integration ─New features implemented ─ Ceph Monitoring Dashboard ─ Ceph RBD Management
  • 16. 16 openATTIC – Ceph Management REST API https://wiki.openattic.org/display/OP/openATTIC+Ceph+REST+API+overview
  • 17. 17 openATTIC – Ceph Development Roadmap ─ Ceph Cluster Status Dashboard incl. Performance Graphs ─ Extend Pool Management ─ OSD Monitoring/Management ─ RBD Management/Monitoring ─ CephFS Management ─ RGW Management (users, buckets keys) ─ Deployment, remote configuration of Ceph nodes (via Salt) ─ Public Roadmap on the openATTIC Wiki to solicit community feedback: http://bit.ly/28PCTWf
  • 18. 18 openATTIC – Storage Management Dashboard
  • 25. 25 openATTIC – Ceph CRUSH map editing
  • 26. 26 ─ www.openattic.org ─ demo.openattic.org ─ blog.openattic.org ─ docs.openattic.org ─bitbucket.org/openattic ─tracker.openattic.org ─@openATTIC ─openATTIC openATTIC – Resources
  • 27. SUSE CERTIFIED LINUX PROFESSIONAL ACADEMY Technical Training for SUSE Linux Enterprise Server 12 No Cost Flexible 12-Week Online Training This popular training model is for technical sales/engineering employees of SUSE partners interested in learning to install and manage SUSE Linux Enterprise Server 12 (SLES 12). Participation in our SUSE Academy also offers no-cost exam vouchers for participants seeking SUSE certification. Learn through self-study of the SLES 12 curriculum and weekly webinar reviews with our field-experienced instructor. Each Academy participant will need 5-7 hours per week to self-study the SLES 12 course assignments, plus 1 hour each week to attend a webinar review of the key concepts studied. Certification is not required to participate. Contact your company’s Partner Executive to ask to be sponsored in our next Academy.