Ceph Object Storage Performance Secrets and Ceph Data Lake SolutionKaran Singh
In this presentation, i have explained how Ceph Object Storage Performance can be improved drastically together with some object storage best practices, recommendations tips. I have also covered Ceph Shared Data Lake which is getting very popular.
This presentation provides an overview of the Dell PowerEdge R730xd server performance results with Red Hat Ceph Storage. It covers the advantages of using Red Hat Ceph Storage on Dell servers with their proven hardware components that provide high scalability, enhanced ROI cost benefits, and support of unstructured data.
Storage 101: Rook and Ceph - Open Infrastructure Denver 2019Sean Cohen
Starting from the basics, we explore the advantages of using Rook as a Storage operator to serve Ceph storage, the leading Software-Defined Storage platform in the Open Source world. Ceph automates the internal storage management, while Rook automates the user-facing operations and effectively turns a storage technology into a service transparent to the user. The combination delivers an impressive improvement in UX and provides the ideal storage platform for Kubernetes.
A comprehensive examination of use cases and open problems will complement our review of the Rook architecture. We will deep-dive into what Rook does well, what it does not do (yet), and what trade-offs using a storage operator involves operationally. With live access to a running cluster, we will showcase Rook in action as we discuss its capabilities.
https://www.openstack.org/summit/denver-2019/summit-schedule/events/23515/storage-101-rook-and-ceph
Ceph Object Storage Performance Secrets and Ceph Data Lake SolutionKaran Singh
In this presentation, i have explained how Ceph Object Storage Performance can be improved drastically together with some object storage best practices, recommendations tips. I have also covered Ceph Shared Data Lake which is getting very popular.
This presentation provides an overview of the Dell PowerEdge R730xd server performance results with Red Hat Ceph Storage. It covers the advantages of using Red Hat Ceph Storage on Dell servers with their proven hardware components that provide high scalability, enhanced ROI cost benefits, and support of unstructured data.
Storage 101: Rook and Ceph - Open Infrastructure Denver 2019Sean Cohen
Starting from the basics, we explore the advantages of using Rook as a Storage operator to serve Ceph storage, the leading Software-Defined Storage platform in the Open Source world. Ceph automates the internal storage management, while Rook automates the user-facing operations and effectively turns a storage technology into a service transparent to the user. The combination delivers an impressive improvement in UX and provides the ideal storage platform for Kubernetes.
A comprehensive examination of use cases and open problems will complement our review of the Rook architecture. We will deep-dive into what Rook does well, what it does not do (yet), and what trade-offs using a storage operator involves operationally. With live access to a running cluster, we will showcase Rook in action as we discuss its capabilities.
https://www.openstack.org/summit/denver-2019/summit-schedule/events/23515/storage-101-rook-and-ceph
Revisiting CephFS MDS and mClock QoS SchedulerYongseok Oh
This presents the CephFS performance scalability and evaluation results. Specifically, it addresses some technical issues such as multi core scalability, cache size, static pinning, recovery, and QoS.
Ceph is an open source project, which provides software-defined, unified storage solutions. Ceph is a distributed storage system which is massively scalable and high-performing without any single point of failure. From the roots, it has been designed to be highly scalable, up to exabyte level and beyond while running on general-purpose commodity hardware.
Ceph scale testing with 10 Billion ObjectsKaran Singh
In this performance testing, we ingested 10 Billion objects into the Ceph Object Storage system and measured its performance. We have observed deterministic performance, check out this presentation to know the details.
In this session, you'll learn how RBD works, including how it:
Uses RADOS classes to make access easier from user space and within the Linux kernel.
Implements thin provisioning.
Builds on RADOS self-managed snapshots for cloning and differential backups.
Increases performance with caching of various kinds.
Uses watch/notify RADOS primitives to handle online management operations.
Integrates with QEMU, libvirt, and OpenStack.
Ceph data services in a multi- and hybrid cloud worldSage Weil
IT organizations of the future (and present) are faced with managing infrastructure that spans multiple private data centers and multiple public clouds. Emerging tools and operational patterns like kubernetes and microservices are easing the process of deploying applications across multiple environments, but the achilles heel of such efforts remains that most applications require large quantities of state, either in databases, object stores, or file systems. Unlike stateless microservices, state is hard to move.
Ceph is known for providing scale-out file, block, and object storage within a single data center, but it also includes a robust set of multi-cluster federation capabilities. This talk will cover how Ceph's underlying multi-site capabilities complement and enable true portability across cloud footprints--public and private--and how viewing Ceph from a multi-cloud perspective has fundamentally shifted our data services roadmap, especially for Ceph object storage.
Using Rook to Manage Kubernetes Storage with CephCloudOps2005
Moh Ahmed and Raymond Maika presented 'Using Rook to Manage Kubernetes Storage with Ceph' at Montreal's first Cloud Native Day, which took place on June 11 in Montreal.
How Netflix Tunes EC2 Instances for PerformanceBrendan Gregg
CMP325 talk for AWS re:Invent 2017, by Brendan Gregg. "
At Netflix we make the best use of AWS EC2 instance types and features to create a high performance cloud, achieving near bare metal speed for our workloads. This session will summarize the configuration, tuning, and activities for delivering the fastest possible EC2 instances, and will help other EC2 users improve performance, reduce latency outliers, and make better use of EC2 features. We'll show how we choose EC2 instance types, how we choose between EC2 Xen modes: HVM, PV, and PVHVM, and the importance of EC2 features such SR-IOV for bare-metal performance. SR-IOV is used by EC2 enhanced networking, and recently for the new i3 instance type for enhanced disk performance as well. We'll also cover kernel tuning and observability tools, from basic to advanced. Advanced performance analysis includes the use of Java and Node.js flame graphs, and the new EC2 Performance Monitoring Counter (PMC) feature released this year."
Ceph Object Storage Reference Architecture Performance and Sizing GuideKaran Singh
Together with my colleagues at Red Hat Storage Team, i am very proud to have worked on this reference architecture for Ceph Object Storage.
If you are building Ceph object storage at scale, this document is for you.
Red Hat Ceph Storage: Past, Present and FutureRed_Hat_Storage
Ceph is a massively scalable, open source, software-defined storage system that runs on commodity hardware. Get an update about the latest version of Red Hat Ceph Storage, including information about the newest features and use cases, with a particular focus on cloud storage and OpenStack. We’ll also explore the themes and directions for the roadmap for the next 12 months.
Revisiting CephFS MDS and mClock QoS SchedulerYongseok Oh
This presents the CephFS performance scalability and evaluation results. Specifically, it addresses some technical issues such as multi core scalability, cache size, static pinning, recovery, and QoS.
Ceph is an open source project, which provides software-defined, unified storage solutions. Ceph is a distributed storage system which is massively scalable and high-performing without any single point of failure. From the roots, it has been designed to be highly scalable, up to exabyte level and beyond while running on general-purpose commodity hardware.
Ceph scale testing with 10 Billion ObjectsKaran Singh
In this performance testing, we ingested 10 Billion objects into the Ceph Object Storage system and measured its performance. We have observed deterministic performance, check out this presentation to know the details.
In this session, you'll learn how RBD works, including how it:
Uses RADOS classes to make access easier from user space and within the Linux kernel.
Implements thin provisioning.
Builds on RADOS self-managed snapshots for cloning and differential backups.
Increases performance with caching of various kinds.
Uses watch/notify RADOS primitives to handle online management operations.
Integrates with QEMU, libvirt, and OpenStack.
Ceph data services in a multi- and hybrid cloud worldSage Weil
IT organizations of the future (and present) are faced with managing infrastructure that spans multiple private data centers and multiple public clouds. Emerging tools and operational patterns like kubernetes and microservices are easing the process of deploying applications across multiple environments, but the achilles heel of such efforts remains that most applications require large quantities of state, either in databases, object stores, or file systems. Unlike stateless microservices, state is hard to move.
Ceph is known for providing scale-out file, block, and object storage within a single data center, but it also includes a robust set of multi-cluster federation capabilities. This talk will cover how Ceph's underlying multi-site capabilities complement and enable true portability across cloud footprints--public and private--and how viewing Ceph from a multi-cloud perspective has fundamentally shifted our data services roadmap, especially for Ceph object storage.
Using Rook to Manage Kubernetes Storage with CephCloudOps2005
Moh Ahmed and Raymond Maika presented 'Using Rook to Manage Kubernetes Storage with Ceph' at Montreal's first Cloud Native Day, which took place on June 11 in Montreal.
How Netflix Tunes EC2 Instances for PerformanceBrendan Gregg
CMP325 talk for AWS re:Invent 2017, by Brendan Gregg. "
At Netflix we make the best use of AWS EC2 instance types and features to create a high performance cloud, achieving near bare metal speed for our workloads. This session will summarize the configuration, tuning, and activities for delivering the fastest possible EC2 instances, and will help other EC2 users improve performance, reduce latency outliers, and make better use of EC2 features. We'll show how we choose EC2 instance types, how we choose between EC2 Xen modes: HVM, PV, and PVHVM, and the importance of EC2 features such SR-IOV for bare-metal performance. SR-IOV is used by EC2 enhanced networking, and recently for the new i3 instance type for enhanced disk performance as well. We'll also cover kernel tuning and observability tools, from basic to advanced. Advanced performance analysis includes the use of Java and Node.js flame graphs, and the new EC2 Performance Monitoring Counter (PMC) feature released this year."
Ceph Object Storage Reference Architecture Performance and Sizing GuideKaran Singh
Together with my colleagues at Red Hat Storage Team, i am very proud to have worked on this reference architecture for Ceph Object Storage.
If you are building Ceph object storage at scale, this document is for you.
Red Hat Ceph Storage: Past, Present and FutureRed_Hat_Storage
Ceph is a massively scalable, open source, software-defined storage system that runs on commodity hardware. Get an update about the latest version of Red Hat Ceph Storage, including information about the newest features and use cases, with a particular focus on cloud storage and OpenStack. We’ll also explore the themes and directions for the roadmap for the next 12 months.
Peanut Butter and jelly: Mapping the deep Integration between Ceph and OpenStackSean Cohen
Ceph is the most widely deployed storage technology used with OpenStack, most often because it's an open source, massively scalable, unified software-defined storage solution. Its popularity is also due to its unique and optimized technical integration with the OpenStack services and its pure-software approach to scaling. In this session, we'll review how Ceph is integrated into Nova, Glance, Keystone, Cinder, and Manila and demonstrate why using traditional storage products won’t give you the full benefits of an elastic cloud infrastructure. We’ll also cover the flexible deployment options, available through Red Hat Enterprise Linux OpenStack Platform and Red Hat Ceph Storage, for seamless operations and key scenarios like disaster recovery. We'll discuss architectural options for deploying a multisite OpenStack cluster and cover the varying levels of maturity in the OpenStack services for configuring multisite. This session will also show how other technologies are using OpenStack Ceph to increase performance and reduce power consumption, such as Intel SSDs. This will include reference architectures and best practices for Ceph and SSDs.
At the Public Sector Red Hat Storage Days on 1/20/16 and 1/21/16, Jason Calloway walked attendees through the basics of scalable POSIX file systems in the cloud.
CEPH & OPENSTACK - Red Hat's Winning Combination for Enterprise CloudsRed Hat India Pvt. Ltd.
CEPH & OPENSTACK - Red Hat's Winning Combination for Enterprise Clouds. A presentation by Rahul Vijayan, Senior Solutions Architect, Bangalore at Red Hat Forum Bangalore
Red Hat Summit 2015: Red Hat Storage Breakfast sessionRed_Hat_Storage
See the presentation shared during a special breakfast session during Red Hat Summit 2015. Learn about our mission, what areas and communities are seeing strong growth, and much more.
Red Hat Gluster Storage - Direction, Roadmap and Use-CasesRed_Hat_Storage
Red Hat Gluster Storage is open, software-defined storage that helps you manage big, unstructured, and semistructured data. This product is based on the open source project GlusterFS, a distributed scale-out file system technology, and focuses on file sharing, analytics, and hyper-converged use cases.
In this session, you will:
See real-life case studies about Red Hat Gluster Storage’s usage in production environments, including ideal workloads.
Learn about the Red Hat Gluster Storage roadmap, including innovations from the GlusterFS community pipeline.
Gain insights into how the product will be integrated with Red Hat Enterprise Virtualization (including hyperconvergence), Red Hat Satellite, and Red Hat Enterprise Linux OpenStack Platform.
Quickfix é uma implementação livre, opensource, do
protocolo Fix, utilizado no mercado financeiro.
O objetivo desta apresentação é mostrar ganhos
de performance e competitivos.
Afinal, no mercado financeiro “ns” e “ms” fazem toda diferença.
Agenda
● Introdução
● O que é Performance Tuning?
● Só se pode “Tunar” o que se pode medir
● Teoria das Filas.
● Interdependência de componentes.
● Componentes “Tunáveis”
● Colhendo informações e acionando o porte o suporte.
Search and Society: Reimagining Information Access for Radical FuturesBhaskar Mitra
The field of Information retrieval (IR) is currently undergoing a transformative shift, at least partly due to the emerging applications of generative AI to information access. In this talk, we will deliberate on the sociotechnical implications of generative AI for information access. We will argue that there is both a critical necessity and an exciting opportunity for the IR community to re-center our research agendas on societal needs while dismantling the artificial separation between the work on fairness, accountability, transparency, and ethics in IR and the rest of IR research. Instead of adopting a reactionary strategy of trying to mitigate potential social harms from emerging technologies, the community should aim to proactively set the research agenda for the kinds of systems we should build inspired by diverse explicitly stated sociotechnical imaginaries. The sociotechnical imaginaries that underpin the design and development of information access technologies needs to be explicitly articulated, and we need to develop theories of change in context of these diverse perspectives. Our guiding future imaginaries must be informed by other academic fields, such as democratic theory and critical theory, and should be co-developed with social science scholars, legal scholars, civil rights and social justice activists, and artists, among others.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
1. THE POWER OF RED HAT CEPH STORAGE
And how it’s essential to your software defined datacenter
Rodrigo Missiaggia
Principal Solutions Architect
28/07/2016
2. WHY YOU SHOULD CARE
Essential – Critical component of software-defined datacenter
Elastic – Massively scalable for next generation workloads
Economical – Runs on standard servers and disks
Efficient – Unifies infrastructures to support different data types
Elegant – Sophisticated & powerful – designed for IT practitioner
Easy – Now included with Red Hat OpenStack Platform / Cloud Suite
3. AGENDA
● Requirements and trends
● Software-defined storage
● Red Hat Ceph Storage 101
● OpenStack integration
● Product features, benefits, and
differentiation
● Service offerings
● Where to go next
5. CUSTOMER REQUIREMENTS
● Greater cost-efficiencies (30-40% annual data growth, while 60%
storage budgets flat or declining)
● Control of data growth with flexible multi-workload architectures
● Freedom from worsening labor constraints of proprietary storage
● Better day-to-day maintenance of complex storage infrastructures
● Enterprise-readiness: resilience, performance, data protection
● Agile infrastructure to match capabilities of cloud services
6. Traditional Open, software-defined
Standard
computers
and disks
Standard
Hardware
OpenSource
Software
Ceph Gluster +++
Control Plane (API, GUI)
ADMIN USER
THE FUTURE OF STORAGE
ADMIN
USER
ADMIN
USER
ADMIN
USER
Interface de Adminsitração
Software e Hardware proprietários
7. FOUNDATIONAL SHIFTS
PROPRIETARY HARDWARE
HARDWARE-BASED INTELLIGENCE
SCALE-UP ARCHITECTURE
CLOSED DEVELOPMENT PROCESS
Standards-based, interoperable hardware
Lower cost, standardized supply chain
Scale-out architecture
Increased operational flexibility
Software-based intelligence
More programmability, agility, and control
Open development process
More flexible, well-integrated technology
8. RISING TIDE OF SOFTWARE-DEFINED STORAGE
“By 2020, between 70-80% of unstructured
data will be held on lower-cost storage
managed by SDS environments.”
“By 2016, server-based storage solutions will
lower storage hardware costs by 50% or more.”
Gartner: “IT Leaders Can Benefit From Disruptive Innovation in the Storage
Industry”
Innovation Insight: Separating Hype From Hope for Software-Defined Storage
~20% CAGR between 2015 and 2019
2013 2014 2015 2016 2017 2018 2019
$1,349M
$1,195M
$1,029M
$859M
$706M
$592M
SDS MARKET SIZE BY SEGMENT
$457M
Block Storage
File Storage
Object Storage
Hyper converged
Source: IDC
“By 2019, 70% of existing storage array products
will also be available as software only versions”
Innovation Insight: Separating Hype From Hope for Software-Defined Storage
9. THE RED HAT STORAGE MISSION
To offer, with our partners, a unified, open
software-defined storage portfolio for next
generation workloads thereby accelerating the
transition to modern IT infrastructures.
12. RED HAT CEPH STORAGE
12
Distributed, enterprise-grade object storage, proven at web scale
Open, massively-scalable, software-defined
Flexible, scale-out architecture on clustered commodity hardware
Single, efficient, unified storage platform (block, object, file)
User-driven storage lifecycle management with 100% API coverage
Integrated, easy-to-use management console
Designed for cloud infrastructure and emerging workloads
13. BUSINESS BENEFITS
● Open source - no proprietary lock-in, large ecosystem, community backing
● Lower cost - than traditional NAS/SAN, particularly petabyte workloads
● Peace of mind - decade of development, production proven, overwhelmingly
preferred, supported and integrated by Red Hat
14. TECHNICAL BENEFITS OF CEPH
● Massive scalability, to
support petabytes of data
● Maximum uptime, with
no single point of failure
● Reduced maintenance,
via self-management and
self-healing
● Operational efficiency,
by distributing data
dynamically among servers
and disks
16. COMPLETE, DEEPLY INTEGRATED STORAGE
FOR OPENSTACK
● Deeply integrated with modular architecture and components for ephemeral
& persistent storage
Nova, Cinder, Manila, Glance, Keystone, Swift
● Optimized for Database as a Service (DaaS) with MySQL workloads
● Bundled in Red Hat OpenStack Platform
17. ADVANTAGES FOR OPENSTACK USERS
● Instantaneous booting of 1 or 100s of VMs
● Instant backups via seamless data migration between Glance, Cinder, Nova
● Tiered I/O performance within single cluster
● Multi-site replication for disaster recovery or archiving
18. SCALABILITY
Hundreds of nodes
CRUSH algorithm
(placement and rebalancing)
No single point of failure
SCALABILITY
Hundreds of nodes
CRUSH algorithm
(placement and rebalancing)
No single point of failure PROTOCOLS
S3, Swift
Cinder block storage
POSIX (Tech preview - TP)
NFS to S3 gateway (TP)
iSCSI (2.1)
PROTOCOLS
S3, Swift
Cinder block storage
POSIX (Tech preview - TP)
NFS to S3 gateway (TP)
iSCSI (2.1)
SECURITY
Pool-level authentication
Active Directory, LDAP, Keystone
v3
At-rest encryption
SECURITY
Pool-level authentication
Active Directory, LDAP, Keystone
v3
At-rest encryptionDATA SERVICES
Snapshots, cloning, and copy-on-write
Global clusters for S3/Swift storage (New)
Disaster recovery for block storage (New)
DATA SERVICES
Snapshots, cloning, and copy-on-write
Global clusters for S3/Swift storage (New)
Disaster recovery for block storage (New)
PERFORMANCE
Client-side caching
Server-side journaling
BlueStore (TP)
PERFORMANCE
Client-side caching
Server-side journaling
BlueStore (TP)
EFFICIENCY
Standard (commodity) hardware
Erasure coding (reduced footprint)
Thin provisioning
EFFICIENCY
Standard (commodity) hardware
Erasure coding (reduced footprint)
Thin provisioning
FEATURES, NO FLUFF
Red Hat Ceph
Storage 2
19. WHAT’S NEW IN 2
1. New storage management platform, “Red Hat
Storage Console 2”
2. RGW geo-clusters with single namespace
3. RBD Mirroring to enable multi-site replication for
disaster recovery and archival
4. Support for Active Directory, LDAP, and Keystone v3
5. Improved S3 and Swift protocol API support
6. Tech preview of CephFS
7. Tech preview of NFS to S3 gateway
8. Tech preview of BlueStore turbocharge
20. NEW INTEGRATED MANAGEMENT WITH
RED HAT STORAGE CONSOLE 2
• Easy to use graphical interface to
manage storage cluster life cycle
• Ansible-based deployment tools for
installation, importation, and granular
configuration from CLI or GUI
• Monitoring and troubleshooting with
statistical and graphical information
about cluster components
RADOS. RGW, RBD, CALAMARI
RED HAT STORAGE CONSOLE 2
CLUSTER OF STANDARD SERVERS AND MEDIA
CLIENTSADMINS
21. RED HAT STORAGE CONSOLE 2
BENEFITS
• Ease of use
Integrated on-premise management console and service dashboard
Easy installation, management, and monitoring from modern UI
• Comprehensive visibility
Unified view of storage infrastructure
Enhanced discovery, insight, and management
• Operational intelligence
Proactive health management, capacity and performance utilization
through advanced monitoring and diagnostic information
22. Great improvements to RGW, Ceph’s
object storage interface:
• Support for authentication using Active
Directory, LDAP & OpenStack Keystone v3
• Greater compatibility with the Amazon S3
and OpenStack Swift object storage APIs
• AWS v4 signatures, object versioning, bulk deletes
• New NFS gateway for bulk import and
export of object data (tech preview)
OBJECT STORAGE IMPROVEMENTS
23. Global object storage clusters with
single namespace
• Enables deployment of clusters across
multiple geographic locations
• Clusters synchronize, allowing users to
read from or write to the closest one
Multi-site replication for block devices
• Replicates virtual block devices across
regions for disaster recovery and archival
NEW MULTISITE CAPABILITIES
USERUSER
CEPH OBJECT GATEWAYCEPH OBJECT GATEWAY
USERUSER
CEPH OBJECT GATEWAYCEPH OBJECT GATEWAY
STORAGE CLUSTER
US-EAST
STORAGE CLUSTER
US-WEST
24. PERFORMANCE BOOST WITH BLUESTORE
• New storage backend optimized for modern media - Tech
preview in RHCS 2
• Replaces FileStore, optimized for HDDs – file system for
object data management impacted performance
• Benefits of BlueStore:
• 2-3X performance
• Mitigates need for underlying file system or dedicated journal device
• Flexible media topologies (SSDs, K/V drives, persistent memory
devices) to help optimize data or metadata I/O
• Native checksumming to detect data corruption on media
25. OPENSTACK FILE SUPPORT WITH CephFS
• POSIX-compliant file system to store data in accordance
with OpenStack Manila Project
• Tech Preview RHCS 2 – Manila Tech Preview OSP 7, 8
• FUSE or kernel clients (RHEL 7.2)
• CephFS Manila driver (tech preview) with OSP 9
• Roadmap: robustness, hardening, then scalability
November 2015:
Manila Tech
Preview in OSP 7
July 2016: CephFS tech preview
in RHCS 2 and clients
August 2016:
CephFS Manila
driver tech
preview in OSP 9
November 2016: Manila
production support in OSP 10
2017: CephFS
production
support RHCS 2.x
Timeline is Red Hat Confidential
26. The other guys
Description Software-defined, unified storage and
distributed object store
Traditional NAS & SAN appliance (still
requiring two storage systems)
Capacity 1000s of nodes, limitless petabytes ~6 PBs
Scalability Easy to add and manage- via single nodes on
standard servers and disks
Difficult - via forklift installation of
additional appliances
VM migration and
backups
Live, instantaneous, for high agility in cloud
environments
Cumbersome and slow: Image pulled
from Swift for each instance
Design process Open source Proprietary
Maintenance Nodes added and removed on fly Appliance replacement impacts data
migration and downtime
Cost Pay-as-you-go OPEX, economical at scale Large upfront CAPEX, much (75%+)
more expensive on PB+ workloads
COMPARING AND CONTRASTING THE OPTIONS
28. SERVICES AVAILABLE FROM RED HAT
Spanning Red Hat Ceph Storage and Red Hat OpenStack Platform
Subscription Benefits – Streamlined product and resource access, lifecycle management,
Knowledgebase and deployment resources, security and accountability
Jumpstart - 3 day consulting for pre-production cluster implementation at customer site
Health Check - 3-5 day evaluation of total solution best practice engagement
Red Hat Storage Consulting Services - recommended for initial storage design and set-up
Global Services and Support - production subscriptions for smooth lifecycle deployments
Red Hat Storage training – 2 and 5 day for storage or cloud admins, including OpenStack
30. REFERENCE ARCHITECTURES
Performance and Sizing Guide: Red Hat Ceph Storage on Supermicro Storage
Performance and Sizing Guide: Red Hat Ceph Storage on QCT Servers
Deploying Red Hat OpenStack Platform 7 with Red Hat OSP director 7.1 (Access via customer portal)
Guidelines and Considerations for Performance and Scaling your Red Hat OpenStack
Platform 7 Cloud (Access via customer portal)
Guidelines and Considerations for Performance and Scaling your Red Hat OpenStack
Platform 6 Cloud (Access via customer portal)
Deploying Highly Available Red Hat OpenStack Platform 6 with Red Hat Ceph Storage
Deploying Red Hat OpenStack Platform 6 with Ceph Storage
Dell Red Hat Cloud Solutions Reference Architecture Guide
Cisco UCS C3160 High-Density Rack Server with Red Hat Ceph Storage
32. WHERE TO GO NEXT?
Red Hat Subscriptions: https://access.redhat.com/subscription-value
Evaluation, Pre-production, and Production contracts available through Red Hat sales
Red Hat Consulting: http://www.redhat.com/en/services/consulting/storage
Red Hat Storage training: https://www.redhat.com/en/services/training
Red Hat Storage test-drive: http://red.ht/cephtestdrive