OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

•

1 like•2,411 views

Paris, 5th December 2013 : OpenStack in Action 4! organized by eNovance, brings together members of the OpenStack community.

Ceph: de factor storage backend for
OpenStack
OpenStack in Action 4! Paris, 5th December

Whoami
💥 Sébas9en Han
💥 French Cloud Engineer working for eNovance
💥 Daily job focused on Ceph and OpenStack
💥 Blogger

Personal blog: hGp://www.sebas9en-‐han.fr/blog/
Company blog: hGp://techs.enovance.com/

Worldwide oﬃces coverage
We design, build and run clouds – any9me -‐ anywhere

The project
➜  Uniﬁed distributed storage system
➜  Started in 2006 as a PhD by Sage Weil
➜  Open source under LGPL license
➜  Written in C++
➜  Build the future of storage on commodity hardware

Key features
➜  Self managing/healing
➜  Self balancing
➜  Painless scaling
➜  Data placement with CRUSH

Controlled replica9on under scalable hashing
➜  Pseudo-random placement algorithm
➜  Statistically uniform distribution
➜  Rule-based conﬁguration

State of the integra9on

Including best Havana’s addi9ons

Why is Ceph so good?
It uniﬁes OpenStack components

Havana’s addi9ons
➜  Complete refactor of the Cinder driver:
•  Librados and librbd usage
•  Flatten volumes created from snapshots
•  Clone depth

➜  Cinder backup with a Ceph backend:
• 
• 
• 
• 
• 

backing up within the same Ceph pool (not recommended)
backing up between different Ceph pools
backing up between different Ceph clusters
Support RBD stripes
Differentials

➜  Nova Libvirt_image_type = rbd
•  Directly boot all the VMs in Ceph
•  Volume QoS

What’s missing?
➜  Direct URL download for Nova
•  Already on the pipe, probably for 2013.2.1

➜  Nova’s snapshots integration
•  Ceph snapshot

https://github.com/jdurgin/nova/commits/havana-ephemeral-rbd

Icehouse roadmap
➜  Implement “bricks” for RBD
➜  Re-implement snapshotting function to use RBD snapshot
➜  RBD on Nova bare metal
➜  Volume migration support
➜  RBD stripes support

« J » poten9al roadmap
➜  Manila support

Fireﬂy
➜  Tiering - cache pool overlay
➜  Erasure code
➜  Ceph OSD ZFS
➜  Full support of OpenStack Icehouse

Many thanks!

Questions?

Contact: sebastien@enovance.com
Twitter: @sebastien_han
IRC: leseb

It wasn’t more then 4 months between the first getting in touch with Opennebula and our productive Opennebula cluster beeing fired up. It was a quick decision that turned our to be the absolute right one. Since a little more than a year we are on our evolving way with Opennebula. So what have we been looking for and why did we end up with Opennebula? How does our setup look like in the moment and what are our future plans with Opennebula? Learnings from a year with Opennebula.

Making sense of Apache Bigtop's role in ODPi and how it matters to Apache Apex

Apache Apex

Containers and HPC

Olli-Pekka Lehto

Containers and CloudStack

ShapeBlue

OpenStack in Action 4! Doug hellman - Intersection of OpenStack and python co...

eNovance

OpenShift, Docker, Kubernetes: The next generation of PaaS

Graham Dumpleton

Containers are upending the way that developers and operations groups are thinking about how to deploy software. To cater for these new ways of thinking, traditional Platform as a Service (PaaS) providers are also needing to adapt. Although PaaS providers have been using containers for some time, the new focus is around Docker and the image portability it provides. It isn't all about containers though, you still need orchestration to manage where containers are deployed, as well as workflows for getting you from source code to deployed application. In this talk you will learn about how OpenShift, Red Hat's Open Source PaaS is being reimplemented around Docker and Kubernetes, adding in its own secret sauce to deliver a next generation PaaS.

Peanut Butter and jelly: Mapping the deep Integration between Ceph and OpenStack

Sean Cohen

Ceph is the most widely deployed storage technology used with OpenStack, most often because it's an open source, massively scalable, unified software-defined storage solution. Its popularity is also due to its unique and optimized technical integration with the OpenStack services and its pure-software approach to scaling. In this session, we'll review how Ceph is integrated into Nova, Glance, Keystone, Cinder, and Manila and demonstrate why using traditional storage products won’t give you the full benefits of an elastic cloud infrastructure. We’ll also cover the flexible deployment options, available through Red Hat Enterprise Linux OpenStack Platform and Red Hat Ceph Storage, for seamless operations and key scenarios like disaster recovery. We'll discuss architectural options for deploying a multisite OpenStack cluster and cover the varying levels of maturity in the OpenStack services for configuring multisite. This session will also show how other technologies are using OpenStack Ceph to increase performance and reduce power consumption, such as Intel SSDs. This will include reference architectures and best practices for Ceph and SSDs.

OpenStack and Ceph: the Winning Pair

Red_Hat_Storage

OpenStack and Ceph: the Winning Pair By: Sebastien Han Ceph has become increasingly popular and saw several deployments inside and outside OpenStack. The community and Ceph itself has greatly matured. Ceph is a fully open source distributed object store, network block device, and file system designed for reliability, performance,and scalability from terabytes to exabytes. Ceph utilizes a novel placement algorithm (CRUSH), active storage nodes, and peer-to-peer gossip protocols to avoid the scalability and reliability problems associated with centralized controllers and lookup tables. The main goal of the talk is to convince those of you who aren't already using Ceph as a storage backend for OpenStack to do so. I consider the Ceph technology to be the de facto storage backend for OpenStack for a lot of good reasons that I'll expose during the talk. Since the Icehouse OpenStack summit, we have been working really hard to improve the Ceph integration. Icehouse is definitely THE big release for OpenStack and Ceph. In this session, Sebastien Han from eNovance will go through several subjects such as: Ceph overview Building a Ceph cluster - general considerations Why is Ceph so good with OpenStack? OpenStack and Ceph: 5 minutes quick start for developers Typical architecture designs State of the integration with OpenStack (icehouse best additions) Juno roadmap and beyond. Video Presentation: http://bit.ly/1iLwTNf

XCP-ng - Olivier Lambert

ShapeBlue

How to Survive an OpenStack Cloud Meltdown with Ceph

Sean Cohen

What if you lost your datacenter completely in a catastrophe, but your users hardly noticed? Sounds like a mirage, but it’s absolutely possible. This talk will showcase OpenStack features enabling multisite and disaster recovery functionalities. We’ll present the latest capabilities of OpenStack and Ceph for Volume and Image Replication using Ceph Block and Object as the backend storage solution, as well as look at the future developments they are driving to improve and simplify the relevant architecture use cases, such as Distributed NFV, an emerging use case that rationalizes your IT by using less control planes and allows you to spread your VNF on multiple datacenters and edge deployments. In this session you will learn about wew OpenStack features enabling Multisite and distributed deployments, as well as review key use cases, architecture design and best practices to help operations avoid the OpenStack cloud Meltdown nightmare. https://youtu.be/n2S7uNC_KMw https://goo.gl/cRNGBK

Architecting a Cloud Native Internet Archive

Ross Kukulinski

From Node Interactive North America 2016. In this talk, Ross Kukulinski, a NodeJS Evangelist, container enthusiast, and NodeSource technical product manager will share his cloud-native implementation of the Internet Archive’s Wayback Machine, including a live demonstration. Ross will share his goals, architecture, and technology stack choices to implement a scalable, containerized, microservice implementation of the Wayback Machine using Node.JS, Docker, and Kubernetes. Topics covered in the talk will include:- Architecture- Scaling- Monitoring- CI/CD

Delve into Helm - Advanced DevOps

Lachlan Evenson

KubeCon EU 2017 Berlin Helm is not just for simple applications running in simple environments. In this talk, we delve into the depths of Helm, focusing on lifecycle management and continuous delivery (CI/CD) of Kubernetes-native applications in different environments. We show how to extend Helm’s capabilities with plugins and add-ons. We'll also see how sophisticated charts like OpenStack and Deis Workflow use these capabilities to model more complex deployments.

'Package Once/Run Anywhere' Big Data and HPC workloads

GreenQloud

Using Rook to Manage Kubernetes Storage with Ceph

CloudOps2005

Cloudformation vs terraform_vs_ansible

Geert Theys

OpenNebula Conf 2014 | Bootstrapping a virtual infrastructure using OpenNebul...

NETWAYS

This talk shows how to setup a virtual infrastructure using OpenNebula as cloud management platform, SaltStack for configuration management and Foreman for bare-metal/ virtual host provisioning. You will see how to combine OpenNebula with bare-metal deployment on standard server hardware using non-shared storage in an environment without physical access to the hardware and no existing base infrastructure like DNS, NTP, DHCP, VPN or other. The infrastructure installation has been done automatically using public code and free Open Source software.

Docker for HPC: how E4 is using it

E4 Computer Engineering SpA

Euro ht condor_alahiff

vandersantiago

Infrastructure as code with TerraformSam Bashton

[Rakuten TechConf2014] [F-4] At Rakuten, The Rakuten OpenStack Platform and B...

Rakuten Group, Inc.

Ceph, Xen, and CloudStack: Semper Melior-XPUS13 McGarry

The Linux Foundation

RBD, the RADOS Block Device in Ceph, gives you virtually unlimited scalability (without downtime), high performance, intelligent balancing and self-healing capabilities that traditional SANs can't provide. Ceph achieves this higher throughput through a unique system of placing objects across multiple nodes, and adaptive load balancing that replicates frequently accessed objects over more nodes. This talk will give a brief overview of the Ceph architecture, current integration with Apache CloudStack, and recent advancements with Xen and blktap2.

What's hot

Ceph & OpenStack talk given @ OpenStack Meetup @ Bangalore, June 2015

Deepak Shetty

OpenNebula Conf 2014 | OpenNebula as alternative to commercial virtualization...

NETWAYS

Making sense of Apache Bigtop's role in ODPi and how it matters to Apache Apex

Apache Apex

Containers and HPC

Olli-Pekka Lehto

Containers and CloudStack

ShapeBlue

OpenStack in Action 4! Doug hellman - Intersection of OpenStack and python co...

eNovance

OpenShift, Docker, Kubernetes: The next generation of PaaS

Graham Dumpleton

Peanut Butter and jelly: Mapping the deep Integration between Ceph and OpenStack

Sean Cohen

OpenStack and Ceph: the Winning Pair

Red_Hat_Storage

XCP-ng - Olivier Lambert

ShapeBlue

How to Survive an OpenStack Cloud Meltdown with Ceph

Sean Cohen

Architecting a Cloud Native Internet Archive

Ross Kukulinski

Delve into Helm - Advanced DevOps

Lachlan Evenson

'Package Once/Run Anywhere' Big Data and HPC workloads

GreenQloud

Using Rook to Manage Kubernetes Storage with Ceph

CloudOps2005

Cloudformation vs terraform_vs_ansible

Geert Theys

OpenNebula Conf 2014 | Bootstrapping a virtual infrastructure using OpenNebul...

NETWAYS

Docker for HPC: how E4 is using it

E4 Computer Engineering SpA

Euro ht condor_alahiff

vandersantiago

Infrastructure as code with TerraformSam Bashton

What's hot (20)

Ceph & OpenStack talk given @ OpenStack Meetup @ Bangalore, June 2015

OpenNebula Conf 2014 | OpenNebula as alternative to commercial virtualization...

Making sense of Apache Bigtop's role in ODPi and how it matters to Apache Apex

Containers and HPC

Containers and CloudStack

OpenStack in Action 4! Doug hellman - Intersection of OpenStack and python co...

OpenShift, Docker, Kubernetes: The next generation of PaaS

Peanut Butter and jelly: Mapping the deep Integration between Ceph and OpenStack

OpenStack and Ceph: the Winning Pair

XCP-ng - Olivier Lambert

How to Survive an OpenStack Cloud Meltdown with Ceph

Architecting a Cloud Native Internet Archive

Delve into Helm - Advanced DevOps

'Package Once/Run Anywhere' Big Data and HPC workloads

Using Rook to Manage Kubernetes Storage with Ceph

Cloudformation vs terraform_vs_ansible

OpenNebula Conf 2014 | Bootstrapping a virtual infrastructure using OpenNebul...

Docker for HPC: how E4 is using it

Euro ht condor_alahiff

Infrastructure as code with Terraform

Similar to OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

[Rakuten TechConf2014] [F-4] At Rakuten, The Rakuten OpenStack Platform and B...

Rakuten Group, Inc.

Ceph, Xen, and CloudStack: Semper Melior-XPUS13 McGarry

The Linux Foundation

OpenNebulaConf2018 - OpenNebula in a Continuous Integration Environment - Geo...

OpenNebula Project

Storage 101: Rook and Ceph - Open Infrastructure Denver 2019

Sean Cohen

Starting from the basics, we explore the advantages of using Rook as a Storage operator to serve Ceph storage, the leading Software-Defined Storage platform in the Open Source world. Ceph automates the internal storage management, while Rook automates the user-facing operations and effectively turns a storage technology into a service transparent to the user. The combination delivers an impressive improvement in UX and provides the ideal storage platform for Kubernetes. A comprehensive examination of use cases and open problems will complement our review of the Rook architecture. We will deep-dive into what Rook does well, what it does not do (yet), and what trade-offs using a storage operator involves operationally. With live access to a running cluster, we will showcase Rook in action as we discuss its capabilities. https://www.openstack.org/summit/denver-2019/summit-schedule/events/23515/storage-101-rook-and-ceph

Ceph, Xen, and CloudStack: Semper Melior

Patrick McGarry

Ceph & OpenStack - Boston Meetup

Patrick McGarry

Ceph and openstack at the boston meetup

Kamesh Pemmaraju

There have been heaping piles of buzz surrounding Ceph and OpenStack lately. Similar amounts of work have been going in to the integration between Ceph and OpenStack in recent versions. We'll take a look at how this work is making all the awesomeness of Ceph available to users in a simple, intuitive, and powerful way. The world of Havana and beyond is certainly no different, and promises to continue the trend of both functionality and buzz-worthiness. This talk given at the OpenStack meetup in Boston (Aug 14, 2013) gives a brief introduction to Ceph for the uninitiated and take a look at what's coming down the road. The short term of Havana has plenty to keep fans of both platforms happy and busy, but there are plenty more interesting problems that we can tackle. In addition to the concrete of the short term we'll take a look at how less-oft-used pieces of the Ceph platform can help augment your OpenStack setup, some general blue sky thinking, and what the community can do to get involved.

Leonid Vasilyev "Building, deploying and running production code at Dropbox"

IT Event

On demand-block-storage-for-docker

Jangseon Ryu

Cloud Foundry 百日行振り返り

nota-ja

CloudStack EU user group - Trillian

ShapeBlue

[BarCamp2018][20180915][Tips for Virtual Hosting on Kubernetes]

Wong Hoi Sing Edison

Avishay Traeger & Shimshon Zimmerman, Stratoscale - Deploying OpenStack Cinde...

Cloud Native Day Tel Aviv

3 ubuntu open_stack_cephopenstackindia

Webinar:Kubecon Barcelona Update + OpenEBS 0.9 release

MayaData Inc

OPENEBS NOW IN CNCF In this webinar, MayaData team give a summary of what being a CNCF project means to the community and updates on the project engagement / contributor meeting schedules. OPENEBS 0.9 RELEASE New features introduced as part of the OpenEBS 0.9 release such as dynamic provisioning of Local PV, performance tuning, new functionalities for backup, HA and security and many other new features. KUBECON ANNOUNCEMENTS We will review some announcements made at KubeCon in Barcelona such as a new storage engine that brings NVMe to the world of Container Attached Storage and deploying OpenEBS at the edge and far-edge. We will also highlight some of the complementary ecosystem projects and of course, lessons learned during the week. DEMO Before we get into Q&A MayaData team will live demonstrate some of the features discussed in the release update.

Kolla talk at OpenStack Summit 2017 in Sydney

Vikram G Hosakote

Ceph Goes on Online at Qihoo 360 - Xuehan Xu

Ceph Community

CEPH DAY BERLIN - WHAT'S NEW IN CEPH

Ceph Community

Introduction into Ceph storage for OpenStack

OpenStack_Online

NLUUG print conference May 26 2016

Igmar Palsenberg

Similar to OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack (20)

[Rakuten TechConf2014] [F-4] At Rakuten, The Rakuten OpenStack Platform and B...

Ceph, Xen, and CloudStack: Semper Melior-XPUS13 McGarry

OpenNebulaConf2018 - OpenNebula in a Continuous Integration Environment - Geo...

Storage 101: Rook and Ceph - Open Infrastructure Denver 2019

Ceph, Xen, and CloudStack: Semper Melior

Ceph & OpenStack - Boston Meetup

Ceph and openstack at the boston meetup

Leonid Vasilyev "Building, deploying and running production code at Dropbox"

On demand-block-storage-for-docker

Cloud Foundry 百日行振り返り

CloudStack EU user group - Trillian

[BarCamp2018][20180915][Tips for Virtual Hosting on Kubernetes]

Avishay Traeger & Shimshon Zimmerman, Stratoscale - Deploying OpenStack Cinde...

3 ubuntu open_stack_ceph

Webinar:Kubecon Barcelona Update + OpenEBS 0.9 release

Kolla talk at OpenStack Summit 2017 in Sydney

Ceph Goes on Online at Qihoo 360 - Xuehan Xu

CEPH DAY BERLIN - WHAT'S NEW IN CEPH

Introduction into Ceph storage for OpenStack

NLUUG print conference May 26 2016

Recently uploaded

LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...

DanBrown980551

Do you want to learn how to model and simulate an electrical network from scratch in under an hour? Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)! During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook. PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides: - A fully editable and extendable library for grid component modelling; - Visualization tools to display your network; - Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses; The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well. What you will learn during the webinar: - For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills; - For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.

Elizabeth Buie - Older adults: Are we really designing for our future selves?

Nexer Digital

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

FIDO Alliance

PHP Frameworks: I want to break free (IPC Berlin 2024)

Ralf Eggert

In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development. This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.

Generative AI Deep Dive: Advancing from Proof of Concept to Production

Aggregage

Elevating Tactical DDD Patterns Through Object Calisthenics

Dorra BARTAGUIZ

After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!

Epistemic Interaction - tuning interfaces to provide information for AI support

Alan Dix

Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024 https://alandix.com/academic/papers/synergy2024-epistemic/ As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.

PCI PIN Basics Webinar from the Controlcase Team

ControlCase

UiPath Community Day Dubai: AI at Work..

UiPathCommunity

Welcome to the first live UiPath Community Day Dubai! Join us for this unique occasion to meet our local and global UiPath Community and leaders. You will get a full view of the MEA region's automation landscape and the AI Powered automation technology capabilities of UiPath. Also, hosted by our local partners Marc Ellis, you will enjoy a half-day packed with industry insights and automation peers networking. 📕 Curious on our agenda? Wait no more! 10:00 Welcome note - UiPath Community in Dubai Lovely Sinha, UiPath Community Chapter Leader, UiPath MVPx3, Hyper-automation Consultant, First Abu Dhabi Bank 10:20 A UiPath cross-region MEA overview Ashraf El Zarka, VP and Managing Director MEA, UiPath 10:35: Customer Success Journey Deepthi Deepak, Head of Intelligent Automation CoE, First Abu Dhabi Bank 11:15 The UiPath approach to GenAI with our three principles: improve accuracy, supercharge productivity, and automate more Boris Krumrey, Global VP, Automation Innovation, UiPath 12:15 To discover how Marc Ellis leverages tech-driven solutions in recruitment and managed services. Brendan Lingam, Director of Sales and Business Development, Marc Ellis

Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...

UiPathCommunity

💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™: See how to accelerate model training and optimize model performance with active learning Learn about the latest enhancements to out-of-the-box document processing – with little to no training required Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath. Speakers: 👨‍🏫 Andras Palfi, Senior Product Manager, UiPath 👩‍🏫 Lenka Dulovicova, Product Program Manager, UiPath

Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...

SOFTTECHHUB

The choice of an operating system plays a pivotal role in shaping our computing experience. For decades, Microsoft's Windows has dominated the market, offering a familiar and widely adopted platform for personal and professional use. However, as technological advancements continue to push the boundaries of innovation, alternative operating systems have emerged, challenging the status quo and offering users a fresh perspective on computing. One such alternative that has garnered significant attention and acclaim is Nitrux Linux 3.5.0, a sleek, powerful, and user-friendly Linux distribution that promises to redefine the way we interact with our devices. With its focus on performance, security, and customization, Nitrux Linux presents a compelling case for those seeking to break free from the constraints of proprietary software and embrace the freedom and flexibility of open-source computing.

Assure Contact Center Experiences for Your Customers With ThousandEyes

ThousandEyes

Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™

UiPathCommunity

In questo evento online gratuito, organizzato dalla Community Italiana di UiPath, potrai esplorare le nuove funzionalità di Autopilot, il tool che integra l'Intelligenza Artificiale nei processi di sviluppo e utilizzo delle Automazioni. 📕 Vedremo insieme alcuni esempi dell'utilizzo di Autopilot in diversi tool della Suite UiPath: Autopilot per Studio Web Autopilot per Studio Autopilot per Apps Clipboard AI GenAI applicata alla Document Understanding 👨‍🏫👨‍💻 Speakers: Stefano Negro, UiPath MVPx3, RPA Tech Lead @ BSP Consultant Flavio Martinelli, UiPath MVP 2023, Technical Account Manager @UiPath Andrei Tasca, RPA Solutions Team Lead @NTT Data

Removing Uninteresting Bytes in Software Fuzzing

Aftab Hussain

Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process. In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds. - These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf

FIDO Alliance

The Metaverse and AI: how can decision-makers harness the Metaverse for their...

Jen Stirrup

The Metaverse is popularized in science fiction, and now it is becoming closer to being a part of our daily lives through the use of social media and shopping companies. How can businesses survive in a world where Artificial Intelligence is becoming the present as well as the future of technology, and how does the Metaverse fit into business strategy when futurist ideas are developing into reality at accelerated rates? How do we do this when our data isn't up to scratch? How can we move towards success with our data so we are set up for the Metaverse when it arrives? How can you help your company evolve, adapt, and succeed using Artificial Intelligence and the Metaverse to stay ahead of the competition? What are the potential issues, complications, and benefits that these technologies could bring to us and our organizations? In this session, Jen Stirrup will explain how to start thinking about these technologies as an organisation.

By Design, not by Accident - Agile Venture Bolzano 2024

Pierluigi Pugliese

GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...

Sri Ambati

FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf

FIDO Alliance

The Future of Platform Engineering

Jemma Hussein Allen

Recently uploaded (20)

LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...

Elizabeth Buie - Older adults: Are we really designing for our future selves?

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

PHP Frameworks: I want to break free (IPC Berlin 2024)

Generative AI Deep Dive: Advancing from Proof of Concept to Production

Elevating Tactical DDD Patterns Through Object Calisthenics

Epistemic Interaction - tuning interfaces to provide information for AI support

PCI PIN Basics Webinar from the Controlcase Team

UiPath Community Day Dubai: AI at Work..

Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...

Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...

Assure Contact Center Experiences for Your Customers With ThousandEyes

Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™

Removing Uninteresting Bytes in Software Fuzzing

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf

The Metaverse and AI: how can decision-makers harness the Metaverse for their...

By Design, not by Accident - Agile Venture Bolzano 2024

GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...

FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf

The Future of Platform Engineering

OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

1. Ceph: de factor storage backend for OpenStack OpenStack in Action 4! Paris, 5th December

2. Whoami 💥 Sébas9en Han 💥 French Cloud Engineer working for eNovance 💥 Daily job focused on Ceph and OpenStack 💥 Blogger Personal blog: hGp://www.sebas9en-‐han.fr/blog/ Company blog: hGp://techs.enovance.com/ Worldwide oﬃces coverage We design, build and run clouds – any9me -‐ anywhere

3. Ceph What is it?

4. The project ➜  Uniﬁed distributed storage system ➜  Started in 2006 as a PhD by Sage Weil ➜  Open source under LGPL license ➜  Written in C++ ➜  Build the future of storage on commodity hardware

5. Key features ➜  Self managing/healing ➜  Self balancing ➜  Painless scaling ➜  Data placement with CRUSH

6. Controlled replica9on under scalable hashing ➜  Pseudo-random placement algorithm ➜  Statistically uniform distribution ➜  Rule-based conﬁguration

7. Overview

8. State of the integra9on Including best Havana’s addi9ons

9. Why is Ceph so good? It uniﬁes OpenStack components

10. Havana’s addi9ons ➜  Complete refactor of the Cinder driver: •  Librados and librbd usage •  Flatten volumes created from snapshots •  Clone depth ➜  Cinder backup with a Ceph backend: •  •  •  •  •  backing up within the same Ceph pool (not recommended) backing up between different Ceph pools backing up between different Ceph clusters Support RBD stripes Differentials ➜  Nova Libvirt_image_type = rbd •  Directly boot all the VMs in Ceph •  Volume QoS

11. Today’s Havana integra9on

12. Is Havana the perfect stack? …

13. Well, almost…

14. What’s missing? ➜  Direct URL download for Nova •  Already on the pipe, probably for 2013.2.1 ➜  Nova’s snapshots integration •  Ceph snapshot https://github.com/jdurgin/nova/commits/havana-ephemeral-rbd

15. Icehouse and beyond Future

16. Tomorrow’s integra9on

17. Icehouse roadmap ➜  Implement “bricks” for RBD ➜  Re-implement snapshotting function to use RBD snapshot ➜  RBD on Nova bare metal ➜  Volume migration support ➜  RBD stripes support « J » poten9al roadmap ➜  Manila support

18. Ceph, what’s coming up? Roadmap

19. Fireﬂy ➜  Tiering - cache pool overlay ➜  Erasure code ➜  Ceph OSD ZFS ➜  Full support of OpenStack Icehouse

20. Many thanks! Questions? Contact: sebastien@enovance.com Twitter: @sebastien_han IRC: leseb

OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack

Similar to OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack (20)

More from eNovance

More from eNovance (20)

Recently uploaded

Recently uploaded (20)

OpenStack in Action 4! Sebastien Han - Ceph: de facto storage backend for OpenStack