GlusterFS is a distributed replicated parallel file system that allows files to be striped, replicated, and distributed across servers for high performance and high availability. It has a fully distributed architecture without a metadata server and uses FUSE for mounting volumes. GlusterFS distributes data across multiple servers and can replicate files on different servers for redundancy. It uses configurable translators for storage, protocols, clustering, encryption and other features.
Slides from the S8 File Systems Tutorial at USENIX LISA'13 conference in Washington, DC. The topic covers ext4, btrfs, and ZFS with an emphasis on Linux implementations.
This presentation is from the ZFS Tutorial presented at the USENIX LISA09 Conference at Baltimore, Maryland in November 2009.
Later versions are available on slideshare.net, too.
Btrfs and Snapper - The Next Steps from Pure Filesystem Features to Integrati...Gábor Nyers
These are the slides of our SUSECon 2013 presentation with Arvin (the inventor of Snapper)
Btrfs as technology has been getting a lot of attention over the past few years. While interesting for its feature set alone, like checksums, copy on write, snapshots and built-in device management, without proper management tooling and integration with other parts of the operating system, it is difficult for the average user to use Btrfs to its full potential.
This session will help you understand the features of Btrfs and how Snapper can be used for snapshot management in SUSE Linux Enterprise. We also will provide use cases and an outlook for future functionality.
Slides from the S8 File Systems Tutorial at USENIX LISA'13 conference in Washington, DC. The topic covers ext4, btrfs, and ZFS with an emphasis on Linux implementations.
This presentation is from the ZFS Tutorial presented at the USENIX LISA09 Conference at Baltimore, Maryland in November 2009.
Later versions are available on slideshare.net, too.
Btrfs and Snapper - The Next Steps from Pure Filesystem Features to Integrati...Gábor Nyers
These are the slides of our SUSECon 2013 presentation with Arvin (the inventor of Snapper)
Btrfs as technology has been getting a lot of attention over the past few years. While interesting for its feature set alone, like checksums, copy on write, snapshots and built-in device management, without proper management tooling and integration with other parts of the operating system, it is difficult for the average user to use Btrfs to its full potential.
This session will help you understand the features of Btrfs and how Snapper can be used for snapshot management in SUSE Linux Enterprise. We also will provide use cases and an outlook for future functionality.
Btrfs: Design, Implementation and the Current StatusLukáš Czerner
Historically Linux has always had quite decent pool of local file systems in the tree. However only one of them has been usually considered as a "General purpose local file system". Extended file system was the one. Now it is about to change as btrfs "B-tree file system" joined the crew. In this talk I would like to give a brief overview on the design and implementation of btrfs and highlight some if its strong and weak qualities. We might even try to peek into the future to see what the future of btrfs might look like, what might be its main use case, if it will leave all other file system behind, or silently die after the hype fade away. Finally, I will introduce you to the current state of development. I'll try to summarize what has been done so far and what you can use today. And of course, highlight features which are either ready or are about to be ready for users to appreciate. Some examples of btrfs usage might follow
Introduction to Btrfs - FLOSS UK Spring Conference York 2015Richard Melville
With the availability of relatively cheap, large capacity hard disks, the likelihood of running out of disk space is relatively low. However, we may be in the process of re-organising our data storage by increasing the number, or capacity, of our disk array. Or, we may wish to substitute SSDs for our conventional HDDs.
Anybody who has run out of disk capacity will know just how frustrating it is. Equally, the re-organisation of our data is also time consuming and can be fraught with difficulty. If we have a RAID we can, of course, remove and replace drives on the fly as they become full, or even fail. With LVM we can extend, or shrink, file systems on the fly by changing the capacity of the data pool.
Wouldn't it be great, though, if we could combine all these functions, and more besides, into one set of tools? Furthermore, what if we could have these tools working at the file system level, rather than on a virtual layer above the file system?
Well, Sun Microsystems thought so too and developed the ZFS file system for use in its Solaris OS. Sun is now owned by Oracle but ZFS is still very much alive. Unfortunately, for GNU/Linux users, the CDDL licence that came with ZFS was not compatible with the GPL, so inclusion in the Linux kernel was just not possible. ZFS can be built as a module, but this is not very convenient for a file system, hence, the birth of Btrfs.
Btrfs could be seen as a ZFS for GNU/Linux. It is younger, and therefore not as complete as ZFS, but it is getting there. Linus Torvalds claims that it will be the default GNU/Linux file system when it is ready for production use, so it is worth becoming familiar with it now. The Btrfs file system is built into recent kernels, and additional userland tools, btrfs-progs, are provided for manipulating the file system.
This talk will be a basic introduction for those not yet familiar with the Btrfs file system.
Describe the following information.
- Background (Why Fujitsu has contributed to Btrfs)
- Introduction to core features
- Development statistics
- Future prospects
This slide is almost the same as my presentation at LinuxCon Europe 2014. The difference is just minor fixes.
The Evolution of Storage on Linux - FrOSCon - 2015-08-22Lenz Grimmer
Linux and Open Source Software have always played a crucial role in data centers to provide storage in various ways. In this talk, Lenz will give an overview of how storage on Linux has evolved over the years, from local file systems to scalable file systems, logical volume managers and cluster file systems to today's modern file systems and distributed, parallel and fault-tolerant file systems.
Gluster Webinar: Introduction to GlusterFSGlusterFS
This webinar provides an introduction to GlusterFS, the leading open source, scale-out NAS file system. Learn how GlusterFS is deployed in the datacenter, in the cloud, or enables you to create a global namespace between the two.
Btrfs: Design, Implementation and the Current StatusLukáš Czerner
Historically Linux has always had quite decent pool of local file systems in the tree. However only one of them has been usually considered as a "General purpose local file system". Extended file system was the one. Now it is about to change as btrfs "B-tree file system" joined the crew. In this talk I would like to give a brief overview on the design and implementation of btrfs and highlight some if its strong and weak qualities. We might even try to peek into the future to see what the future of btrfs might look like, what might be its main use case, if it will leave all other file system behind, or silently die after the hype fade away. Finally, I will introduce you to the current state of development. I'll try to summarize what has been done so far and what you can use today. And of course, highlight features which are either ready or are about to be ready for users to appreciate. Some examples of btrfs usage might follow
Introduction to Btrfs - FLOSS UK Spring Conference York 2015Richard Melville
With the availability of relatively cheap, large capacity hard disks, the likelihood of running out of disk space is relatively low. However, we may be in the process of re-organising our data storage by increasing the number, or capacity, of our disk array. Or, we may wish to substitute SSDs for our conventional HDDs.
Anybody who has run out of disk capacity will know just how frustrating it is. Equally, the re-organisation of our data is also time consuming and can be fraught with difficulty. If we have a RAID we can, of course, remove and replace drives on the fly as they become full, or even fail. With LVM we can extend, or shrink, file systems on the fly by changing the capacity of the data pool.
Wouldn't it be great, though, if we could combine all these functions, and more besides, into one set of tools? Furthermore, what if we could have these tools working at the file system level, rather than on a virtual layer above the file system?
Well, Sun Microsystems thought so too and developed the ZFS file system for use in its Solaris OS. Sun is now owned by Oracle but ZFS is still very much alive. Unfortunately, for GNU/Linux users, the CDDL licence that came with ZFS was not compatible with the GPL, so inclusion in the Linux kernel was just not possible. ZFS can be built as a module, but this is not very convenient for a file system, hence, the birth of Btrfs.
Btrfs could be seen as a ZFS for GNU/Linux. It is younger, and therefore not as complete as ZFS, but it is getting there. Linus Torvalds claims that it will be the default GNU/Linux file system when it is ready for production use, so it is worth becoming familiar with it now. The Btrfs file system is built into recent kernels, and additional userland tools, btrfs-progs, are provided for manipulating the file system.
This talk will be a basic introduction for those not yet familiar with the Btrfs file system.
Describe the following information.
- Background (Why Fujitsu has contributed to Btrfs)
- Introduction to core features
- Development statistics
- Future prospects
This slide is almost the same as my presentation at LinuxCon Europe 2014. The difference is just minor fixes.
The Evolution of Storage on Linux - FrOSCon - 2015-08-22Lenz Grimmer
Linux and Open Source Software have always played a crucial role in data centers to provide storage in various ways. In this talk, Lenz will give an overview of how storage on Linux has evolved over the years, from local file systems to scalable file systems, logical volume managers and cluster file systems to today's modern file systems and distributed, parallel and fault-tolerant file systems.
Gluster Webinar: Introduction to GlusterFSGlusterFS
This webinar provides an introduction to GlusterFS, the leading open source, scale-out NAS file system. Learn how GlusterFS is deployed in the datacenter, in the cloud, or enables you to create a global namespace between the two.
GlusterFS : un file system open source per i big data di oggi e domani - Robe...Codemotion
GlusterFS (www.gluster.org) è un file system distribuito open source, scalabile fino ai petabytes. La presentazione ha lo scopo di mostrare le feature di questo FS e la nostra esperienza, che parte nel 2010 con un cluster da 4TB all'odierno da 30TB: perché è stato scelto, principali features, evoluzione, fallimenti (anche quelli), futuro. Alcune feature: accesso in user-space, protocollo nativo, NFS, SMB . Replicazione, distribuzione, striping dei file o una loro combinazione (e.g: distributed striped replicated). All'interno dell'ecosistema Hadoop può sostituire HDFS.
Architecture of the Upcoming OrangeFS v3 Distributed Parallel File SystemAll Things Open
All Things Open 2014 - Day 2
Thursday, October 23rd, 2014
Boyd Wilson
Executive Director with Omnibond
Lunch Session
Architecture of the Upcoming OrangeFS v3 Distributed Parallel File System
Software Defined Analytics with File and Object Access Plus Geographically Di...Trishali Nayar
Introduction to Spectrum Scale Active File Management (AFM)
and its use cases. Spectrum Scale Protocols - Unified File & Object Access (UFO) Feature Details
AFM + Object : Unique Wan Caching for Object Store
Learning Puppet is hard.
But: You can use Puppet by using YAML only.
In this talk I am going to explain the YAML/Hiera based node classification and the possibility to manage systems by using YAML only.
HashiTalksDACH-Terraform-Managing training instances in the CloudMartin Alfke
Cloud automation is important. When we have a need for a training instance, we use terraform for VM provisioning.
But: each setup has slight differences (SW Versions, Number of VMs needed, ...)
We decided to build the terraform code as abstract as possible and use a per setup data based approach to provide information on numbers of VMs and deployment order.
All data are then used in combination with terraform and Puppet Bolt.
ADDO 2019 DevOps in a containerized worldMartin Alfke
"We don't do DevOps anymore, we do containers"
Are containers the death to DevOps?
Why do we still need DevOps when doing containers?
DevOps KATA ((K)Culture, Automation, Transparency, Agility)
“Docker, Docker, Docker, Docker,…” developers really love Docker. Usually one sees the no longer need for configuration management, the easy way to spin up a platform on a laptop, the low resource footprint. But how do you deploy laptops in data centers?
This talk will give you an insight how we (more Ops then Dev) started to learn (and love) containers, the issues we saw when running them in larger scale and how Ops people should start dealing with Container technologies.
PuppetConf 2016 Moving from Exec to Types and ProvidesMartin Alfke
"We want to automate this application rollout and configuration by using Puppet DSL." The task is clear, the tool is clear. But how to proceed? Installation is delivered as tarball, configuration is done by running cli commands. This talk will give an overview on how we started using commands within exec resources, the difficulties and problems that rose up, and the process of moving to Types and Providers.
PuppetCamp London fall 2014
Martin Alfke - Can you upgrade to Puppet 4.x?
My talk at PuppetCamp London 2014 taking care on best practices and bad examples and an outlook to Puppet 4.
Puppet User Group Berlin Q1 meetup:
Introduction to the new, experimental puppet parser
http://www.meetup.com/Puppet-User-Group-Berlin/events/145643562/
Essentials of Automations: The Art of Triggers and Actions in FMESafe Software
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...Neo4j
Leonard Jayamohan, Partner & Generative AI Lead, Deloitte
This keynote will reveal how Deloitte leverages Neo4j’s graph power for groundbreaking digital twin solutions, achieving a staggering 100x performance boost. Discover the essential role knowledge graphs play in successful generative AI implementations. Plus, get an exclusive look at an innovative Neo4j + Generative AI solution Deloitte is developing in-house.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionAggregage
Join Maher Hanafi, VP of Engineering at Betterworks, in this new session where he'll share a practical framework to transform Gen AI prototypes into impactful products! He'll delve into the complexities of data collection and management, model selection and optimization, and ensuring security, scalability, and responsible use.
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...SOFTTECHHUB
The choice of an operating system plays a pivotal role in shaping our computing experience. For decades, Microsoft's Windows has dominated the market, offering a familiar and widely adopted platform for personal and professional use. However, as technological advancements continue to push the boundaries of innovation, alternative operating systems have emerged, challenging the status quo and offering users a fresh perspective on computing.
One such alternative that has garnered significant attention and acclaim is Nitrux Linux 3.5.0, a sleek, powerful, and user-friendly Linux distribution that promises to redefine the way we interact with our devices. With its focus on performance, security, and customization, Nitrux Linux presents a compelling case for those seeking to break free from the constraints of proprietary software and embrace the freedom and flexibility of open-source computing.
Maruthi Prithivirajan, Head of ASEAN & IN Solution Architecture, Neo4j
Get an inside look at the latest Neo4j innovations that enable relationship-driven intelligence at scale. Learn more about the newest cloud integrations and product enhancements that make Neo4j an essential choice for developers building apps with interconnected data and generative AI.
Climate Impact of Software Testing at Nordic Testing DaysKari Kakkonen
My slides at Nordic Testing Days 6.6.2024
Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!SOFTTECHHUB
As the digital landscape continually evolves, operating systems play a critical role in shaping user experiences and productivity. The launch of Nitrux Linux 3.5.0 marks a significant milestone, offering a robust alternative to traditional systems such as Windows 11. This article delves into the essence of Nitrux Linux 3.5.0, exploring its unique features, advantages, and how it stands as a compelling choice for both casual users and tech enthusiasts.
In his public lecture, Christian Timmerer provides insights into the fascinating history of video streaming, starting from its humble beginnings before YouTube to the groundbreaking technologies that now dominate platforms like Netflix and ORF ON. Timmerer also presents provocative contributions of his own that have significantly influenced the industry. He concludes by looking at future challenges and invites the audience to join in a discussion.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
A tale of scale & speed: How the US Navy is enabling software delivery from l...sonjaschweigert1
Rapid and secure feature delivery is a goal across every application team and every branch of the DoD. The Navy’s DevSecOps platform, Party Barge, has achieved:
- Reduction in onboarding time from 5 weeks to 1 day
- Improved developer experience and productivity through actionable findings and reduction of false positives
- Maintenance of superior security standards and inherent policy enforcement with Authorization to Operate (ATO)
Development teams can ship efficiently and ensure applications are cyber ready for Navy Authorizing Officials (AOs). In this webinar, Sigma Defense and Anchore will give attendees a look behind the scenes and demo secure pipeline automation and security artifacts that speed up application ATO and time to production.
We will cover:
- How to remove silos in DevSecOps
- How to build efficient development pipeline roles and component templates
- How to deliver security artifacts that matter for ATO’s (SBOMs, vulnerability reports, and policy evidence)
- How to streamline operations with automated policy checks on container images
GridMate - End to end testing is a critical piece to ensure quality and avoid...ThomasParaiso2
End to end testing is a critical piece to ensure quality and avoid regressions. In this session, we share our journey building an E2E testing pipeline for GridMate components (LWC and Aura) using Cypress, JSForce, FakerJS…
Removing Uninteresting Bytes in Software FuzzingAftab Hussain
Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process.
In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds.
- These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.
UiPath Test Automation using UiPath Test Suite series, part 6DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 6. In this session, we will cover Test Automation with generative AI and Open AI.
UiPath Test Automation with generative AI and Open AI webinar offers an in-depth exploration of leveraging cutting-edge technologies for test automation within the UiPath platform. Attendees will delve into the integration of generative AI, a test automation solution, with Open AI advanced natural language processing capabilities.
Throughout the session, participants will discover how this synergy empowers testers to automate repetitive tasks, enhance testing accuracy, and expedite the software testing life cycle. Topics covered include the seamless integration process, practical use cases, and the benefits of harnessing AI-driven automation for UiPath testing initiatives. By attending this webinar, testers, and automation professionals can gain valuable insights into harnessing the power of AI to optimize their test automation workflows within the UiPath ecosystem, ultimately driving efficiency and quality in software development processes.
What will you get from this session?
1. Insights into integrating generative AI.
2. Understanding how this integration enhances test automation within the UiPath platform
3. Practical demonstrations
4. Exploration of real-world use cases illustrating the benefits of AI-driven test automation for UiPath
Topics covered:
What is generative AI
Test Automation with generative AI and Open AI.
UiPath integration with generative AI
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Dr. Sean Tan, Head of Data Science, Changi Airport Group
Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.
4. General Information I
File System Solutions
Shared Disk File System
•San or Block Access
•Mostly used in HA setup (e.g. DRBD)
Distributed File System
•Network File System
•NFS
•SMB/CIFS
•9P
Distributed replicated File System
•Replication
•HA and offline operation
•Coda
•MS DFS
•MooseFS
4
Thursday, November 4, 2010
5. General Information II
File System Solutions
Distributed parallel File System
•Setup across multiple servers
•HPC
Distributed replicated parallel File System
•HPC and HA
•Cosmos
•MogileFS
•GPFS (IBM)
•GFS (Google)
•Hadoop
•GlusterFS
5
Thursday, November 4, 2010
6. Customer Platform
Shared Storage Issues
Bad performance of NFS kernel stack
Limitations of concurrent NFS accesses
Customer data already on NFS system
Environment and Requirements
Debian GNU/Linux Version 4 (etch) – 3 years old
Most D f-t p FS need complex data migration
Solution has to be expandable
6
Thursday, November 4, 2010
7. Why GlusterFS ?
Decision basics
Possibility to run NFS and GlusterFS in parallel
No data migration necessary
Easy setup
Extendable (e.g. new storage nodes)
min. Kernel 2.6.3x --> optimization for FUSE context switches !
7
Thursday, November 4, 2010
9. GlusterFS Basics
Hardware
Any x86 Hardware
Direct attached storage, RAID
FC, Infiniband or iSCSI SAN
Gigabit or 10 Gigabit network or Infiniband
OS
Linux, Solaris, OpenSolaris, OS X, FreeBSD
ext3 or ext4 Filesystem (tested)
Other POSIX compliant filesystems should also work
Architecture
No Meta-Data Server (fully distributed architecture - Elastic Hash)
Replication (RAID 1)
Distribution (RAID 0)
FUSE (Standard)
NFS (unfs3 - depreciated)
SMB/CIFS
DAV
9
Thursday, November 4, 2010
12. GlusterFS Architecture Overview III
Recommended Server Setup
GlusterFS daemons
GlusterFS Server
Network
*nix distribution
FileSystem (ext3/ext4 or POSIX)
Volume Manager (LVM2 only)
HW RAID
Disks
Image Copyright by Gluster.Inc.
12
Thursday, November 4, 2010
14. GlusterFS Translators
GlusterFS modular extension
storage
•posix – for underlying filesystem
•bdb – database storage system
protocol
•server – required for server config (e.g. Inifiniband or TCP)
•client – required for client config (e.g. Infiniband or TCP)
cluster
•distribute – storage spread to multiple servers
•replicate – mirror content between servers
•stripe – striping between multiple servers
•unify – obsolete, use cluster/distribute
•nufa – HPC - higher preference for a local volume
encryption
•rot-13 – sample code for encryption
14
Thursday, November 4, 2010
15. GlusterFS Translators
performance
•readahead – for sequential read performance
•writebehind – aggregate written blocks
•io-threads – number of threads
•io-cache – read cache block size
•quickread – fetch small files in a single call
•stat-prefetch – prefetch stats in readdir
•symlink-cache – undocumented
15
Thursday, November 4, 2010
16. GlusterFS Translators
features
•locks – POSIX locking
•filter – filtering on user id or group id
•access-control – undocumented
•path-convertor – internal path converter
•quota – don’t grow beyond disk space
•read-only – included in feature/filter
•trash – recycle bin (use on server)
debug
•trace – trace glusterfs functions and system calls
•io-stats – collect performance data
•error-gen – undocumented
16
Thursday, November 4, 2010
17. GlusterFS
Configuration
Thursday, November 4, 2010
18. GlusterFS Configuration Location
Configuration files (path and names)
Server
•/etc/glusterfs/glusterfsd.vol
Client
•/etc/glusterfs/glusterfs.vol
Possible location of config files for clients
Local on disk
Remote on glusterfs-Server
18
Thursday, November 4, 2010
19. GlusterFS Configuration Example
2 Servers – n Clients – replication
Server 1 + 2
volume posix
type storage/posix
option directory /data/export
end-volume
volume locks
type features/locks
subvolumes posix
end-volume
volume server
volume brick type protocol/server
type performance/io-threads option transport-type tcp
option thread-count 8 option auth.addr.brick.allow 192.168.0.102
subvolumes locks subvolumes brick
end-volume end-volume
19
Thursday, November 4, 2010
20. GlusterFS Configuration Example
2 Servers – n Clients – replication
Clients
volume remote1
type protocol/client
option transport-type tcp volume replicate
option remote-host server1.example.com type cluster/replicate
option remote-subvolume brick subvolumes remote1 remote2
end-volume end-volume
volume remote2 volume writebehind
type protocol/client type performance/write-behind
option transport-type tcp option window-size 1MB
option remote-host server2.example.com subvolumes replicate
option remote-subvolume brick end-volume
end-volume
volume cache
type performance/io-cache
option cache-size 512MB
subvolumes writebehind
end-volume
20
Thursday, November 4, 2010
21. GlusterFS Configuration @Customer
Servers - both
volume posix
type storage/posix
option directory /data
End-volume
volume iostats
type debug/io-stats
subvolumes posix volume iothreads
end-volume type performance/io-threads
option thread-count 16
volume locks subvolumes locks
type features/locks end-volume
subvolumes iostats
end-volume volume writebehind
type performance/write-behind
option cache-size 64MB
option flush-behind off
subvolumes iothreads
end-volume
21
Thursday, November 4, 2010
22. GlusterFS Configuration @Customer
Servers - both - continued
volume brick
type performance/io-cache
option cache-size 2048MB
option cache-timeout 5
subvolumes writebehind
End-volume
volume server-tcp
type protocol/server
option transport-type tcp
option auth.addr.brick.allow *
option transport.socket.listen-port 6996
option transport.socket.nodelay on
subvolumes brick
end-volume
22
Thursday, November 4, 2010