Linux and Open Source Software have always played a crucial role in data centers to provide storage in various ways. In this talk, Lenz will give an overview of how storage on Linux has evolved over the years, from local file systems to scalable file systems, logical volume managers and cluster file systems to today's modern file systems and distributed, parallel and fault-tolerant file systems.
Linux History
Design Principles
Kernel Modules
Process Management
Scheduling
Memory Management
File Systems
Input and Output
Interprocess Communication
Network Structure
Security
Basic Information About Linux. This helps you to know about the basic details of linux, such as architecture, kernel design, process management, file management and etc.
Linux History
Design Principles
Kernel Modules
Process Management
Scheduling
Memory Management
File Systems
Input and Output
Interprocess Communication
Network Structure
Security
Basic Information About Linux. This helps you to know about the basic details of linux, such as architecture, kernel design, process management, file management and etc.
Unix and shell programming | Unix File System | Unix File Permission | BlocksLOKESH KUMAR
Unix and shell programming | Introduction to Unix Operating system | Unix file system | Unix File Permissions | Unix Blocks | Feature of Unix Operating System | Kernel and Shell | Types of Shells
Overview of the architecture of the Linux kernel, based on "Anatomy of the Linux Kernel" by M. Tim Jones (IBM Developerworks), http://www.ibm.com/developerworks/linux/library/l-linux-kernel/
Case study of windows a product of microsoft including the history and related to operating system with MS-DOS its scheduling, networking, performance, etc. It also contains the windows architecture, it's system components like kernel, and scheduling through threads in windows.
From Windows to Linux: Converting a Distributed Perforce Helix InfrastructurePerforce
There are many advantages to running Perforce Helix on Linux servers. See the process and pitfalls encountered when converting a distributed Perforce infrastructure from Windows to Linux.
Unix and shell programming | Unix File System | Unix File Permission | BlocksLOKESH KUMAR
Unix and shell programming | Introduction to Unix Operating system | Unix file system | Unix File Permissions | Unix Blocks | Feature of Unix Operating System | Kernel and Shell | Types of Shells
Overview of the architecture of the Linux kernel, based on "Anatomy of the Linux Kernel" by M. Tim Jones (IBM Developerworks), http://www.ibm.com/developerworks/linux/library/l-linux-kernel/
Case study of windows a product of microsoft including the history and related to operating system with MS-DOS its scheduling, networking, performance, etc. It also contains the windows architecture, it's system components like kernel, and scheduling through threads in windows.
From Windows to Linux: Converting a Distributed Perforce Helix InfrastructurePerforce
There are many advantages to running Perforce Helix on Linux servers. See the process and pitfalls encountered when converting a distributed Perforce infrastructure from Windows to Linux.
How to Use Oracle RAC in a Cloud? - A Support QuestionMarkus Michalewicz
This presentation, which was first presented during Sangam16, discusses general and specific support rules for the Oracle Database and Oracle RAC with the purpose of enabling you to determine whether a given system is supported, certified or even recommended. This presentation was last updated on August 31st 2017 (minor update).
I have described all about linux OS starting from basics.
I guess this PPT will really be very very helpful for you guys.
This was one of the most appreciable PPT in my time when i presented it in my class.
UNIT V CASE STUDY
Linux System – Design Principles, Kernel Modules, Process Management, Scheduling, Memory Management, Input-Output Management, File System, Inter-process Communication; Mobile OS – iOS and Android – Architecture and SDK Framework, Media Layer, Services Layer, Core OS Layer, File System.
Ceph Management and Monitoring - DevConf.CZ - 2019-01-26Lenz Grimmer
Slide of my presentation "Ceph Management and Monitoring with the Dashboard" for DevConf.CZ in Brno, CZ — https://devconfcz2019.sched.com/event/Jcjm/ceph-management-and-monitoring-with-the-dashboard#
Ceph and Storage Management with openATTIC - FrOSCon 2016-08-21Lenz Grimmer
Slides of my presentation "Ceph and Storage Management with openATTIC" held at FrOSCon in St. Augustin (Germany) on 2016-08-21. A video recording can be found here: https://media.ccc.de/v/froscon2016-1755-open_source_storage_management_mit_openattic
Ceph and Storage Management with openATTIC - SUSE MOST - 2016-06-07Lenz Grimmer
Slides of my webinar "Ceph and Storage Management with openATTIC", held on 2016-06-07 for the SUSE Monthly Open Source Talks (MOST) - https://www.suse.com/partners/most
A presentation held at SAPO CodeBits 2010 (http://codebits.eu/intra/s/session/114), describing the operational theory and basics as well as the building blocks of a remote-controlled model quadrocopter.
A video of this talk can be found here: http://videos.sapo.pt/HZSIm9FUl3D3bfqmVcsv
Presentation about the new features and improvements in MySQL 5.5. Held at the SAPO CodeBits on 2010-11-11. A video recording of the session can be found here: http://codebits.eu/intra/s/session/144
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Essentials of Automations: The Art of Triggers and Actions in FMESafe Software
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
Pushing the limits of ePRTC: 100ns holdover for 100 daysAdtran
At WSTS 2024, Alon Stern explored the topic of parametric holdover and explained how recent research findings can be implemented in real-world PNT networks to achieve 100 nanoseconds of accuracy for up to 100 days.
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™UiPathCommunity
In questo evento online gratuito, organizzato dalla Community Italiana di UiPath, potrai esplorare le nuove funzionalità di Autopilot, il tool che integra l'Intelligenza Artificiale nei processi di sviluppo e utilizzo delle Automazioni.
📕 Vedremo insieme alcuni esempi dell'utilizzo di Autopilot in diversi tool della Suite UiPath:
Autopilot per Studio Web
Autopilot per Studio
Autopilot per Apps
Clipboard AI
GenAI applicata alla Document Understanding
👨🏫👨💻 Speakers:
Stefano Negro, UiPath MVPx3, RPA Tech Lead @ BSP Consultant
Flavio Martinelli, UiPath MVP 2023, Technical Account Manager @UiPath
Andrei Tasca, RPA Solutions Team Lead @NTT Data
PHP Frameworks: I want to break free (IPC Berlin 2024)Ralf Eggert
In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development.
This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.
zkStudyClub - Reef: Fast Succinct Non-Interactive Zero-Knowledge Regex ProofsAlex Pruden
This paper presents Reef, a system for generating publicly verifiable succinct non-interactive zero-knowledge proofs that a committed document matches or does not match a regular expression. We describe applications such as proving the strength of passwords, the provenance of email despite redactions, the validity of oblivious DNS queries, and the existence of mutations in DNA. Reef supports the Perl Compatible Regular Expression syntax, including wildcards, alternation, ranges, capture groups, Kleene star, negations, and lookarounds. Reef introduces a new type of automata, Skipping Alternating Finite Automata (SAFA), that skips irrelevant parts of a document when producing proofs without undermining soundness, and instantiates SAFA with a lookup argument. Our experimental evaluation confirms that Reef can generate proofs for documents with 32M characters; the proofs are small and cheap to verify (under a second).
Paper: https://eprint.iacr.org/2023/1886
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
Enhancing Performance with Globus and the Science DMZGlobus
ESnet has led the way in helping national facilities—and many other institutions in the research community—configure Science DMZs and troubleshoot network issues to maximize data transfer performance. In this talk we will present a summary of approaches and tips for getting the most out of your network infrastructure using Globus Connect Server.
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
The Evolution of Storage on Linux - FrOSCon - 2015-08-22
1. The Evolution of Storage
on Linux
Lenz Grimmer <lenz.grimmer@it-novum.com>
FrOSCON 2015, Sankt Augustin
22. August 2015
2. 2
Agenda
A trip down memory lane (pun intended)
Overview of how storage on Linux has evolved
Local file systems and related concepts/technologies
Network Services
Distributed / Cluster filesystems
3. 3
Introduction
40+ file systems in /fs/
Focus on the most popular/widely used systems
Primary focus on the software side
High-level Descriptions only
4. 4
Noteworthy Observations / Conclusions
The role of SourceForge.net today
Distribution kernels vs. mainline Linux
Honorable mention: Christoph Hellwig
Don‘t miss his talk about the Linux Storage Stack tomorrow (14:00, HS6)
Big Thanks to: LWN, Kernelnewbies.org, Thorsten Leemhuis
(Heise) and Wikipedia
6. 6
MINIX file system
While developing Linux in 1991, Linus required some form of
persistent storage
A Minix-compatible file system was the canonical choice:
Well-documented, robust
Exchange data with the host OS (and vice versa)
Severely limited
Max. file/filesystem size: 64MB (16bit block addresses)
14 char file names
Only one time stamp (mtime)
7. 7
Virtual File System Switch (VFS)
Abstraction / indirection layer to route file oriented system calls to
necessary functions in the physical filesystem code to do the I/O
Eased the addition of new file systems
Initially written by Chris Provenzano
Integrated into Linux 0.96
Defines a set of functions that every filesystem has to implement
Three kinds of objects: filesystems, inodes, and open files
8. 8
Extended File System (ext)
Designed by Rémy Card
Max. file/filesystem size: 2 GB, max. file name size was 255 chars
Metadata structure inspired by the traditional Unix File System
(UFS)
Added to Linux 0.96c in April 1992
Issues remained (bad performance, missing time stamps,
fragmentation)
9. 9
Second Extended File System (ext2)
Also implemented by Rémy Card
Introduced in Linux Kernel 0.99 (January 1993)
Designed with extensibility in mind
Adopted advanced ideas from other file systems (e.g. BSD Fast File System),
e.g. mtime/ctime/atime, file attributes, BSD/SysV semantics, different block
sizes, immutable/append-only files
Initially supported file/file systems sizes up to 2TB (limitation of the block
device layer)
Kernel version 2.6.17 (March 2006) extended max. file system size to 32TB
(using 8kB Blocks)
10. 10
FAT/MSDOS
Added to Linux in 1992/1993 by Werner Almesberger
VFAT support was later developed by Gordon Chaffee
VFAT filesystem is compatible with Windows 95/NT long filenames on the
FAT filesystem
Initially called xmsdos
Patches for Linux 1.2.x and 1.3.x.
As of Linux 1.3.60, the vfat filesystem is part of the Linux kernel distribution
Mtools as a userland-only alternative
11. 11
NTFS
NTFS driver for Linux by Martin von Löwis (started around 1996)
Legato Systems later sponsored Anton Altaparmakov to further
develop NTFS on Linux since June 2001
Read-only mode only, with no fault-tolerance supported
NFTS-TNG replaced old NTFS driver in Linux 2.5.11 (April 29th,
2002)
NTFS-3G (FUSE-based) by Tuxera (read-write support)
13. 13
Fsck vs. Journaling
Unclean unmounts, too many mount counts, or remounts after
a long time period triggered file system checks
Disk drives got bigger
A Journaling file system keeps track of changes not yet
committed to the file system's main part in a Journal
Keep track of just metadata changes or data as well
Several file systems were developed in parallel, to alleviate this
shortcoming of ext2, namely ext3, XFS, JFS and ReiserFS.
14. 14
Journaling Block Device layer (JBD)
JBD established as a filesystem-independent service, to be used
by any file system
First incarnation of JBD developed by Stephen C. Tweedie
together with the ext3 file system
OCFS2 and later ext4 also used JBD and it’s successor JBD2
15. 15
Third extended filesystem (ext3)
Originally released in September 1999
Written by Stephen Tweedie for the 2.2 branch
Ported to 2.4 kernels by Peter Braam, Andreas Dilger, Andrew
Morton, Alexander Viro, Ted Ts'o and Stephen Tweedie
Merged with the mainline Linux kernel 2.4.15 (November 2001)
Basically ext2 with journaling capabilities, easy conversion
Max filesystem size: 8TB, Max 32k subdirs/directory
16. 16
IBM JFS
Rooted in AIX and OS/2 Warp Server (new design in 1995)
Port to Linux started in December 1999 (Dave Kleikamp, Steve Best)
Uses own journaling implementation (metadata only)
Max volume size: 32PB, Max file size: 4PB
Later ported to AIX 5L as JFS2 (April 2001)
JFS 0.0.1 released in Feb. 2000., 0.1.0 (Beta) in August 2000
Version 1.0.0 was released in June 2001
Kernel module since 2.4.18pre9-ac4, Version 1.1.0 was included by Marcelo
Tosatti in Linux 2.4.20.
17. 17
ReiserFS
Early supported by SuSE, Introduced in version 2.4.1 (2001)
The first journaling file system to be included in mainline
Max volume size: 16TB
Based on B+ trees
Metadata-only journaling (block journaling since 2.6.8)
Online resizing
Tail packing block suballocation
Reiser4 still under active development (Edward Shishkin)
18. 18
SGI XFS
64-bit journaling file system created by Silicon Graphics
SGI IRIX since 1994, GPLed in 2000
Version 1.0 for Linux in May 2001 as Patch against 2.4.2
Merged in 2.6.x and 2.4.25 (Feb 2004)
Steve Lord, Russell Cattelan, Nathan Scott, Jim Mostek
Advanced features, high performance
Max volume size: 16EB
20. 20
The need for Logical Volume Management
Initially, Linux could only address disks/partitions
Changes to the layout required downtime and shuffling of data
Logical Volume Management abstracts physical disk drives
First incarnation of Linux LVM was introduced in Kernel version
2.4
Heinz Mauelshagen wrote the original LVM code in 1998,
inspired by HP-UX's volume manager.
21. 21
Device Mapper (DM)
A kernel framework for mapping physical block devices onto higher-
level virtual block devices
Added in Linux 2.6
Passes data from a virtual block device, which is provided by the
device mapper itself, to another block device
Pluggable design
Data can be also modified in transition
Forms the foundation of LVM2/EVMS, RAID and dm-crypt disk
encryption and many other useful features
22. 22
DM Multipath (DM-MPIO)
Consists of kernel components and user-space components
Provides input-output (I/O) fail-over and load-balancing within Linux
for block devices
Handles the rerouting of block I/O to an alternate path in the event of
a path failure
Can also balance the I/O load across all of the available paths in Fibre
Channel (FC) or iSCSI SAN environments
Started as part of a patchset created by Joe Thornber, later
maintained by Alasdair G Kergon at Red Hat. Christophe Varoqui
maintains the userland multipath tools
23. 23
DM-Cache
Allows a fast device (e.g. an SSD) to be used as a cache for a slower device
(e.g. a rotating disk)
Different policy plugins can be used to change the algorithms used to select
which blocks are promoted, demoted, cleaned etc.
Supports writeback and writethrough modes
Requires three physical storage devices to separately store actual data,
cache data and required metadata
Joe Thornber, Heinz Mauelshagen and Mike Snitzer
Inclusion into the Linux mainline kernel version 3.9, released on April 28,
2013
24. 24
LVM2
Based on DM
Flexible storage management
Add/remove disks
Resize/move logical volumes
Move LVs between PVs
Span volumes across multiple physical devices
RAID
Thin provisioning
Cluster Volume Manager
25. 25
IBM EVMS
IBM-sponsored effort to provide volume management services for
Linux
A single, unified system for handling all storage management tasks
Despite many of the features and GUI management tools found in
EVMS, LVM2 was preferred
As a result, IBM dropped their kernel driver and reworked their tools
to work with LVM2 instead
Development stopped in 2006
27. 27
NFS
Rick Sladkey original author of the NFS client and also ported the NFS server
and the RPC library code. Doug Quale helped extending the kernel to
support networking filesystems
NFS Version 2 since 1.2 kernel series
Kernel 2.2.18 a major milestone: mixing Linux NFS with other operating
systems' NFS, use file locking reliably over NFS, and NFS Version 3.
NFS Versions 2, 3, and 4 are supported on 2.6 and later kernels. Version 4.1
(Client) at least kernel 2.6.31
NFSv4 for Linux has been under development at CITI and NetApp since 2001
28. 28
Samba
A free-software re-implementation of the SMB/CIFS networking protocol
Andrew Tridgell started development of Samba in 1992, Jeremy Allison
joined early on
Volker Lendecke founded SerNet in 1997, to provide commercial support
Version 3 (2003): file and print services for Microsoft Windows clients and can
integrate with a Windows NT 4.0 server domain, either as a Primary Domain
Controller (PDC) or as a domain member
Samba4 installations can act as an Active Directory domain controller or
member server, at Windows 2008 domain and forest functional levels.
29. 29
SMB vs.CIFS
SMB "server message block" and CIFS "common internet file system"
are protocols. CIFS is the extension of the SMB protocol
“smbfs” was an older FS originated from the Samba project, heavily
coupled with the Samba tools (smb.conf, smbmount, etc.). Removed
in Linux 2.6.27
CIFS VFS was added to mainline Linux kernels in 2.5.42 Supports
advanced network file system features such as locking, Unicode
(advanced internationalization), hardlinks, dfs (hierarchical,
replicated name space), distributed caching and uses native TCP
names. All key network functions implemented in kernel
31. 31
Fourth Extended Filesystem (ext4)
Advanced version of ext3, led by Ted Tso et al
Incorporated scalability and reliability enhancements for supporting
large filesystems up to 1EB.
First experimental support for ext4 was merged into Linux 2.6.19,
which was released on 29 November 2006.
Ext4 was marked as experimental until Linux 2.6.27
Starting with 2.6.28 (December 2008), ext4 was marked as stable
New extent format reduced metadata overhead (RAM, IO for access,
transactions)
32. 32
Btrfs
Chris Mason (Oracle) in 2007
COW (Snapshots)
Checksums, Compression
RAID, Volume management
Conversion of ext3/4 file systems
Merged into mainline Linux 2.6.29 (March 2009)
Florian Winkler talks about Btrfs today (11:15, HS7)
33. 33
ZFS
Filesystem and logical volume manager combined
Designed and implemented at Sun Microsystems (Jeff Bonwick, Matthew
Ahrens)
Development started in 2001,officially announced in 2004
128bit, COW, Snapshots, Deduplication, RAID
OpenSolaris (CDDL)
Early port based on FUSE
Kernel modules based OpenZFS (2013)
Not included in mainline Linux due to license incompatibilities
35. 35
Network Block Device (NBD)
Remotely access a block device attached to another system
Userspace Server/Client, Client kernel module
Issues arise if network goes down or server crashes
Markus Pargmann talks about NBD on Sunday (16:30, HS6)
36. 36
Distributed Replicated Block Device (DRBD)
A shared-nothing, synchronously replicated block device
“RAID1 over Network”
Writes to the primary node are transferred to the lower-level block device and
simultaneously propagated to the secondary node
The secondary node then transfers data to its corresponding lower-level block
device. All read I/O is performed locally
Fail-over capabilities (Secondary/Primary)
Lars Ellenberg and Philipp Reisner originally submitted code in July 2007
DRBD was merged on 8 December 2009 during the "merge window" for Linux
kernel version 2.6.33
38. 38
OCFS/OCFS2
Shared disk file system by Oracle
Main focus of OCFS was to accommodate Oracle clustered databases,
not POSIX-compliant
OCFS2 designed as a Linux filesystem from scratch
On-disk filesystem implementation heavily inspired by ext3, uses JBD
for journaling
OCFS2 integrated into version 2.6.16 of mainline Linux
Max Volume/File Size 4PB (currently limited to 16TB)
Trivia question: what feature do OCFS2 and Btrfs have in common?
39. 39
GFS/GFS2
Shared disk filesystem, allows concurrent access to the same block storage
Development of GFS began in 1995 and was originally developed by
University of Minnesota professor Matthew O'Keefe and a group of students
Originally for SGI IRIX, ported to Linux in 1998
Acquired by Sistina in 2000, turned into proprietary product
OpenGFS fork
Red Hat acquired Sistina in 2003 and released GFS2 under GPL in June 2004
GFS2 and the DLM merged into Linux 2.6.19 (29 November 2006)
40. 40
Storage Requirements and Challenges
Amount of data to be stored grows exponentially
Today, Storage has to be:
Fault tolerant, reliable
Scalable without limitations or service interruptions
Distributable
Easy to manage / automate
Previous approaches do not address these requirements
42. 42
GlusterFS
Aggregates various storage servers over Ethernet or Infiniband RDMA
interconnect into one large parallel network file system
Storage bricks export local file systems as volumes
GlusterFS clients create composite virtual volumes from multiple remote
servers using stackable „translators“
Translators provide Mirroring, Replication, Striping, etc.
Final volume mounted by client host using its own native protocol via FUSE,
using NFS v3 protocol (via built-in server translator)
Originally developed by Gluster, Inc., which was acquired by Red Hat in 2011
43. 43
Ceph
Initially created by Sage Weil, founded Inktank in 2012
First release in July 2012
Object, block, and file storage from a single distributed computer cluster
Reliable autonomic distributed object store (RADOS)
RADOS Block Device (RBD), Snapshots
RadosGW provides REST API (Amazon S3/OpenStack Swift)
Completely distributed without a single point of failure
Replicates data for fault tolerance (CRUSH)
Ceph client code was merged into mainling Linux version 2.6.34
Red Hat acquired Inktank in April 2014
44. 44
Lustre
Parallel distributed file system, generally used for large-scale cluster computing
Widely used in TOP500 supercomputers
Max. volume size: 100 PB (production), over 16 EB (theoretical)
Max. file size: 2.5 PB (ext4), 16 EB (ZFS)
Started as a research project in 1999 by Peter Braam at CMU, who founded Cluster Filesystems Inc. in
2001 to work on Intermezzo, Coda and Lustre
First installed in March 2003 on the MCR Linux Cluster (Lawrence Livermore National Laboratory).
Lustre 1.0.0 was released in December 2003.
Acquired by Sun Microsystems in 2007
Oracle acquired Sun in 2010 and discontinued the development
Whamcloud->Intel, OpenScalabaleFilesystems Inc. (OpenSFS), Xyratex Inc.
45. 45
Shameless plug: openATTIC
Unified Storage: manage XFS, ZFS, Btrfs, NFS, Samba
Modern GUI (AngularJS/Boostrap)
REST API
Built-in Monitoring
Clustering (Pacemaker/Corosync, DRBD)
http://www.openattic.org/
Find us in the exhibition hall
46. 46
PHP-ENTWICKLER (M/W) mit
Linux Know-how
Sie entwickeln leidenschaftlich gerne und fühlen sich im
Open Source-Umfeld Zuhause?
Dann sollten wir uns kennenlernen!
Diese Aufgaben erwarten Sie bei uns…
• Entwicklung unseres Systemmonitoring-Tools
openITCOCKPIT für Frontend und/oder Backend
• Konzeption und Realisierung von Projekten in
Teamarbeit
• Testing der entwickelten Anwendungen
• Pflege und Ausbau der bestehenden Entwicklungs- und
Testumgebung
Weitere Informationen finden Sie unter:
www.it-novum.com/karriere
Gesucht: PHP-Entwickler (m/w) mit Linux Know-How