pNFS allows clients to directly access file data from storage devices, bypassing the metadata server. This provides improved scalability and performance over traditional NFS. Key aspects of pNFS include the ability to retrieve and return file layouts describing data distribution, as well as control protocols for coordinating between clients, metadata servers, and storage devices. The pNFS specification was standardized in 2010 and implementations have since appeared in Linux distributions and vendor solutions. Open issues remain around layout state handling and compatibility of different layout types.
SUN Network File system - Design, Implementation and Experience aniadkar
Overview of SUN Network File system and its design, architecture and implementation along with changes in NFS v3 and NFS v4
Presented by – Aniruddh Adkar
CSE 710 Parallel and Distributed File Systems ( Spring 2016 )
SUNY, University at Buffalo
A Performance Characterization of Postgres on Different Storage SystemsDong Ye
Performance is an important factor when considering different storage systems for Postgres. In this talk we present a detailed performance characteristics on a number of different storage systems including Fibre Channel SAN, Enterprise NAS, and local storage (SSD and SAS disks) behind hardware RAID controller with battery backed write cache. We look at both OLTP and OLAP workloads.
Presented at Postgres Open 2014
SUN Network File system - Design, Implementation and Experience aniadkar
Overview of SUN Network File system and its design, architecture and implementation along with changes in NFS v3 and NFS v4
Presented by – Aniruddh Adkar
CSE 710 Parallel and Distributed File Systems ( Spring 2016 )
SUNY, University at Buffalo
A Performance Characterization of Postgres on Different Storage SystemsDong Ye
Performance is an important factor when considering different storage systems for Postgres. In this talk we present a detailed performance characteristics on a number of different storage systems including Fibre Channel SAN, Enterprise NAS, and local storage (SSD and SAS disks) behind hardware RAID controller with battery backed write cache. We look at both OLTP and OLAP workloads.
Presented at Postgres Open 2014
Filesystem Showdown: What a Difference a Decade MakesPerforce
In the last 10 years, Ext4 has risen in prominence, ReiserFS has fallen to the wayside, ZFS has been ported to Linux, XFS keeps plugging along, and there's a new kid: Btrfs. NTFS has evolved, too. It's now 2016. How do these filesystems stack up against each other? Does it really make that much of a difference? We’ll show you the results of standard, consistent tests across platforms (Linux vs. Windows) and filesystems to see if the differences are worth choosing one over the other. For simplicity's sake, the tests are performed on identical hardware with out-of-the-box settings.
Let’s discover btrfs features like copy-on-write and subvolumes, as well as how easy it is to implement istantaneus backups and snapshots that automatically share unchanged files. You can also see or restore your files from backup so simple as opening a directory. Furthermore we will see how to setup transparent automatic compression of files to increase the disk space.
This is the presentation given during CentOS Dojo Bangalore.
The slides are originally authored by Vijay Bellur, Lalatendu Mohanty. Added a few slides at the end for CentOS setup.
OSBConf 2015 | Scale out backups with bareos and gluster by niels de vosNETWAYS
During this talk, Niels will explain the basics of Gluster and show how Bareos integrates with it. Gluster provides a Software Defined Storage environment that can scale-out when the backup storage needs to grow. With a live demonstration Niels shows how simple it is to setup a small Gluster environment and configure Bareos to use the native Gluster protocol.
Get the latest update from Panasas on the status of pNFS - parallel NFS. This presentation explains how you can innovate faster, better, and at a lower cost with Panasas and pNFS, the emerging standard for parallel I/O and the next major extension to the ubiquitous standard, NFS.
Get the latest update from Panasas on the status of pNFS - parallel NFS. This presentation explains how you can innovate faster, better, and at a lower cost with Panasas and pNFS, the emerging standard for parallel I/O and the next major extension to the ubiquitous standard, NFS.
Filesystem Showdown: What a Difference a Decade MakesPerforce
In the last 10 years, Ext4 has risen in prominence, ReiserFS has fallen to the wayside, ZFS has been ported to Linux, XFS keeps plugging along, and there's a new kid: Btrfs. NTFS has evolved, too. It's now 2016. How do these filesystems stack up against each other? Does it really make that much of a difference? We’ll show you the results of standard, consistent tests across platforms (Linux vs. Windows) and filesystems to see if the differences are worth choosing one over the other. For simplicity's sake, the tests are performed on identical hardware with out-of-the-box settings.
Let’s discover btrfs features like copy-on-write and subvolumes, as well as how easy it is to implement istantaneus backups and snapshots that automatically share unchanged files. You can also see or restore your files from backup so simple as opening a directory. Furthermore we will see how to setup transparent automatic compression of files to increase the disk space.
This is the presentation given during CentOS Dojo Bangalore.
The slides are originally authored by Vijay Bellur, Lalatendu Mohanty. Added a few slides at the end for CentOS setup.
OSBConf 2015 | Scale out backups with bareos and gluster by niels de vosNETWAYS
During this talk, Niels will explain the basics of Gluster and show how Bareos integrates with it. Gluster provides a Software Defined Storage environment that can scale-out when the backup storage needs to grow. With a live demonstration Niels shows how simple it is to setup a small Gluster environment and configure Bareos to use the native Gluster protocol.
Get the latest update from Panasas on the status of pNFS - parallel NFS. This presentation explains how you can innovate faster, better, and at a lower cost with Panasas and pNFS, the emerging standard for parallel I/O and the next major extension to the ubiquitous standard, NFS.
Get the latest update from Panasas on the status of pNFS - parallel NFS. This presentation explains how you can innovate faster, better, and at a lower cost with Panasas and pNFS, the emerging standard for parallel I/O and the next major extension to the ubiquitous standard, NFS.
Emerging Persistent Memory Hardware and ZUFS - PM-based File Systems in User ...Kernel TLV
In this talk, Dr. Amit Golander looks into emerging PM/NVDIMM devices, the value they bring to applications and most importantly how they revolutionize the storage stack.
In the second part, Boaz Harrosh and Shachar Sharon dive into new opportunities to develop memory-based filesystems in user space, leveraging a new open source project called ZUFS. ZUFS was presented in the last Linux Plumbers conference and unlike FUSE it focuses on delivering low latency and zero copy.
Dr. Amit Golander was the CTO of Plexistor, which developed the first enterprise-grade PM-based file system, and which was acquired earlier this year by NetApp.
Boaz Harrosh and Shachar Sharon are ZUFS maintainers and longtime Storage and Linux veterans.
Architecture of the Upcoming OrangeFS v3 Distributed Parallel File SystemAll Things Open
All Things Open 2014 - Day 2
Thursday, October 23rd, 2014
Boyd Wilson
Executive Director with Omnibond
Lunch Session
Architecture of the Upcoming OrangeFS v3 Distributed Parallel File System
The Network File System (NFS) Version 4 is a distributed file system similar to previous versions of NFS in its straightforward design, simplified error recovery, and independence of transport protocols and operating systems for file access in a heterogeneous network.
NFS, was developed by Sun Microsystems to provide distributed transparent file access in a heterogeneous network. It achieves this by being relatively simple in design and not relying too heavily on any particular file system model.
This presentation is based on the paper of “The NFS Version 4 Protocol” written by Brian Pawlowski, Spencer Shepler, Carl Beame, Brent Callaghan, Michael Eisler, David Noveck, David Robinson and Robert Thurlow.
This presentation is from the ZFS Tutorial presented at the USENIX LISA09 Conference at Baltimore, Maryland in November 2009.
Later versions are available on slideshare.net, too.
An Introduce of OPNFV (Open Platform for NFV)Mario Cho
OPNFV is Open Platform for Network Function Virtualization.
It lecture are talk on Open Software Conference 2015.
The Lecture of OPNFV explain OPNFV sub-software technology like The Linux Kernel, Virtualization, Software Defined Network, OpenStack, OpenDaylight, and Network Function Virtualization.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
3. Traditional NFS limitations
� Single NFS server bottleneck: limited bandwidth & CPU
� Multiple NFS servers are separate storage islands
NFS
Page 3
4. Proprietary Solutions
� SAN (IBM, EMC, Sun) and Object (IBM, HP, Panasas) file
systems:
– Clients bypasses metadata server to access data
– Each system is doing differently implementation
� Scalable/cluster NFS servers:
– Facilitate scalable aggregate load
– Do not provide scalable/parallel bandwidth to a single file
Page 4
5. What Is pNFS?
Metadata Server
� pNFS protocol
– NFSv4.1
pN FS
� Storage access protocol Protocol
C lient
– File (NFSv4.1) Control
Protocol
– Block (FC, iSCSI, FCoE)
– Object (OSD2)
� Control protocol Storage Access
– Implementation decision Protocol
Data Servers
Page 5
6. pNFS Advantage
� Distributed data access across the storage cluster
� Reduce load on NFS server
� I/O Acceleration
Page 6
7. pNFS Performance
� Linear I/O increase
� Client performance limitation is on backend
� Numbers taken with EMC MPFS, from which pNFS block
layout derives
Page 7
9. Other NFSv4.1 Key Features
� EOS (Exactly Once Semantics)
� File and directory delegation
� No more “silly rename”
� Data retention
� Session trunking and client ID trunking
Page 9
10. pNFS Timeline
� 2004 — CMU, NetApp and Panasas drafted pNFS problem and
requirement statements
� 2005 — CITI, EMC, NetApp and Panasas drafted pNFS extensions
� 2005 — NetApp and Sun demonstrated pNFS at Connectathon
� 2005 — pNFS added to NFSv4.1 draft
� 2006-2008 — specification baked
– Bake-a-thons, Connectathon
– 26 iterations of NFSv4.1/pNFS spec
� 2009 — RFC submitted
� 2010 — RFC published
� 2010 — Fedora 10 includes pNFS server/client gits and rpms
� 2010 — RHEL6.x is promised to have pNFS
Page 10
11. Industry Support
� BlueArc � NetApp
� CITI � Ohio SuperComputer Center
� CMU � Panasas
� EMC � Seagate
� IBM � StorSpeed
� LSI � Sun Microsystems (now Oracle)
Page 11
12. Linux pNFS Client
� Applications transparency
� Fewer support issues for storage vendors
� Generic pNFS client with layout driver plugins
Client
Applications
pNFS Kernel
M odule
Layout
D river
N F S v 4.1
S torage LayoutGet
Protocol LayoutReturn
pNFS
Control Protocol Server
Page 12
13. pNFS Primitives
� Layout
– Describes how a file is distributed among storage
� Segment
– Each layout has one or more segments. A segment is a distribution
pattern.
� Device
– Describes the storage (file server, backend block device, OSD data
server)
� Layout OPs
– Layoutget, layoutreturn, layoutcommit, cb_layoutrecall
Page 13
15. Linux pNFS Merge Plan
� End of 2010
– Linux 2.6.37 — Files pNFS client and server
� Feb, 2011
– Linux 2.6.38 — Object pNFS client and server
� May, 2011
– Linux 2.6.39 — Block pNFS client and server
Page 15
16. What Is Expected In NFSv4.x
� File, Block, Object layout driver
� Server side copy
� Federated file system
Page 16
17. Open Issue – Layout stateid, open mode relationship
Client Behavior Server Returns
OPEN read-only open stateid1
LAYOUTGET with layout stateid1
IOMODE_READ
CLOSE
OPEN read-write open stateid2
LAYOUTGET with layout stateid1
IOMODE_READ using open
stateid2
LAYOUTGET with IOMODE_RW NFS4ERR_OPENMODE
using layout stateid1
Page 17
18. Open Issues
� Is LAYOUTRETURN still necessary for forgetful mode?
� Slot id is required for every COMPOUND request, but
idempotent non-modifying requests do not really need one
� Security issue for block layout
� Can File, Object and Block layouts co-exist in the same
storage network?
Page 18