SlideShare a Scribd company logo
pNFS Status




September 2010
Larry Jones, Panasas
Review: The pNFS Standard

          The pNFS standard defines the NFSv4.1 protocol extensions
          between the server and client
          The I/O protocol between the client and storage is specified
          elsewhere, for example:
           o   SCSI Block Commands (SBC) over Fibre Channel (FC)
           o   SCSI Object-based Storage Device (OSD) over iSCSI
           o   Network File System (NFS)

          The control protocol between the server and storage devices is
          also specified elsewhere, for example:
           o   SCSI Object-based Storage Device (OSD) over iSCSI




                                                Client
                                                                                                    Storage


                                                                   NFS 4.1 Server
Slide 2                                                                             Panasas, Inc.
Review: pNFS Client


          Common client for different storage servers


                                           Client Apps


                                           pNFS Client        1. SBC (blocks)
                                                              2. OSD (objects)
                                                     Layout   3. NFS (files)
                         NFSv4.1                     Driver   4. PVFS2 (files)
                                                              5. Future backend…


                   pNFS Server

                                   Layout metadata
                                   grant & revoke
                      Cluster
                    Filesystem




Slide 3                                                                       Panasas, Inc.
Standards drive adoption and
          unlock markets




Slide 4                                  Panasas, Inc.
Standards drive down costs




Slide 5                      Panasas, Inc.
pNFS adds value across the workflow

                           Technical Workflow – Simulation Driven
                      Pre-processing                    Computation

          Geometry
                      Geometry          Mesh               Solve
                                                                            HPC
                       Repair         Generation
                                                             Solve
                                                           IFEA
                                                           EFEA
                                                             Solve
          Tech                                               IFEA
                                                           CFD
                                                             EFEA
                                                              CSM
                                                           CEM
          Apps                                               CFD
                                                              CFD
                                                             CEM
                      Post-processing                        CEM

                     Quantitative
                                     Visualization
                     Assessment


                     Human Intensive                 Compute Intensive

                                    Storage Management
Slide 6                                                               Panasas, Inc.
pNFS Value: Technical Applications
      Scalability
          o   Consolidate more users into a single system
          o   Accelerate workflows by consolidating data across the organization
      Ease of Use
          o   High performance, standard pNFS client delivered with the desktop OS
          o   Single mount point makes data sharing easy across projects and workgroups
      Performance
          o   Faster I/O to high performance workstations – eliminate the “filer bottleneck”
          o   Load balance small I/O requests across all servers

   Performance (YMMV)                             NFS                   pNFS
   High Concurrency (many clients/files)          10s to 100s of users Scales linearly
   Single Client Read/Write                       10s to 100s of MB/s   Scales linearly
   Capacity                                       10s to 100s of TBs    Scales linearly

Slide 7                                                                      Panasas, Inc.
pNFS Value: HPC Applications

      Scalability
          o   Eliminates islands of storage - NFS
          o   Eliminates store and forward protocols – Clustered NFS
      Performance
          o   Enables concurrent write to eliminate serial I/O write bottlenecks
          o   Eliminates hot spots due to poor data distribution across servers
          o   Balance I/O demand across many storage devices
          o   Scale I/O to meet the most demanding cluster requirements

   Performance (YMMV)                             NFS                    pNFS
   Concurrent Write (N ->1)                       Difficult              Scales linearly
   Concurrent Read                                10s to 100s of MB/s    Scales linearly
   High Bandwidth – Read/Write                    10s to 100s of MB/s    Scales linearly

Slide 8                                                                      Panasas, Inc.
pNFS Value: Storage Management

      Standard client
          o   Transparent to applications
          o   Common client for different storage back ends
          o   Fewer support issues for storage vendors
          o   Normalizes access to clustered file systems
      Manageability
          o   No Mount load balancing
          o   No storage load or capacity balancing
          o   No (fewer) Mount Tables to manage
          o   Easier provisioning – Single storage pool
      Scalability
          o   Eliminates store and forward protocols
          o   Virtualized storage - distributes data across storage cluster
Slide 9                                                                       Panasas, Inc.
Standards process milestone

      2003 First pNFS meeting among vendors
      2005 First IETF drafts
      2008 Approval of drafts for standard track
      2010 RFC status achieved!
           o   5661: NFSv4.1 protocol
           o   5662: NFSv4.1 XDR Representation
           o   5663: pNFS Block/Volume Layout
           o   5664: pNFS Objects Operation


Slide 10                                           Panasas, Inc.
Linux Release Cycle 2010

    2.6.34
      o    Merge window February 2010, Released May 2010
      o    21 NFS 4.1 patches
    2.6.35
      o    Merge window May 2010, release August 2010
      o    1 client and 1 server patch (4.1 support)
    2.6.36
      o    Merge window August 2010
      o    16 patches accepted into the merge
    2.6.37 preparations
      o    290 patches represent pNFS functionality
      o    Finalizing patches before October Bake-a-thon testing session

Slide 11                                                                   Panasas, Inc.
Linux Release Cycle 2011


    2.6.37
      o    Merge window November 2010
      o    Files pNFS client and server
    2.6.38
      o    Merge window February 2011
      o    Object pNFS client and server
    2.6.39
      o    Merge window May 2011
      o    Blocks client and server



Slide 12                                   Panasas, Inc.
Key pNFS Participants




           Panasas (Objects)
           Network Appliance (Files over NFSv4)
           IBM (Files, based on GPFS)
           EMC (Blocks, HighRoad MPFSi)
           Sun/Oracle (Files over NFSv4)
           U of Michigan/CITI (Files over PVFS2)
Slide 13                                           Panasas, Inc.
pNFS Community Update: Clients


       RedHat:
           o   Red Hat is fully committed to support pNFS in an upcoming RHEL6.x release.
           o   Red Hat is actively contributing to get pNFS working in the upstream kernel.
           o   Red Hat has built a special version of pNFS for Fedora and is working to test
               that with multiple partners.
           o   Sayan Saha – RedHat product manager – 09/10/10


      Microsoft / CITI
           o   CITI would like to announce that we have a beta version of the pnfs windows
               client available for download. You can find the location of the git repository as
               well as directions on how to build and install it at
               http://citi.umich.edu/projects/nfsv4/windows/.
           o   --CITI – 9/13/10
Slide 14                                                                        Panasas, Inc.
pNFS Community Update: Servers


      Panasas
           o   Panasas was instrumental in creating the standard, has developers working
               on the kernel implementation of pNFS and will deliver pNFS servers based on
               our industry-leading PanFS products when the Linux clients are available.
           o   Faye Pairman, CEO – 08/10/10


      NetApp
           o   “The pNFS protocol will also be a boon to server clustering in general. "You
               get all the management advantages of storage clustering without having to
               pay for any of the performance drawbacks that you would get in the absence
               of a more agile protocol like parallel NFS."
           o   Mike Eisler, Sr. Technical Director – 06/07/10



Slide 15                                                                    Panasas, Inc.
pNFS Community Update: Servers


      EMC
           o   From the Celerra VG8 spec sheet:
           o   DART file server facilities
           o   Protocols supported:
                  NFSv2, v3 and v4 (including NFSv4.1 with pNFS support)



      BlueArc
           o   “the scale aspect of BlueArc products are going to be enhanced with Parallel
               NFS (pNFS) support, with BlueArc likely to introduce a PAFS (Parallel
               Aggregate File System) capability to its software.”
           o   Mike Gustafson, CEO - The Register – 3/24/10



Slide 16                                                                    Panasas, Inc.
Thank you for supporting pNFS!

      pNFS is a long range investment for the Technical
      Computing and storage community
      SNIA is sponsoring a Developer/Future End User Interest
      Group
           o   Looking for potential pNFS Users and Analysts that will provide
               feedback to the vendor community and/or talk to the press
           o   See me if you’re interested…
                                   layout




                                                                   Storage
                        Clients
                                                  NFSv4.1 Server

Slide 17                                                               Panasas, Inc.

More Related Content

What's hot

Canon XF100 & XF105
Canon XF100 & XF105Canon XF100 & XF105
Canon XF100 & XF105
AV ProfShop
 
NetApp Multi-Protocol Storage Evaluation
NetApp Multi-Protocol Storage EvaluationNetApp Multi-Protocol Storage Evaluation
NetApp Multi-Protocol Storage Evaluation
NetApp
 
Xen community update
Xen community updateXen community update
Xen community update
The Linux Foundation
 
Oracle rac 10g best practices
Oracle rac 10g best practicesOracle rac 10g best practices
Oracle rac 10g best practices
Haseeb Alam
 
Sap On Esx Backup Methodology
Sap On Esx   Backup MethodologySap On Esx   Backup Methodology
Sap On Esx Backup Methodology
Maarten Daniels
 
Simulation Directed Co-Design from Smartphones to Supercomputers
Simulation Directed Co-Design from Smartphones to SupercomputersSimulation Directed Co-Design from Smartphones to Supercomputers
Simulation Directed Co-Design from Smartphones to Supercomputers
Eric Van Hensbergen
 
Windows offloaded data_transfer_steve_olsson
Windows offloaded data_transfer_steve_olssonWindows offloaded data_transfer_steve_olsson
Windows offloaded data_transfer_steve_olsson
scsibeast
 
What’s new System Center 2012 SP1, VMM
What’s new System Center 2012 SP1, VMMWhat’s new System Center 2012 SP1, VMM
What’s new System Center 2012 SP1, VMM
Microsoft TechNet - Belgium and Luxembourg
 
Tungsten University: Set Up And Manage Advanced Replication Topologies
Tungsten University: Set Up And Manage Advanced Replication TopologiesTungsten University: Set Up And Manage Advanced Replication Topologies
Tungsten University: Set Up And Manage Advanced Replication Topologies
Continuent
 
z/VSE Fast Path to Linux on System z
z/VSE Fast Path to Linux on System zz/VSE Fast Path to Linux on System z
z/VSE Fast Path to Linux on System z
IBM India Smarter Computing
 
Facebook's HBase Backups - StampedeCon 2012
Facebook's HBase Backups - StampedeCon 2012Facebook's HBase Backups - StampedeCon 2012
Facebook's HBase Backups - StampedeCon 2012
StampedeCon
 
Using Q4M - a message queue for MySQL #osdc.tw
Using Q4M - a message queue for MySQL #osdc.twUsing Q4M - a message queue for MySQL #osdc.tw
Using Q4M - a message queue for MySQL #osdc.tw
Kazuho Oku
 
TSM 6.4 update 22.11.2012
TSM 6.4 update 22.11.2012TSM 6.4 update 22.11.2012
TSM 6.4 update 22.11.2012
Solv AS
 
Ps3q06 20060189-michael
Ps3q06 20060189-michaelPs3q06 20060189-michael
Ps3q06 20060189-michael
Reuven Goldberg
 
2008 EBU Training BBC Scotland Infrastructure
2008 EBU Training BBC Scotland Infrastructure2008 EBU Training BBC Scotland Infrastructure
2008 EBU Training BBC Scotland Infrastructure
European Broacasting Union
 
Baidu cloudfoundry english
Baidu cloudfoundry englishBaidu cloudfoundry english
Baidu cloudfoundry english
James Watters
 
Multi-threaded Performance Pitfalls
Multi-threaded Performance PitfallsMulti-threaded Performance Pitfalls
Multi-threaded Performance Pitfalls
Ciaran McHale
 
Xrm xensummit
Xrm xensummitXrm xensummit
Xrm xensummit
The Linux Foundation
 
Presentation power vm virtualization without limits
Presentation   power vm virtualization without limitsPresentation   power vm virtualization without limits
Presentation power vm virtualization without limits
solarisyougood
 
SANsymphony V
SANsymphony VSANsymphony V
SANsymphony V
TTEC
 

What's hot (20)

Canon XF100 & XF105
Canon XF100 & XF105Canon XF100 & XF105
Canon XF100 & XF105
 
NetApp Multi-Protocol Storage Evaluation
NetApp Multi-Protocol Storage EvaluationNetApp Multi-Protocol Storage Evaluation
NetApp Multi-Protocol Storage Evaluation
 
Xen community update
Xen community updateXen community update
Xen community update
 
Oracle rac 10g best practices
Oracle rac 10g best practicesOracle rac 10g best practices
Oracle rac 10g best practices
 
Sap On Esx Backup Methodology
Sap On Esx   Backup MethodologySap On Esx   Backup Methodology
Sap On Esx Backup Methodology
 
Simulation Directed Co-Design from Smartphones to Supercomputers
Simulation Directed Co-Design from Smartphones to SupercomputersSimulation Directed Co-Design from Smartphones to Supercomputers
Simulation Directed Co-Design from Smartphones to Supercomputers
 
Windows offloaded data_transfer_steve_olsson
Windows offloaded data_transfer_steve_olssonWindows offloaded data_transfer_steve_olsson
Windows offloaded data_transfer_steve_olsson
 
What’s new System Center 2012 SP1, VMM
What’s new System Center 2012 SP1, VMMWhat’s new System Center 2012 SP1, VMM
What’s new System Center 2012 SP1, VMM
 
Tungsten University: Set Up And Manage Advanced Replication Topologies
Tungsten University: Set Up And Manage Advanced Replication TopologiesTungsten University: Set Up And Manage Advanced Replication Topologies
Tungsten University: Set Up And Manage Advanced Replication Topologies
 
z/VSE Fast Path to Linux on System z
z/VSE Fast Path to Linux on System zz/VSE Fast Path to Linux on System z
z/VSE Fast Path to Linux on System z
 
Facebook's HBase Backups - StampedeCon 2012
Facebook's HBase Backups - StampedeCon 2012Facebook's HBase Backups - StampedeCon 2012
Facebook's HBase Backups - StampedeCon 2012
 
Using Q4M - a message queue for MySQL #osdc.tw
Using Q4M - a message queue for MySQL #osdc.twUsing Q4M - a message queue for MySQL #osdc.tw
Using Q4M - a message queue for MySQL #osdc.tw
 
TSM 6.4 update 22.11.2012
TSM 6.4 update 22.11.2012TSM 6.4 update 22.11.2012
TSM 6.4 update 22.11.2012
 
Ps3q06 20060189-michael
Ps3q06 20060189-michaelPs3q06 20060189-michael
Ps3q06 20060189-michael
 
2008 EBU Training BBC Scotland Infrastructure
2008 EBU Training BBC Scotland Infrastructure2008 EBU Training BBC Scotland Infrastructure
2008 EBU Training BBC Scotland Infrastructure
 
Baidu cloudfoundry english
Baidu cloudfoundry englishBaidu cloudfoundry english
Baidu cloudfoundry english
 
Multi-threaded Performance Pitfalls
Multi-threaded Performance PitfallsMulti-threaded Performance Pitfalls
Multi-threaded Performance Pitfalls
 
Xrm xensummit
Xrm xensummitXrm xensummit
Xrm xensummit
 
Presentation power vm virtualization without limits
Presentation   power vm virtualization without limitsPresentation   power vm virtualization without limits
Presentation power vm virtualization without limits
 
SANsymphony V
SANsymphony VSANsymphony V
SANsymphony V
 

Similar to Panasas pNFS Status (September 2010)

pnfs status
pnfs statuspnfs status
pnfs status
bergwolf
 
Vm13 vnx mixed workloads
Vm13 vnx mixed workloadsVm13 vnx mixed workloads
Vm13 vnx mixed workloads
pittmantony
 
Pnfs
PnfsPnfs
Panasas pNFS Status - Brent Welch
Panasas pNFS Status - Brent WelchPanasas pNFS Status - Brent Welch
Panasas pNFS Status - Brent Welch
Panasas
 
Do More with Oracle Environment with Open and Best of breed Technologies
Do More with Oracle Environment with Open and Best of breed TechnologiesDo More with Oracle Environment with Open and Best of breed Technologies
Do More with Oracle Environment with Open and Best of breed Technologies
EMC Forum India
 
Paravirtualized File Systems
Paravirtualized File SystemsParavirtualized File Systems
Paravirtualized File Systems
Eric Van Hensbergen
 
CLFS 2010
CLFS 2010CLFS 2010
CLFS 2010
bergwolf
 
SNIA Europe - DCSEurope_April2013 (AOrdoubadian)
SNIA Europe - DCSEurope_April2013 (AOrdoubadian)SNIA Europe - DCSEurope_April2013 (AOrdoubadian)
SNIA Europe - DCSEurope_April2013 (AOrdoubadian)
Ali Ordoubadian
 
SUN Network File system - Design, Implementation and Experience
SUN Network File system - Design, Implementation and Experience SUN Network File system - Design, Implementation and Experience
SUN Network File system - Design, Implementation and Experience
aniadkar
 
Linux cifs-client-guide
Linux cifs-client-guideLinux cifs-client-guide
Linux cifs-client-guide
unixadminrasheed
 
BSDCan2006.pdf
BSDCan2006.pdfBSDCan2006.pdf
BSDCan2006.pdf
JoseRamirez260192
 
Filesystems, RPC and HDFS
Filesystems, RPC and HDFSFilesystems, RPC and HDFS
Filesystems, RPC and HDFS
Alexander Alten
 
IMCSummit 2015 - Day 1 Developer Track - Evolution of non-volatile memory exp...
IMCSummit 2015 - Day 1 Developer Track - Evolution of non-volatile memory exp...IMCSummit 2015 - Day 1 Developer Track - Evolution of non-volatile memory exp...
IMCSummit 2015 - Day 1 Developer Track - Evolution of non-volatile memory exp...
In-Memory Computing Summit
 
Ibm spectrum scale fundamentals workshop for americas part 5 spectrum scale_c...
Ibm spectrum scale fundamentals workshop for americas part 5 spectrum scale_c...Ibm spectrum scale fundamentals workshop for americas part 5 spectrum scale_c...
Ibm spectrum scale fundamentals workshop for americas part 5 spectrum scale_c...
xKinAnx
 
PROSE
PROSEPROSE
Storage virtualization citrix blr wide tech talk
Storage virtualization citrix blr wide tech talkStorage virtualization citrix blr wide tech talk
Storage virtualization citrix blr wide tech talk
Sisimon Soman
 
Introduction to NVMe Over Fabrics-V3R
Introduction to NVMe Over Fabrics-V3RIntroduction to NVMe Over Fabrics-V3R
Introduction to NVMe Over Fabrics-V3R
Simon Huang
 
VDI storage and storage virtualization
VDI storage and storage virtualizationVDI storage and storage virtualization
VDI storage and storage virtualization
Sisimon Soman
 
Data Center: Cloud & Convergencia
Data Center: Cloud & ConvergenciaData Center: Cloud & Convergencia
Data Center: Cloud & Convergencia
Logicalis Latam
 
San 101 basics of administrating a san
San 101 basics of administrating a sanSan 101 basics of administrating a san
San 101 basics of administrating a san
pineapplebed24
 

Similar to Panasas pNFS Status (September 2010) (20)

pnfs status
pnfs statuspnfs status
pnfs status
 
Vm13 vnx mixed workloads
Vm13 vnx mixed workloadsVm13 vnx mixed workloads
Vm13 vnx mixed workloads
 
Pnfs
PnfsPnfs
Pnfs
 
Panasas pNFS Status - Brent Welch
Panasas pNFS Status - Brent WelchPanasas pNFS Status - Brent Welch
Panasas pNFS Status - Brent Welch
 
Do More with Oracle Environment with Open and Best of breed Technologies
Do More with Oracle Environment with Open and Best of breed TechnologiesDo More with Oracle Environment with Open and Best of breed Technologies
Do More with Oracle Environment with Open and Best of breed Technologies
 
Paravirtualized File Systems
Paravirtualized File SystemsParavirtualized File Systems
Paravirtualized File Systems
 
CLFS 2010
CLFS 2010CLFS 2010
CLFS 2010
 
SNIA Europe - DCSEurope_April2013 (AOrdoubadian)
SNIA Europe - DCSEurope_April2013 (AOrdoubadian)SNIA Europe - DCSEurope_April2013 (AOrdoubadian)
SNIA Europe - DCSEurope_April2013 (AOrdoubadian)
 
SUN Network File system - Design, Implementation and Experience
SUN Network File system - Design, Implementation and Experience SUN Network File system - Design, Implementation and Experience
SUN Network File system - Design, Implementation and Experience
 
Linux cifs-client-guide
Linux cifs-client-guideLinux cifs-client-guide
Linux cifs-client-guide
 
BSDCan2006.pdf
BSDCan2006.pdfBSDCan2006.pdf
BSDCan2006.pdf
 
Filesystems, RPC and HDFS
Filesystems, RPC and HDFSFilesystems, RPC and HDFS
Filesystems, RPC and HDFS
 
IMCSummit 2015 - Day 1 Developer Track - Evolution of non-volatile memory exp...
IMCSummit 2015 - Day 1 Developer Track - Evolution of non-volatile memory exp...IMCSummit 2015 - Day 1 Developer Track - Evolution of non-volatile memory exp...
IMCSummit 2015 - Day 1 Developer Track - Evolution of non-volatile memory exp...
 
Ibm spectrum scale fundamentals workshop for americas part 5 spectrum scale_c...
Ibm spectrum scale fundamentals workshop for americas part 5 spectrum scale_c...Ibm spectrum scale fundamentals workshop for americas part 5 spectrum scale_c...
Ibm spectrum scale fundamentals workshop for americas part 5 spectrum scale_c...
 
PROSE
PROSEPROSE
PROSE
 
Storage virtualization citrix blr wide tech talk
Storage virtualization citrix blr wide tech talkStorage virtualization citrix blr wide tech talk
Storage virtualization citrix blr wide tech talk
 
Introduction to NVMe Over Fabrics-V3R
Introduction to NVMe Over Fabrics-V3RIntroduction to NVMe Over Fabrics-V3R
Introduction to NVMe Over Fabrics-V3R
 
VDI storage and storage virtualization
VDI storage and storage virtualizationVDI storage and storage virtualization
VDI storage and storage virtualization
 
Data Center: Cloud & Convergencia
Data Center: Cloud & ConvergenciaData Center: Cloud & Convergencia
Data Center: Cloud & Convergencia
 
San 101 basics of administrating a san
San 101 basics of administrating a sanSan 101 basics of administrating a san
San 101 basics of administrating a san
 

More from Panasas

Is Your Storage Ready for Commercial HPC? - Three Steps to Take
Is Your Storage Ready for Commercial HPC? - Three Steps to TakeIs Your Storage Ready for Commercial HPC? - Three Steps to Take
Is Your Storage Ready for Commercial HPC? - Three Steps to Take
Panasas
 
PanasasActiveStor
PanasasActiveStorPanasasActiveStor
PanasasActiveStor
Panasas
 
Panasas ActiveStor Reliability that Improves with Scale
Panasas ActiveStor Reliability that Improves with ScalePanasas ActiveStor Reliability that Improves with Scale
Panasas ActiveStor Reliability that Improves with Scale
Panasas
 
Evolution of RAID
Evolution of RAIDEvolution of RAID
Evolution of RAID
Panasas
 
ActiveStor Performance at Scale
ActiveStor Performance at ScaleActiveStor Performance at Scale
ActiveStor Performance at Scale
Panasas
 
Panasas® activestor® and ansys
Panasas® activestor® and ansysPanasas® activestor® and ansys
Panasas® activestor® and ansys
Panasas
 
Panasas ® California Institute of Technology Success Story
Panasas ® California Institute of Technology Success StoryPanasas ® California Institute of Technology Success Story
Panasas ® California Institute of Technology Success Story
Panasas
 
Panasas ® Los Alamos National Laboratory
Panasas ® Los Alamos National LaboratoryPanasas ® Los Alamos National Laboratory
Panasas ® Los Alamos National Laboratory
Panasas
 
Panasas ® University of Cologne Success Story
Panasas ® University of Cologne Success StoryPanasas ® University of Cologne Success Story
Panasas ® University of Cologne Success Story
Panasas
 
PANASAS® ACTIVESTOR® AND STAR-CCM+
PANASAS® ACTIVESTOR® AND STAR-CCM+PANASAS® ACTIVESTOR® AND STAR-CCM+
PANASAS® ACTIVESTOR® AND STAR-CCM+
Panasas
 
Panasas ® Deluxe Australlia
Panasas ® Deluxe Australlia Panasas ® Deluxe Australlia
Panasas ® Deluxe Australlia
Panasas
 
Panasas ® University of Oxford
Panasas ®  University of OxfordPanasas ®  University of Oxford
Panasas ® University of Oxford
Panasas
 
Panasas ® Terraspark Geosciences Customer Success Story
Panasas ®  Terraspark Geosciences Customer Success StoryPanasas ®  Terraspark Geosciences Customer Success Story
Panasas ® Terraspark Geosciences Customer Success Story
Panasas
 
Panasas ® UCLA Customer Success Story
Panasas ®  UCLA Customer Success StoryPanasas ®  UCLA Customer Success Story
Panasas ® UCLA Customer Success Story
Panasas
 
Panasas ® The Defence Academy of the United Kingdom
Panasas ®  The Defence Academy of the United Kingdom Panasas ®  The Defence Academy of the United Kingdom
Panasas ® The Defence Academy of the United Kingdom
Panasas
 
Panasas® Utah State Univercity
Panasas®  Utah State UnivercityPanasas®  Utah State Univercity
Panasas® Utah State Univercity
Panasas
 
Accelerate Discovery
Accelerate DiscoveryAccelerate Discovery
Accelerate Discovery
Panasas
 
Accelerate Financial Simulation & Analytics
Accelerate Financial Simulation & AnalyticsAccelerate Financial Simulation & Analytics
Accelerate Financial Simulation & Analytics
Panasas
 
Accelerate Oil & Gas Discovery
Accelerate Oil & Gas DiscoveryAccelerate Oil & Gas Discovery
Accelerate Oil & Gas Discovery
Panasas
 
Panasas® ActiveStor ® 16
Panasas® ActiveStor ® 16Panasas® ActiveStor ® 16
Panasas® ActiveStor ® 16
Panasas
 

More from Panasas (20)

Is Your Storage Ready for Commercial HPC? - Three Steps to Take
Is Your Storage Ready for Commercial HPC? - Three Steps to TakeIs Your Storage Ready for Commercial HPC? - Three Steps to Take
Is Your Storage Ready for Commercial HPC? - Three Steps to Take
 
PanasasActiveStor
PanasasActiveStorPanasasActiveStor
PanasasActiveStor
 
Panasas ActiveStor Reliability that Improves with Scale
Panasas ActiveStor Reliability that Improves with ScalePanasas ActiveStor Reliability that Improves with Scale
Panasas ActiveStor Reliability that Improves with Scale
 
Evolution of RAID
Evolution of RAIDEvolution of RAID
Evolution of RAID
 
ActiveStor Performance at Scale
ActiveStor Performance at ScaleActiveStor Performance at Scale
ActiveStor Performance at Scale
 
Panasas® activestor® and ansys
Panasas® activestor® and ansysPanasas® activestor® and ansys
Panasas® activestor® and ansys
 
Panasas ® California Institute of Technology Success Story
Panasas ® California Institute of Technology Success StoryPanasas ® California Institute of Technology Success Story
Panasas ® California Institute of Technology Success Story
 
Panasas ® Los Alamos National Laboratory
Panasas ® Los Alamos National LaboratoryPanasas ® Los Alamos National Laboratory
Panasas ® Los Alamos National Laboratory
 
Panasas ® University of Cologne Success Story
Panasas ® University of Cologne Success StoryPanasas ® University of Cologne Success Story
Panasas ® University of Cologne Success Story
 
PANASAS® ACTIVESTOR® AND STAR-CCM+
PANASAS® ACTIVESTOR® AND STAR-CCM+PANASAS® ACTIVESTOR® AND STAR-CCM+
PANASAS® ACTIVESTOR® AND STAR-CCM+
 
Panasas ® Deluxe Australlia
Panasas ® Deluxe Australlia Panasas ® Deluxe Australlia
Panasas ® Deluxe Australlia
 
Panasas ® University of Oxford
Panasas ®  University of OxfordPanasas ®  University of Oxford
Panasas ® University of Oxford
 
Panasas ® Terraspark Geosciences Customer Success Story
Panasas ®  Terraspark Geosciences Customer Success StoryPanasas ®  Terraspark Geosciences Customer Success Story
Panasas ® Terraspark Geosciences Customer Success Story
 
Panasas ® UCLA Customer Success Story
Panasas ®  UCLA Customer Success StoryPanasas ®  UCLA Customer Success Story
Panasas ® UCLA Customer Success Story
 
Panasas ® The Defence Academy of the United Kingdom
Panasas ®  The Defence Academy of the United Kingdom Panasas ®  The Defence Academy of the United Kingdom
Panasas ® The Defence Academy of the United Kingdom
 
Panasas® Utah State Univercity
Panasas®  Utah State UnivercityPanasas®  Utah State Univercity
Panasas® Utah State Univercity
 
Accelerate Discovery
Accelerate DiscoveryAccelerate Discovery
Accelerate Discovery
 
Accelerate Financial Simulation & Analytics
Accelerate Financial Simulation & AnalyticsAccelerate Financial Simulation & Analytics
Accelerate Financial Simulation & Analytics
 
Accelerate Oil & Gas Discovery
Accelerate Oil & Gas DiscoveryAccelerate Oil & Gas Discovery
Accelerate Oil & Gas Discovery
 
Panasas® ActiveStor ® 16
Panasas® ActiveStor ® 16Panasas® ActiveStor ® 16
Panasas® ActiveStor ® 16
 

Recently uploaded

Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
Jason Yip
 
AppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSFAppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSF
Ajin Abraham
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
ssuserfac0301
 
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and BioinformaticiansBiomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Neo4j
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
panagenda
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
Tatiana Kojar
 
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
saastr
 
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
saastr
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
MichaelKnudsen27
 
"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota
Fwdays
 
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
Edge AI and Vision Alliance
 
Essentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation ParametersEssentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation Parameters
Safe Software
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
Ivanti
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
Jakub Marek
 
Apps Break Data
Apps Break DataApps Break Data
Apps Break Data
Ivo Velitchkov
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
Hiroshi SHIBATA
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
Jason Packer
 
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Pitangent Analytics & Technology Solutions Pvt. Ltd
 

Recently uploaded (20)

Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
 
AppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSFAppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSF
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
 
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and BioinformaticiansBiomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
 
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
 
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
 
"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota
 
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
 
Artificial Intelligence and Electronic Warfare
Artificial Intelligence and Electronic WarfareArtificial Intelligence and Electronic Warfare
Artificial Intelligence and Electronic Warfare
 
Essentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation ParametersEssentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation Parameters
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
 
Apps Break Data
Apps Break DataApps Break Data
Apps Break Data
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
 
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
 

Panasas pNFS Status (September 2010)

  • 2. Review: The pNFS Standard The pNFS standard defines the NFSv4.1 protocol extensions between the server and client The I/O protocol between the client and storage is specified elsewhere, for example: o SCSI Block Commands (SBC) over Fibre Channel (FC) o SCSI Object-based Storage Device (OSD) over iSCSI o Network File System (NFS) The control protocol between the server and storage devices is also specified elsewhere, for example: o SCSI Object-based Storage Device (OSD) over iSCSI Client Storage NFS 4.1 Server Slide 2 Panasas, Inc.
  • 3. Review: pNFS Client Common client for different storage servers Client Apps pNFS Client 1. SBC (blocks) 2. OSD (objects) Layout 3. NFS (files) NFSv4.1 Driver 4. PVFS2 (files) 5. Future backend… pNFS Server Layout metadata grant & revoke Cluster Filesystem Slide 3 Panasas, Inc.
  • 4. Standards drive adoption and unlock markets Slide 4 Panasas, Inc.
  • 5. Standards drive down costs Slide 5 Panasas, Inc.
  • 6. pNFS adds value across the workflow Technical Workflow – Simulation Driven Pre-processing Computation Geometry Geometry Mesh Solve HPC Repair Generation Solve IFEA EFEA Solve Tech IFEA CFD EFEA CSM CEM Apps CFD CFD CEM Post-processing CEM Quantitative Visualization Assessment Human Intensive Compute Intensive Storage Management Slide 6 Panasas, Inc.
  • 7. pNFS Value: Technical Applications Scalability o Consolidate more users into a single system o Accelerate workflows by consolidating data across the organization Ease of Use o High performance, standard pNFS client delivered with the desktop OS o Single mount point makes data sharing easy across projects and workgroups Performance o Faster I/O to high performance workstations – eliminate the “filer bottleneck” o Load balance small I/O requests across all servers Performance (YMMV) NFS pNFS High Concurrency (many clients/files) 10s to 100s of users Scales linearly Single Client Read/Write 10s to 100s of MB/s Scales linearly Capacity 10s to 100s of TBs Scales linearly Slide 7 Panasas, Inc.
  • 8. pNFS Value: HPC Applications Scalability o Eliminates islands of storage - NFS o Eliminates store and forward protocols – Clustered NFS Performance o Enables concurrent write to eliminate serial I/O write bottlenecks o Eliminates hot spots due to poor data distribution across servers o Balance I/O demand across many storage devices o Scale I/O to meet the most demanding cluster requirements Performance (YMMV) NFS pNFS Concurrent Write (N ->1) Difficult Scales linearly Concurrent Read 10s to 100s of MB/s Scales linearly High Bandwidth – Read/Write 10s to 100s of MB/s Scales linearly Slide 8 Panasas, Inc.
  • 9. pNFS Value: Storage Management Standard client o Transparent to applications o Common client for different storage back ends o Fewer support issues for storage vendors o Normalizes access to clustered file systems Manageability o No Mount load balancing o No storage load or capacity balancing o No (fewer) Mount Tables to manage o Easier provisioning – Single storage pool Scalability o Eliminates store and forward protocols o Virtualized storage - distributes data across storage cluster Slide 9 Panasas, Inc.
  • 10. Standards process milestone 2003 First pNFS meeting among vendors 2005 First IETF drafts 2008 Approval of drafts for standard track 2010 RFC status achieved! o 5661: NFSv4.1 protocol o 5662: NFSv4.1 XDR Representation o 5663: pNFS Block/Volume Layout o 5664: pNFS Objects Operation Slide 10 Panasas, Inc.
  • 11. Linux Release Cycle 2010 2.6.34 o Merge window February 2010, Released May 2010 o 21 NFS 4.1 patches 2.6.35 o Merge window May 2010, release August 2010 o 1 client and 1 server patch (4.1 support) 2.6.36 o Merge window August 2010 o 16 patches accepted into the merge 2.6.37 preparations o 290 patches represent pNFS functionality o Finalizing patches before October Bake-a-thon testing session Slide 11 Panasas, Inc.
  • 12. Linux Release Cycle 2011 2.6.37 o Merge window November 2010 o Files pNFS client and server 2.6.38 o Merge window February 2011 o Object pNFS client and server 2.6.39 o Merge window May 2011 o Blocks client and server Slide 12 Panasas, Inc.
  • 13. Key pNFS Participants Panasas (Objects) Network Appliance (Files over NFSv4) IBM (Files, based on GPFS) EMC (Blocks, HighRoad MPFSi) Sun/Oracle (Files over NFSv4) U of Michigan/CITI (Files over PVFS2) Slide 13 Panasas, Inc.
  • 14. pNFS Community Update: Clients RedHat: o Red Hat is fully committed to support pNFS in an upcoming RHEL6.x release. o Red Hat is actively contributing to get pNFS working in the upstream kernel. o Red Hat has built a special version of pNFS for Fedora and is working to test that with multiple partners. o Sayan Saha – RedHat product manager – 09/10/10 Microsoft / CITI o CITI would like to announce that we have a beta version of the pnfs windows client available for download. You can find the location of the git repository as well as directions on how to build and install it at http://citi.umich.edu/projects/nfsv4/windows/. o --CITI – 9/13/10 Slide 14 Panasas, Inc.
  • 15. pNFS Community Update: Servers Panasas o Panasas was instrumental in creating the standard, has developers working on the kernel implementation of pNFS and will deliver pNFS servers based on our industry-leading PanFS products when the Linux clients are available. o Faye Pairman, CEO – 08/10/10 NetApp o “The pNFS protocol will also be a boon to server clustering in general. "You get all the management advantages of storage clustering without having to pay for any of the performance drawbacks that you would get in the absence of a more agile protocol like parallel NFS." o Mike Eisler, Sr. Technical Director – 06/07/10 Slide 15 Panasas, Inc.
  • 16. pNFS Community Update: Servers EMC o From the Celerra VG8 spec sheet: o DART file server facilities o Protocols supported: NFSv2, v3 and v4 (including NFSv4.1 with pNFS support) BlueArc o “the scale aspect of BlueArc products are going to be enhanced with Parallel NFS (pNFS) support, with BlueArc likely to introduce a PAFS (Parallel Aggregate File System) capability to its software.” o Mike Gustafson, CEO - The Register – 3/24/10 Slide 16 Panasas, Inc.
  • 17. Thank you for supporting pNFS! pNFS is a long range investment for the Technical Computing and storage community SNIA is sponsoring a Developer/Future End User Interest Group o Looking for potential pNFS Users and Analysts that will provide feedback to the vendor community and/or talk to the press o See me if you’re interested… layout Storage Clients NFSv4.1 Server Slide 17 Panasas, Inc.