Red Hat Enterprise Linux / NFS



Syed M Shaaf                 Klaus Oxdal
Solution Architect           Partner and Alliances, Nordics
Red Hat                      Red Hat




1                    Red Hat Enterprise Linux and NFS | Syed M Shaaf
WHAT WE DO
       We offer a range of mission-critical software and services covering:


             IaaS/PaaS                  MIDDLEWARE                     OPERATING SYSTEM


                      VIRTUALIZATION                         STORAGE



    HOW WE DO IT.
    We develop everything using
                                                             THE BENEFITS.
    an OPEN SOURCE model.
                                                                  Flexibility

    Shared development reduces                                    Faster technology innovation
    costs & accelerates innovation.
                                                                  Better quality
    Open collaboration offers
    products that genuinely meet                                  Better price & performance
    customers' requirements.
                                                                  Alignment to your needs




2                             Red Hat Enterprise Linux and NFS | Syed M Shaaf
PRODUCT PROCESS
PARTICIPATE   100,000+
               PROJECTS                                    We participate in & create upstream
                                                           projects.


                                                           We build & support open communities
                                                           around integrated projects.
INTEGRATE

                                                           We enable software & hardware
                                                           partners to participate at every stage
                                                           of development.


 STABILIZE                                                 We commercialize these
                                                           innovations together with a rich
                                                           ecosystem of services & certifications.




 3               Red Hat Enterprise Linux and NFS | Syed M Shaaf
OUR CUSTOMERS


         The largest global exchange
                on the planet.                                                         The largest global distribution
                                                                                            system in the world.




We are pleased to offer supported enterprise-class Red Hat
Enterprise Linux on demand for our customers.                                                       A leading enterprise cloud
                                                                                                        computing vendor.




        Wherever you live, it is likely that several letters that you                                  Red Hat has impressed us with its
        have received have been read, coded, and processed for                                         outstanding engineering capabilities
        delivery by one of our systems using JBoss Enterprise                                          and commitment to our strategic
        Application Platform as the middleware foundation.                                             alliance.




    4                                             Red Hat Enterprise Linux and NFS | Syed M Shaaf
Red Hat Enterprise Linux




5          Red Hat Enterprise Linux and NFS | Syed M Shaaf
RED HAT ENTERPRISE LINUX 6
SCALABILITY




6             Red Hat Enterprise Linux and NFS | Syed M Shaaf
RED HAT ENTERPRISE LINUX 6
SCALABILITY




7             Red Hat Enterprise Linux and NFS | Syed M Shaaf
RED HAT ENTERPRISE LINUX 6
SCALABILITY




8             Red Hat Enterprise Linux and NFS | Syed M Shaaf
RED HAT ENTERPRISE LINUX 6
COMMUNITY LEADERSHIP




9             Red Hat Enterprise Linux and NFS | Syed M Shaaf
NFS




10   Red Hat Enterprise Linux and NFS | Syed M Shaaf
NFS V4

 â—Ź   NFS version 3 most used! Why Change it??
     Performance!
 â—Ź   Version 4 is now the default protocol version for
     RHEL6
 â—Ź   IETF: RFC3530: http://tools.ietf.org/html/rfc3530




11                     Red Hat Enterprise Linux and NFS | Syed M Shaaf
NFS Version 4.0 – Noteworthy features

 â—Ź   Version 4 is a Stateful Protocol.
      â—Ź   Delegations
 â—Ź   Mandated Security
 â—Ź   Referrals
 â—Ź   Firewall Friendly (kinda!)




12                      Red Hat Enterprise Linux and NFS | Syed M Shaaf
NFS version 4 – Gotchas!

 ●   “All My files are owned by NOBODY!!!”
      â—Ź   Idmapping: steved@redhat.com ==> 3606
      â—Ź   DNS problem 90% of the time
      â—Ź   'Domain=' in /etc/idmapd.conf
 â—Ź   Mounting Legacy servers.
      â—Ź   Mount negotiation start at v4
      â—Ź   For Legacy server use /etc/nfsmount.conf mount
          negotiation




13                        Red Hat Enterprise Linux and NFS | Syed M Shaaf
NFS version 4.1

 â—Ź   Sessions
      â—Ź   Session IDs
 â—Ź   Parallel NFS (pNFS)
      â—Ź   File Layout (NAS environment) - Netapp
      â—Ź   Block Layout
      â—Ź   Object Layout
 â—Ź   IETF: RFC5661
      â—Ź   http://tools.ietf.org/html/rfc5661




14                         Red Hat Enterprise Linux and NFS | Syed M Shaaf
NFS version 4.1 in RHEL

 â—Ź   RHEL6 Client
     â—Ź   Tech Preview in 6.2
     â—Ź   pNFS: File layouts only
 â—Ź   RHEL7 Client
     â—Ź   All layouts supported.




15                       Red Hat Enterprise Linux and NFS | Syed M Shaaf
NFS version 4.1 – Make it work!

 â—Ź   Enabling 4.1/pNFS on the client
      â—Ź   mount -o minorversion=1

 â—Ź   Does the server support pNFS
      â—Ź   nfs4filelayout_init: NFSv4 File Layout Driver
          Registering..
      ●   “pnfs=<layout>” in /proc/self/mountstats




16                        Red Hat Enterprise Linux and NFS | Syed M Shaaf
NFS version 4.2

 â—Ź   Labeled NFS
      â—Ź   Security contexts
 â—Ź   Server to Server Copy
      â—Ź   offload to server copy operation
 â—Ź   Sparse Files
 â—Ź   IETF: Internet-Draft
      â—Ź   http://tools.ietf.org/html/draft-ietf-nfsv4-minorversion2-11




17                         Red Hat Enterprise Linux and NFS | Syed M Shaaf
6.4 and some important
            changes




18          Red Hat Enterprise Linux and NFS | Syed M Shaaf
Operating system - IO


                    Operating System ( Kernel )



                                      2:
       1:


                               Buffers and Cache
                                                                       Storage

                                                                         Data
                                           3:
     Application
                                                                         Data
   Application
Cache/Buffer Pool
                                                                         Data




19                   Red Hat Enterprise Linux and NFS | Syed M Shaaf
Operating system – Direct IO


                    Operating System ( Kernel )
                                                                       2:


       1:


                               Buffers and Cache
                                                                       Storage

                                                                         Data

     Application
                                                                         Data
   Application
Cache/Buffer Pool
                                                                         Data




20                   Red Hat Enterprise Linux and NFS | Syed M Shaaf
Direct IO with PNFS, is it useful?

 â—Ź   O_DIRECT patches into pnfs
 â—Ź   Access the storage directly. Why?
 â—Ź   Databases are a good candidate, when?
 â—Ź   All operations are done in block size multiples




21                     Red Hat Enterprise Linux and NFS | Syed M Shaaf
RED HAT ENTERPRISE LINUX 6
Slots and TCP window size
 â—Ź   Allow the number of available slots to grow with the
     TCP window size.
 â—Ź   RHEL 6.3 dynamically allocates RPC slots up to the
     sunrpc.tcp_max_slot_table_entries ( 65536)
      â—Ź   Previously the number of in-flight RPC requests was
          limited to 128 (default 16). This affected the
          performance of OLTP workloads when using the kernel
          based NFS client.
 â—Ź   NFS 4.1 max session slots is set with the boot
     parameter:
     nfs.max_session_slots (do not set higher than above)

22                      Red Hat Enterprise Linux and NFS | Syed M Shaaf
References

 â—Ź   Steve Dickson
      â—Ź   http://people.redhat.com/steved/Summits/

 â—Ź   NFSv4.1 new features: Sessions, Parallel NFS (pNFS)
      â—Ź   http://www.iaps.com/nfsv4.1-new-features.html

 â—Ź   Parallel NFS (pNFS)
      â—Ź   http://www.pnfs.com/




23                       Red Hat Enterprise Linux and NFS | Syed M Shaaf
Thank you!

     Syed M Shaaf                          Klaus Oxdal
     Solution Architect                    Partner and Alliances, Nordics
     Red Hat                               Red Hat




24      Red Hat Enterprise Linux and NFS | Syed M Shaaf

Red Hat Enterprise Linux and NFS by syedmshaaf

  • 1.
    Red Hat EnterpriseLinux / NFS Syed M Shaaf Klaus Oxdal Solution Architect Partner and Alliances, Nordics Red Hat Red Hat 1 Red Hat Enterprise Linux and NFS | Syed M Shaaf
  • 2.
    WHAT WE DO We offer a range of mission-critical software and services covering: IaaS/PaaS MIDDLEWARE OPERATING SYSTEM VIRTUALIZATION STORAGE HOW WE DO IT. We develop everything using THE BENEFITS. an OPEN SOURCE model. Flexibility Shared development reduces Faster technology innovation costs & accelerates innovation. Better quality Open collaboration offers products that genuinely meet Better price & performance customers' requirements. Alignment to your needs 2 Red Hat Enterprise Linux and NFS | Syed M Shaaf
  • 3.
    PRODUCT PROCESS PARTICIPATE 100,000+ PROJECTS We participate in & create upstream projects. We build & support open communities around integrated projects. INTEGRATE We enable software & hardware partners to participate at every stage of development. STABILIZE We commercialize these innovations together with a rich ecosystem of services & certifications. 3 Red Hat Enterprise Linux and NFS | Syed M Shaaf
  • 4.
    OUR CUSTOMERS The largest global exchange on the planet. The largest global distribution system in the world. We are pleased to offer supported enterprise-class Red Hat Enterprise Linux on demand for our customers. A leading enterprise cloud computing vendor. Wherever you live, it is likely that several letters that you Red Hat has impressed us with its have received have been read, coded, and processed for outstanding engineering capabilities delivery by one of our systems using JBoss Enterprise and commitment to our strategic Application Platform as the middleware foundation. alliance. 4 Red Hat Enterprise Linux and NFS | Syed M Shaaf
  • 5.
    Red Hat EnterpriseLinux 5 Red Hat Enterprise Linux and NFS | Syed M Shaaf
  • 6.
    RED HAT ENTERPRISELINUX 6 SCALABILITY 6 Red Hat Enterprise Linux and NFS | Syed M Shaaf
  • 7.
    RED HAT ENTERPRISELINUX 6 SCALABILITY 7 Red Hat Enterprise Linux and NFS | Syed M Shaaf
  • 8.
    RED HAT ENTERPRISELINUX 6 SCALABILITY 8 Red Hat Enterprise Linux and NFS | Syed M Shaaf
  • 9.
    RED HAT ENTERPRISELINUX 6 COMMUNITY LEADERSHIP 9 Red Hat Enterprise Linux and NFS | Syed M Shaaf
  • 10.
    NFS 10 Red Hat Enterprise Linux and NFS | Syed M Shaaf
  • 11.
    NFS V4 â—Ź NFS version 3 most used! Why Change it?? Performance! â—Ź Version 4 is now the default protocol version for RHEL6 â—Ź IETF: RFC3530: http://tools.ietf.org/html/rfc3530 11 Red Hat Enterprise Linux and NFS | Syed M Shaaf
  • 12.
    NFS Version 4.0– Noteworthy features ● Version 4 is a Stateful Protocol. ● Delegations ● Mandated Security ● Referrals ● Firewall Friendly (kinda!) 12 Red Hat Enterprise Linux and NFS | Syed M Shaaf
  • 13.
    NFS version 4– Gotchas! ● “All My files are owned by NOBODY!!!” ● Idmapping: steved@redhat.com ==> 3606 ● DNS problem 90% of the time ● 'Domain=' in /etc/idmapd.conf ● Mounting Legacy servers. ● Mount negotiation start at v4 ● For Legacy server use /etc/nfsmount.conf mount negotiation 13 Red Hat Enterprise Linux and NFS | Syed M Shaaf
  • 14.
    NFS version 4.1 â—Ź Sessions â—Ź Session IDs â—Ź Parallel NFS (pNFS) â—Ź File Layout (NAS environment) - Netapp â—Ź Block Layout â—Ź Object Layout â—Ź IETF: RFC5661 â—Ź http://tools.ietf.org/html/rfc5661 14 Red Hat Enterprise Linux and NFS | Syed M Shaaf
  • 15.
    NFS version 4.1in RHEL â—Ź RHEL6 Client â—Ź Tech Preview in 6.2 â—Ź pNFS: File layouts only â—Ź RHEL7 Client â—Ź All layouts supported. 15 Red Hat Enterprise Linux and NFS | Syed M Shaaf
  • 16.
    NFS version 4.1– Make it work! ● Enabling 4.1/pNFS on the client ● mount -o minorversion=1 ● Does the server support pNFS ● nfs4filelayout_init: NFSv4 File Layout Driver Registering.. ● “pnfs=<layout>” in /proc/self/mountstats 16 Red Hat Enterprise Linux and NFS | Syed M Shaaf
  • 17.
    NFS version 4.2 â—Ź Labeled NFS â—Ź Security contexts â—Ź Server to Server Copy â—Ź offload to server copy operation â—Ź Sparse Files â—Ź IETF: Internet-Draft â—Ź http://tools.ietf.org/html/draft-ietf-nfsv4-minorversion2-11 17 Red Hat Enterprise Linux and NFS | Syed M Shaaf
  • 18.
    6.4 and someimportant changes 18 Red Hat Enterprise Linux and NFS | Syed M Shaaf
  • 19.
    Operating system -IO Operating System ( Kernel ) 2: 1: Buffers and Cache Storage Data 3: Application Data Application Cache/Buffer Pool Data 19 Red Hat Enterprise Linux and NFS | Syed M Shaaf
  • 20.
    Operating system –Direct IO Operating System ( Kernel ) 2: 1: Buffers and Cache Storage Data Application Data Application Cache/Buffer Pool Data 20 Red Hat Enterprise Linux and NFS | Syed M Shaaf
  • 21.
    Direct IO withPNFS, is it useful? â—Ź O_DIRECT patches into pnfs â—Ź Access the storage directly. Why? â—Ź Databases are a good candidate, when? â—Ź All operations are done in block size multiples 21 Red Hat Enterprise Linux and NFS | Syed M Shaaf
  • 22.
    RED HAT ENTERPRISELINUX 6 Slots and TCP window size â—Ź Allow the number of available slots to grow with the TCP window size. â—Ź RHEL 6.3 dynamically allocates RPC slots up to the sunrpc.tcp_max_slot_table_entries ( 65536) â—Ź Previously the number of in-flight RPC requests was limited to 128 (default 16). This affected the performance of OLTP workloads when using the kernel based NFS client. â—Ź NFS 4.1 max session slots is set with the boot parameter: nfs.max_session_slots (do not set higher than above) 22 Red Hat Enterprise Linux and NFS | Syed M Shaaf
  • 23.
    References â—Ź Steve Dickson â—Ź http://people.redhat.com/steved/Summits/ â—Ź NFSv4.1 new features: Sessions, Parallel NFS (pNFS) â—Ź http://www.iaps.com/nfsv4.1-new-features.html â—Ź Parallel NFS (pNFS) â—Ź http://www.pnfs.com/ 23 Red Hat Enterprise Linux and NFS | Syed M Shaaf
  • 24.
    Thank you! Syed M Shaaf Klaus Oxdal Solution Architect Partner and Alliances, Nordics Red Hat Red Hat 24 Red Hat Enterprise Linux and NFS | Syed M Shaaf