Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Lustre Releases Update from LAD'14

1,041 views

Published on

In this video from the LAD'14 Lustre Administrators and Developers Conference, Peter Jones from Intel presents: Lustre Releases.

Learn more: http://www.eofs.eu/?id=lad14
Watch the video presentation: http://wp.me/p3RLHQ-d1q

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Lustre Releases Update from LAD'14

  1. 1. Lustre* Releases Peter Jones Lustre Support and Releases Manager *Other names and brands may be claimed as the property of others.
  2. 2. Lustre 2.4.x has been most common choice for new deployments Recent shift towards Lustre 2.5.x 2 Lustre* Release Trends Lustre Versions in Production *Other names and brands may be claimed as the property of others. 40 35 30 25 20 15 10 5 0 1.6.x 1.8.x 2.0 2.1.x 2.2 2.3 2.4.x 2.5.x Source: OpenSFS Survey March 2014 76 Respondents could make multiple selections
  3. 3. Lustre 2.1.0 declared GA Oct 2011 RHEL 6.x servers and large LUNs the main attraction Still a large number of sites in production on 2.1.x but many of larger sites have now upgraded § NASA/CEA/LLNL all upgraded to more current releases Formerly maintenance release stream § Latest release 2.1.6 June 2013 3 Lustre* 2.1.x *Other names and brands may be claimed as the property of others.
  4. 4. Lustre 2.4.0 declared GA May 2013 Features include DNE Remote Directories (LU-1187); Network Request Scheduler (LU-398) and ZFS support (LU-1305) Most active codeline over past year § NASA/CEA/LLNL/ORNL all running in production § DDN, Bull and others using for deployments Formerly maintenance release stream § Latest release 2.4.3 Mar 2014 4 Lustre* 2.4.x *Other names and brands may be claimed as the property of others.
  5. 5. Lustre 2.5.0 declared GA Oct 2013 HSM (LU-3608) is the primary feature § Manages data transfer between different storage types Indications are that this codeline will be widely adopted § Many upgrades underway Present maintenance release stream § Latest release 2.5.3 Sept 2014 § Lustre 2.5.4 targeted for Q4 2014 5 Lustre* 2.5.x *Other names and brands may be claimed as the property of others.
  6. 6. Declared GA July 2014 Several new features § LFSCK MDT-OST Consistency (LU-1267) § Single client IO performance (LU-3321) § DNE Striped directories (LU-3531) preview Much groundwork to support newer kernels Feature release only; no maintenance releases planned 6 Lustre* 2.6 *Other names and brands may be claimed as the property of others.
  7. 7. Commits between 2.5.50 and 2.6 GA by Organization 7 Lustre* 2.6 – Code Contributions ANU 1 Bull 11 CEA 7 Cray 21 DDN 33 EMC 9 GSI 6 Intel 654 Xyratex 31 Suse 7 LLNL 22 ORNL 83 Suse 122 Xyratex SGI 70 *Other names and brands may be claimed as the property of others. IU 6 SGI 3 ANU 4 Bull 952 CEA 611 Cray 6389 DDN 3021 EMC 2840 GSI 125 Intel 80179 IU 5679 LLNL 1324 ORNL 28609 1945 Number of Commits Lines of Code changed
  8. 8. Version Commits LOC Developers Organizations 1.8.0 997 291K 41 1 2.1.0 752 92K 55 7 2.2.0 329 58K 42 10 2.3.0 586 87K 52 13 2.4.0 1123 348K 69 19 2.5.0 471 102K 70 15 2.6.0 894 132K 76 14 8 Lustre* Version Statistics *Other names and brands may be claimed as the property of others.
  9. 9. Targeted GA Feb 2015 § Feature freeze Oct 31st 2014 Several new features targeted for this release § UID Mapping (LU-3527) § LFSCK MDT-MDT Consistency (LU-4788) § Dynamic LNET Configuration (LU-2456) Will add RHEL7 client support § Likely SLES12 client support too when GA confirmed Interop and upgrades supported with 2.6 and 2.5.x releases Feature release only; no maintenance releases planned 9 Lustre* 2.7 *Other names and brands may be claimed as the property of others.
  10. 10. First appeared in staging area in 3.11 kernel Client is slightly ahead of a 2.4.0 client in functionality Some sites report on mailing lists to be running in production Linux distribution releases now contain in-kernel Lustre client § Ubuntu 14.04 and SLES12 do; RHEL 7 just missed out (3.10) § Poses some logistical challenges (LU-5628) Working with upstream community to get Lustre out of staging § Remove typedefs (LU-5478) § Deprecate proc/fs/lustre (LU-5030) § Aiming to complete much of this work for Lustre 2.7 10 Upstream Lustre* Client *Other names and brands may be claimed as the property of others.
  11. 11. Well-established release validation practices § Automated functional regression tests across test matrix § SWL runs on Hyperion § Execution of feature test plans Continuing to evolve testing practices § Fault injection § Aged file system testing § Soak testing § Static code analysis tools 11 Lustre* Release Testing *Other names and brands may be claimed as the property of others.
  12. 12. Latest version of user documentation dynamically available to download § http://lustre.opensfs.org/documentation/ See Richard Henwood’s recent LUG presentation for details on how to contribute § http://cdn.opensfs.org/wp-content/uploads/2013/05/ Henwood_manual_LUG13_FINAL_v2.pdf If you know of gaps then please open an LUDOC ticket § If you have not got time to work out the correct format to submit then unformatted text will provide a starting point for someone else to complete Internals documention also being improved (LU-1892) 12 Lustre* Release Documentation *Other names and brands may be claimed as the property of others.
  13. 13. Combines previous TWG and CDWG § Chris Morrone of LLNL is lead Single forum for all Lustre development matters § Oversees entire Lustre development cycle § Maintains the roadmap § Plans major releases § Collects requirements for future Lustre features § Sets priorities for test matrix For more information visit the wiki http://wiki.opensfs.org/Lustre_Working_Group 13 OpenSFS Lustre* Working Group *Other names and brands may be claimed as the property of others.

×