Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

HPC at the University of Michigan: A Multi‐Tenant, Multi‐Science Campus Service Provider

301 views

Published on

In this deck from the DDN User Group at SC18 in Dallas, Brock Palen from the University of Michigan presents: HPC at the University of Michigan: A Multi‐Tenant, Multi‐Science Campus Service Provider.

Advanced Research Computing — Technology Services provides access to and support for advanced computing resources. ARC-TS facilitates new and more powerful approaches to research challenges in fields ranging from physics to linguistics, and from engineering to medicine."

Learn more: https://arc-ts.umich.edu/about/
and
http://ddn.com

Sign up for our insideHPC Newsletter: http://insidehpc.com/newsletter

Published in: Technology
  • Be the first to comment

  • Be the first to like this

HPC at the University of Michigan: A Multi‐Tenant, Multi‐Science Campus Service Provider

  1. 1. Multi-Tenant, Multi-Science Campus Service Provider
  2. 2. 100 Top 10 Graduate Programs Scientific Diversity ○ Medicine ○ Engineering ○ Arts
  3. 3. Brock Palen | @brockpalen | brockp@umich.edu Director Adv. Research Computing - Technology Srvs. ● NPACI Student 2004 ● Original Campus Champions Group Member ● BSE Nuclear Engineering Reactor Modeling
  4. 4. 5
  5. 5. History of Campus Storage Offerings ● One size fits all ● Assumes the value of all data are the same ○ Hot vs. Warm vs. Archive/Publication A lot of build your own
  6. 6. Problem: What to Optimize For ● Thousands of Users ○ Novice Level (Generally) ○ Not Leadership Class ○ Tend to Graduate ● Scientific Diversity ○ Protected and Open Data ○ Big IO, Lots of Files
  7. 7. Solution: Locker Bulk Storage ● 2 Site - 5 PByte ● Encrypted at rest ● Grow’s in reasonable increments ● Globus / NFS / CIFS
  8. 8. Great Lakes Solution: IME + GridScaler 2 PB Spinning 5% NVMe IME NVMe Metadata + Data in Metadata
  9. 9. Great Lakes
  10. 10. Thank You - Contact • hpc-support@umich.edu • http://arc-ts.umich.edu/ • @ARCTS_UM • brockp@umich.edu • http://myumi.ch/aV7kz 12
  11. 11. Justification - Flux 1.3 PB File Size Range Average Size MB % of Total Files % of Total Space >1GB 5561.053 0.02% 58.14% >512MB - 1GB 698.909 0.02% 8.73% >256MB - 512MB 380.379 0.03% 5.96% >128MB - 256MB 176.324 0.05% 4.90% >32MB - 128MB 56.892 0.24% 8.12% >1MB - 32MB 5.435 3.33% 10.98% 0-1MB 0.054 96.32% 3.16%

×