0
HPC Storage at Stanford
University
!

William Law
Stanford Research Computing
Center
wlaw@stanford.edu
!
We are a new center
!

Working across disciplines, across the university.
!
The grand tradition is for each research cluster to be a stand alone
island.
!
Backups? Who needs ‘em.

!

Oh, we do.

!
Storage

!

• AFS
• box.com
• GPFS
• Lustre
• NFS
• Full HW solutions (panasas, isilon, netapp)

!
Data Transfer

!

•  Aspera (Enterprise, Faspex)
•  Globus Online
•  box.com

!
Concerns

!

• 

IOPS 

• 

Storage Growth

• 

Sharing/Transfer/Workflows

• 

Data Integrity

• 

Backups

• 

Long Term ...
Path Forward
!

Standardize platforms
Use open protocols for access
Provide access to common storage pools
across resource...
Stanford: Solving the HPC Data Deluge
Upcoming SlideShare
Loading in...5
×

Stanford: Solving the HPC Data Deluge

349

Published on

In this presentation from the Dell booth at SC13, Will Law from Stanford describes how Big Data gets handled for HPC at the University.

"As science drives a rapidly growing need for storage, existing environments face increasing pressure to expand capabilities while controlling costs. Many researchers, scientists and engineers find that they are outgrowing their current system, but fear their organizations may be too small to cover the cost and support needed for more storage. Join these experts for a lively discussion on how you can take control and solve the HPC data deluge."

Watch the video presentation: http://insidehpc.com/2013/12/03/panel-discussion-solving-hpc-data-deluge/

Published in: Business, Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
349
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
5
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Transcript of "Stanford: Solving the HPC Data Deluge"

  1. 1. HPC Storage at Stanford University ! William Law Stanford Research Computing Center wlaw@stanford.edu !
  2. 2. We are a new center ! Working across disciplines, across the university. !
  3. 3. The grand tradition is for each research cluster to be a stand alone island. !
  4. 4. Backups? Who needs ‘em. ! Oh, we do. !
  5. 5. Storage ! • AFS • box.com • GPFS • Lustre • NFS • Full HW solutions (panasas, isilon, netapp) !
  6. 6. Data Transfer ! •  Aspera (Enterprise, Faspex) •  Globus Online •  box.com !
  7. 7. Concerns ! •  IOPS •  Storage Growth •  Sharing/Transfer/Workflows •  Data Integrity •  Backups •  Long Term Data Retention/Sustainability (who pays?) •  Security and Compliance (and dealing with PHI) •  Cost !
  8. 8. Path Forward ! Standardize platforms Use open protocols for access Provide access to common storage pools across resources !
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×