Your SlideShare is downloading. ×
  • Like
SURFsara Cloud - OpenNebula Tech Day 2014.03.26
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Now you can save presentations on your phone or tablet

Available for both IPhone and Android

Text the download link to your phone

Standard text messaging rates apply

SURFsara Cloud - OpenNebula Tech Day 2014.03.26

  • 336 views
Published

SURFsara Cloud explained

SURFsara Cloud explained

Published in Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
336
On SlideShare
0
From Embeds
0
Number of Embeds
2

Actions

Shares
Downloads
18
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. — experiences with OpenNebula 3.X HPC Cloud at SURFsara Ander Astudillo <ander.astudillo@surfsara.nl> Lykle Voort <lykle.voort@surfsara.nl> OpenNebula Tech Day Ede (The Netherlands) 26th March 2014 #
  • 2. e-Infrastructure landscape 3 Cartesius (National Supercomputer) Bull bullx, 13984 cores, 41.75 TB memory, 2.4 PB disk, 271 TFlop/s LISA (National compute cluster) Dell cluster, 6528 cores, 16 TB of memory, 46 TFlop/s Grid 5000 cores, 4 PB disk, 6 PB tape 11 sites Visualization Collaboratorium Remote visualization Render cluster Network SURFnet7 GLIF NetherLight Innovative infrastructures Hadoop GPU cluster BeeHub HPC Cloud
  • 3. Agenda 1.- SURFsara’s HPC Cloud service 2.- User experience 3.- SURFsara’s HPC Cloud implementation
  • 4. What do we (SURFsara) want to offer? 5 Services for scientists …scientists ⇏ systems gurus … complex users’ problems • Data: big, dirty, non-structured… • Computation: complex (e.g.: modeling, simulation) • Libraries nightmare • 3rd party, incompatibility, maintenance… … flexibility … trial and error … test … cooperate … share … show … scratch … privacy 1.- Our service
  • 5. Where does the HPC Cloud fit? 61.- Our service
  • 6. What does our HPC Cloud offer? 7 Your own world In a jar 1.- Our service IaaS: Network filter
  • 7. What does a user see? 81.- Our service
  • 8. User experience
  • 9. Our decisions 102.- User experience HPC • Big nodes • Fast interconnect • MPI-alike computation • Own flexibility Cloud light • Smaller nodes • CPU overcommit • (Interactive) services • Projects • Documentation • System load • Network filters • Dynamic DNS • VirDir • Image upload • Wizard tweaks
  • 10. Accounting 112.- User experience Per project User accounts CPU time Images storage VirDir
  • 11. Accounting (& figures) 122.- User experience Per project User accounts CPU time Images storage VirDir 180+ projects active: 110+ 370+ users active: 240+ Since 2009 until March 2014: 300+ requests 32.000+ VM 130+ TB in use 850+ years 3.700+ images
  • 12. User applications 132.- User experience • Profit from cloud elasticity • Provide own service to own users • Software that requires licenses • Workflows • Training • Intensive compute Fields: • Biology • Genetics • Informatics • Chemistry • Ecology • Linguistics • Robotics • Business • Social sciences • Engineering • Humanities
  • 13. User applications 142.- User experience • High-memory nodes • Database as a Service Experimental additions:
  • 14. SURFsara’s HPC Cloud implementation
  • 15. Hardware 163.- Implementation 30 HPC nodes 19× 32-core Intel Xeon-E7 11× 32-core Intel Xeon-E5 256 GB RAM 1 TByte local disk Ethernet 2×10GE Each new HPC node delivers 12K SPECints under ideal circumstances 10 light nodes 8 cores AMD Opteron 6212 64 GB RAM 6 TByte local disk Ethernet 1×10GE Network 144 ports 10GE, 1-hop Storage 800TB shared (Arista DCS-7504)
  • 16. 800TB Shared Storage 2×10Gbps 4 Service Nodes Virtualised Services 30 large compute nodes .... .. 10 light compute nodes Network overview 3.- Implementation 4×10Gbps
  • 17. Software 3.- Implementation
  • 18. Groups’ network isolation 3.- Implementation
  • 19. The good 3.- Implementation • Live migration • HUGE disks possible • Security • Ease of use
  • 20. Ander Astudillo <ander.astudillo@surfsara.nl> Lykle Voort <lykle.voort@surfsara.nl> Credits Images: Wikipedia, Science Park Front slide photo: dvanzuijlekom in Flicker Slides: SURFsara colleagues