HPC in the Cloud


Published on

Presentation from "Introduction to Parallel Processing" course at the Ben-Gurion University of the Negev

Published in: Technology
1 Like
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

HPC in the Cloud

  1. 1. Introduction toParallel Processing HPC in the Cloud Guy Tel-Zur A demo to my class, 2011
  2. 2. http://aws.amazon.com/console/
  3. 3. Sign In
  4. 4. EC2 Dashboard
  5. 5. EC2 AMI for scientific computing in Python and RAMI ID: ami-84bd41edSource: http://www.r-bloggers.com/ec2-ami-for-scientific-computing-in-python-and-r/
  6. 6. Launching Instance
  7. 7. Connect using PuTTY
  8. 8. Install VNC serverfrom the following packages: * xtightvncviewer * xvnc4viewer
  9. 9. Add a userAs root:useradd telzurmkdir /home/telzurchown –R telzur /home/telzursu telzur
  10. 10. Passwordless sshssh-keygen -t dsacd .sshcat ./id_dsa.pub >> authorized_keys2Use a lightweight window manager such as icewm
  11. 11. Open ports 5800,5900-5901…in the security group for VNC to work
  12. 12. Install a light window managerapt-get install icewm
  13. 13. HPC Cluster
  14. 14. 16 cores
  15. 15. EBS /dev/sdh  /volchange made in /etc/fstab
  16. 16. Installations• yum install• gcc• gcc-c++• gcc-gfortran• Lapsck• Python-devel• Need more repositories:• rpm -Uvh http://download.fedora.redhat.com/pub/epel/5/x86_64/epel- release-5-4.noarch.rpm• yum install atlas.x86_64 blas.x86_64 lapack.x86_64• yum groupinstall XFCE (startxfce4)• yum install glibc-devel.i386
  17. 17. Test MPI
  18. 18. Quality of Service ????1:41 AM PDT We are currently investigating latency and error rates with EBS volumes andconnectivity issues reaching EC2 instances in the US-EAST-1 region.2:18 AM PDT We can confirm connectivity errors impacting EC2 instances and increasedlatencies impacting EBS volumes in multiple availability zones in the US-EAST-1 region.Increased error rates are affecting EBS CreateVolume API calls. We continue to worktowards resolution.2:49 AM PDT We are continuing to see connectivity errors impacting EC2 instances,increased latencies impacting EBS volumes in multiple availability zones in the US-EAST-1region, and increased error rates affecting EBS CreateVolume API calls. We are alsoexperiencing delayed launches for EBS backed EC2 instances in affected availability zonesin the US-EAST-1 region. We continue to work towards resolution.3:20 AM PDT Delayed EC2 instance launches and EBS API error rates are recovering. Werecontinuing to work towards full resolution.4:09 AM PDT EBS volume latency and API errors have recovered in one of the twoimpacted Availability Zones in US-EAST-1. We are continuing to work to resolve the issuesin the second impacted Availability Zone. The errors, which started at 12:55AM PDT, beganrecovering at 2:55am PDT5:02 AM PDT Latency has recovered for a portion of the impacted EBS volumes. We arecontinuing to work to resolve the remaining issues with EBS volume latency and error ratesin a single Availability Zone.6:09 AM PDT EBS API errors and volume latencies in the affected availability zoneremain. We are continuing to work towards resolution.
  19. 19. BBC
  20. 20. Source: http://ec2disabled.com/(partial list) Who is affected by EC2?
  21. 21. Saving the computer as an AMI
  22. 22. 2 X 16cores !
  23. 23. Add graphical WM (xfce4) usingremote desktop (VNC) – Open port
  24. 24. Price$1.60/hour for this xlarge machine$4,290 for 1 year$6,590 for 3 yearsThis is the TCO !
  25. 25. vi /etc/ssh/sshd_configChange: password authentication from no to yesRload sshd by /etc/init.d/sshd reload