The document provides a guide for setting up a high-performance computing (HPC) environment on the cloud using AWS EC2, including steps for instance launching and configuration. It details installation processes for necessary software and troubleshooting connectivity issues in the US-East-1 region with AWS services. The document also includes pricing information for EC2 instances and outlines the recovery status from connectivity errors affecting EBS volumes and EC2 instances.

1. Introduction to
Parallel Processing
HPC in the Cloud
Guy Tel-Zur
A demo to my class, 2011

2. http://aws.amazon.com/console/

3. Sign In

4. EC2 Dashboard

5. EC2 AMI for scientific computing in
Python and R
AMI ID: ami-84bd41ed
Source: http://www.r-bloggers.com/ec2-ami-for-scientific-computing-in-python-and-r/

11. Launching Instance

13. Connect using PuTTY

15. Install VNC server
from the following packages: * xtightvncviewer * xvnc4viewer

16. Add a user
As root:
useradd telzur
mkdir /home/telzur
chown –R telzur /home/telzur
su telzur

17. Passwordless ssh
ssh-keygen -t dsa
cd .ssh
cat ./id_dsa.pub >> authorized_keys2
Use a lightweight window manager such as icewm

18. Open ports 5800,5900-5901…
in the security group for VNC to work

19. Install a light window manager
apt-get install icewm

20. HPC Cluster

21. 16 cores

22. EBS /dev/sdh  /vol
change made in /etc/fstab

23. Installations
• yum install
• gcc
• gcc-c++
• gcc-gfortran
• Lapsck
• Python-devel
• Need more repositories:
• rpm -Uvh http://download.fedora.redhat.com/pub/epel/5/x86_64/epel-
release-5-4.noarch.rpm
• yum install atlas.x86_64 blas.x86_64 lapack.x86_64
• yum groupinstall XFCE (startxfce4)
• yum install glibc-devel.i386

24. Test MPI

26. Quality of Service ????
1:41 AM PDT We are currently investigating latency and error rates with EBS volumes and
connectivity issues reaching EC2 instances in the US-EAST-1 region.
2:18 AM PDT We can confirm connectivity errors impacting EC2 instances and increased
latencies impacting EBS volumes in multiple availability zones in the US-EAST-1 region.
Increased error rates are affecting EBS CreateVolume API calls. We continue to work
towards resolution.
2:49 AM PDT We are continuing to see connectivity errors impacting EC2 instances,
increased latencies impacting EBS volumes in multiple availability zones in the US-EAST-1
region, and increased error rates affecting EBS CreateVolume API calls. We are also
experiencing delayed launches for EBS backed EC2 instances in affected availability zones
in the US-EAST-1 region. We continue to work towards resolution.
3:20 AM PDT Delayed EC2 instance launches and EBS API error rates are recovering. We're
continuing to work towards full resolution.
4:09 AM PDT EBS volume latency and API errors have recovered in one of the two
impacted Availability Zones in US-EAST-1. We are continuing to work to resolve the issues
in the second impacted Availability Zone. The errors, which started at 12:55AM PDT, began
recovering at 2:55am PDT
5:02 AM PDT Latency has recovered for a portion of the impacted EBS volumes. We are
continuing to work to resolve the remaining issues with EBS volume latency and error rates
in a single Availability Zone.
6:09 AM PDT EBS API errors and volume latencies in the affected availability zone
remain. We are continuing to work towards resolution.

27. BBC

28. Source: http://ec2disabled.com/
(partial list)
Who is affected by EC2?

32. Saving the computer as an AMI

35. 2 X 16cores !

37. Add graphical WM (xfce4) using
remote desktop (VNC) – Open port

38. Price
$1.60/hour for this xlarge machine
$4,290 for 1 year
$6,590 for 3 years
This is the TCO !

39. vi /etc/ssh/sshd_config
Change: password authentication from no to yes
Rload sshd by /etc/init.d/sshd reload