Flocking HTCondor     Between    Two Clouds        Guy Tel-Zur  tel-zur@computer.org        March 2013
Goal• Submit HTCondor jobs from Amazon EC2  HTCondor pool and flock to another HTCondor  pool on Rackspace.• Both pools us...
Outline• Install Windows Server 2008 with HTCondor  on Rackspace (Pool 1)• Install Windows Serve 2008 with HTCondor on  EC...
Open terminal from here
The server is up
In the next slides we show HTCondor  Installation steps on the first node
Verify that condor service is running
condor_status works
Before first submissionstore your credentials
A simple test  program
Now we repeat the above steps andinstall a HTCondor node on AWS EC2
The new machine is ready to be         launched
EC2 dashboard
Connecting with remote       desktop
The test program works also on EC2
Add Flocking• Edit condor_config• At both ends:   – Set the IP addresses of the condor master nodes     in the flock_from ...
Check Flocking at                                                                         both endsEach pool “sees”the oth...
Each pool can see the other pool
Reference• HTCondor:  http://research.cs.wisc.edu/htcondor/• Rackspace: http://www.rackspace.com/• AWS: http://aws.amazon....
HTCondor flocking between two clouds
HTCondor flocking between two clouds
HTCondor flocking between two clouds
HTCondor flocking between two clouds
HTCondor flocking between two clouds
HTCondor flocking between two clouds
HTCondor flocking between two clouds
HTCondor flocking between two clouds
HTCondor flocking between two clouds
HTCondor flocking between two clouds
HTCondor flocking between two clouds
HTCondor flocking between two clouds
HTCondor flocking between two clouds
HTCondor flocking between two clouds
HTCondor flocking between two clouds
HTCondor flocking between two clouds
Upcoming SlideShare
Loading in …5
×

HTCondor flocking between two clouds

5,311 views

Published on

1 Comment
3 Likes
Statistics
Notes
No Downloads
Views
Total views
5,311
On SlideShare
0
From Embeds
0
Number of Embeds
3,573
Actions
Shares
0
Downloads
0
Comments
1
Likes
3
Embeds 0
No embeds

No notes for slide
  • Kwap32xZVPDX
  • Rcy49;AuTmD
  • HTCondor flocking between two clouds

    1. 1. Flocking HTCondor Between Two Clouds Guy Tel-Zur tel-zur@computer.org March 2013
    2. 2. Goal• Submit HTCondor jobs from Amazon EC2 HTCondor pool and flock to another HTCondor pool on Rackspace.• Both pools use Windows Server 2008
    3. 3. Outline• Install Windows Server 2008 with HTCondor on Rackspace (Pool 1)• Install Windows Serve 2008 with HTCondor on EC2 (Pool 2)• Modify the condor_config file FLOCK_FROM and FLOCK_TO specifying the IP addresses of the Central Managers.• Verify the Flocking works
    4. 4. Open terminal from here
    5. 5. The server is up
    6. 6. In the next slides we show HTCondor Installation steps on the first node
    7. 7. Verify that condor service is running
    8. 8. condor_status works
    9. 9. Before first submissionstore your credentials
    10. 10. A simple test program
    11. 11. Now we repeat the above steps andinstall a HTCondor node on AWS EC2
    12. 12. The new machine is ready to be launched
    13. 13. EC2 dashboard
    14. 14. Connecting with remote desktop
    15. 15. The test program works also on EC2
    16. 16. Add Flocking• Edit condor_config• At both ends: – Set the IP addresses of the condor master nodes in the flock_from and flock_to statements – Save and restart condor• That’s it !!!
    17. 17. Check Flocking at both endsEach pool “sees”the other pool NOTE! In this demo for simplicity firewalls were disabled. This is not recommended in real production runs!
    18. 18. Each pool can see the other pool
    19. 19. Reference• HTCondor: http://research.cs.wisc.edu/htcondor/• Rackspace: http://www.rackspace.com/• AWS: http://aws.amazon.com/

    ×