HTCondor flocking between two clouds

4,641
-1

Published on

1 Comment
3 Likes
Statistics
Notes
No Downloads
Views
Total Views
4,641
On Slideshare
0
From Embeds
0
Number of Embeds
52
Actions
Shares
0
Downloads
0
Comments
1
Likes
3
Embeds 0
No embeds

No notes for slide
  • Kwap32xZVPDX
  • Rcy49;AuTmD
  • HTCondor flocking between two clouds

    1. 1. Flocking HTCondor Between Two Clouds Guy Tel-Zur tel-zur@computer.org March 2013
    2. 2. Goal• Submit HTCondor jobs from Amazon EC2 HTCondor pool and flock to another HTCondor pool on Rackspace.• Both pools use Windows Server 2008
    3. 3. Outline• Install Windows Server 2008 with HTCondor on Rackspace (Pool 1)• Install Windows Serve 2008 with HTCondor on EC2 (Pool 2)• Modify the condor_config file FLOCK_FROM and FLOCK_TO specifying the IP addresses of the Central Managers.• Verify the Flocking works
    4. 4. Open terminal from here
    5. 5. The server is up
    6. 6. In the next slides we show HTCondor Installation steps on the first node
    7. 7. Verify that condor service is running
    8. 8. condor_status works
    9. 9. Before first submissionstore your credentials
    10. 10. A simple test program
    11. 11. Now we repeat the above steps andinstall a HTCondor node on AWS EC2
    12. 12. The new machine is ready to be launched
    13. 13. EC2 dashboard
    14. 14. Connecting with remote desktop
    15. 15. The test program works also on EC2
    16. 16. Add Flocking• Edit condor_config• At both ends: – Set the IP addresses of the condor master nodes in the flock_from and flock_to statements – Save and restart condor• That’s it !!!
    17. 17. Check Flocking at both endsEach pool “sees”the other pool NOTE! In this demo for simplicity firewalls were disabled. This is not recommended in real production runs!
    18. 18. Each pool can see the other pool
    19. 19. Reference• HTCondor: http://research.cs.wisc.edu/htcondor/• Rackspace: http://www.rackspace.com/• AWS: http://aws.amazon.com/

    ×