IT Infrastructure Through The Public Network Challenges And Solutions


Published on

Identifying the challenges that companies face when they wish to adopt Infrastructure as a Service like those from Amazon and Rackspace and possible solutions to those problems. This presentation seeks to provide insight and possible solutions, covering the areas of security, availability, cloud standards, interoperability, vendor lock in and performance management.

1 Like
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Cloud computing is the delivery of computing as a service rather than a product, whereby shared resources, software and information are provided to computers and other devices as a utility (like the electricity grid) over a network (typically theInternet).Application or "Software as a Service (SaaS)" deliver software as a service over the Internet, eliminating the need to install and run the application on the customer's own computers and simplifying maintenance and support.Platform as a service (PaaS) is the delivery of a computing platform and solution stack as a service. PaaS offerings may include facilities for application design, application development, testing, deployment and hostingInfrastructure as a service (IaaS)is thedelivery of computer infrastructure – typically a platform virtualization environment – as a service, along with raw (block) storage and networking.
  • Many are in draft – Currently centered around Amazon EC2 API andIn September 2007 Dell, HP, IBM, Microsoft, VMware and XenSource submitted to the Distributed Management Task Force (DMTF) a proposal for OVF, then named "Open Virtual Machine Format"
  • Many are in draft
  • Many are in draft
  • Many are in draft
  • Many are in draft
  • IT Infrastructure Through The Public Network Challenges And Solutions

    1. 1. IT Infrastructure Through the Public Network:<br />Challenges & Solutions<br />
    2. 2. $ whoami<br />Martin Jackson – Uncommon Sense Consulting<br />Working in the IT Field since 1993<br />Linux and Virtualization Consultant specialising in automated build and deployment of virtual infrastructures<br />Infrastructure as Code Hacker<br />DevOps Advocate<br />Keen Judoka<br />@actionjack on Twitter<br /><br />
    3. 3. $ cat /infrastructure/info<br />Source:<br />
    4. 4. $ whatisiaas<br />Outsourced Hardware<br />Outsourced Operating system<br />Outsourced Network<br />Self Managed<br />Typically available in Minutes<br />Pay per play<br />
    5. 5. #1 <br />Challenge:<br />Security<br />
    6. 6. $ info security<br />How do you protect your data in an infrastructure that you do not own or control?<br />
    7. 7. $ cat security/access<br />Protect your API keys and Use complex passwords<br />Cyber-Ark Enterprise Vault<br />Manage Engine Password Manager Pro <br />KeePass<br />APG and GPG<br />
    8. 8. $ cat security/access<br />Keep your systems patched (religiously)<br />Yum<br />Red Hat Network<br />Microsoft Update Network<br />ShavlikNetChk Protect<br />Apt<br />
    9. 9. $ cat security/access<br />Limit access to least privilege <br />Only create accounts for those who “need” them<br />Create separate accounts per device<br />Do not allow direct access via privileged user accounts e.g. Administrator or Root<br />Use audited privilege elevation e.g. sudo, rootsh, sudosh, runas, shellrunas<br />Only use encrypted login mechanisms e.g. ssh, ssl certificates<br />
    10. 10. $ cat security/access<br />Aggregate and monitor all login attempts<br />Splunk<br />Logstash<br />Graylog2<br />GFI Events Manager<br />
    11. 11. $ cat security/data<br />Encrypt your sensitive data before you place it into the cloud<br />PGP, GPG<br />Keep it encrypted while in the cloud<br />TrueCrypt, LUKS<br />Ensure encryption is maintained if data needs to be transmitted elsewhere<br />SCP, SSL, VPN, SSH<br />
    12. 12. $ cat security/network<br />If you need Secure Intra IaaS communication<br />SSL Auth<br />CohesiveFT’s VPN-Cubed<br />OpenVPN<br />Amazon Virtual Private Cloud<br />
    13. 13. #2 <br />Challenge:<br />Outages<br />
    14. 14. $ whatis outage<br />Unplanned unavailability of a service<br />" the cloud, you control your SLA..." <br />George Reese, founder enStratus Networks LLC<br />
    15. 15. $ whatis outage<br />“large-scale, essentially self-managed and commoditised infrastructure-as-a-service (IaaS) has price benefits but, if things go wrong, they do so in a big way”<br />Dr Aydin Kurt-Elli, Lumison<br />
    16. 16. $ whatis outage<br />Vendor: TerremarkOutage Date: March 17, 2010Outage Duration: 7 hoursReason for Outage:Terremark'svCloud Express services suffered an outage after a bout of connectivity loss in its Miami data center. T he outage resulted in intermittent periods of connectivity with high data packet loss starting at 11:54 a.m. eastern and lasting more than seven hours, ending at 7:05 p.m. eastern time. According to Apparent Networks' Cloud Performance Center, during the outage access to systems in Terremark's Miami data center was severely degraded and often unavailable, affecting many businesses using Terremark'svCloud Express services.Severity: Medium<br />;jsessionid=o+AywGYF+Mv5w3ZoWChIbQ**.ecappj01?pgno=5<br />
    17. 17. $ whatis outage<br />Vendor:Rackspace<br />Outage Date:2011-02-01<br />Outage Duration:30 minutes<br />Reason for Outage:DNS Issue Causes MySQL Server Outage.An unspecified DNS issue prevented users from connecting to MySQL and making external API calls. Rackspace resolved the issue and advised their users to refresh their browsers to view the site properly. <br />Severity:Low<br /> <br /><br />
    18. 18. $ whatis outage<br />Vendor:Rackspace<br />Outage Date:April 28,2011<br />Outage Duration:6 hours<br />Reason for Outage:At approximately 4:00 PM (CDT) customers began to experience connectivity issues related to Domain Name System (DNS) on Jungle Disk/Cloud Drive.The issue was identified to be an error with hostname translations on a single DNS server. This server was returning erroneous DNS emergency maintenance to change the DNS configuration was performed In order to mitigate the issue.<br />Severity: Medium<br /> <br /> <br />
    19. 19. $ whatis outage<br />Vendor: Amazon Web ServiceOutage Date: April 21, 2011Outage Duration: UnknownReason for Outage:Amazon began reporting trouble on its Service Health Dashboard about 5 a.m. Eastern today. At 5:16 a.m., the site reported connectivity issues that were affecting its Relational Database Service, which is used to manage a relational database in the cloud, across multiple zones in the eastern U.S. A networking event early this morning triggered a large amount of re-mirroring of EBS volumes in US-EAST-1.The re-mirroring created a shortage of capacity in one of the US-EAST-1 Availability Zones, which impacted new EBS volume creation as well as the pace with which we could re-mirror and recover affected EBS volumes. Amazon also reported problems with its EC2, or Elastic Compute Cloud, a service that provides pay-as-you-go compute capacity in the cloud. The company also reported issues with its EBS, or Elastic Block Storage, which is storage related to the EC2 service.<br />Severity: High<br /><br />
    20. 20. $ whatis outage<br />Vendor: Amazon Web ServiceOutage Date: August 08, 2011Outage Duration: 30 MinutesReason for Outage: The issue happened in the networks that connect the Availability Zones to the internet. The event began when a southern router inside one of Availability Zones briefly stopped exchanging route information with all adjacent devices, going into an incommunicative state. Upon re-establishing its health, the router began advertising an unusable route to other southern routers in other Availability Zones, deviating from its configuration and bypassing the standard protocol restriction on how routes are allowed to flow. The bad default internet route was picked up and used by the routers in other Availability Zones. Internet traffic from multiple Availability Zones in US East was immediately not routable out to the internet through the border. The issue was resolved by removing the router from service.Severity:Medium<br /><br />
    21. 21. $ whatis outage<br />Failure is the new black, expect it and embrace it<br />Design for failure and build your infrastructures to be redundant on 5 different levels<br />Physical<br />Virtual resource<br />Availability zone<br />Region<br />Cloud<br />
    22. 22. #3 <br />Challenge:<br />Standards<br />
    23. 23. $ find standard<br />Cloud standards and Interoperability<br />To be honest they don’t exist yet…<br /><br />
    24. 24. $ cat standard/api<br />Many different clouds…<br />Many ways to interact with them…<br />All do the same sort thing…<br />Let abstract them<br />Deltacloud<br />Libcloud<br />Jclouds<br />
    25. 25. $ cat standard/api/deltacloud<br /><br />Ruby client<br />require 'deltacloud' <br />api_url= 'http://localhost:3001/api' <br />api_name= 'mockuser' <br />api_password= 'mockpassword' <br />client = api_name, api_password, api_url ) <br /><br />
    26. 26. $ cat standard/api/libcloud<br /><br />Python client<br />from libcloud.compute.types import Provider<br />from libcloud.compute.providers import get_driver<br />EC2_ACCESS_ID = 'your access id'<br />EC2_SECRET_KEY = 'your secret key'<br />Driver = get_driver(Provider.EC2)<br />conn = Driver(EC2_ACCESS_ID, EC2_SECRET_KEY)<br /><br />
    27. 27. $ cat standard/api/jclouds<br /><br />Java client<br />ComputeServiceContext context = <br /> new ComputeServiceContextFactory().createContext("aws-ec2", <br />accesskeyid,<br />secretkey, <br />ImmutableSet.<Module> of(new Log4JLoggingModule(), <br />new JschSshClientModule()));<br /><br />
    28. 28. #4 <br />Challenge:<br />Monitoring and Management<br />
    29. 29. $ service monitor status<br />Pay per play monitoring or fixed instance<br />On premise or Off<br />Ramping up and tearing down of instances<br />Focus on Service monitoring vs host monitoring<br />Monitoring tool must have an api<br />
    30. 30. $ service monitor status<br />Next Generation Cloud Monitoring Services<br />Cloudkick -<br />Pingdom -<br />Watchmouse -<br />Monitis–<br />
    31. 31. $ service management status<br />Provision within minutes – Ready in Days???<br />If it takes 5 minutes to get a Virtual Machine<br />How long are you willing to wait to use it?<br />Data Center Automation Tools can help<br />Puppet<br />Chef<br />CFEngine<br />
    32. 32. $ cat management/puppet<br /><br />package { 'openssh-server':<br />ensure => installed,<br />}<br />
    33. 33. $ cat management/chef<br /><br />package "openssh-server" do<br /> action :install<br />end<br />
    34. 34. $ cat management/chef<br /><br />control:<br />any::<br />actionsequence= (<br /> packages<br /> )<br />DefaultPkgMgr= ( rpm )<br />RPMcommand= ( /bin/rpm )<br />RPMInstallCommand= ( "/usr/bin/yum -y install %s" )<br />packages:<br /> any::<br />openssh-server action=install<br />
    35. 35. #5 <br />Challenge:<br />Governance<br />
    36. 36. $ make governance<br />The game has changed and you’ll need to change with it<br />Conway's law applies:<br />“...organizations which design systems ... are constrained to produce designs which are copies of the communication structures of these organizations.”<br />
    37. 37. Challenge:<br />Questions<br />
    38. 38. $ cat links<br /><br /><br /><br /><br /><br /><br /><br /><br />