Using ArcGIS Server in the      Amazon cloud                    Sterling Quinn
Topics Covered  •   Overview of Amazon EC2  •   Working with Amazon EC2  •   Scaling your configuration  •   Case Studies ...
Overview of Amazon EC2
Conceptual Overview  •   What is a Virtual Machine?      -   Using a single physical machine to host multiple          con...
Conceptual Overview Your Server Room     Amazon EC2
Advantages of EC2  •   Robust hardware and network infrastructure  •   Elastic deployments  •   Fast and inexpensive proto...
Key terms: EC2 instance and AMI  •   EC2 instance      -   Virtual machine running on Amazon EC2      -   You pick the siz...
ESRI-developed AMIs  •   ArcGIS Server AMI       - ArcGIS Server 10.0sp2 for Microsoft .NET         Framework       - ArcG...
How do I work with EC2?  •   AWS Management Console  •   Amazon EC2 API Tools  •   Other Third Party Tools      -   Elasti...
Getting an instance running
Demo: Create an instance
Working with Instances
How do I use my instance?
Configuring the instance  •   Change the Operating System Administrator password  •   License ArcGIS  •   Add or remove EB...
Moving your data
Moving your data  •   Transferring data across the Internet      -   Can be slow      -   Can pose security concerns  •   ...
Publishing services
Map caching   •   EC2 gives you temporary “boxes” for caching   •   Probably faster to rebuild your cache on EC2 than to  ...
Preserving your configuration
Demo: Setting up services
Scaling your configuration
Testing and scaling  •   Testing is an iterative process  •   Function -> Performance  •   Scale up for QA testing of Stag...
Vertical and horizontal scaling                Instance                                   VerticalAMI                Insta...
Vertical scaling  •   Change instance type      -   Can now be done “in place”  •   Apply Elastic IP      -   Replacement ...
Horizontal scalingOn-premises architecture   Amazon EC2 architecture    Web server & SOM          Elastic Load Balancer   ...
Setting up a load balancer  •   Use AWS Management Console  •   Add and remove instances with “point and click”  •   Confi...
Horizontal Scaling with EC2
Auto scaling  •   Use Amazon APIs to add and remove instances from      your site as needed      -   Works off triggers, s...
Auto scaling with EC2                        Auto scaling rules
Demo: Scaling the system
Scripting basic actions  •   Amazon API allows for automatic:      -   Stopping / Starting instances      -   Apply Elasti...
Case Study: Japan Quake 2011
Japan Disaster – Case Study Late on a Thursday night…
Initial Response  •   Quickly deployed a New Media map      -   Hosted locally  •   CNN links to the map      -   Local ma...
Local Layout               ArcGIS       Users   Server               ArcSDE               Server
Which scaling was right for us?                Instance                                   VerticalAMI                Insta...
Final Layout                             Elastic                              Load Users                      Balancer    ...
Case Study  •   Deployed app in a high capacity setup      -   Took only a couple hours      -   Initially 2 ArcGIS Server...
Case Study: Spain Elections
Common Amazon EC2    Questions              Sterling Quinn
How does the billing work?  •   Two separate costs to consider:      -   Amazon EC2      -   Esri licensing  •   Amazon EC...
Will Amazon EC2 save me money?
Is Amazon EC2 secure?  •   Amazon provides…      -   Secure physical facilities for data centers      -   Multifactor auth...
The Road Ahead… •   What’s coming in 10.1     -   New architecture of the 10.1 ArcGIS Server     -   Esri-provided app for...
Q u e s tio n s …
Using ArcGIS Server in the Amazon Cloud
Upcoming SlideShare
Loading in …5
×

Using ArcGIS Server in the Amazon Cloud

1,241 views
1,113 views

Published on

Presentation by Sterling Quinn on Esri European User Conference 2011

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,241
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
25
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Using ArcGIS Server in the Amazon Cloud

  1. 1. Using ArcGIS Server in the Amazon cloud Sterling Quinn
  2. 2. Topics Covered • Overview of Amazon EC2 • Working with Amazon EC2 • Scaling your configuration • Case Studies • FAQs
  3. 3. Overview of Amazon EC2
  4. 4. Conceptual Overview • What is a Virtual Machine? - Using a single physical machine to host multiple concurrently running Operating Systems. - Physical machine is a shared resource • What is Amazon EC2? - Amazon Elastic Compute Cloud - You run virtual machines on Amazon’s hardware within data centers located in different geographic regions.
  5. 5. Conceptual Overview Your Server Room Amazon EC2
  6. 6. Advantages of EC2 • Robust hardware and network infrastructure • Elastic deployments • Fast and inexpensive prototyping • Easy short-term or emergency deployments • Ease of setting up a public-facing site isolated from your own network
  7. 7. Key terms: EC2 instance and AMI • EC2 instance - Virtual machine running on Amazon EC2 - You pick the size and spec • Amazon Machine Image (AMI) - Defines OS and software on your EC2 instance AMI EC2 instances
  8. 8. ESRI-developed AMIs • ArcGIS Server AMI - ArcGIS Server 10.0sp2 for Microsoft .NET Framework - ArcGIS Desktop - Any extension you can license - Windows Server 2008 64 Bit - 100 GB attached drive • Enterprise geodatabase AMI - ArcSDE 10sp2 - PostGRES SQL relational database - Windows Server 2008 64 Bit
  9. 9. How do I work with EC2? • AWS Management Console • Amazon EC2 API Tools • Other Third Party Tools - Elastic Fox, O2 Amazon EC Browser
  10. 10. Getting an instance running
  11. 11. Demo: Create an instance
  12. 12. Working with Instances
  13. 13. How do I use my instance?
  14. 14. Configuring the instance • Change the Operating System Administrator password • License ArcGIS • Add or remove EBS Volumes No need to run the post install!
  15. 15. Moving your data
  16. 16. Moving your data • Transferring data across the Internet - Can be slow - Can pose security concerns • Various options outlined in help - Choice based on personal preference and your IT policies
  17. 17. Publishing services
  18. 18. Map caching • EC2 gives you temporary “boxes” for caching • Probably faster to rebuild your cache on EC2 than to copy it • Can test instance types relatively cheaplyEC2 Configuration CPU RAM Cost/hr SOCs Bld time Tiles/sec “Cost”m1.large-1 2 7.5 $0.48 2 39:02 32 $ 0.31m1.xlarge 4 15 $0.96 5 12:40 99 $ 0.20m2.2xlarge 4 34.2 $1.24 5 9:37 131 $ 0.20m2.4xlarge 8 68.4 $2.48 10 7:24 170 $ 0.31c1.xlarge 8 7 $1.16 10 10:17 123 $ 0.20Results of a test cache with approx. 75,000 tiles on different instance types
  19. 19. Preserving your configuration
  20. 20. Demo: Setting up services
  21. 21. Scaling your configuration
  22. 22. Testing and scaling • Testing is an iterative process • Function -> Performance • Scale up for QA testing of Staging and Production Production Staging Development
  23. 23. Vertical and horizontal scaling Instance VerticalAMI Instance Horizontal
  24. 24. Vertical scaling • Change instance type - Can now be done “in place” • Apply Elastic IP - Replacement instances can be mapped to same EIP
  25. 25. Horizontal scalingOn-premises architecture Amazon EC2 architecture Web server & SOM Elastic Load Balancer Web server SOM SOC SOC SOC
  26. 26. Setting up a load balancer • Use AWS Management Console • Add and remove instances with “point and click” • Configure a health check - Bad instances auto-removed
  27. 27. Horizontal Scaling with EC2
  28. 28. Auto scaling • Use Amazon APIs to add and remove instances from your site as needed - Works off triggers, such as CPU usage - Need a custom AMI created before doing this
  29. 29. Auto scaling with EC2 Auto scaling rules
  30. 30. Demo: Scaling the system
  31. 31. Scripting basic actions • Amazon API allows for automatic: - Stopping / Starting instances - Apply Elastic IP Address - Etc.. • This can save you money - Example: Stopping instances on weekends • ArcGIS Server Blog Posts - Introduction to scripting with Amazon EC2 - Tips and tricks for scripting ArcGIS Server on Amazon EC2
  32. 32. Case Study: Japan Quake 2011
  33. 33. Japan Disaster – Case Study Late on a Thursday night…
  34. 34. Initial Response • Quickly deployed a New Media map - Hosted locally • CNN links to the map - Local machine fails to handle load • We need to scale quickly…
  35. 35. Local Layout ArcGIS Users Server ArcSDE Server
  36. 36. Which scaling was right for us? Instance VerticalAMI Instance Horizontal
  37. 37. Final Layout Elastic Load Users Balancer ArcGIS Servers Elastic IP ArcSDE Server
  38. 38. Case Study • Deployed app in a high capacity setup - Took only a couple hours - Initially 2 ArcGIS Servers and 1 SDE Server • Al-Jazeera embeds map the following Monday - Increase to 6 ArcGIS Servers quickly to handle load - Double the size of the SDE Server • Scaling was handled manually in this case study
  39. 39. Case Study: Spain Elections
  40. 40. Common Amazon EC2 Questions Sterling Quinn
  41. 41. How does the billing work? • Two separate costs to consider: - Amazon EC2 - Esri licensing • Amazon EC2 is billed like a utility - Water, Gas, Electric... • Reserved Instances can be cheaper in the long run • AWS Calculators are available for creating monthly cost estimates
  42. 42. Will Amazon EC2 save me money?
  43. 43. Is Amazon EC2 secure? • Amazon provides… - Secure physical facilities for data centers - Multifactor authentication for management console - Key pair required for obtaining passwords - Configurable firewall on each instance • You’re responsible for… - Setting up ArcGIS Server security - Keeping the admin passwords safe - Configuring the security groups correctly - Virus scanning, updates, avoiding harmful files
  44. 44. The Road Ahead… • What’s coming in 10.1 - New architecture of the 10.1 ArcGIS Server - Esri-provided app for building a site - Ubuntu AMIs - One AMI contains both server and enterprise geodatabase
  45. 45. Q u e s tio n s …

×