RightScale Webinar: February 1, 2011 – Just like our customers, RightScale runs in the cloud and requires the best platform to automate operations. As such, RightScale uses RightScale to manage RightScale. Our complete infrastructure – development, testing, staging, and production – consists of servers that are configured, launched and managed by the RightScale Platform.
4. Topics Managing RightScale on RightScale (Dev, Staging, Prod & Meta) RightScale Meta manages RightScale Production Production System Overview Monitoring Production – QuisCustodietIpsosCustodes Our Favorite RightScale Features Our Not-so-favorite Features Deploying RightScale – Cloud Best Practices
5. Managing RightScale on RightScale RightScale Production RightScale Staging RightScale Development Customer A Customer D Customer B Customer C RightScale Development
6. RS Production is managed by RS Meta RightScale Meta Production RightScale Production RightScale Staging RightScale Development Customer A Customer D RightScale Development
7. A multitude of RightScale systems Meta Production manages the Production system Meta currently lives outside the cloud containing production Meta is extremely secure, accessible only by a handful of operations folks The Production system is my.rightscale.com We are reaching 200 servers with a large fraction in EC2 US-East Servers are located in every cloud to achieve high availability Servers are allocated in well defined availability zones A few staging systems are used for integration and QA Ad hoc systems for performance testing, demos, betas, etc. Many development systems with simplified configurations Development systems are available at the click of a button
9. Some interesting RightScale numbers 2M servers launched by RightScale RightScale continuously monitors more than 70k servers Every day at RightScale: 2,000 array resize actions are executed 35,000 alert escalations are triggered 20,000 escalation emails are sent to users 9.0TB of monitoring data is exchange with our servers 1.6TB of logging data is sent to our servers
10. RightScale production (simplified) others Main App Front Ends logging API dashboard databases daemons DB Master monitoring DB Slave mirrors
11. What do our users do? Dashboard, API, monitoring graphs & event notifications Most of the requests are monitoring updates 85% (70%) Dashboard and API calls are heavier requests; they represent 7% of requests but 26% of bandwidth
12. We eat our own dog food Production servers are organized into independent deployments Core servers: frontends, core/api servers, databases, daemons
13. We eat our own dog food We use security groups extensively to isolate servers ServerTemplates are versioned for each major release This preserves the ability to launch exact configurations of past versions
14. Monitoring, alerts & escalations We monitor as much relevant data as possible and display it in insightful ways to quickly detect patterns and abnormalities We proactively eliminate the conditions that raise critical alerts No broken windows policy. No critical alerts can remain unresolved. API Network Activity Dashboard Network Activity
16. How to monitor hundreds of servers? We leverage a monitoring data warehouse to develop heat maps & stacked graphs
17. QuisCustodietIpsosCustodes?* We monitor the monitoring and alerting systems We extensively use alerts to monitor the responsiveness of all RightScale servers When you have hundreds of cloud servers, you statistically see more instance failures. Instance and EBS failures can cause headaches. Be prepared to grab a new instance. The meta & production monitoring and alerting systems are fully decoupled from each other * Who watches the watchmen?
18. Our favorite RightScale features RightImages – Resist the temptation to build custom images. Leverage pure, base images to avoid introducing surprises. Input Inheritance – Makes it easy to keep configurations in sync for dozens of servers ServerTemplates – Makes it very easy to reproduce configurations across production, staging and development. You have to fully automate configuration to manage a high number of servers. Component Library – There are always new assets (RightScripts, ServerTemplates, Macros, etc.) that can be adapted to our needs Monitoring – It’s easy to make collectdplugins to monitor just about anything
19. Our not-so-favorite features ServerTemplates Inputs – Powerful but too many of them make templates difficult to use. Document them well for others. Revision Management – Still a ways to go to make users aware of new versions and how to update Component Library – Finding new resources from the library is not easy and intuitive Alerts – They work pretty well but they are not easy to configure, in particular, custom ones
20. Best practices for upgrading RightScale In the cloud, the cost of duplicating servers is minimal Avoid upgrading existing servers (a non-cloud approach). Launch fresh ones with new software instead (fail forward). Old servers can take over in case something goes wrong Launch additional slaves to capture recovery points One slave continues to replicate in case of master failure Another slave is frozen at upgrade point – can rollback by failing over Don’t forget to take snapshots in case of major failure
21. Upgrading RightScale Step-by-Step Front Ends Main App Main App 7) Take snapshot at cutoff 2) Servers with new code 9) Reconnect all servers 10) Open access to site 8) Update schema Databases DB Master DB Slave DB Slave 3) Add second slave 6) Stop replication 4) Cut access to site 5) Stop all access to databases 1) Servers with currentcode
22. Upgrading RightScale Step-by-Step Front Ends Main App Main App Servers with new code Cutoff Snapshot Databases DB Master DB Slave DB Slave Servers with old code
23. Q&A / Getting Started Have a project and want to discuss how RightScale can help? Contact sales@rightscale.com or (866) 720-0208 Ready to get started? Sign up for our Free Edition:www.RightScale.com/Free Call us for a VIP trial of our paid editions Need to learn more? TCO calculator:www.RightScale.com/tco-calculator User Conference Videos: www.RightScale.com/conference Webinar archive: www.RightScale.com/webinars White papers: www.RightScale.com/whitepapers
RightScale'sServerTemplates allow you to capture best practices for provisioning and automating cloud infrastructure. In this breakout session, we will explore how you can leverage the RightScale platform to share ServerTemplates with others. Specifically, we'll walk through the steps to share and update ServerTemplates across your organization. We'll also show you how to publish ServerTemplates publicly for the whole world to use. This topic is best for: IT members who are responsible for maintaining server configurations within the organization, developers who would like to share work product within their group or ISVs wishing to reach cloud users by publishing through RightScale.
RightScale'sServerTemplates allow you to capture best practices for provisioning and automating cloud infrastructure. In this breakout session, we will explore how you can leverage the RightScale platform to share ServerTemplates with others. Specifically, we'll walk through the steps to share and update ServerTemplates across your organization. We'll also show you how to publish ServerTemplates publicly for the whole world to use. This topic is best for: IT members who are responsible for maintaining server configurations within the organization, developers who would like to share work product within their group or ISVs wishing to reach cloud users by publishing through RightScale.
RightScale'sServerTemplates allow you to capture best practices for provisioning and automating cloud infrastructure. In this breakout session, we will explore how you can leverage the RightScale platform to share ServerTemplates with others. Specifically, we'll walk through the steps to share and update ServerTemplates across your organization. We'll also show you how to publish ServerTemplates publicly for the whole world to use. This topic is best for: IT members who are responsible for maintaining server configurations within the organization, developers who would like to share work product within their group or ISVs wishing to reach cloud users by publishing through RightScale.
RightScale'sServerTemplates allow you to capture best practices for provisioning and automating cloud infrastructure. In this breakout session, we will explore how you can leverage the RightScale platform to share ServerTemplates with others. Specifically, we'll walk through the steps to share and update ServerTemplates across your organization. We'll also show you how to publish ServerTemplates publicly for the whole world to use. This topic is best for: IT members who are responsible for maintaining server configurations within the organization, developers who would like to share work product within their group or ISVs wishing to reach cloud users by publishing through RightScale.
RightScale'sServerTemplates allow you to capture best practices for provisioning and automating cloud infrastructure. In this breakout session, we will explore how you can leverage the RightScale platform to share ServerTemplates with others. Specifically, we'll walk through the steps to share and update ServerTemplates across your organization. We'll also show you how to publish ServerTemplates publicly for the whole world to use. This topic is best for: IT members who are responsible for maintaining server configurations within the organization, developers who would like to share work product within their group or ISVs wishing to reach cloud users by publishing through RightScale.
RightScale'sServerTemplates allow you to capture best practices for provisioning and automating cloud infrastructure. In this breakout session, we will explore how you can leverage the RightScale platform to share ServerTemplates with others. Specifically, we'll walk through the steps to share and update ServerTemplates across your organization. We'll also show you how to publish ServerTemplates publicly for the whole world to use. This topic is best for: IT members who are responsible for maintaining server configurations within the organization, developers who would like to share work product within their group or ISVs wishing to reach cloud users by publishing through RightScale.
RightScale'sServerTemplates allow you to capture best practices for provisioning and automating cloud infrastructure. In this breakout session, we will explore how you can leverage the RightScale platform to share ServerTemplates with others. Specifically, we'll walk through the steps to share and update ServerTemplates across your organization. We'll also show you how to publish ServerTemplates publicly for the whole world to use. This topic is best for: IT members who are responsible for maintaining server configurations within the organization, developers who would like to share work product within their group or ISVs wishing to reach cloud users by publishing through RightScale.
RightScale'sServerTemplates allow you to capture best practices for provisioning and automating cloud infrastructure. In this breakout session, we will explore how you can leverage the RightScale platform to share ServerTemplates with others. Specifically, we'll walk through the steps to share and update ServerTemplates across your organization. We'll also show you how to publish ServerTemplates publicly for the whole world to use. This topic is best for: IT members who are responsible for maintaining server configurations within the organization, developers who would like to share work product within their group or ISVs wishing to reach cloud users by publishing through RightScale.
RightScale'sServerTemplates allow you to capture best practices for provisioning and automating cloud infrastructure. In this breakout session, we will explore how you can leverage the RightScale platform to share ServerTemplates with others. Specifically, we'll walk through the steps to share and update ServerTemplates across your organization. We'll also show you how to publish ServerTemplates publicly for the whole world to use. This topic is best for: IT members who are responsible for maintaining server configurations within the organization, developers who would like to share work product within their group or ISVs wishing to reach cloud users by publishing through RightScale.
RightScale'sServerTemplates allow you to capture best practices for provisioning and automating cloud infrastructure. In this breakout session, we will explore how you can leverage the RightScale platform to share ServerTemplates with others. Specifically, we'll walk through the steps to share and update ServerTemplates across your organization. We'll also show you how to publish ServerTemplates publicly for the whole world to use. This topic is best for: IT members who are responsible for maintaining server configurations within the organization, developers who would like to share work product within their group or ISVs wishing to reach cloud users by publishing through RightScale.
RightScale'sServerTemplates allow you to capture best practices for provisioning and automating cloud infrastructure. In this breakout session, we will explore how you can leverage the RightScale platform to share ServerTemplates with others. Specifically, we'll walk through the steps to share and update ServerTemplates across your organization. We'll also show you how to publish ServerTemplates publicly for the whole world to use. This topic is best for: IT members who are responsible for maintaining server configurations within the organization, developers who would like to share work product within their group or ISVs wishing to reach cloud users by publishing through RightScale.
RightScale'sServerTemplates allow you to capture best practices for provisioning and automating cloud infrastructure. In this breakout session, we will explore how you can leverage the RightScale platform to share ServerTemplates with others. Specifically, we'll walk through the steps to share and update ServerTemplates across your organization. We'll also show you how to publish ServerTemplates publicly for the whole world to use. This topic is best for: IT members who are responsible for maintaining server configurations within the organization, developers who would like to share work product within their group or ISVs wishing to reach cloud users by publishing through RightScale.
RightScale'sServerTemplates allow you to capture best practices for provisioning and automating cloud infrastructure. In this breakout session, we will explore how you can leverage the RightScale platform to share ServerTemplates with others. Specifically, we'll walk through the steps to share and update ServerTemplates across your organization. We'll also show you how to publish ServerTemplates publicly for the whole world to use. This topic is best for: IT members who are responsible for maintaining server configurations within the organization, developers who would like to share work product within their group or ISVs wishing to reach cloud users by publishing through RightScale.
RightScale'sServerTemplates allow you to capture best practices for provisioning and automating cloud infrastructure. In this breakout session, we will explore how you can leverage the RightScale platform to share ServerTemplates with others. Specifically, we'll walk through the steps to share and update ServerTemplates across your organization. We'll also show you how to publish ServerTemplates publicly for the whole world to use. This topic is best for: IT members who are responsible for maintaining server configurations within the organization, developers who would like to share work product within their group or ISVs wishing to reach cloud users by publishing through RightScale.
RightScale'sServerTemplates allow you to capture best practices for provisioning and automating cloud infrastructure. In this breakout session, we will explore how you can leverage the RightScale platform to share ServerTemplates with others. Specifically, we'll walk through the steps to share and update ServerTemplates across your organization. We'll also show you how to publish ServerTemplates publicly for the whole world to use. This topic is best for: IT members who are responsible for maintaining server configurations within the organization, developers who would like to share work product within their group or ISVs wishing to reach cloud users by publishing through RightScale.
RightScale'sServerTemplates allow you to capture best practices for provisioning and automating cloud infrastructure. In this breakout session, we will explore how you can leverage the RightScale platform to share ServerTemplates with others. Specifically, we'll walk through the steps to share and update ServerTemplates across your organization. We'll also show you how to publish ServerTemplates publicly for the whole world to use. This topic is best for: IT members who are responsible for maintaining server configurations within the organization, developers who would like to share work product within their group or ISVs wishing to reach cloud users by publishing through RightScale.
RightScale'sServerTemplates allow you to capture best practices for provisioning and automating cloud infrastructure. In this breakout session, we will explore how you can leverage the RightScale platform to share ServerTemplates with others. Specifically, we'll walk through the steps to share and update ServerTemplates across your organization. We'll also show you how to publish ServerTemplates publicly for the whole world to use. This topic is best for: IT members who are responsible for maintaining server configurations within the organization, developers who would like to share work product within their group or ISVs wishing to reach cloud users by publishing through RightScale.
RightScale'sServerTemplates allow you to capture best practices for provisioning and automating cloud infrastructure. In this breakout session, we will explore how you can leverage the RightScale platform to share ServerTemplates with others. Specifically, we'll walk through the steps to share and update ServerTemplates across your organization. We'll also show you how to publish ServerTemplates publicly for the whole world to use. This topic is best for: IT members who are responsible for maintaining server configurations within the organization, developers who would like to share work product within their group or ISVs wishing to reach cloud users by publishing through RightScale.
RightScale'sServerTemplates allow you to capture best practices for provisioning and automating cloud infrastructure. In this breakout session, we will explore how you can leverage the RightScale platform to share ServerTemplates with others. Specifically, we'll walk through the steps to share and update ServerTemplates across your organization. We'll also show you how to publish ServerTemplates publicly for the whole world to use. This topic is best for: IT members who are responsible for maintaining server configurations within the organization, developers who would like to share work product within their group or ISVs wishing to reach cloud users by publishing through RightScale.