Building a CloudStack UI for the Enterprise


Published on

Published in: Software
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Building a CloudStack UI for the Enterprise

  1. 1. © 2014 Sungard AS. All rights reserved. Building a CloudStack UI for the Enterprise David Grizzanti, Bill Jones Sungard Availability Services CCCNA’14 - APRIL 10TH, 2014 - DENVER, CO
  2. 2. Overview !   Who are we? –  David Grizzanti (Software Engineer @ Sungard AS) –  Bill Jones (Software Engineer @ Sungard AS) !   Cloud Engineering @ Sungard Availability Services –  Current Cloud Offering & why CloudStack is the future !   What’s unique about our UI –  Features –  Technologies we’re using !   Overall Architecture !   Integrating with CloudStack !   Demo !   Continuous Integration 2 CCCNA’14 - April 10th, 2014 - Denver, CO
  3. 3. About Sungard Availability Services Sungard Availability Services provides IT Operations support to IT departments that need to ensure business viability by keeping mission critical information and applications up and running. Sungard AS provides tailored enterprise cloud services, as well as innovative solutions including: !   Disaster Recovery !   Managed Hosting !   Software !   Consulting As of March 31st, 2014 Sungard AS was split from Sungard and became a separate, independent company.
  4. 4. Cloud Engineering at Sungard AS Current Cloud Platform !   Enterprise Cloud Services – we operate a shared, multi-tenant infrastructure !   We provide a fully managed “Virtual Data Center” environment for our customers !   Our customers get cloud economics and agility without needing to re-architect their applications !   We currently use traditional network isolation and security techniques !   We have developed our own orchestration platform for our fully automated service provisioning Issues with this approach !   Runs on complicated hardware !   Difficult to perform upgrades, general lifecycle issues !   Need for a self-service option 4CCCNA’14 - April 10th, 2014 - Denver, CO
  5. 5. Cloud Engineering at Sungard AS Future/Choosing CloudStack !   We are growing, so scaling is a concern !   Customers want more flexibility and provide more customization !   Improve reliability of provisioning automation !   Provide more features to customers in an agile fashion !   Need for a “Public” cloud as well as enterprise offerings What UI do we offer our customers? 5CCCNA’14 - April 10th, 2014 - Denver, CO
  6. 6. UI: Necessary Features Self Service !   Ability to enter credit card and spin up a VM within minutes Utility Billing !   Customer shouldn’t be blocked from adding more capacity Cost Control !   Customers can see projected spend and manage budgets across their entire company Make it straightforward and easy to use! 6CCCNA’14 - April 10th, 2014 - Denver, CO
  7. 7. UI: What sets us apart Real Time Notifications to the UI !   Integrates with Event Bus/RabbitMQ Elevated Permissions on top of API !   Allow more than just ROOT Admin to administer accounts Roles !   Allow for multiple user Roles above what CloudStack provides Customer centric UI !   Workplace concept to integrate CloudStack resources and billing 7CCCNA’14 - April 10th, 2014 - Denver, CO
  8. 8. Overall Architecture Unified Cloud Portal Web Single Sign On Bunny Ears Billing Integration API Hermes Client/Browser CloudPlatform SockJS
  9. 9. Let’s talk about the tech! !   Ruby (Bunny Ears) –  Worker that’s reading from RabbitMQ !   Ruby on Rails –  Main web app (running under nginx + unicorn) ! Node.js (Hermes) –  Notifies client/browser of changes CloudStack resource state ! Backbone.js/Marionette.js + SockJS(WebSockets) –  Javascript frameworks used to drive UI changes in the browser –  Websockets keep connection open to Node.js for updating client’s browser ! Redis –  Storing information related to each async job –  User invites !   Bootstrap –  Responsive front-end framework 9CCCNA’14 - April 10th, 2014 - Denver, CO
  10. 10. Working with the CloudStack API Benefits !   Fully featured API ! Async Jobs Job Management !   Storing request parameters + Job ID in Redis for retrieval and correlation Areas for improvement !   Better permissions model (this is already in progress) !   A Truly RESTful interface !   Consistency around responses for all requests (async and non-async) 10CCCNA’14 - April 10th, 2014 - Denver, CO Web
  11. 11. Example…
  12. 12. Working with the Event Bus Benefits !   Real time notifications (async jobs results) !   No polling required Node.js + SockJS (Websockets) !   Worker process reads from RabbitMQ !   Queries CloudStack/Redis !   Sends events to Hermes -> Client’s browser Areas for improvement !   Multiple events types can sometimes be confusing !   Data spread across more than 1 event !   Incorrect information included in events 12CCCNA’14 - April 10th, 2014 - Denver, CO Hermes Bunny Ears Client/Browser
  13. 13. Overall Architecture Unified Cloud Portal Web Single Sign On Bunny Ears Billing Integration API Hermes Client/Browser CloudPlatform SockJS
  14. 14. Let’s see a Demo!
  15. 15. VM Creation
  16. 16. VM Events
  17. 17. Network Configuration
  18. 18. Testing is Hard Try as hard as possible to TDD Tried to use VCR in the beginning… The rise and fall of Smokestack !   Built a replica of CloudStack for integration testing (well, almost) !   Became too much work to maintain !   Went with “simulator” (quicker on dev cycle) Test Coverage !   Code Climate !   Quality & security analysis for Ruby on Rails and Javascript 18CCCNA’14 - April 10th, 2014 - Denver, CO
  19. 19. Continuous Integration with CloudStack Typical Flows !   Run master after each push !   Job in jenkins to build new projects for each new branch we push, auto-build on intial push or update !   Both master and “feature” branches run full unit and integration tests Run full test suite after every code push !   Challenge of trying to run “integration” tests on every push !   Using CloudStack Simulator for feature tests –  Pool of CloudStack instances –  Vagrant/VirtualBox + Rails app to handle resetting each instance after use 19CCCNA’14 - April 10th, 2014 - Denver, CO
  20. 20. Simulator Pool
  21. 21. Next Steps Move to Docker? Docker CloudStack Simulator ! 21CCCNA’14 - April 10th, 2014 - Denver, CO
  22. 22. Tools for sharing Built a fully featured ruby client for CloudStack (StackerBee) !   Exception handling !   Idiomatic Ruby formatting for names (snake_case vs mixedCase) !   Handling of map parameters !   Configurable API version !   CloudStack REPL !   Faraday – HTTP lib (configurable middleware) !   Exposes console access URL !   Tests! Vagrant CloudStack Simulator ! 22CCCNA’14 - April 10th, 2014 - Denver, CO
  23. 23. Logging Tracing requests while testing !   Need a reliable way to trace a request all phases of the application !   UI -> CloudStack !   CloudStack -> RabbitMQ -> BunnyEars -> Hermes -> Client 23CCCNA’14 - April 10th, 2014 - Denver, CO
  24. 24. Credits/Acknowledgements 24CCCNA’14 - April 10th, 2014 - Denver, CO
  25. 25. Questions? David Grizzanti @dgrizzanti Bill Jones