The adoption of Cloud Computing Solutions in datacenters worldwide has proven to be the right path, as it reduces costs, automates operation tasks and improve time-to-market for newly developed applications. However, cloud solutions are still in an early stage and do not meet all requirements for company environments, especially those with high capacity With that in mind, Globo.com embraced an open cloud solutions, Cloudstack, and began developing together with the community to fulfill all its high availability, high capacity and high throughput requirements. Integration between Cloudstack and Globo.com’s infrastructure happens in all levels, with an special attention to network equipment management, DNS automation and load balancing In this presentation, Globo.com will show the challenges in adopting cloud computing for its services and how these challenges were met with newly develop

1. globo
.com
Orchestrating Shared
Networks,Physical LB
and DNS on Cloudstack

2. Team

3. Team

6. BroadcastTV Books and Magazines Music Movies
PayTV Newspsaper Music Internet

7. Globo.com
‣ 2 Datacenters
‣ Rio de Janeiro (Main Datacenter)
‣ São Paulo (CDN)
‣ More than 1Tbps of internet connectivity
‣ More than 2000 Servers
‣ More than 400 Developers

8. New DataCenter in Rio (2015-03)
‣ Capacity for more than 10000 servers

9. Globo.com
‣ We are a technology company
‣ Developers and Services providers for:
‣ Content Management System (CMS)
‣ Internet Infra Structure
‣ Connectivity
‣ Hosting
‣ CDN
‣ Information Security
‣ NewTechnologies (Private Cloud and PaaS)

10. IaaS at Globo.com
‣ CloudStack
‣ Private Cloud
‣ Launched in Jan/2014
‣ opensource.globo.com

11. Setup of ACS
‣ Advanced ZoneType
‣ Shared Networks
‣ XenServer 6.2
‣ ACSVersion 4.3+

12. DNS Integration

13. DNS on unmodified ACS
News APP Network
VR's name resolution is only within network
MySQL Network
VR's name resolution is only within network
News MySQL
Virtual Router
(DHCP, DNS)
Virtual Router
(DHCP, DNS)
Internal DNS
delegate
delegate
Who Is
news.mysql.globo.com?
News App

14. GloboDNS
‣ Manage Bind Server
‣ Fork of PowerDNS on Rails
‣ HTTP(S) API
‣ Import data from Bind
‣ Open Source
‣ https://github.com/globocom/GloboDNS

15. GloboDNS plugin

16. GloboDNS plugin

17. GloboDNS plugin
Now the name "news.mysql.globo.com" is globally
available to all networks

18. With GloboDNS plugin
News APP NetworkMySQL Network
news.mysql.globo.com
Virtual Router
(DHCP, DNS)
Virtual Router
(DHCP, DNS)
newsapp.globo.com
Internal DNS
Naming resolution Naming resolution
XX

20. Creating a new domain
is easy using templates

22. Administrators
are responsible
for managing
complexity

23. Load Balancer

24. LB on unmodified ACS

25. LB on unmodified ACS

26. LB on unmodified ACS

27. LB on unmodified ACS

28. LB with GloboNetworkAPI
‣ LB IP in different network
‣ Doesn't work as LB in ACS
‣ Uses new commands
‣ Hardware-based
‣ GloboNetworkAPI abstract hardware
‣ Usually LB have public IPs, notVMs

29. LB with GloboNetworkAPI

30. LB with GloboNetworkAPI

31. LB with GloboNetworkAPI

32. LB with GloboNetworkAPI

33. LB with GloboNetworkAPI

34. Shared Networks

35. Shared Networks

36. Shared Networks
Unmodified ACS

37. Shared Networks
Unmodified ACS With GloboNetwork

38. Shared Networks

39. GloboNetworkAPI

40. What is GloboNetworkAPI?
‣ Open Source REST API for IP Networking Control
‣ Automates provisioning of network resources
‣ Vendor agnostic
‣ Plugin based

41. Features
‣ Cabling documentation (patch-panels/DIO’s capability)
‣ Layer 2 documentation (vlan)
‣ Layer 3 documentation (IP networks)
‣ Automatic allocation ofVlans, Networks and IP’s
‣ IPv6 support
‣ ACL (access control list) documentation/versioning/applying
‣ Load-Balancer support
‣ Automated equipment configuration (plugin based)
‣ User/Equipment Group based authorization

42. Globo NetworkAPI
‣ globonetworkapi.rtfd.org
‣ globonetworkapi-webui.rtfd.org
‣ globonetworkapi-client-python.rtfd.org
‣ https://github.com/globocom/GloboNetworkAPI-
client-java

43. Environment

44. Globo NetworkAPI
‣ Environment:
‣ Vlan/IP network usable range
‣ Templates for equipment configuration (plugins)
‣ Resources allocated/deployed on demand

45. Environment Config

46. Environment Config

47. Tradicional DC Infrastructure

48. GloboNetworkAPI + ACS
‣ Zones per type of traffic
‣ Type of traffic defines the Environments
‣ ACS maps zones to environments
‣ Xen Servers with tagged vlans (802.1Q)

49. Virtualized DC Infrastructure

51. Globo NetworkAPI Load
Balancer
‣ Load balancer has its own environment
‣ In front ofVM networks
‣ LB across zones
‣ LB as an additional plugin on Cloudstack

52. GloboNetworkAPI WebUI

53. Roadmap
‣ On ACS
‣ Integrating with baseline (GloboDNS on 4.5?)
‣ OAuth2 (in progress)
‣ ACL API
‣ IPv6 Support
‣ Native Load Balancer Support

54. References
‣ opensource.globo.com
‣ https://github.com/globocom/GloboDNS
‣ https://github.com/globocom/cloudstack
‣ globonetworkapi.rtfd.org
‣ https://cwiki.apache.org/confluence/display/CLOUDSTACK/Bind
+and+PowerDNS+integration+by+Globo+DNSAPI

55. We are hiring
!
https://github.com/globocom/IWantToWorkAtGloboCom
Questions?
iaas@corp.globo.com
Maurício Kilikrates A N dos Anjos <mkilikrates@corp.globo.com>
MarcusVinicius Gonçalves Cesário <marcus.vinicius@corp.globo.com>
Silvano Nogueira Buback <silvano@corp.globo.com>