Your SlideShare is downloading. ×
Monitoring IAAS & PAAS Solutions
Monitoring IAAS & PAAS Solutions
Monitoring IAAS & PAAS Solutions
Monitoring IAAS & PAAS Solutions
Monitoring IAAS & PAAS Solutions
Monitoring IAAS & PAAS Solutions
Monitoring IAAS & PAAS Solutions
Monitoring IAAS & PAAS Solutions
Monitoring IAAS & PAAS Solutions
Monitoring IAAS & PAAS Solutions
Monitoring IAAS & PAAS Solutions
Monitoring IAAS & PAAS Solutions
Monitoring IAAS & PAAS Solutions
Monitoring IAAS & PAAS Solutions
Monitoring IAAS & PAAS Solutions
Monitoring IAAS & PAAS Solutions
Monitoring IAAS & PAAS Solutions
Monitoring IAAS & PAAS Solutions
Monitoring IAAS & PAAS Solutions
Monitoring IAAS & PAAS Solutions
Monitoring IAAS & PAAS Solutions
Monitoring IAAS & PAAS Solutions
Monitoring IAAS & PAAS Solutions
Monitoring IAAS & PAAS Solutions
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Monitoring IAAS & PAAS Solutions

2,041

Published on

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
2,041
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
83
Comments
0
Likes
1
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Monitoring & Managing IaaS & PaaS Solutions with Hyperic HQ Isaac Christoffersen – inCommon, Inc
  • 2. ADVOCATE “ When the people are invested with the power to control their own destiny, they take an interest.” – Michael Tiemann “ Simplicity is complexity resolved” – Constantin Broncusi
  • 3. Goal – The Intelligent Data Center SpringOne 2GX 2009. All rights reserved. Do not distribute without permission.
    • Self-healing from power, network and system outages
    • Enabling active participation by consumers in demand response
    • Operating resiliently against physical and cyber attack
    • Providing data quality and integrity for 21st century needs
    • Accommodating all computation and storage options
    • Enabling new products, services, and markets
    • Optimizing assets and operating efficiently
    The effective and efficient data center is responsive to the needs of the organizations that it supports and it is built upon a dynamic infrastructure that can be managed with business rules
  • 4. Reality – Far from the goal SpringOne 2GX 2009. All rights reserved. Do not distribute without permission.
    • Rip and replace technology upgrades
    • Vendor driven licensing agreements are not flexible enough to meet changing operational demands
    • Tough staffing decisions – Testers or more call center staff
    • Unable to keep an accurate inventory of systems and software within the infrastructure
    • Approaching space, power and cooling capacities despite efficiency improvements
    • Failing to handle the increasing data and growing user demands
    • Failing to satisfy scalability, availability and agility targets
    • Long term maintenance contracts tie up budgets long after components have depreciated
    Technological advances in the energy efficiency, server virtualization, networking, storage, software design and data management are not being utilized to their fullest potential
  • 5. Opportunity Obstacles = Innovation
    • Opportunity
    • Virtualization
    • Consolidation
    • Standardization
    • Provisioning & Self-Regeneration
    • Services
    • Cloud Computing
    • Obstacle
    • Server Sprawl
    • Density
    • One Ring to Rule Them All
    • Bob the Builder, Design By Committee
    • Legacy
    • Cloud Computing
      • Clarity, “Throw It Over the Fence”
    SpringOne 2GX 2009. All rights reserved. Do not distribute without permission. U
  • 6. System Provisioning Complexity SpringOne 2GX 2009. All rights reserved. Do not distribute without permission. Tools People Policy Linux Xen Hyperic & Drools Cobbler & Koan Puppet Linux Administrators SAN Engineers Network Engineers Process Infrastructure Service Level Agreements Budgets Staffing Guidance Procurement Process Order Fulfillment Process Staff Recruitment & Hiring I need 3 servers to use for the development of a proof of concept. It's going to be the next big thing! Commodity Servers SANs Networking Equipment Power HVAC Systems
  • 7. Buzz or the Way Forward? SpringOne 2GX 2009. All rights reserved. Do not distribute without permission. Source: NIST, Information Technology Laboratory http://csrc.nist.gov/groups/SNS/cloud-computing/cloud-computing-v25.ppt
  • 8. Service Layers SpringOne 2GX 2009. All rights reserved. Do not distribute without permission. Infrastructure Software Platform Data Center Server, Storage, & Network provisioning Database Provisioning Web Site Provisioning & Hosting Application Provisioning Service Composition Composable Applications Capability Provisioning Enterprise Service Providers How do I get the most of my IT and personnel resources? How do I store & retrieve my inventory data? How do I deploy my web services? How can I collaborate across the enterprise? How can I view my corporate sales data? How can I build my web hosting business? How can I manage my customer relationships? How can I run my company's IT department? The Intelligent Data Center is built on top of separate service layers that make it easier to address individual business concerns across different technical domains. It marks the shift from technology and business driven solutions to the era where technology and business both share the driver's seat .
  • 9. "As we enjoy great advantages from the inventions of others, we should be glad of an opportunity to serve others by any invention of ours; and this we should do freely and generously." – Benjamin Franklin EDUCATE
  • 10. Software meets Infrastructure
    • Common Software Engineering Techniques in Infrastructure
      • Domain Modeling
      • Continuous Integration
      • Design Patterns
    • Service Capabilities
      • Provisioning
      • Monitoring <= A must for dynamic environments
    Conway’s Law: “Any organization that designs a system (defined broadly) will produce a design whose structure is a copy of the organization's communication structure.”
  • 11. Using Continuous Integration Consistent, repeatable builds encourage fast deployment and consistently identical systems without the burden of managing images
    • Utilizing automated and scripted installs, we can:
      • Create new systems quickly with little manual interaction.
      • Have a setup for repeating the build process in an efficient and stable manner.
    • And these builds can:
      • Use the most current version of software
      • Configure the desired server functionality (i.e. Web, SMTP, DHCP server)‏
      • Execute all relevant tests successfully.
    A repeatable build improves product quality, reduces the mundane tasks and minimizes dependencies on key people. build cycle Software packages
  • 12. Using Domain Modeling SpringOne 2GX 2009. All rights reserved. Do not distribute without permission. role resource service site node host zone has a is a has a composed of
  • 13. Using Design Patterns SpringOne 2GX 2009. All rights reserved. Do not distribute without permission. Event-driven Consumer Control Bus Message Broker Patterns from EAI Patterns (http://www.eaipatterns.com
  • 14. Demo
  • 15. Provisioning Workflow SpringOne 2GX 2009. All rights reserved. Do not distribute without permission. Infrastructure as a Service (IaaS) Network Storage Compute Resource Pools Memory Data Consistency Distributed Storage Content Delivery Service Hosting Container Partitioning Virtual Servers Messaging Durability HA Cluster Grid Database Platform as a Service (PaaS) Database Platform Web Site Hosting Web Application Hosting Messaging Hosting Service Hosting Web Server Provisioning Service JMS Notify Web Site Hosting Service Process Request Create Disk Partition Create Web VM Create Web Server Register System
  • 16. Kickstart Snippet SpringOne 2GX 2009. All rights reserved. Do not distribute without permission. # Puppet client installation with its prerequisites. Puppet is a # configuration management tool that, in conjuction with a puppet master # (puppet-server) can be used to affect the nature of the infrastructure # in real time. yum -y install ruby rubygems ruby-rdoc ruby-irb puppet facter cat >> /etc/puppet/puppet.conf <<EOF server = sentry.incommon.us EOF chkconfig --add puppet chkconfig puppet on
  • 17. Hyperic Puppet Module SpringOne 2GX 2009. All rights reserved. Do not distribute without permission. class hyperic { class agent { package { &quot;hyperic-hq-agent&quot;: ensure => installed } file { &quot;agent.properties&quot;: source => &quot;puppet:///files/agent.properties&quot;, mode => 644, owner => &quot;hyperic&quot;, group => &quot;hyperic&quot;, require => Package[hyperic-hq-agent], ensure => present, path => &quot;/opt/hyperic/hyperic-hq-agent/conf/agent.properties&quot;; } }
  • 18. ACCELERATE “ Eighty-five percent of companies are already using open-source software, with most of the remaining 15 percent expecting to do so within the next year” – Gartner, User Survey Analysis: Open-Source Software, Worldwide, 2008 “ While some departments already use open source technologies, overall it has been estimated that the global loss due to proprietary software is 'in excess of $1 trillion a year.'” - Michael Tiemann
  • 19. Case Study: Commercial Web Hosting Provider
    • Initial Condition
    • 1100+ Individual Servers
    • Rip-and-replace hardware upgrades
    • Static and dedicated server resources
    • Difficult to upgrade software versions
    • Desired Condition
    • Reduced server footprint
    • Improved ability to seamlessly integrate new hardware and remove unused system components
    • Ability to expand and contract based upon the system workload
    Solution An environment that delivers dynamic provisioning of server, storage and network resources. ( IaaS - Infrastructure as a Service ) Deployment of new Platforms to provision Web, Mail, FTP, PostGres and MySQL resources. ( PaaS - Platform as a Service ) Dramatic increases in licensing fees from a proprietary software solution. Non-standard configuration of servers. No means to monitor system health.
    • Key Open Source Technologies
    • Platform
    • CentOS Enterprise Linux 5
    • Xen (Virtualization) ‏
    • GFS (Distributed File System) ‏
    • Red Hat Cluster Services
    • JBoss Application Platform
    • High Availability Messaging (JMS, SOAP) ‏
    • Broker-based architecture
    • Business Rules
    • Hyperic
    • System- ‏ wide monitoring of system events and processes
    • Open Source Installation and Configuration Management
    • Cobbler
    • Puppet
    • Core Software
    • Apache
    • Zimbra
    • Key Open Source Technologies
    • Platform
    • CentOS Enterprise Linux 5
    • Xen (Virtualization) ‏
    • Middleware
    • Jboss Application Server
    • High Availability Messaging (JMS, SOAP) ‏
    • Drools Business Rules
    • Monitoring & Inventory Management
    • Hyperic HQ Open Source
    • Installation & Configuration Management
    • Cobbler
    • Puppet
    • Core Software
    • Apache
    • Zimbra
    • Postgres, MySQL
    • ProFTP
    • Directory Server
  • 20. Case Study: Department of Defense Client
    • Initial Condition
    • New research project with constantly evolving infrastructure requirements. This made it difficult to provision the data center resources.
    • Desired Condition
    • Operational, multi-tenant environment in 30 days.
    • Small footprint (1 rack)
    • Shared storage solution
    • Rapid provision of VMs based on pre-defined profiles
    • Windows, RHEL 4/5 and Oracle guest machines
    Solution An environment that delivers dynamic provisioning of server, storage and network resources. ( IAAS - Infrastructure as a Service ) Deployment of new Platforms to provision Oracle database and VM resources. ( PAAS - Platform as a Service ) Needed to support multiple PoC efforts. No easy way to truly evaluate software and overall solution capabilities. Needed capability to provision data and compute resources as well as reclaim resources from completed development efforts.
    • Key Open Source Technologies
    • Platform
    • CentOS Enterprise Linux 5
    • Xen (Virtualization) ‏
    • GFS (Distributed File System) ‏
    • Red Hat Cluster Services
    • JBoss Application Platform
    • High Availability Messaging (JMS, SOAP) ‏
    • Broker-based architecture
    • Business Rules
    • Hyperic
    • System- ‏ wide monitoring of system events and processes
    • Open Source Installation and Configuration Management
    • Cobbler
    • Puppet
    • Core Software
    • Apache
    • Zimbra
    • Key Open Source Technologies
    • Platform
    • Red Hat Enterprise Linux 5
    • Xen (Virtualization) ‏
    • GFS (Distributed File System) ‏
    • Oracle 11G
    • Monitoring & Inventory Management
    • Hyperic HQ Open Source
    • Installation & Configuration Management
    • Cobbler
    • Puppet
    • Satellite Server
    • Core Software
    • Apache
    • Zimbra
    • Postgres, MySQL
    • ProFTP
    • Directory Server
  • 21. Case Study: Federal Government Client
    • Initial Condition
    • Content spread across 3 labs and 2 buildings.
    • 55+ under-utilized servers
    • Lack of available power and cooling resources .
    • Difficult to know current state of system.
    • Desired Condition
    • Consolidation into single lab
    • Significant reduction in power utilization
    • Ability to expand and contract based upon the system workload
    Solution Using a combination of grid, virtualization and service architectures, two separate grids were constructed – one for hosting services and one for hosting multi-terabyte databases. New monitoring system provided ability to monitor infrastructure and report on current workloads and system configurations. Needed a system to capture, manage, store, preserve, and deliver content and documents related to organizational processes. This system had to scale to handle exponentially increasing data volumes and rapidly growing user community.
    • Key Open Source Technologies
    • Platform
    • CentOS Enterprise Linux 5
    • Xen (Virtualization) ‏
    • GFS (Distributed File System) ‏
    • Red Hat Cluster Services
    • JBoss Application Platform
    • High Availability Messaging (JMS, SOAP) ‏
    • Broker-based architecture
    • Business Rules
    • Hyperic
    • System- ‏ wide monitoring of system events and processes
    • Open Source Installation and Configuration Management
    • Cobbler
    • Puppet
    • Core Software
    • Apache
    • Zimbra
    • Key Open Source Technologies
    • Platform
    • Red Hat Enterprise Linux 5
    • Xen (Virtualization) ‏
    • Middleware
    • High Availability Messaging (JMS, SOAP) ‏
    • Open Source Enterprise Service Bus
    • Monitoring & Inventory Management
    • Hyperic-based Open Source monitoring solution
    • Core Software
    • Apache
    • Tomcat-based application servers
  • 22. Finding Balance SpringOne 2GX 2009. All rights reserved. Do not distribute without permission. Coase’s Law: “There must be a balance between the costs of the transactions that a company must pay and the opportunity to make everything in house.”
    • The Internet Inverse: “The size of a company will decrease until the cost of doing something inside the company will be lower than doing it outside“ ( Wikinomics) ‏
    • Build, Buy, Lease : The classic build, buy, lease decision points will determine the viability of utility computing:
      • Money : What are the costs associated with storing, moving and retrieving data?
      • Time : Is the data available on-demand? Is the latency associated with remote storage of data acceptable for the business process?
      • Resources : Does the organization have an IT Staff? Are the skill sets of the staff in line with the objectives of the organization?
    • The constant need for IT : Whether the data center is in-house or outsourced, IT expertise will still be in demand.
    • Corporate Computing is not going away : Information Technology and data both represent assets and competitive advantage to corporations
  • 23. Q&A
  • 24. Advocate – Educate – Accelerate SpringOne 2GX 2009. All rights reserved. Do not distribute without permission. As community engagement practitioners, we seek to build ongoing, permanent relationships for the purpose of applying a collective vision for the benefit of the community. inCommon, Inc. was started to advocate the use of Open Source and Open Architecture solutions in the U.S. government market. As part of this mission, we seek to educate individuals on the value of Virtual, Grid and SOA architectures based on Open Source and Open Architecture constructs. We work with clients to efficiently and effectively accelerate systems delivery while maximizing existing resources whenever possible.

×