Goldstone Overview


Published on

An introduction to Solinea's goldstone application. Goldstone is a tool that OpenStack cloud operators can use to help see the structure and health of their cloud.

Published in: Technology
1 Like
No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Goldstone Overview

  1. 1. Accelerating Adoption of Open Infrastructure May 2014 Goldstone Overview
  2. 2. Copyright 2014 Solinea, Inc. Solinea at a Glance CUSTOMERSOVERVIEW Industry Focus Open Infrastructure, OpenStack Headquarters San Francisco, CA Founded January 2013 Geographies Asia, USA PAST DEPLOYMENTS TEAM Major US Telco US Infrastructure Service Provider North Asian Telco Global Electronics Manufacturer Global Gaming Company Top 5 Global Automotive Firm Tier 1 Network Provider Risk Management Analytics Easter Europe CSP OpenStack Distro Provider Security Analytics Firm Leading SDN Provider
  3. 3. Copyright 2014 Solinea, Inc. Solinea Services Conceive Architect Integrate Adopt Conceive the cloud strategy for existing and new cloud services to drive customer adoption Architect the cloud platforms based on market demand and internal capabilities Implement the cloud offerings and integrate them into the existing infrastructure & processes Operate the cloud, transfer knowledge, train the team and enable rapid adoption
  4. 4. Copyright 2014 Solinea, Inc. Complexity Reigns in Cloud (not just OpenStack)
  5. 5. Copyright 2014 Solinea, Inc. Same Problems, Different Clouds • Every cloud Solinea built needed operational tools • Tired of integrating series of expensive tools that didn’t exactly match the need …
  6. 6. Copyright 2014 Solinea, Inc. Cloud Operators Need Tools Require full FCAPS suite of functionality Fault Configuration Accounting Performance Security Need history to determine normal operations Troubleshooting is very important
  7. 7. Copyright 2014 Solinea, Inc. Existing OpenStack Tools Ceilometer Metering tool Aimed at accounting information of FCAPS model No management No troubleshooting Horizon Cloud user focused No history Security challenges No troubleshooting Synchronous only - no scheduling of tasks
  8. 8. Copyright 2014 Solinea, Inc. Common Monitoring Tools Nagios and Zabbix Monitoring tool only - no management capabilities Scalability issues for larger cloud Not OpenStack specific - requires significant customization Requires agents on each node
  9. 9. Copyright 2014 Solinea, Inc. Areas of Focus Discover • Map OpenStack topology • Present map view for sysadmin Report • Display key metrics specific to OpenStack • Alert sysadmin on abnormalities Analyze • Calculate key indicators • Provide guidance on troubleshooting
  10. 10. Copyright 2014 Solinea, Inc. Manage and Monitor OpenStack The Goldstone Deep Space Communications Complex (GDSCC), commonly called the Goldstone Observatory, is located in the U.S. state of California's Mojave Desert. Operated for the Jet Propulsion Laboratory, its main purpose is to track and communicate with space missions. It is named after Goldstone, California, a nearby gold-mining ghost town. (Because everyone asks…)
  11. 11. Copyright 2014 Solinea, Inc. Cross-Product Resource View • Service resource view of OpenStack cloud topology • Self-discovered and auto-updating • Discovers across availability zones • Drills down into individual services
  12. 12. Copyright 2014 Solinea, Inc. Nova Discovery View
  13. 13. Copyright 2014 Solinea, Inc. Cinder Discovery View
  14. 14. Copyright 2014 Solinea, Inc. Detailed Resource Inspection Popup provides full details on the chosen resource
  15. 15. Copyright 2014 Solinea, Inc. Glance Discovery View
  16. 16. Copyright 2014 Solinea, Inc. Keystone Discovery View
  17. 17. Copyright 2014 Solinea, Inc. Log Viewing, Filtering, and Searching
  18. 18. Copyright 2014 Solinea, Inc. API Performance • Database keeps long history of events • Analysis to provide key performance metric - API response time
  19. 19. Copyright 2014 Solinea, Inc. Key Metric Reporting
  20. 20. DEMO
  21. 21. Copyright 2014 Solinea, Inc. Goldstone Architecture
  22. 22. Copyright 2014 Solinea, Inc. Anatomy of an OpenStack Message  Most projects use a similar format – Date: 2014-05-02 14:10:57.278 – PID: 3609 – Level: INFO – Prog: oslo.messaging._drivers.impl_qpid – ID: [-] – Msg: Connected to AMQP …
  23. 23. Copyright 2014 Solinea, Inc. Shipping via rsyslog (conf.d)  rsyslog.d/10-goldstone.conf file: $WorkDirectory /var/lib/rsyslog # where to place spool files $ActionQueueFileName fwdGoldstone # unique name prefix for spool files $ActionQueueMaxDiskSpace 1g # 1gb space limit (use as much as possible) $ActionQueueSaveOnShutdown on # save messages to disk on shutdown $ActionQueueType LinkedList # run asynchronously $ActionResumeRetryCount -1 # infinite retries if host is down local0.* @@ # nova local1.* @@ # glance local2.* @@ # neutron local3.* @@ # ceilometer local4.* @@ # swift local5.* @@ # cinder local6.* @@ # keystone
  24. 24. Copyright 2014 Solinea, Inc. Logstash Input input { tcp { port => 5514 # matches port that rsyslog ships to type => syslog # insert a type field to identify this as an incoming message from syslog } }
  25. 25. Copyright 2014 Solinea, Inc. Logstash Filtering filter { magic_happens_here: { tokenizing, pattern matching, categorization, transformation, etc. } }
  26. 26. Copyright 2014 Solinea, Inc. Logstash Output output { elasticsearch { host => localhost port => 9200 protocol => http } }
  27. 27. Copyright 2014 Solinea, Inc. Result in ES: photo credit: <a href="">Robbert van der Steeg</a> via <a href="">photopin</a> <a href="">cc</a>
  28. 28. Copyright 2014 Solinea, Inc. Goldstone Availability Currently in early access program Available free of charge Sending out batches of installations in weekly waves for support reasons (installer) Next batch goes out on June 15th Tell us about your environment and register: 
  29. 29. Copyright 2014 Solinea, Inc. Goldstone Requirements Goldstone server 4GB RAM x64 CPU CentOS / RHEL 6.5 Network access to OpenStack servers on management network Logs need to be forwarded to this server Requires OpenStack Icehouse
  30. 30. Copyright 2014 Solinea, Inc. Goldstone Roadmap Regular point release updates during OpenStack development periods Releasing version 1 (“Asteroid”) now Major release to coincide with OpenStack Juno release in October Version 2 due at OpenStack Summit Paris (“Blackhole”) Concentrating on reporting and analysis features
  31. 31. John Stanford, VP Development; Ken Pepple, CTO; Thank You