CF Summit 2014 - In Pursuit of Complete Visibility

1,875 views

Published on

Presentation slides from my talk at CFSummit 2014.

Abstract:

"When working with Cloud Foundry, AppFirst’s unique data collection provides unparalleled visibility over traditional tools. This full stack visibility spans the entire PaaS and respective services.

In this talk, Wayne E. Seguin of Stark & Wayne will discuss how his team found and utilized AppFirst for PaaS to gain unprecedented visibility. Through years of experience working with PaaS operations, they combined lessons learned in operations workflows yielding a deep understanding of both the space and needs. This year we will roll out an integration enabling Cloud Foundry operators to have full scale visibility across all resources."

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,875
On SlideShare
0
From Embeds
0
Number of Embeds
997
Actions
Shares
0
Downloads
7
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • We were excited to come and meet everyone here at CF Summit!

    The flight here was a lot of fun…
  • We want all of this across BOSH, Services deployed on BOSH, CF, Applications running on CF and oh yeah we want our Legacy Systems to also be able to be monitored by the same methods.
  • We also want this to be able to be deployed via SaaS for smaller environments as well as installable on-prem for our larger more strict environments.

  • CF Summit 2014 - In Pursuit of Complete Visibility

    1. 1. In Pursuit of Complete Visibility Enterprise BOSH & Cloud Foundry
    2. 2. HELLO EVERYONE
    3. 3. S&W 1
    4. 4. TRY CLOUD FOUNDRY First an announcement
    5. 5. http://trycf.starkandwayne.com
    6. 6. BACKGROUND
    7. 7. Our Backgrounds • Years in the PaaS space focused on Operations – Metrics & Data Collection – Aggregation – Correlation – Alerting – Working for/with Dr. Nic 
    8. 8. THE GOAL
    9. 9. The Goal Enterprise Operations Monitoring
    10. 10. ENTERPRISE REQUIREMENTS
    11. 11. Enterprise Requirements • Complete Operational Overview – Cross Systems Correlation • Root Cause Analysis
    12. 12. Enterprise Requirements • Historical Auditing – Capacity Planning – Billing Systems Verification & Validation
    13. 13. Enterprise Requirements • Forensics – Especially in the event of systemic failure
    14. 14. Enterprise Requirements • Security – Who, What, When, Where, How • Why => RCA
    15. 15. DATA COLLECTION REQUIREMENTS
    16. 16. Data Collection Requirements System Metrics CPU RAM Disk Network In/Out Etc…
    17. 17. Data Collection Requirements Process Resource Metrics CPU & RAM utilization Files & Socket read/write tps Threads Stolen Time (Living in a virtual world) etc…
    18. 18. Data Collection Requirements Logs (Obviously :p …)
    19. 19. Data Collection Requirements Polling style metrics collection NRPE JMX WPC etc…
    20. 20. Data Collection Requirements Application specific metrics StatsD style / namespaced Ingestion of APM summaries
    21. 21. Data Collection Requirements Business Metrics KPI’s
    22. 22. Data Collection Requirements Physical Devices Switches Routers SAN & Compute Servers (IPMI)
    23. 23. Data Collection Requirements External (“3rd party”) Data APIs Ex: CloudWatch => Correlate with all other data
    24. 24. SUMMARY REQUIREMENTS
    25. 25. Summary Requirements Operational Dashboards BOSH Subsystems CF Subsystems Per-Application Dashboards Business (KPI) Dashboards
    26. 26. Summary Requirements Ability to export data collected for representation via other means
    27. 27. EXPERIENCE BASED REQUIREMENTS
    28. 28. Experience Based Requirements Ability to detect and alert on File systems remounted read-only File systems mounted in place of another
    29. 29. INTEGRATION REQUIREMENTS
    30. 30. Integration Requirements Primitives allowing us to identify and link BOSH subsystems with VMs CF Subsystems with VMs Applications running in DEAs
    31. 31. HAVE CAKE & EAT IT
    32. 32. Have Cake & Eat It BOSH Services CF Applications Legacy Systems
    33. 33. Have Cake & Eat It SaaS On-Prem
    34. 34. Have Cake & Eat It • Minimize CapEX & OpEX – Through consolidation of Systems • Allow Ops to run lean & mean – This is one reason we love BOSH+CF after all!!!
    35. 35. THE APPROACH
    36. 36. Vendor Partner We have found that AppFirst fulfills and/or has it on their roadmap to fulfill all of our requirements for integration.
    37. 37. ROADMAP Roadmap towards effective and efficient operations
    38. 38. Phase I – BOSH Integration We are currently working with Pivotal Web Services and AppFirst on the BOSH layer integration.
    39. 39. Phase I – BOSH Integration This gives us the basic essential data blocks System Metrics Process Metrics Log Metrics
    40. 40. Phase II – Targeted Alerting Alerting based on detected failure cases Zombie containers File Systems remounted Read Only File Systems remounted incorrectly Network saturation DEA Pool Saturation etc…
    41. 41. Phase III – Subsystems Detection Detection of BOSH/CF Subsystems for Automatic Targeted metrics/logs collection Operations Dashboards per Subsystem DEAs Message Bus Router Cloud Controller etc…
    42. 42. Phase IV – Applications View Aggregated process health and log view for any given application running across all DEAs
    43. 43. QUESTIONS?

    ×