In Pursuit of Complete Visibility within Cloud Foundry (Cloud Foundry Summit 2014)
Upcoming SlideShare
Loading in...5
×
 

In Pursuit of Complete Visibility within Cloud Foundry (Cloud Foundry Summit 2014)

on

  • 3,077 views

Technical Track presented by Wayne E. Seguin at Stark & Wayne. ...

Technical Track presented by Wayne E. Seguin at Stark & Wayne.

When working with Cloud Foundry, AppFirst’s unique data collection provides unparalleled visibility over traditional tools. This full stack visibility spans the entire PaaS and respective services.

In this talk, Wayne E. Seguin of Stark & Wayne will discuss how his team found and utilized AppFirst for PaaS to gain unprecedented visibility. Through years of experience working with PaaS operations, they combined lessons learned in operations workflows yielding a deep understanding of both the space and needs. This year we will roll out an integration enabling Cloud Foundry operators to have full scale visibility across all resources.

Statistics

Views

Total Views
3,077
Views on SlideShare
487
Embed Views
2,590

Actions

Likes
1
Downloads
22
Comments
0

8 Embeds 2,590

http://www.gopivotal.com 2352
https://2014.event.cfsummit.com 125
http://direct.gopivotal.com 41
https://www.gopivotal.com 41
https://direct.gopivotal.com 28
http://beratav037.vertexinc.com 1
http://mixmodelos.com 1
http://www.pivotal.io 1
More...

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • We were excited to come and meet everyone here at CF Summit! <br /> <br /> The flight here was a lot of fun… <br />
  • We want all of this across BOSH, Services deployed on BOSH, CF, Applications running on CF and oh yeah we want our Legacy Systems to also be able to be monitored by the same methods.
  • We also want this to be able to be deployed via SaaS for smaller environments as well as installable on-prem for our larger more strict environments. <br /> <br />

In Pursuit of Complete Visibility within Cloud Foundry (Cloud Foundry Summit 2014) In Pursuit of Complete Visibility within Cloud Foundry (Cloud Foundry Summit 2014) Presentation Transcript

  • In Pursuit of Complete Visibility Enterprise BOSH & Cloud Foundry
  • HELLO EVERYONE
  • S&W 1
  • TRY CLOUD FOUNDRY First an announcement
  • http://trycf.starkandwayne.com
  • BACKGROUND
  • Our Backgrounds • Years in the PaaS space focused on Operations – Metrics & Data Collection – Aggregation – Correlation – Alerting – Working for/with Dr. Nic 
  • THE GOAL
  • The Goal Enterprise Operations Monitoring
  • ENTERPRISE REQUIREMENTS
  • Enterprise Requirements • Complete Operational Overview – Cross Systems Correlation • Root Cause Analysis
  • Enterprise Requirements • Historical Auditing – Capacity Planning – Billing Systems Verification & Validation
  • Enterprise Requirements • Forensics – Especially in the event of systemic failure
  • Enterprise Requirements • Security – Who, What, When, Where, How • Why => RCA
  • DATA COLLECTION REQUIREMENTS
  • Data Collection Requirements System Metrics CPU RAM Disk Network In/Out Etc…
  • Data Collection Requirements Process Resource Metrics CPU & RAM utilization Files & Socket read/write tps Threads Stolen Time (Living in a virtual world) etc…
  • Data Collection Requirements Logs (Obviously :p …)
  • Data Collection Requirements Polling style metrics collection NRPE JMX WPC etc…
  • Data Collection Requirements Application specific metrics StatsD style / namespaced Ingestion of APM summaries
  • Data Collection Requirements Business Metrics KPI’s
  • Data Collection Requirements Physical Devices Switches Routers SAN & Compute Servers (IPMI)
  • Data Collection Requirements External (“3rd party”) Data APIs Ex: CloudWatch => Correlate with all other data
  • SUMMARY REQUIREMENTS
  • Summary Requirements Operational Dashboards BOSH Subsystems CF Subsystems Per-Application Dashboards Business (KPI) Dashboards
  • Summary Requirements Ability to export data collected for representation via other means
  • EXPERIENCE BASED REQUIREMENTS
  • Experience Based Requirements Ability to detect and alert on File systems remounted read-only File systems mounted in place of another
  • INTEGRATION REQUIREMENTS
  • Integration Requirements Primitives allowing us to identify and link BOSH subsystems with VMs CF Subsystems with VMs Applications running in DEAs
  • HAVE CAKE & EAT IT
  • Have Cake & Eat It BOSH Services CF Applications Legacy Systems
  • Have Cake & Eat It SaaS On-Prem
  • Have Cake & Eat It • Minimize CapEX & OpEX – Through consolidation of Systems • Allow Ops to run lean & mean – This is one reason we love BOSH+CF after all!!!
  • THE APPROACH
  • Vendor Partner We have found that AppFirst fulfills and/or has it on their roadmap to fulfill all of our requirements for integration.
  • ROADMAP Roadmap towards effective and efficient operations
  • Phase I – BOSH Integration We are currently working with Pivotal Web Services and AppFirst on the BOSH layer integration.
  • Phase I – BOSH Integration This gives us the basic essential data blocks System Metrics Process Metrics Log Metrics
  • Phase II – Targeted Alerting Alerting based on detected failure cases Zombie containers File Systems remounted Read Only File Systems remounted incorrectly Network saturation DEA Pool Saturation etc…
  • Phase III – Subsystems Detection Detection of BOSH/CF Subsystems for Automatic Targeted metrics/logs collection Operations Dashboards per Subsystem DEAs Message Bus Router Cloud Controller etc…
  • Phase IV – Applications View Aggregated process health and log view for any given application running across all DEAs
  • QUESTIONS?