Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

PCF Data Collection for TBM

197 views

Published on

SpringOne Platform 2018
PCF Data Collection for TBM
Raj Sivaraj, Mastercard; Chris Busch, Pivotal

Published in: Software
  • Get Paid To Manage Facebook Fan Pages! Facebook Fan Page Workers Required - Start Immediately. ★★★ http://ishbv.com/socialpaid/pdf
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Be the first to like this

PCF Data Collection for TBM

  1. 1. PCF Data Collection for TBM Raj Sivaraj Mastercard @rajsivaraj1 Chris Busch Pivotal @chriscbusch https://springoneplatform.io/2018/sessions/pcf-data-collection-for-tbm
  2. 2. Unless otherwise indicated, these slides are © 2013 -2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/ Agenda  Mastercard Perspective  Service-based View  What is TBM?  Apptio - what is it?  PCF Data Collection – Current State  PCF AIs – Cost Model  The future is charge-back to the business 3
  3. 3. Unless otherwise indicated, these slides are © 2013 -2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/ Mastercard Perspective  Mastercard has been developing a key services-based strategy to identify software and infrastructure dependencies across the organization  By using this strategy, Mastercard has been able to more accurately define true costs back to the line of business on a products use of other software and corporate resources.  The Digital Native Architecture (DNA) team decided to collect both IaaS resource usage data and Pivotal Cloud Foundation application and service instance usage to identify costs back to product line-of-business for expense identification and management.
  4. 4. Unless otherwise indicated, these slides are © 2013 -2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/ A Service-based View identify software and infrastructure dependencies  Map to show how business software uses shared services or other business software  All software uses IT infrastructure to execute, communicate, and store data  Roll those costs up for show-back Business Software Shared Services Infrastructure
  5. 5. Unless otherwise indicated, these slides are © 2013 -2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/ What is Technology Business Management (TBM)?“The adoption of tools and processes to shift the management of technology costs to technology value, enabling and supporting the acceleration of the business technology agenda.” - Forrester Vendor Landscape Technology Business Management Solutions Report  Business model and decision-making framework which enables IT to run as a business.  Provides IT organizations with the solutions - strategies, methodologies, and tools - to manage the cost, quality, and value of their IT services.  Gives technology leaders and their business partners the facts they need to collaborate on business-aligned decisions.  Integrated view of technology cost and performance - financial transparency  Define true costs back to the line of business  Impact businesses ability to more accurately plan, budget and forecast  Record of the hybrid nature of IT
  6. 6. Unless otherwise indicated, these slides are © 2013 -2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/ Image Courtesy: https://www.nist.gov/sites/default/files/documents/2017/05/12/doc2017financialmanagementconference-tbm.pdf TBM - Benefits
  7. 7. Unless otherwise indicated, these slides are © 2013 -2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/ Apptio – what is it?  Purpose-built to manage the business of IT o cost transparency, insights, planning  Data aggregation across multiple source systems o AI and SI data o IaaS data o BU, shared services, infrastructure  Configure your cost model  Design reports and analytics that BU’s need to manage their business
  8. 8. Unless otherwise indicated, these slides are © 2013 -2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/ PCF Data collection – current state  Usage report extract collected per foundation via the CF CLI usage- report plugin  Run monthly as part of Concourse pipeline  Only includes Application Instance (AI) data - no Service Instance (SI)  Provided to finance team  Used to show “possible” charges back to the business unit  Set charge per AI used for charge {"date":"2018-07-30", "org":[ {"org":"ORG1","apps":38,"ais":30,"memusd":21376, "memusdpct":21,"mquota":102400}, {"org":"ORG2","apps":0,"ais":0,"memusd":0, "memusdpct":0,"mquota":10240}, {"org":"ORG3","apps":0,"ais":0,"memusd":0, "memusdpct":0,"mquota":10240}, ... {"org":"ORG24","apps":9,"ais":15,"memusd":15360, "memusdpct":10,"mquota":153600}, {"org":"ORG25","apps":0,"ais":0,"memusd":0, "memusdpct":0,"mquota":30000}, {"org":"ORG26","apps":2,"ais":2,"memusd":64, "memusdpct":1,"mquota":10240}, {"org":"ORG27","apps":0,"ais":0,"memusd":0, "memusdpct":0,"mquota":102400}, {"org":"ORG29","apps":30,"ais":53,"memusd":15616, "memusdpct":15,"mquota":102400} ], "paasusg": {"paas":"stl-env2","orgs":"29","apps":214,"ais":249, "memusd":197312,"memusdpct":5,"mquota":3725920} } usage-report output
  9. 9. Unless otherwise indicated, these slides are © 2013 -2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/ PCF Foundation 1 Diego CellDiego Cell 1 PCF AIs – Cost Model AI1AI1AI1AI1AI1 Diego CellDiego Cell 1 AI1AI1AI1AI1AI1 C1 C2 C3  Infrastructure-as-a-service (IaaS) costs  Pivotal Cloud Foundry Application Instances (AI’s) and Service Instances (SI’s)  Monitoring tools (Splunk, DynaTrace, etc.)  Operations Control Center / Help Desk / Support  Third party licenses / SaaS services  Etc.
  10. 10. Unless otherwise indicated, these slides are © 2013 -2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/ PCF Data collection – work-in-progress  IaaS resource usage data  Pivotal Cloud Foundry application and service instance data  Developed cf-orgs-usage app to collect detailed usage data across all orgs in all foundations IaaS’s Monthly Data vSphere resources utilized vSphere Monthly Data Automated Ingest of Invoice Data from Microsoft Azure Monthly Data Automated Ingest of Invoice Data from Google Google Foundations App / Service Instances per org / space per foundation using a daily average On/Off Prem Foundations
  11. 11. Unless otherwise indicated, these slides are © 2013 -2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/ Importing data into Apptio AI & SI data all orgs and spaces all PCF Foundations Apptio Internal Agent Apptio data importer Apptio datastore cf-orgs-usage SaaS Agent IaaS data Azure and Google all PCF Foundations - flat rates for monitoring, support, etc., as part of model IaaS specific Apptio Reports
  12. 12. Unless otherwise indicated, these slides are © 2013 -2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/ cf-orgs-usage application  Developed by Pivotal team  Used by Apptio DataLink  Includes all orgs and spaces  Separate calls for o Application Instances (AI’s) o Service Instances (SI’s) o Task (tbd)  Deployable as o cf push to org / space o Tile deployment to system org and usage-audit space https://github.com/cbusch-pivotal/cf-orgs-usage { "app_usages": [ { "organization_guid": "d2458bfa-baea-4240-87ea-32fc01247ccd", "organization_name": "system", "period_start": "2017-10-01T00:00:00Z", "period_end": "2017-10-31T23:59:59Z", "space_guid": "b1f9f421-82d8-4ba7-8ffe-906e0e945313", "space_name": "SMOKE-1-SPACE-3da3132e-de6e-40ba-4", "app_name": "SMOKES-1-APP-090091c8-3484-4efc-4", "app_guid": "062a1999-3c38-4b5e-844f-205724693ef8", "instance_count": 1, "memory_in_mb_per_instance": 1024, "duration_in_seconds": 28 }, { ... }, { "organization_guid": "eff5e065-14eb-43ed-b410-3ade0b0b334a", "organization_name": "busch", "period_start": "2017-10-01T00:00:00Z", "period_end": "2017-10-31T23:59:59Z", "space_guid": "50ad0f02-b185-4dc0-bb77-0521b8d10bda", "space_name": "dev", "app_name": "cf-usage-report", "app_guid": "5491b67a-cfa6-415b-b938-788fa379a046", "instance_count": 1, "memory_in_mb_per_instance": 1024, "duration_in_seconds": 14875 } ] }
  13. 13. Unless otherwise indicated, these slides are © 2013 -2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/ Tagging of IaaS components Challenges  What IaaS components really are part of the PCF deploy  We use the IaaS’s for work other than in PCF  Configuration Management Database (CMDB) Need  Tagging will help us identify the proper compute, networking, and storage IaaS assets that truly tie back to PCF implementations
  14. 14. Unless otherwise indicated, these slides are © 2013 -2018 Pivotal Software, Inc. and licensed under a Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by -nc/3.0/ Audience participation  Do you use an AI standard cost model?  How did the business responded to the cost?  Are you doing show-back or charge-back, or anything?  What are you currently doing for show-back and/or charge- back?
  15. 15. Resources  “Usage Report” CF CLI plugin https://plugins.cloudfoundry.org/ , cf install-plugin -r CF-Community "Usage Report“  Apptio Integration https://www.apptio.com/resources/data-sheets/apptio-datalink  Gather AI/SI data for all orgs http://github.com/cbusch-pivotal/cf-orgs-usage  MS Azure data collection https://docs.microsoft.com/en-us/azure/billing/billing-usage-rate-card-overview
  16. 16. > Stay Connected. Raj Sivaraj @rajsivaraj1, raj.sivaraj@mastercard.com Chris Busch, @chriscbusch, cbusch@pivotal.com Other Mastercard session: Extreme Pipelines with Bill Marchlewski and Cory Jett #springon e @s1p

×