<ul>Case Study: How Caixa Econômica in Brazil Uses IBM® Rational® Insight and Performance Measurement to Support Outsourci...
<ul>Agenda </ul><ul><li>Performance Measurement
IBM Rational Insight
Insight at Caixa Econômica Federal </li></ul><ul><ul><ul><ul><ul><li>- Customer Profile
- Problem Description
- Proposed Solution
- Solution Deployment
- Architecture Overview
- Reports Delivered
- CAIXA Benefits
- Next Steps
- Lessons Learned </li></ul></ul></ul></ul></ul>
<ul>What is an IT Performance Measurement System? </ul><ul><li>The use of measurement to determine and manage the performa...
Set of measurements that best address the goals, development goals and delivery strategy
Rolling out the right amount of measurement at the right level for the right audience
Making data available to support decisions </li></ul></ul><ul><li>Measured Capability Improvement (MCI) Supports  performa...
<ul>MCI: Leverage a control framework to manage to expected business results </ul><ul>Operational  Level </ul><ul>Practice...
<ul>3-Tiered Performance Measurement </ul><ul><li>Business Level Metrics </li></ul><ul><ul><li>Usage: Provide specific inf...
Audience: CxO
Example: Revenue, Time-to-ROI, KPIs (specific to LOB) </li></ul></ul><ul><li>Operational Level Metrics </li></ul><ul><ul><...
Audience: VP of development, Development Mgmt., Operations Mgmt.
Example: Productivity measurements, Quality measurements, Time-to-Value measurements </li></ul></ul><ul><li>Practice Level...
Audience: Project manager, team lead and team members
Example: Iteration velocity, project backlog, defect density, growth chart, SPI, CPI </li></ul></ul>
<ul>Agenda </ul><ul><li>Performance Measurement
IBM Rational Insight
Insight at Caixa Econômica Federal </li></ul><ul><ul><ul><ul><ul><li>- Customer Profile
- Problem Description
- Proposed Solution
- Solution Deployment
- Architecture Overview
- Reports Delivered
Upcoming SlideShare
Loading in …5
×

Case Study: How Caixa Econômica in Brazil Uses IBM® Rational® Insight and Performance Measurement to Support Outsourcing to Its Software Factories

1,060 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,060
On SlideShare
0
From Embeds
0
Number of Embeds
7
Actions
Shares
0
Downloads
15
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Author Notes: This is the PowerPoint template for the Innovate 2011 Track Sessions ALL FINAL FILES MUST BE CONVERTED TO LOTUS SYMPHONY. Learn more here: http://w3.ibm.com/connections/wikis/home?lang=en#/wiki/Rational%27s%20Phased%20Approach%20in%20Migrating%20to%20Lotus%20Symphony Additional IBM Rational presentation resources can be found on Rational’s Managing the Brand W3 Intranet site: https://w3-03.ibm.com/software/marketing/marksite.nsf/AllMarketingPages/Brand-Rational-rt_rtb?opendocument?opendocument Third party material cannot be used in a presentation without written permission (this includes product and Web page screen shots). Images must be acquired from a ‘royalty-free to use’ source such as: Microsoft Clip Art library http://www.freebyte.com/clipart_images_photos_icons/#freevectorgraphics http:// www.freedigitalphotos.net / IBMers can use images from: IBM image library: https://w3-03.ibm.com/software/marketing/marksite.nsf/AllMarketingPages/Brand-Rational-rt_rtb?OpenDocument&amp;ExpandSection=3,2#_Section3 Royalty free images in Marketing Asset Manager database (you will need to register to access this site) : http://217.28.164.25/IBM001/templates/login.html
  • Essentials of Test Management with IBM Rational TestManager Module 4 - Determining and Reporting Test Results
  • Author Note: Optional Rational QUESTIONS slide. Available in English only.
  • Daily iPod Touch giveaway sponsored by Alliance Tech Each time you complete a session survey, your name will be entered to win the daily IPOD touch! Complete your session surveys online each day at a conference kiosk or on your Innovate 2010 Portal! On Wednesday be sure to complete your full conference evaluation to receive your free conference t-shirt!
  • Author Note: Mandatory Rational Closing Slide (includes standard legal disclaimer). Available in English only.
  • Case Study: How Caixa Econômica in Brazil Uses IBM® Rational® Insight and Performance Measurement to Support Outsourcing to Its Software Factories

    1. 1. <ul>Case Study: How Caixa Econômica in Brazil Uses IBM® Rational® Insight and Performance Measurement to Support Outsourcing to Its Software Factories </ul><ul>Wagner Arnaut IT Specialist, IBM [email_address] </ul><ul>Paulo Lacerda IT Specialist, IBM [email_address] </ul><ul>Rodrigo Evangelista Caixa National Architecture Manager [email_address] <li>PPM-1565 </li></ul>
    2. 2. <ul>Agenda </ul><ul><li>Performance Measurement
    3. 3. IBM Rational Insight
    4. 4. Insight at Caixa Econômica Federal </li></ul><ul><ul><ul><ul><ul><li>- Customer Profile
    5. 5. - Problem Description
    6. 6. - Proposed Solution
    7. 7. - Solution Deployment
    8. 8. - Architecture Overview
    9. 9. - Reports Delivered
    10. 10. - CAIXA Benefits
    11. 11. - Next Steps
    12. 12. - Lessons Learned </li></ul></ul></ul></ul></ul>
    13. 13. <ul>What is an IT Performance Measurement System? </ul><ul><li>The use of measurement to determine and manage the performance of organizations against their goals </li></ul><ul><li>Challenges in performance measurement </li></ul><ul><ul><li>Connection between improving high-level goals and software delivery strategy
    14. 14. Set of measurements that best address the goals, development goals and delivery strategy
    15. 15. Rolling out the right amount of measurement at the right level for the right audience
    16. 16. Making data available to support decisions </li></ul></ul><ul><li>Measured Capability Improvement (MCI) Supports performance measurement by providing a 3-tiered performance measurement system and the relationships between metrics in each tier </li></ul>
    17. 17. <ul>MCI: Leverage a control framework to manage to expected business results </ul><ul>Operational Level </ul><ul>Practice Level </ul><ul>Business Level </ul><ul>Business Objectives </ul><ul>Measures (Automatic Collection) </ul><ul>Efficiency </ul><ul>Control </ul><ul>Value </ul>Feedback Feedback Feedback <ul>Process Enactment / Governance Enforcement / Process Awareness (Jazz Platform or other non-Jazz-based products) </ul><ul>Performance Measurement </ul><ul>Control Metrics (Subjective) (Self-Check) </ul><ul>Control Metrics (Objective) (Rational Insight ) Velocity, Backlog, Density Growth, SPI, CPI </ul><ul>Value Metrics (Objective) (Rational Insight / Cognos) Cost, Revenue, Time-to-ROI, etc </ul><ul>Operational Effectiveness Metrics (Objective) (Rational Insight) Productivity, Quality, Time-to-Value, etc. </ul><ul>Process Definition / Practices (RMC) </ul><ul>Operational Objectives </ul><ul>Other Data Sources </ul>
    18. 18. <ul>3-Tiered Performance Measurement </ul><ul><li>Business Level Metrics </li></ul><ul><ul><li>Usage: Provide specific information that has impact on the business mission
    19. 19. Audience: CxO
    20. 20. Example: Revenue, Time-to-ROI, KPIs (specific to LOB) </li></ul></ul><ul><li>Operational Level Metrics </li></ul><ul><ul><li>Usage: Measure and manage improvements to development performance
    21. 21. Audience: VP of development, Development Mgmt., Operations Mgmt.
    22. 22. Example: Productivity measurements, Quality measurements, Time-to-Value measurements </li></ul></ul><ul><li>Practice Level Metrics </li></ul><ul><ul><li>Usage: 1) Demonstrate the level of adoption, 2) Track and monitor progress
    23. 23. Audience: Project manager, team lead and team members
    24. 24. Example: Iteration velocity, project backlog, defect density, growth chart, SPI, CPI </li></ul></ul>
    25. 25. <ul>Agenda </ul><ul><li>Performance Measurement
    26. 26. IBM Rational Insight
    27. 27. Insight at Caixa Econômica Federal </li></ul><ul><ul><ul><ul><ul><li>- Customer Profile
    28. 28. - Problem Description
    29. 29. - Proposed Solution
    30. 30. - Solution Deployment
    31. 31. - Architecture Overview
    32. 32. - Reports Delivered
    33. 33. - CAIXA Benefits
    34. 34. - Next Steps
    35. 35. - Lessons Learned </li></ul></ul></ul></ul></ul>
    36. 36. <ul>Introducing Rational Insight </ul><ul><li>Automatic collection, measurement and analysis of real-time data for informed decision making
    37. 37. Measures tailored and optimized by specific role providing relevant timely information
    38. 38. Visibility into your data across projects, products, and geographical boundaries to monitor status and progress in a single view
    39. 39. Continual process improvement with the adoption of best practice frameworks to assess, measure, and improve results. </li></ul>
    40. 40. <ul>Cognos DataManager </ul><ul>Cognos FrameworkManager </ul><ul>ETL (Extract, Transform, Load) </ul><ul>Rational Data Warehouse </ul><ul>Focal Point </ul><ul>Rational Insight Architecture Overview </ul><ul>ClearQuest </ul><ul>ClearCase </ul><ul>RequisitePro </ul><ul>RTC </ul><ul>RQM </ul><ul>MS Project </ul><ul>DOORS </ul><ul>HP Quality Cntr </ul><ul>Web architecture to retrieve product data in XML (REST get) </ul><ul>Project, Process and Portfolio Management </ul><ul>Requirements Management </ul><ul>Change and Release Management </ul><ul>Quality Management </ul><ul>Rational Insight Provide objective insight and transparent governance for software and systems delivery </ul><ul>XML </ul><ul>TestManager </ul><ul>DataStream </ul><ul>DataStream </ul><ul>Enterprise Reporting Server (Cognos 8 BI Server) </ul><ul>CIO </ul><ul>Project Manager </ul><ul>Development Team Lead </ul><ul>Release Manger </ul>
    41. 41. <ul>Agenda </ul><ul><li>Performance Measurement
    42. 42. IBM Rational Insight
    43. 43. Insight at Caixa Econômica Federal </li></ul><ul><ul><ul><ul><ul><li>- Customer Profile
    44. 44. - Problem Description
    45. 45. - Proposed Solution
    46. 46. - Solution Deployment
    47. 47. - Architecture Overview
    48. 48. - Reports Delivered
    49. 49. - CAIXA Benefits
    50. 50. - Next Steps
    51. 51. - Lessons Learned </li></ul></ul></ul></ul></ul>
    52. 52. <ul>Customer Profile </ul><ul>Business </ul><ul><li>Largest public bank in Latin America *
    53. 53. Customer base of 33.6 million people*
    54. 54. More than 17,000 points of attendance in all 5,561 Brazilian cities *
    55. 55. The bank in charge to support Brazilian Government social initiatives </li></ul><ul>IT </ul><ul><li>Software development geographically distributed in three cities: </li></ul><ul><ul><li>Brasilia
    56. 56. Rio de Janeiro
    57. 57. São Paulo </li></ul></ul><ul><li>Development outsourced to 5 external software factories
    58. 58. More then 900 applications </li></ul><ul>*source: http://www.caixa.gov.br </ul>
    59. 59. <ul>Problem Description </ul><ul><li>It is difficult to understand the status of each development unit. </li></ul><ul><ul><li>Brasília, Rio de Janeiro and São Paulo </li></ul></ul><ul><li>Manual work to extract metrics from development units </li></ul><ul><ul><li>Completion of worksheets to consolidate information from different systems
    60. 60. Reports are always outdated – Offline Reports </li></ul></ul><ul><li>Executives do not have enough visibility into development performance </li></ul><ul><ul><li>They needed to create a comparison view between: </li><ul><li>Development units
    61. 61. Teams
    62. 62. Projects </li></ul></ul></ul><ul><li>Metrics are required to support key business decisions </li></ul><ul><ul><li>Investment/Enablement </li></ul></ul><ul><li>Difficult to align IT KPIs and Corporate KPIs </li></ul><ul><li>Caixa need to have visibility about Software Factories productivity </li></ul><ul><ul><li>Need to compare Software Factories results </li></ul></ul>
    63. 63. <ul>Proposed Solution </ul><ul><li>Use Rational Insight to provide executive dashboards and reports with consolidated performance information from development units/software factories/teams/projects.
    64. 64. Initially we wanted to see the following metrics: </li></ul><ul><ul><li>Total function points delivered
    65. 65. Software factory payments
    66. 66. Open x closed demands
    67. 67. Demand backlog
    68. 68. Production environment Incidents </li></ul></ul><ul><li>Considering the following dimensions: </li></ul><ul><ul><li>development area, software factory, system, department, date </li></ul></ul><ul><li>It was necessary to get data from the following support systems: </li></ul><ul><ul><li>SIGCP: An ASP/SQL Server application used to manage software factory contracts.
    69. 69. SISOL: A ClearQuest workfow used to manage software development demands.
    70. 70. Rational Team Concert </li></ul></ul><ul>Rational Insight </ul>
    71. 71. <ul>Software Development Governance – Quick Wins </ul><ul>1 </ul><ul>2 </ul><ul>3 </ul><ul>4 </ul><ul>5 </ul><ul>6 </ul><ul>7 </ul><ul>8 </ul><ul>9 </ul><ul>10 </ul><ul>Software Development Metrics Dashboard </ul><ul>Installation and Configuration </ul><ul>Metrics from SISOL (CQ) + SIGCP + TeamConcert </ul><ul>Operational Support + Enablement </ul><ul>11 Fev </ul><ul>11 Mar </ul><ul>11 Abr </ul><ul>11 Mai </ul><ul>11 Jun </ul><ul>11 Dez </ul><ul>11 Nov </ul><ul>11 Out </ul><ul>11 Set </ul><ul>11 Ago </ul><ul>11 Jul </ul><ul>Architecture and Metrics Definition.Initial Customization </ul>
    72. 72. <ul>Solution Deployment </ul><ul><li>Insight and Data Services Installation and setup
    73. 73. SIGCP Live data reports </li></ul><ul><ul><li>Reports Definition
    74. 74. Reporting Metadata
    75. 75. Reports Creation </li></ul></ul><ul><li>SIGCP data warehouse reports </li></ul><ul><ul><li>Dimensional modeling
    76. 76. ETL Jobs
    77. 77. Reports Creation </li></ul></ul><ul>1 week </ul><ul>2 weeks </ul><ul>6 weeks </ul>
    78. 78. <ul>Solution Deployment </ul><ul><li>ClearQuest Connection </li></ul><ul><ul><li>Dimensional Modeling
    79. 79. ClearQuest data extraction customization
    80. 80. Reports Creation </li></ul></ul><ul><li>Rational Team Concert Connection </li></ul><ul><ul><li>Dimensional Modeling
    81. 81. TeamConcert data extraction customization </li><ul><li>Custom fields </li></ul><li>Reports Creation </li></ul></ul><ul><li>Performance Tuning </li></ul><ul>4 weeks </ul><ul>4 week </ul><ul>3 weeks </ul>
    82. 82. <ul>CAIXA Performance Measurement View </ul>Caixa's measurement portal is here Caixa's measurement portal is here Caixa's measurement portal is here
    83. 83. <ul>Architecture Overview </ul>
    84. 84. <ul>Reports Delivered – Payment Dashboard </ul><ul>Home Grown Application <li>Data Source </li></ul>
    85. 85. <ul>Reports Delivered – Function Points Dashboard </ul><ul>Home Grown Application <li>Data Source </li></ul>
    86. 86. <ul>Reports Delivered – On-time delivery rate </ul><ul>Home Grown Application <li>Data Source </li></ul>
    87. 87. <ul>Reports Delivered – Business Demands Dashboard </ul><ul><li>Home grown
    88. 88. application
    89. 89. +
    90. 90. ClearQuest
    91. 91. Data Source </li></ul>
    92. 92. <ul>Reports Delivered – Comparing Development Units </ul><ul>Home Grown Application <li>Data Source </li></ul>
    93. 93. <ul>Reports Delivered – Software Development Tasks Dashboard </ul><ul>RTC Data Source </ul>
    94. 94. <ul>Reports Delivered – Incidents Dashboard </ul><ul><li>Customized RTC Data Source </li></ul>
    95. 95. <ul>CAIXA Benefits </ul><ul>CAIXA now has a set of dashboards and charts that provide a high level view of its software development organization performance, that includes: </ul><ul><ul><li>Single point of access to the development metrics, KPIs and related reports.
    96. 96. Consolidate data from all development areas that can be easily compared along the time.
    97. 97. Automated data extraction eliminating the need of manual data collection and consolidation.
    98. 98. Cross tool reporting, allowing the association of data extracted from different software development tools and administrative applications to provide valuable information.
    99. 99. Measures aligned with IT KPIs and Corporate KPIs
    100. 100. Data updated on daily basis
    101. 101. Software Development Decision Making tool in many levels: </li><ul><li>Business
    102. 102. IT – Operational
    103. 103. Software Development – Operational
    104. 104. Project - Practices </li></ul></ul></ul>
    105. 105. <ul>Next Steps </ul><ul>There's more to come: </ul><ul><li>Implement CAIXA software development performance measurement system. </li></ul><ul><ul><li>CAIXA has a list of about 30 key performance indicators that are going to be implemented using Rational Insight. </li></ul></ul><ul><li>Connect Insight to Rational ClearCase to provide change management metrics;
    106. 106. Connect Insight to Rational RequisitePro to provide requirement related metrics;
    107. 107. Connect Insight to Operational Deployment Management Systems (IMPACT or RTC) to provide metrics about release promotion to production environment. </li></ul>
    108. 108. <ul>Next Steps – Work in progress </ul><ul>Project dashboard <li>RTC, SISOL(CQ), RequisitePro and ClearCase Data Source </li></ul>
    109. 109. <ul>Lessons Learned </ul>1. Take some time to understand customer requirements and the data available from your data sources. It can be risky not giving it the right importance, this will save you of unnecessary rework. <ul><ul><li>Try to get Data Models from external data sources </li></ul></ul>2. Do a quick st art with Live Data reports and then go to data warehouse reporting. 3. Test, test, test. <ul><ul><li>Working with a lot of data and calculations may be tricky and some mistakes may happen at some point in the report development process (ETL, metadata, report creation). It's very important that you spend some time testing the source data, the ETL jobs and the reports you create before publishing them. </li></ul></ul>4. Understanding dimensional modeling concepts is very useful when customizing Rational Insight ETL Jobs and data model. It will help you with some basic tasks and avoid unnecessary changes in your model. There are some good books on this subject.
    110. 110. <ul>Lessons Learned </ul><ul><li>Performance may become an issue. </li></ul><ul><ul><li>Databases skills makes the difference here to do query performance analysis, index creation, etc.
    111. 111. Some reports may not be need to run against the database every time the user access them, generally because their data is update weekly or daily. In those cases, for performance reasons, it may be better to use a static version of the report weekly or daily updated.
    112. 112. Insight Architecture Optimization </li></ul></ul><ul><ul><ul><li>Distribute some Cognos services between more then one server </li></ul></ul></ul><ul><ul><ul><ul><li>content manager, report service, presentation service, etc... </li></ul></ul></ul></ul><ul><ul><ul><li>Add HTTP Server (IIS) to the architecture </li></ul></ul></ul><ul><ul><ul><ul><li>Reduce application server workload
    113. 113. Enable static files compression
    114. 114. Caching </li></ul></ul></ul></ul><ul><ul><ul><li>Enable query parallel execution
    115. 115. Increase BIBusTKServerMain.exe idleTimeLimitSec. </li></ul></ul></ul><ul><li>Unleash the labs team played a key role in our deployment to do the </li></ul><ul>initial data extraction and report customization. </ul>
    116. 116. <ul>www.ibm.com/software/rational </ul>
    117. 117. <ul>Daily iPod Touch giveaway </ul><ul><li>Complete your session surveys online each day at a conference kiosk or on your Innovate 2011 Portal!
    118. 118. Each day that you complete all of that day’s session surveys, your name will be entered to win the daily IPOD touch!
    119. 119. On Wednesday be sure to complete your full conference evaluation to receive your free conference t-shirt! </li></ul><ul>SPONSORED BY </ul>
    120. 120. <ul>© Copyright IBM Corporation 2011. All rights reserved. The information contained in these materials is provided for informational purposes only, and is provided AS IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in these materials may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. IBM, the IBM logo, Rational, the Rational logo, Telelogic, the Telelogic logo, and other IBM products and services are trademarks of the International Business Machines Corporation, in the United States, other countries or both. Other company, product, or service names may be trademarks or service marks of others. </ul><ul>www.ibm.com/software/rational </ul>

    ×