Application Sustainability Assessment Framework within the  Canada Revenue Agency David Gibson,  Solutions Quality Program...
What You Can Expect from this Presentation <ul><li>An overview of the application sustainability framework (ASAF) process ...
Agenda <ul><li>Introduction  </li></ul><ul><li>Application Sustainability Overview </li></ul><ul><li>Application Sustainab...
Introduction <ul><li>History :   </li></ul><ul><ul><li>In September 2006, CRA’s Information Technology Branch (ITB) partic...
CRA Corporate Profile <ul><li>Mission :   </li></ul><ul><ul><li>To administer tax, benefits and related programs to ensure...
Application Sustainability Overview <ul><li>Software is an Asset and like all assets, their value needs to be amortized an...
Application Sustainability Overview <ul><li>As applications continue to age beyond the 8-9 year point, productivity begins...
Defining Sustainability <ul><li>“ Sustainability” :   the ability of an application to continue to meet requirements withi...
Application Sustainability Assessment Framework <ul><li>Technology alignment </li></ul><ul><li>Application complexity </li...
Business Constraint <ul><li>Business requirements evolve continuously over time  to address: </li></ul><ul><ul><li>Changin...
Architecture Constraint <ul><li>Evolution of technology can occur at a rapid pace, driven by improvements in hardware, sof...
Operations Constraint <ul><li>Provides the day-to-day view of people, processes and policies relating to the applications ...
The ASAF Process  <ul><li>The ASAF uses a  continuous improvement  process based on the spiral model as the basis for its’...
Step 1: Measure <ul><li>Sustainability assessment results are based on the measurement of  available  metrics.  It is expe...
Step 1: Measure (cont.) <ul><li>Lessons Learned </li></ul><ul><ul><li>Initially, measure what is available </li></ul></ul>...
Step 2: Analyze <ul><li>Measurement quantifies the software asset for each of the metrics collected, then compares using a...
Result: The Balanced View <ul><li>The result is an assessment value by constraint (per application) </li></ul>The combinin...
The ASAF Sustainability Matrix <ul><li>The ASAF Sustainability Matrix is based on the TBS – Integrated Risk Management Fra...
Other views of Application Sustainability <ul><li>Many organizations are now promoting application sustainability. </li></...
Application Report Cards <ul><li>Application Report cards provide a snapshot of an individual applications overall health ...
Report Cards: Summary <ul><li>A one page summary for  each  application, indicating the current and previous assessments B...
Report Cards: Architecture <ul><li>Provides a summary of the Architecture metrics and score results for the application </...
Report Cards: Business <ul><li>Provides a summary of the Business metrics and score results for the application </li></ul>23
Report Cards: Operations <ul><li>Provides a summary of the Operations metrics and score results for the application </li><...
Overall Assessment Results: Aggregated <ul><li>ASAF Score Distribution Summary Reports (produced yearly) </li></ul>25
Overall Assessment Results: Individual <ul><li>Reporting by Individual ASAF Scorecard Metrics (produced yearly) </li></ul>26
Overall Assessment Results: Matrices <ul><li>Examples of ASAF Reports By:   </li></ul><ul><li>Balanced View </li></ul><ul>...
Overall Assessment Results: Line of Business <ul><li>Reporting by Line of Business (produced yearly) </li></ul>28
Forecasting the Balanced View <ul><li>Plotting of the yearly assessments of the Balanced View allows the ability to foreca...
Step 3, 4, & 5: Communicate / Manage / Improve <ul><li>ASAF provides for the identification and forecasting of sustainabil...
Desired Outcomes of Measuring Sustainability 31
Future Sustainability Activities at CRA <ul><li>ASAF   </li></ul><ul><ul><li>Assess CRA Local Application Repository </li>...
Conclusions <ul><li>Software is an Asset: Sustainability helps plan for Maintenance, Refactoring and eventual Retirement. ...
Questions 34
For More Information about the ASAF…. <ul><li>Please contact: </li></ul><ul><ul><ul><li>David Gibson </li></ul></ul></ul><...
Upcoming SlideShare
Loading in …5
×

Application Sustainability Assessment Framework within the Canada Revenue Agency

2,318 views

Published on

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
2,318
On SlideShare
0
From Embeds
0
Number of Embeds
8
Actions
Shares
0
Downloads
71
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Application Sustainability Assessment Framework within the Canada Revenue Agency

    1. 1. Application Sustainability Assessment Framework within the Canada Revenue Agency David Gibson, Solutions Quality Program Information Technology Branch Canada Revenue Agency GTEC 2008 October 29, 2008
    2. 2. What You Can Expect from this Presentation <ul><li>An overview of the application sustainability framework (ASAF) process within CRA </li></ul><ul><li>Challenges, opportunities and lessons learned </li></ul><ul><li>Access to the ASAF documentation and framework </li></ul>2
    3. 3. Agenda <ul><li>Introduction </li></ul><ul><li>Application Sustainability Overview </li></ul><ul><li>Application Sustainability Assessment Framework </li></ul><ul><li>Application Sustainability Process </li></ul><ul><li>Application Report Cards </li></ul><ul><li>Questions / Contact Information </li></ul>3
    4. 4. Introduction <ul><li>History : </li></ul><ul><ul><li>In September 2006, CRA’s Information Technology Branch (ITB) participated in the Integrated Risk Management Program’s - Risk Identification and Assessment workshop </li></ul></ul><ul><li>Major Conclusion : </li></ul><ul><ul><li>Sustainability of aging applications was among the highest risks facing CRA for the future. </li></ul></ul><ul><li>Result : </li></ul><ul><ul><li>Application Sustainability Assessment project was initiated to address this risk, by developing a framework (ASAF) and a continuous improvement process to measure and manage sustainability. </li></ul></ul>4
    5. 5. CRA Corporate Profile <ul><li>Mission : </li></ul><ul><ul><li>To administer tax, benefits and related programs to ensure compliance on behalf of governments across Canada, thereby contributing to the ongoing economic and social well-being of Canadians </li></ul></ul><ul><li>Size of Organization: </li></ul><ul><ul><li>40,000 full-time employees, 3000 in ITB. </li></ul></ul><ul><li>Application Portfolio: </li></ul><ul><ul><li>454 corporate applications, 35 million lines of code. </li></ul></ul><ul><li>Annual Statistics: </li></ul><ul><ul><li>Collection: $350 billion annually, averaging $1.3 billion per working day </li></ul></ul><ul><ul><li>Tax Return Processing: 25 million individual; 1.6 million business, 6.8 million GST/HST </li></ul></ul><ul><ul><li>$15 billion benefit payments distributed to 11 million Canadians </li></ul></ul><ul><ul><li>CRA Web-site: 36 million visits; 61 million publications downloaded </li></ul></ul><ul><ul><li>Public Enquiries: > 25 million enquiries answered </li></ul></ul>5
    6. 6. Application Sustainability Overview <ul><li>Software is an Asset and like all assets, their value needs to be amortized and depreciated with plans made for maintenance, re-factoring and eventual retirement as they deteriorate normally. </li></ul><ul><li>Some Facts : </li></ul><ul><ul><li>Large systems are delivered with thousands of latent bugs </li></ul></ul><ul><ul><li>Roughly 7% of all defect repairs will introduce a new defect </li></ul></ul><ul><ul><li>Defects are not randomly distributed and patterns can be identified </li></ul></ul><ul><ul><li>Continuous growth and software aging increases complexity </li></ul></ul><ul><ul><li>Software entropy (tendency to destabilize) is natural and predictable </li></ul></ul><ul><ul><ul><ul><ul><li>Source: Quality Assurance Institute Worldwide </li></ul></ul></ul></ul></ul><ul><li>ASAF provides one tool for understanding asset degradation, and total cost of ownership by introducing a framework for measurement, and a process for management of the software. </li></ul>6
    7. 7. Application Sustainability Overview <ul><li>As applications continue to age beyond the 8-9 year point, productivity begins to decline 2-3% per year </li></ul><ul><ul><li>And up to the 8-9 year mark, productivity increases </li></ul></ul>7 System Age to Support Productivity Relationship 1000 1200 1400 1600 1800 2000 2200 2400 2600 2800 3000 0 2 4 6 8 10 12 Age of Applications (Years) Function Points Supported per Person CRA’s Portfolio Average Age
    8. 8. Defining Sustainability <ul><li>“ Sustainability” : the ability of an application to continue to meet requirements within accepted cost and quality constraints. </li></ul><ul><li>To “ Assess ” sustainability, we must: </li></ul><ul><ul><li>understand application requirements </li></ul></ul><ul><ul><li>measure application performance </li></ul></ul><ul><ul><li>know acceptable limits of cost and quality </li></ul></ul><ul><ul><li>have a well-defined vision for the future </li></ul></ul><ul><li>“ The Goal” : to know where we are, where we are going, and what the road ahead will look like. </li></ul>8
    9. 9. Application Sustainability Assessment Framework <ul><li>Technology alignment </li></ul><ul><li>Application complexity </li></ul><ul><li>Architectural alignment </li></ul>Architecture <ul><li>Consult business clients to determine development plans and priorities </li></ul><ul><li>Business/IT alignment </li></ul>Business <ul><li>Annual maintenance and support costs </li></ul><ul><li>Application Quality </li></ul><ul><li>Availability of support skills </li></ul><ul><li>Compliance with operational policies and processes </li></ul>Operations 9
    10. 10. Business Constraint <ul><li>Business requirements evolve continuously over time to address: </li></ul><ul><ul><li>Changing market conditions </li></ul></ul><ul><ul><li>Changing client needs </li></ul></ul><ul><ul><li>Legislative and Regulatory changes </li></ul></ul><ul><li>Impacts to Sustainability : </li></ul><ul><ul><li>Increased complexity and difficulty supporting new requirements based on existing design; </li></ul></ul><ul><ul><li>Higher maintenance costs </li></ul></ul><ul><ul><li>Increased change request turn-around time </li></ul></ul><ul><ul><li>Decrease in application quality </li></ul></ul>10
    11. 11. Architecture Constraint <ul><li>Evolution of technology can occur at a rapid pace, driven by improvements in hardware, software, database and programming languages </li></ul><ul><li>Technologies also go through a natural lifecycle from infancy to elderly, effecting the sustainability of applications dependant on them. </li></ul><ul><li>Impacts to Sustainability : </li></ul><ul><ul><li>Lack of vendor support </li></ul></ul><ul><ul><li>Diminishing community and 3 rd party markets </li></ul></ul><ul><ul><li>Fewer available skilled resources </li></ul></ul><ul><ul><li>Declining compatibility and interoperability </li></ul></ul>11
    12. 12. Operations Constraint <ul><li>Provides the day-to-day view of people, processes and policies relating to the applications operating environment. </li></ul><ul><li>Encompasses a wide variety of areas, including workforce availability, skill sets, organizational process and procedures, change and problem management </li></ul><ul><li>Impacts to Sustainability : </li></ul><ul><ul><li>Budget Inadequacy </li></ul></ul><ul><ul><li>Unavailability of required skill sets as workforce ages </li></ul></ul><ul><ul><li>Non-compliance with established SDLC procedures and best practices </li></ul></ul>12
    13. 13. The ASAF Process <ul><li>The ASAF uses a continuous improvement process based on the spiral model as the basis for its’ yearly assessments. </li></ul><ul><li>The approach has 5 steps. </li></ul>Step 1: Measure Step 2: Analyze Step 3: Communicate Step 4: Manage Step 5: Improve 13
    14. 14. Step 1: Measure <ul><li>Sustainability assessment results are based on the measurement of available metrics. It is expected that over time the number of metrics, and collection methods will increase. </li></ul><ul><li>Where does the Source Data come From? </li></ul><ul><li>CRA Measurements and Metrics programs provide the source data collected for use by the ASAF, including: </li></ul><ul><li>CRA Configuration Management; </li></ul><ul><ul><li>Change / Problem Management: INFOMAN, Remedy </li></ul></ul><ul><ul><li>The Solutions Application Catalogue: SAC </li></ul></ul><ul><ul><li>Client, Architect and Application Owner Questionnaires </li></ul></ul><ul><li>Technical Standards </li></ul><ul><ul><li>Application / Technology Framework </li></ul></ul><ul><ul><li>Technology Architecture Outlook </li></ul></ul>14
    15. 15. Step 1: Measure (cont.) <ul><li>Lessons Learned </li></ul><ul><ul><li>Initially, measure what is available </li></ul></ul><ul><ul><li>Collect only measurement that will be used </li></ul></ul><ul><ul><li>Increase the number of metrics gradually over time </li></ul></ul><ul><ul><li>Preview Questionnaires / Surveys with the clients </li></ul></ul><ul><li>Methods of Collection </li></ul><ul><ul><li>Web Applications (through the SAC) </li></ul></ul><ul><ul><li>Questionnaires </li></ul></ul><ul><ul><li>Automated Interfaces and Reports </li></ul></ul><ul><ul><li>Metrics </li></ul></ul>15
    16. 16. Step 2: Analyze <ul><li>Measurement quantifies the software asset for each of the metrics collected, then compares using a standardized rating scale </li></ul><ul><li>ASAF scoring algorithm is applied to create an overall sustainability score which is used for comparison and evaluation of score distributions to identify trends and patterns. </li></ul><ul><li>Distribution results are compared by: </li></ul><ul><ul><li>individual metric; </li></ul></ul><ul><ul><li>by individual application, </li></ul></ul><ul><ul><li>by line of business, organizational structure, etc. </li></ul></ul><ul><li>Lessons Learned </li></ul><ul><ul><li>Adaptable to any organization because scoring algorithm can be aligned to available metrics and enterprise goals by weighting individual factors </li></ul></ul><ul><ul><li>The scoring algorithm does not have to be complicated to identify sustainability patterns and trends </li></ul></ul>16
    17. 17. Result: The Balanced View <ul><li>The result is an assessment value by constraint (per application) </li></ul>The combining of these values results in a single Balanced View 17
    18. 18. The ASAF Sustainability Matrix <ul><li>The ASAF Sustainability Matrix is based on the TBS – Integrated Risk Management Framework </li></ul><ul><li>Provides a view of: </li></ul><ul><li>Sustainability vs. Business Priority </li></ul>18
    19. 19. Other views of Application Sustainability <ul><li>Many organizations are now promoting application sustainability. </li></ul>19
    20. 20. Application Report Cards <ul><li>Application Report cards provide a snapshot of an individual applications overall health </li></ul><ul><li>Summary </li></ul><ul><li>Architecture </li></ul><ul><li>Business </li></ul><ul><li>Operations </li></ul>20
    21. 21. Report Cards: Summary <ul><li>A one page summary for each application, indicating the current and previous assessments Balanced View, Constraints and general trends (increase / decrease) </li></ul>21
    22. 22. Report Cards: Architecture <ul><li>Provides a summary of the Architecture metrics and score results for the application </li></ul>22
    23. 23. Report Cards: Business <ul><li>Provides a summary of the Business metrics and score results for the application </li></ul>23
    24. 24. Report Cards: Operations <ul><li>Provides a summary of the Operations metrics and score results for the application </li></ul>24
    25. 25. Overall Assessment Results: Aggregated <ul><li>ASAF Score Distribution Summary Reports (produced yearly) </li></ul>25
    26. 26. Overall Assessment Results: Individual <ul><li>Reporting by Individual ASAF Scorecard Metrics (produced yearly) </li></ul>26
    27. 27. Overall Assessment Results: Matrices <ul><li>Examples of ASAF Reports By: </li></ul><ul><li>Balanced View </li></ul><ul><li>Line of Business </li></ul><ul><li>Technology Alignment to Enterprise Architecture. </li></ul>27
    28. 28. Overall Assessment Results: Line of Business <ul><li>Reporting by Line of Business (produced yearly) </li></ul>28
    29. 29. Forecasting the Balanced View <ul><li>Plotting of the yearly assessments of the Balanced View allows the ability to forecast sustainability, and compare results of previous action plans </li></ul>29
    30. 30. Step 3, 4, & 5: Communicate / Manage / Improve <ul><li>ASAF provides for the identification and forecasting of sustainability patterns and trends, but there is no silver bullet. </li></ul><ul><li>Communication is established through bilateral presentations and meetings, with the goal of highlighting sustainability risks and determining a course of action. </li></ul><ul><li>ASAF results can be used as input to: </li></ul><ul><ul><li>Planning & prioritization exercises </li></ul></ul><ul><ul><li>Alignment to the enterprise architecture where required </li></ul></ul><ul><ul><li>Preparation of architectural transition options </li></ul></ul><ul><ul><li>Preparation of a business case for funding </li></ul></ul>30
    31. 31. Desired Outcomes of Measuring Sustainability 31
    32. 32. Future Sustainability Activities at CRA <ul><li>ASAF </li></ul><ul><ul><li>Assess CRA Local Application Repository </li></ul></ul><ul><ul><li>Continued enhancements to the ASAF web application as part of continuous improvement process </li></ul></ul><ul><ul><li>Providing input for major business cases to modernize applications </li></ul></ul><ul><li>SAC </li></ul><ul><ul><li>Continued integration of the SAC and ASAF </li></ul></ul><ul><li>Metrics </li></ul><ul><ul><li>Gradual increase in the number of Metrics collected and used by ASAF </li></ul></ul><ul><li>Measurements </li></ul><ul><ul><li>Continued automation of measurements interfaces for collection of data </li></ul></ul>32
    33. 33. Conclusions <ul><li>Software is an Asset: Sustainability helps plan for Maintenance, Refactoring and eventual Retirement. </li></ul><ul><li>Sustainability Assessments highlight predictable patterns that can be used for planning, prioritization and reduction of the total cost of ownership of applications. </li></ul><ul><li>The ASAF provides a customizable framework and process that can be adapted quickly and easily by any organization. </li></ul>33
    34. 34. Questions 34
    35. 35. For More Information about the ASAF…. <ul><li>Please contact: </li></ul><ul><ul><ul><li>David Gibson </li></ul></ul></ul><ul><ul><ul><li>Solutions Quality Program Division </li></ul></ul></ul><ul><ul><ul><li>Information Technology Branch </li></ul></ul></ul><ul><ul><ul><li>4-29 875 Heron Road </li></ul></ul></ul><ul><ul><ul><li>(613) 941-8542 </li></ul></ul></ul><ul><ul><ul><li>[email_address] </li></ul></ul></ul>35

    ×