Create a Roadmap for EA Using Capability
Maturity Models
University of Alaska - PM and EA Workshop – May 2008

Leo de Sousa, Manager, Application Services and Enterprise
Architecture
British Columbia Institute of Technology
Agenda

•   Capability Maturity Models
•   Value and Benefits
•   Measurement
•   Now Build Your CMM
•   Future
•   Questions




                      © 2007 BCIT IT Services
Capability Maturity Models
• CMM was developed by the SEI at Carnegie Mellon
  University in Pittsburgh
   – http://www.sei.cmu.edu/cmm/
• Five Level Model to guide and assess the maturity
  of a process
• Now adapted as a model to describe incremental
  attributes of maturity for methodologies and
  disciplines




                         © 2007 BCIT IT Services
CMM – Capability Maturity Models

                                                                                            Level 4 + ……
                                                                        Level 3 + ……
                                                                                            • Discipline is
                                                                                              optimized for
                                              Level 2 + ……              • Integrated into
                                                                                              effectiveness
                                                                         broader areas
                            Level 1 + ……                                                      and efficacy
                                              • Processes are            of practice
                                               tested, tuned,
                            • Definition of                                                 • Consistent       Attributes
Value




                                               and systemized           • Recognized
        • General             semantics and                                                   application of
                                                                          opportunities
          awareness of        process                                                         Best Practices
                                              • Systemic                  to apply
          discipline &/or     targets           approach to               discipline &/or
          methods                                                                           • Operates as a
                                                discipline &/or           methodology
                            • Where you                                                      “Centre of
                                                methodology
        • Some early &        want to be                                                      Excellence”
          isolated
          attemps




          Initial             Process          Process                     Process            Process           Descript.
        Awareness             Defined         Repeatable                   Managed           Optimized

                                                                                                                 Level #
         Level 1            Level 2            Level 3                    Level 4           Level 5

                                              Time
                                                     © 2007 BCIT IT Services
Capability Maturity Model - Benefits
 • Level 5: Optimizing - Continuously targeting
   improvements required to meet business objectives

 • Level 4: Quantitatively Managed - Predictable
   results, knowledge of factors causing variance and reuse


 • Level 3: Defined - Meeting cost and functionality targets
   as well as improved quality

 • Level 2: Repeatable - Meeting schedule and reduced
   turnover resulting from less overtime

 • Level 1: Initial - No benefits: Inconsistency, schedule and
   budget overruns, and defective applications



                             © 2007 BCIT IT Services
CMM's Five Maturity Levels for Software Processes


1. At the initial level, processes are disorganized,
   even chaotic.
   – Success is likely to depend on individual efforts,
     and is not considered to be repeatable, because
     processes would not be sufficiently defined and
     documented to allow them to be replicated.




                          © 2007 BCIT IT Services
CMM's Five Maturity Levels for Software Processes


2. At the repeatable level, basic project management
   techniques are established
   – Successes could be repeated, because the
     requisite processes would have been made
     established, defined, and documented.




                          © 2007 BCIT IT Services
CMM's Five Maturity Levels for Software Processes

 3. At the defined level, an organization has
    developed its own standard software process
    through greater attention to
        documentation, standardization, and
        integration.




                          © 2007 BCIT IT Services
CMM's Five Maturity Levels for Software Processes

 4. At the managed level, an organization monitors
    and controls its own processes
    – through data collection and analysis.




                          © 2007 BCIT IT Services
CMM's Five Maturity Levels for Software Processes

 5. At the optimizing level, processes are constantly
    being improved
    – through monitoring feedback from current
      processes and introducing innovative
      processes to better serve the organization's
      particular needs.




                          © 2007 BCIT IT Services
The Value of CMMs

• You can use CMMs to:
   – Describe the maturity process of EA
   – Create a roadmap for maturing EA
   – Communicate with clients of EA
• Use CMMs as roadmaps to maturing a methodology
  – “What should I do next?”
  – “Where should I focus next?”
• Can be used as a performance development tool by
  managers
• Useful Work Planning tool by the EA


                         © 2007 BCIT IT Services
Measuring the Value – Use a CMM Roadmap

• Maturing our EA Methodology
   – Introducing new EA practice required a plan and a roadmap
   – Enterprise Architect needed a way to communicate their EA’s process to
     stakeholders
   – Published the EA CMM within IT Services and to the BCIT client
     community
• Measurement Attributes
   –   Easy to assess if complete or not
   –   Simple scoring system – no weighting for more complex attributes
   –   Updated as attributes are complete
   –   Reviewed annually to account for changes in strategy
• Communication
   – The CMM is the roadmap
   – Clients (internally and externally) can see where the practice is going




                                    © 2007 BCIT IT Services
CMM – Enterprise Architecture
                                                                        Level 3 + ……
                                                                                           Level 4 + ……
                                                                        • EA GP & Stds
                                                                                           • EA integrated
                                                                         recognized
                                                                                             in BCIT
                                                                         institutionally
                                               Level 2 + ……                                • EA Standards
                                                                        • BCIT Capital
                                               • EA Guiding                                  & Waivers
                                                                          Plan adjusted
                                                 Principles                                  improve EA
                                                                          based on EA
                                                 Published                                 • EA metrics
                            Level 1 + ……                                • Senior Mgmt
                                               • EA Roles Integ.                            support
                            • Implements                                  involved in
                                               • EA Process                                 every decision
                              Zachman                                     EA review
                                                 Communicate                                maker at BCIT
                            • EA Guiding                                • Domain Arch.
                                               • EA Manages                                • Explicit
                              Principles                                  Manage docs                        Attributes
Value




        • EA ad hoc                              Artifacts                                  governance of
                            • EA Roles                                  • Explicit
        • EA docs & stds                       • Senior Mgmt                                IT purchases
                            • Explicit links                              governance
          created locally                        support and                                using EA Stds
                              to BCIT                                     for managing
        • Tech Reqmts                            endorse EA                                 & Waivers
                              strategy                                    IT purchase
          determine                            • Explicit EA                               • Technology
                            • EA Artifact                                 variances
          strategy                               governance                                  Investments
                              Development                               • All planned IT
        • No IT Service                          for BCIT IT                                 Optimized
                            • EA Docs                                     purchases
          Culture                                purchases                                   with EA
                              Centralized                                 governed by
                                                 based on stds            EA standards


        EA Process           EA Process        EA Process                EA Process        EA Process         Descript.
         Informal           Development         Defined                   Managed          Optimized

                                                                                                              Level #
         Level 1             Level 2           Level 3                    Level 4          Level 5

                                               Time
                                                     © 2007 BCIT IT Services
EA CMM in Excel




                  © 2007 BCIT IT Services
Measuring the Value – Level 1

Level 1 – EA Process Informal

                                                 Architecture planning/implementation done
EA ad hoc for architecture domains               in silos

                                                 Lack of an integrated architecture,
EA documents and standards created locally          standardized


Technology requirements determine                Technology decisions are based on existing
implementation strategy                          vendor requirements


Lack of IT Service Culture                       Firefighting or reactive mode

Business needs do not drive technology
adoption                                         Minimal links to business strategy

            Possible Score:5                                       Actual Score:5




                                         © 2007 BCIT IT Services
Measuring the Value – Level 2

Level 2 – EA Process Development


Adopt EA Framework                                Selected Zachman Framework
EA Guiding Principles and Standards               Create EA guiding principles for making
   Developed                                         technology decisions
                                                  Articulated roles in various governance
                                                      groups and responsibilities for
EA roles and responsibilities developed               architecture changes

Explicit links to BCIT Strategy                   IT Projects support a strategic initiative
                                                  Create and publish documents and standards
EA Artifact Development                              based on guiding principles
                                                  Created a web place with doc repository and
EA documents centralized                             blog

            Possible Score: 6                                       Actual Score: 6




                                          © 2007 BCIT IT Services
Measuring the Value – Level 3
 Level 3 – EA Process Defined

                                                         Publish EA guiding principles for making technology
EA Guiding Principles and Standards Published            decisions


EA roles integrated into IT Services processes           EA Approval in PM and ChgM



EA Process Communicated                                  Make EA presentations internally and externally
                                                         Enterprise Architect responsible for evolving
Enterprise Architect Manages Documents                   documents


Senior Mgmt support and endorse EA                       Senior Mgmt make decisions using EA principles

Explicit EA governance for IT Services technology        IT Services will ensure technology purchases from
purchases based on standards                             their budget meet EA standards


Define and Capture EA Metrics                            Publish current EA metrics and identify target metrics


Build EA Documents                                       Domain Architects develop current state documents

               Possible Score: 8                                              Actual Score: 5.5

                                                    © 2007 BCIT IT Services
Measuring the Value – Level 4
 Level 4 – EA Process Managed

EA Guiding Principles and Standards Embedded into           Clients leverage EA documents to plan and implement
Institutional Culture                                       technology


BCIT Capital Plan adjusted based on EA principles           Operational Planning and Budget Requests rely on EA



                                                            Senior Mgmt present institutional strategy (internal &
Senior Mgmt understand and use EA                           external) using EA


Domain Architects Manage Documents                          Domain Architects responsible for currency of documents


                                                            IT Services Mgmt must approve a deviation from EA
Deviations from EA Standards require an Approved Waiver     standards


Explicit EA governance for all BCIT technology purchases    IT Services will ensure BCIT technology purchases meet EA
based on standards                                          standards


Conduct EA Metric Gap Analysis                              Generate projects that move EA to target metric

                Possible Score: 7                                                Actual Score: 1.5

                                                       © 2007 BCIT IT Services
Measuring the Value – Level 5
Level 5 – EA Process Optimized

EA integrated into the education, research and
business of BCIT                               EA Documents used by every decision maker

Explicit governance of technology purchases        Senior Mgmt must approve a deviation from EA
using EA standards & waivers                       standards


EA metrics are the authoritative source to         Senior Mgmt use EA dashboard to understand
improve BCIT using technology                      current and projected technology needs

EA drives Strategic and Operational Budget         Budgets are approved based on EA identified
Planning                                           needs instead of a bidding process

Technology investments optimized by adhering No unplanned technology investments made at
to Institutional EA process                  BCIT

            Possible Score: 5                                           Actual Score: 0.5




                                              © 2007 BCIT IT Services
Measuring the Value – Where are we?


Enterprise




                                                                                                                     Total
                                                                                                             Total
Architecture
CMM Summary         1               2                   3                     4               5
                          Actual




                                                                                    Actual




                                                                                                    Actual
                                          Actual




                                                                 Actual




                                                                                                                     Actual
                   Plan




                                                                                             Plan
                                   Plan




                                                     Plan




                                                                             Plan




                                                                                                             Plan
as of March 2008




Enterprise
Architecture       5       5       6       6          8         5.5          7      1.5      5      0.5      31      18.5




                                                   © 2007 BCIT IT Services
Time to Build Your CMM


    Building Your EA CMM
                      Add
                  activities                   Score your
    Identify 5
                      and                      completion
   levels of EA
                  processes                      of each
     Maturity
                   for each                      activity
                     level



                     © 2007 BCIT IT Services
Questions




            © 2007 BCIT IT Services

Create a roadmap for ea using capability maturity models

  • 1.
    Create a Roadmapfor EA Using Capability Maturity Models University of Alaska - PM and EA Workshop – May 2008 Leo de Sousa, Manager, Application Services and Enterprise Architecture British Columbia Institute of Technology
  • 2.
    Agenda • Capability Maturity Models • Value and Benefits • Measurement • Now Build Your CMM • Future • Questions © 2007 BCIT IT Services
  • 3.
    Capability Maturity Models •CMM was developed by the SEI at Carnegie Mellon University in Pittsburgh – http://www.sei.cmu.edu/cmm/ • Five Level Model to guide and assess the maturity of a process • Now adapted as a model to describe incremental attributes of maturity for methodologies and disciplines © 2007 BCIT IT Services
  • 4.
    CMM – CapabilityMaturity Models Level 4 + …… Level 3 + …… • Discipline is optimized for Level 2 + …… • Integrated into effectiveness broader areas Level 1 + …… and efficacy • Processes are of practice tested, tuned, • Definition of • Consistent Attributes Value and systemized • Recognized • General semantics and application of opportunities awareness of process Best Practices • Systemic to apply discipline &/or targets approach to discipline &/or methods • Operates as a discipline &/or methodology • Where you “Centre of methodology • Some early & want to be Excellence” isolated attemps Initial Process Process Process Process Descript. Awareness Defined Repeatable Managed Optimized Level # Level 1 Level 2 Level 3 Level 4 Level 5 Time © 2007 BCIT IT Services
  • 5.
    Capability Maturity Model- Benefits • Level 5: Optimizing - Continuously targeting improvements required to meet business objectives • Level 4: Quantitatively Managed - Predictable results, knowledge of factors causing variance and reuse • Level 3: Defined - Meeting cost and functionality targets as well as improved quality • Level 2: Repeatable - Meeting schedule and reduced turnover resulting from less overtime • Level 1: Initial - No benefits: Inconsistency, schedule and budget overruns, and defective applications © 2007 BCIT IT Services
  • 6.
    CMM's Five MaturityLevels for Software Processes 1. At the initial level, processes are disorganized, even chaotic. – Success is likely to depend on individual efforts, and is not considered to be repeatable, because processes would not be sufficiently defined and documented to allow them to be replicated. © 2007 BCIT IT Services
  • 7.
    CMM's Five MaturityLevels for Software Processes 2. At the repeatable level, basic project management techniques are established – Successes could be repeated, because the requisite processes would have been made established, defined, and documented. © 2007 BCIT IT Services
  • 8.
    CMM's Five MaturityLevels for Software Processes 3. At the defined level, an organization has developed its own standard software process through greater attention to documentation, standardization, and integration. © 2007 BCIT IT Services
  • 9.
    CMM's Five MaturityLevels for Software Processes 4. At the managed level, an organization monitors and controls its own processes – through data collection and analysis. © 2007 BCIT IT Services
  • 10.
    CMM's Five MaturityLevels for Software Processes 5. At the optimizing level, processes are constantly being improved – through monitoring feedback from current processes and introducing innovative processes to better serve the organization's particular needs. © 2007 BCIT IT Services
  • 11.
    The Value ofCMMs • You can use CMMs to: – Describe the maturity process of EA – Create a roadmap for maturing EA – Communicate with clients of EA • Use CMMs as roadmaps to maturing a methodology – “What should I do next?” – “Where should I focus next?” • Can be used as a performance development tool by managers • Useful Work Planning tool by the EA © 2007 BCIT IT Services
  • 12.
    Measuring the Value– Use a CMM Roadmap • Maturing our EA Methodology – Introducing new EA practice required a plan and a roadmap – Enterprise Architect needed a way to communicate their EA’s process to stakeholders – Published the EA CMM within IT Services and to the BCIT client community • Measurement Attributes – Easy to assess if complete or not – Simple scoring system – no weighting for more complex attributes – Updated as attributes are complete – Reviewed annually to account for changes in strategy • Communication – The CMM is the roadmap – Clients (internally and externally) can see where the practice is going © 2007 BCIT IT Services
  • 13.
    CMM – EnterpriseArchitecture Level 3 + …… Level 4 + …… • EA GP & Stds • EA integrated recognized in BCIT institutionally Level 2 + …… • EA Standards • BCIT Capital • EA Guiding & Waivers Plan adjusted Principles improve EA based on EA Published • EA metrics Level 1 + …… • Senior Mgmt • EA Roles Integ. support • Implements involved in • EA Process every decision Zachman EA review Communicate maker at BCIT • EA Guiding • Domain Arch. • EA Manages • Explicit Principles Manage docs Attributes Value • EA ad hoc Artifacts governance of • EA Roles • Explicit • EA docs & stds • Senior Mgmt IT purchases • Explicit links governance created locally support and using EA Stds to BCIT for managing • Tech Reqmts endorse EA & Waivers strategy IT purchase determine • Explicit EA • Technology • EA Artifact variances strategy governance Investments Development • All planned IT • No IT Service for BCIT IT Optimized • EA Docs purchases Culture purchases with EA Centralized governed by based on stds EA standards EA Process EA Process EA Process EA Process EA Process Descript. Informal Development Defined Managed Optimized Level # Level 1 Level 2 Level 3 Level 4 Level 5 Time © 2007 BCIT IT Services
  • 14.
    EA CMM inExcel © 2007 BCIT IT Services
  • 15.
    Measuring the Value– Level 1 Level 1 – EA Process Informal Architecture planning/implementation done EA ad hoc for architecture domains in silos Lack of an integrated architecture, EA documents and standards created locally standardized Technology requirements determine Technology decisions are based on existing implementation strategy vendor requirements Lack of IT Service Culture Firefighting or reactive mode Business needs do not drive technology adoption Minimal links to business strategy Possible Score:5 Actual Score:5 © 2007 BCIT IT Services
  • 16.
    Measuring the Value– Level 2 Level 2 – EA Process Development Adopt EA Framework Selected Zachman Framework EA Guiding Principles and Standards Create EA guiding principles for making Developed technology decisions Articulated roles in various governance groups and responsibilities for EA roles and responsibilities developed architecture changes Explicit links to BCIT Strategy IT Projects support a strategic initiative Create and publish documents and standards EA Artifact Development based on guiding principles Created a web place with doc repository and EA documents centralized blog Possible Score: 6 Actual Score: 6 © 2007 BCIT IT Services
  • 17.
    Measuring the Value– Level 3 Level 3 – EA Process Defined Publish EA guiding principles for making technology EA Guiding Principles and Standards Published decisions EA roles integrated into IT Services processes EA Approval in PM and ChgM EA Process Communicated Make EA presentations internally and externally Enterprise Architect responsible for evolving Enterprise Architect Manages Documents documents Senior Mgmt support and endorse EA Senior Mgmt make decisions using EA principles Explicit EA governance for IT Services technology IT Services will ensure technology purchases from purchases based on standards their budget meet EA standards Define and Capture EA Metrics Publish current EA metrics and identify target metrics Build EA Documents Domain Architects develop current state documents Possible Score: 8 Actual Score: 5.5 © 2007 BCIT IT Services
  • 18.
    Measuring the Value– Level 4 Level 4 – EA Process Managed EA Guiding Principles and Standards Embedded into Clients leverage EA documents to plan and implement Institutional Culture technology BCIT Capital Plan adjusted based on EA principles Operational Planning and Budget Requests rely on EA Senior Mgmt present institutional strategy (internal & Senior Mgmt understand and use EA external) using EA Domain Architects Manage Documents Domain Architects responsible for currency of documents IT Services Mgmt must approve a deviation from EA Deviations from EA Standards require an Approved Waiver standards Explicit EA governance for all BCIT technology purchases IT Services will ensure BCIT technology purchases meet EA based on standards standards Conduct EA Metric Gap Analysis Generate projects that move EA to target metric Possible Score: 7 Actual Score: 1.5 © 2007 BCIT IT Services
  • 19.
    Measuring the Value– Level 5 Level 5 – EA Process Optimized EA integrated into the education, research and business of BCIT EA Documents used by every decision maker Explicit governance of technology purchases Senior Mgmt must approve a deviation from EA using EA standards & waivers standards EA metrics are the authoritative source to Senior Mgmt use EA dashboard to understand improve BCIT using technology current and projected technology needs EA drives Strategic and Operational Budget Budgets are approved based on EA identified Planning needs instead of a bidding process Technology investments optimized by adhering No unplanned technology investments made at to Institutional EA process BCIT Possible Score: 5 Actual Score: 0.5 © 2007 BCIT IT Services
  • 20.
    Measuring the Value– Where are we? Enterprise Total Total Architecture CMM Summary 1 2 3 4 5 Actual Actual Actual Actual Actual Actual Plan Plan Plan Plan Plan Plan as of March 2008 Enterprise Architecture 5 5 6 6 8 5.5 7 1.5 5 0.5 31 18.5 © 2007 BCIT IT Services
  • 21.
    Time to BuildYour CMM Building Your EA CMM Add activities Score your Identify 5 and completion levels of EA processes of each Maturity for each activity level © 2007 BCIT IT Services
  • 22.
    Questions © 2007 BCIT IT Services

Editor's Notes

  • #23 Show BCIT EA CMM Scoring