Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.



Published on

Published in: Business, Technology
  • Be the first to comment

  • Be the first to like this


  1. 1. Capability Maturity Model® (CMM®) IntegrationsmAppraisals Methods วรวุฒ ิ รามจันทร์ เทคโนโลยีสารสนเทศและการจัดการ
  2. 2. AGENDAS SCAMPI คื ออะไร? ใครเป็ นใครในกระบวนการ SCAMPI ขอบเขตและแผนงาน การสั มภาษณ์ การชี แจงและตอบคําถาม Q&A 2
  3. 3. “The Standard CMMI Appraisal Method for Process Improvement (SCAMPI) is an invaluable tool for organizations seeking todrive quantifiable improvements in systems and software engineering. ” CMMI SCAMPI Distilled: Appraisals for Process Improvement By Dennis M. Ahern Jim Armstrong Aaron Clouse Jack Ferguson Will Hayes Kenneth Nidiffer 3
  4. 4. Definitions Appraisal  An examination of one or more processes by a trained team of professionals using a model as a basis for determining strengths and weaknesses SCAMPI  Standard CMMI® Appraisal Method for Process Improvement 4
  5. 5. Appraisal Principles Start with a Process Reference Model Use a Defined Appraisal Method Involve Senior Management as AppraisalSponsors Observe Non-Attribution Approach the Appraisal Collaboratively Focus on Action 5
  6. 6. Basic Appraisal Precepts Non-Attribution  Nothing seen or heard during an appraisal will be attributed to a person or project Confidentiality  All artifacts provided to the team during the appraisal will either be returned to the appraised organization, destroyed, or deleted Appraisal findings are the property of the appraisal sponsor(s) and will not be divulged or used outside the context of the appraisal without the specific permission of the sponsor(s) 6
  7. 7. Appraisal Method Classes 7
  8. 8. CMMI® -DEV v1.2 8
  9. 9. Continuous Representation•Organizational Process •Project Planning •Requirements Mgmt. •Configuration Mgmt.Focus •Project Monitoring and •Requirements Dept. •Process and Product•Organizational Process Control •Technical Solution Quality AssuranceDefinition •Supplier Agreement Mgmt. •Product Integration • Measurement &•Organizational Training •Integrated Project Mgmt. •Verification Analysis•Organizational Process •Risk Management •Validation •Decision Analysis andPerformance •Quantitative Project Mgmt. Resolution•Organizational Innovation • Causal Analysis andand Deployment Resolution 9
  10. 10. Reasons for Appraisals Generating Maturity Level or Capability LevelRatings (A)Status of Process Implementation (B) Evaluation for Award or Incentive Fee (B) Internal Snapshot, Mini-Appraisal (B/C) Education, Gap Analysis (B/C) Contract Monitoring (B/C)Planning an Improvement Strategy (C) 10
  11. 11. Resource Requirements - 1 Certified Lead Appraiser or Team Leader Qualified Team Members  Training Requirements • Introduction to CMMI® • SCAMPI Team Training  Team Knowledge/Experience Requirements • 5 Yrs Engineering, 3 Yrs Management • Domain Knowledge is necessary and At Least Half of the team should have appraisal experience Logistic Support at the Appraisal Site 11
  12. 12. Resource Requirements - 2 Travel Resource Requirements depend on:  Mode of Evidence Review (Discovery or Verification)  Scope  Other Sponsor Information RequirementsScope Determines:  Team Size and Composition  Time Required 12
  13. 13. Typical Appraisal Activities Planning and Preparation  Appraisal Input and Plan  Team Selection and Training  Readiness Review Conduct Appraisal  Document Review  Interviews  Collation of Findings Preliminary Findings Presentation Report Results  Final Findings Presentation  Executive Level Outbrief Appraisal Disclosure Statement 13
  14. 14. Generic SCAMPI C Timeline 14
  15. 15. Preliminary StepsWith the Appraisal Sponsor:  Review and discuss program work requirements in terms of processes  Decide which Process Areas are most critical to the success of the program and should be appraised  Other important Program Information Needs 15
  16. 16. What is Scope? Scope is  The Number of Process Areas to be Appraised and  Other important Program Information Needs Scope should include  Process Areas most critical to the success of the program  Whatever else the sponsor wants, e.g., • Strengths and Weaknesses • Observations • Recommendations for Implementation • Process Improvement Plan Scope Determines:  Appraisal Team Size and Composition  Time Required 16
  17. 17. Scope: “You Must Decide” Business and Technical Objectives Program Risks Where Failure Is Unacceptable What Is Negotiable/Not-Negotiable Dependencies and Constraints Historical Information Other Program Information Needs 17
  18. 18. SCAMPI Process Flow - Plan & Prepare Plan for Obtain/analyze initial appraisal objective evidence (OE) scope, appraisal plan 1 questionnaires, mapping, documents, 2 PII (mapping) database, Prepare appraisal team Prepare to collect OE & participants trained team, participants readiness review, data collection plan oriented Conduct appraisal1 Questionnaires - optional2 PII = practice implementation indicator 18
  19. 19. SCAMPI Process Flow - Conduct Examine OE Validate practice implementation gaps Questionnaire results, PII database, documents, interviews Prelim. findings, findings feedback Verify OE Document OE Direct & indirect artifacts, affirmations, gap Recorded/updated appraisal data (e.g., observations, strengths tagged notes, PII database, gaps) Characterize Generate assessment implementation of results practices Final findings, ratings Instantiation-level & organizational unit -level characterizations Report resultsNote: Verify & validate data is an iterative process 19
  20. 20. SCAMPI Process Flow - Report Results Conduct appraisal Deliver appraisal results Findings presentation, * final report Package & archive appraisal results Lessons learned, appraisal record (sponsor), appraisal report/feedback (SEI)* Final report is optional 20
  21. 21. Role of Interviews Draw on existing expertise and knowledge ofresident management, engineering, and supportprofessionals Supplement knowledge gained from review oforganizational and project documents Start the thinking process about what it wouldreally take to further improve the organizationsdevelopment capabilities Obtain buy-in of discussion participants inassessment outcome 21
  22. 22. Types of Interviews Project Leader interviews  If multiple projects are being appraised in an organization, one session for each project Functional area interviews  Management group or groups  Engineering group or groups  Support group or groups  Process group or groups Organizational Roles  Senior/Middle Managers  Project Leaders  Practitioners 22
  23. 23. Format of Interviews Who will be there?  For some interviews, the entire team will be present; for others, a team sub-set will be present  Follow-up interviews may be with a team sub-set What to bring with you?  You may bring a few items that are particularly helpful in your daily work, or that typify what you produce What kind of questions will be asked?  There may be some broad, general questions; however, interview questions will generally be narrowly focused and rather detailed 23
  24. 24. About Interviews It is OK to say  I don’t know.  We are not at that stage yet The only bad answer is adisingenuous answer 24
  25. 25. Characterizing Practice Implementation• Assign characterization values reflecting the extent of practice implementation for each instance – For practices implemented by projects, an instance = each project – For practices implemented organization-wide, the instance• Aggregate practice characterizations to organizational unit (OU) level using defined method aggregation rules 25
  26. 26. Rules for Characterizing Practice Implementation – Instantiation Level Label MeaningFully Implemented (FI) Direct artifacts present & appropriate • Supported by indirect artifact &/or affirmation • No weaknesses notedLargely Implemented • Direct artifacts present & appropriate(LI) • Supported by indirect artifact &/or affirmation • One or more weaknesses notedPartially Implemented Direct artifacts absent or judged inadequate(PI) • Artifacts or affirmations indicate some aspects of the practice are implemented • One or more weaknesses notedNot implemented (NI) Any situation not covered by above 26
  27. 27. Rules for Aggregating Practice Implementation - *OU Level Condition Outcome RemarksAll X (e.g., all LI) X All instantiations have the same characterization.All (LI or FI) LI All instantiations are characterized LI or higher.Any PI, No NI LI or PI Team judgment is applied to choose LI or PI for the OU.Any NI NI, PI, or Team judgment is applied to choose LI NI, PI, or LI for the OU.* OU = organizational unit 27
  28. 28. 28
  29. 29. Rules Short answers Trade answer sheets and grade yourneighbor Top 4 go to the tie-breaker rounds Top 2 go to the final tie-breaker 29
  30. 30. Ready? 30
  31. 31. Questions1. Name the seven Level 2 Process areas in theStaged Presentation of CMMI® (1 pt per correctanswer)2. How does any organization get a Maturity Level 3Rating? (2 points)3. What are the 3 phases of a SCAMPI Appraisal?4. Name the 3 hard prerequisites for being aSCAMPI Appraisal Team Member 31
  32. 32. Answers1. REQM, PP, PMC, CM, SAM, MA, and PPQA (1 pt percorrect answer)2. Successfully pass a SCAMPI Class A Appraisal (1)3. Plan and Prepare, Execute, Report Findings (1 pt/correctanswer)4. Intro to CMMI Course, 5 years of Engineering Experienceand 3 years of Management Experience (2 pts/correctanswer) Perfect Score = 20 32
  33. 33. Tie Breakers Round 11. What three things comprise the scope ofan appraisal2. What is the sunset date for CMMI® v1.2? 33
  34. 34. Tie-Breaker AnswersFirst question:  The projects or instantiations to be appraised  The process areas to be appraised and to what level  Additional products requested by the sponsor 34
  35. 35. CMMI ML3 Certified Company 35
  36. 36. Q&A 36
  37. 37. THE END นักศึกษาสามารถดาวน์โหลด เอกสารประกอบการเรี ยน ได้ ที 37
  38. 38. Q&A 38