Collabera        Indwelling and Outflowing –            Applying the JIDOKA Technique                                  Mos...
Collabera            2
Collabera            3
Collabera            4
Collabera            5
Collabera     Non Controllable       Controllable         Output                Input           Lag                 Lead  ...
Collabera              Code                   Structural                application profile                               ...
Collabera            8
Collabera            9
Collabera            10
Collabera            11
Collabera            Population : 20.5 M            Richest city in India, Per-capita            income in 2009 was 486,00...
Collabera                                Figuring out   Customer                                                          ...
Collabera            14
Collabera                                    Cost of fixing defect                               80            Hours for f...
Collabera            JIDOKA-Step By Step                       Structural                   application profile           ...
Collabera              CASE Study : Correlating use case to SIT                                                           ...
Collabera            JIDOKA in Requirements                      “Can I say my requirements are at                      a ...
Collabera            Gold – Silver - Bronze Rating                     Special considerations of non functional and interf...
Collabera   Requirements Qualification matrix                       Planning & Tracking iterative assessment (Score Card) ...
Collabera     Requirements structure- A deeper insight                                     TS 1   TS 2   TS N# of use case...
Collabera                  Figured out - Requirements    Customer                                                         ...
Collabera            JIDOKA-Step By Step                       Structural                   application profile           ...
Collabera                        JIDOKA - ArchitectureNumber of ASRs                         Attributes                   ...
Collabera    Customer           Figured out - Architecture                                                                ...
Collabera            JIDOKA-Step By Step                       Structural                   application profile           ...
Collabera                   The problem of plenty Cyclomatic         % comment Lines       Density of comment  Violations ...
Collabera               Correlating SIT with engineering metrics                     II            % Branches             ...
Collabera                                          Case Study       Study from European university      Number of Class vs...
Collabera               Sample Java Class and Code toxicity analysis                        Correlates to                 ...
Collabera                UC complexity vs. max code complexity                         2.3.47.2                           ...
Collabera            32
Collabera              Unit test measures            Unit Test coverage            Test LOC Vs SLOC            Test Pass p...
Collabera    Customer                      Figured out - Coding                                                           ...
Collabera            JIDOKA-Step By Step                       Structural                   application profile           ...
Collabera                                 Variant -1       Application     TC   TV     TI    Others         Before  1   Ap...
Collabera                     Variant – 2            % Navigation test cases               % Presentation test cases      ...
Collabera                             Variant - 3            Scenario Level                 Test case Level • % of end to ...
Collabera    Customer                     JIDOKAA in software                                                             ...
Collabera            Shifting to the better - I                         40
Collabera            Improved Pre-SIT Detection                                        III                                ...
Collabera            Shift in defect distributionRequirements &   Code Review   Unit Test         System Test   Post Relea...
Collabera                             What Did We See….                                    CSAT performance            Ove...
Collabera               Qualitative Benefits      These metrics and dashboards are easier to      understand      Improve ...
Collabera      Thank       youMosesraj R - (mosesrajr@collabera.com)Smitha T – (smithat@collabera.com)                    ...
Upcoming SlideShare
Loading in …5
×

Indwelling and outflowing – applying the jidoka technique

656 views

Published on

Published in: Business, Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
656
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Indwelling and outflowing – applying the jidoka technique

  1. 1. Collabera Indwelling and Outflowing – Applying the JIDOKA Technique Moses & Smitha Collabera solutions Bangalore 1
  2. 2. Collabera 2
  3. 3. Collabera 3
  4. 4. Collabera 4
  5. 5. Collabera 5
  6. 6. Collabera Non Controllable Controllable Output Input Lag Lead 6 6
  7. 7. Collabera Code Structural application profile Test case adequacy JIDOKA structure Requirements structure 7
  8. 8. Collabera 8
  9. 9. Collabera 9
  10. 10. Collabera 10
  11. 11. Collabera 11
  12. 12. Collabera Population : 20.5 M Richest city in India, Per-capita income in 2009 was 486,000 (US$10,692) ( 3 times the national average) 6% of India’s GDP & Highest GDP of any City in South/West/Central Asia Commercial and entertainment capital of India & one of the worlds top 10 centers of commerce 70% of capital transactions to Indias economy Home to premier financial, scientific & nuclear institutions A potpourri of many communities and cultures. 12
  13. 13. Collabera Figuring out Customer Customer Require Architect Design & Unit System ments ure Coding Testing TestingEngineering Metrics ? ? ? ? ? Requirements Architecture System Quality Code Review Unit Testing Review review testing Control defects defects defects defects defects Metrics Project EffortManagement Schedule 13
  14. 14. Collabera 14
  15. 15. Collabera Cost of fixing defect 80 Hours for fixing 60 40 20 0 Pre-SIT SIT UAT Cost of fixing 3.5 18 80 15
  16. 16. Collabera JIDOKA-Step By Step Structural application profile Test case Code adequacy structure Requirements structure 16
  17. 17. Collabera CASE Study : Correlating use case to SIT Functional Use Case Defects # of change after first baseline Volatility SIT defects Mapped to each use case Level 1 Basic & alternate flows Detailing α Level 2 Additional details UAT defects Mapped to each use case Level 1 No SME reviews Level 2 SME reviews Verification Production Mapped to each use case defects As defined in UCP template Based on # of transactions Complexity 17
  18. 18. Collabera JIDOKA in Requirements “Can I say my requirements are at a level “ X” which signifies the quality of my requirements?” “Can I set thresholds and monitor my requirements that enables me to do course corrections?” 18
  19. 19. Collabera Gold – Silver - Bronze Rating Special considerations of non functional and interface aspects documented and reviewed. Validated through prototypes Alternate scenarios added and reviewed Basic Flow Available, documented and reviewed. 19
  20. 20. Collabera Requirements Qualification matrix Planning & Tracking iterative assessment (Score Card) Functional Requirements assessment (Score Card) Non Functional Requirements assessment Business Requirements (Score Card) assessment (Score Card) Requirement documentation assessment (Score Card) Proposal / SOW / Discovery Requirement Phase Design Phase 20
  21. 21. Collabera Requirements structure- A deeper insight TS 1 TS 2 TS N# of use cases and #of reports Category 1% Use cases withAlternate /exceptional flows Category 2% use cases withoutbusiness rules Category 3% use cases withOpen points Category 4% Use cases withscreens/Prototypes Category 5% of use case withQOS criteria 80% 60% 20% 21
  22. 22. Collabera Figured out - Requirements Customer Customer Require Architect Design & Unit System ments ure Coding Testing Testing % UC with Alt flows % UC with OpenEngineering points Metrics % Ucs without businessrules % Use cases with ? ? ? ? screens/PrototypeQuality Control Requirements Architecture System Metrics Code Review Unit Testing Review review testing Project EffortManagement Schedule 22
  23. 23. Collabera JIDOKA-Step By Step Structural application profile Test case Code adequacy structure Requirements structure 23
  24. 24. Collabera JIDOKA - ArchitectureNumber of ASRs Attributes Baselin Candid Candidat Candid% coverage of BR to e Arch ate e Arch 2 ateASRs Arch 1 Arch n Map all Stakeholder# of architectural Concernsstyles/patterns Identify ArchitecturallyRatio of ASRs covered Significant Requirementsthrough structured Architecture Strategy &decision making Styletechniques ( to Architecturally Significanttradeoffs, risks & Decisionssensitivities ) Architectural ViewsCompleteness of Architectural Analysis &architectural views EvaluationQuality attributeranking 24
  25. 25. Collabera Customer Figured out - Architecture Customer Require Architect Design & Unit System ments ure Coding Testing Testing %coverage of % UC with Alt flows BRtoASRs % UC with Open #ofarchstylesEngineering points Metrics % Ucs with more than2 changes % Use cases with /patterns Ratioof ASDto tradeoffs, risks & ? ? ? screens/Prototype sensitivitiesQuality Control Requirements Architecture System Metrics Code Review Unit Testing Review review testing Project Effort VarianceManagement Schedule Variance 25
  26. 26. Collabera JIDOKA-Step By Step Structural application profile Test case Code adequacy structure Requirements structure 26
  27. 27. Collabera The problem of plenty Cyclomatic % comment Lines Density of comment Violations complexity lines %Branch Java NCSS Public undocumented Complexity API distribution by Statements method Depth of Npath Complexity Duplicated lines Inheritance Duplicated blocks Complexity Calls/method Class Fan Out distribution by class Complexity Number of children Methods / Class Afferent couplings Class Data Abstraction File dependencies to Class Coupling coupling Lack of cohesion cut Maintainability methods Index Boolean Expression Package dependencies complexity to cut 27
  28. 28. Collabera Correlating SIT with engineering metrics II % Branches Block Depth % Branches Block Depth Cyclomatic Complexity Cyclomatic Complexity 28 Slide 28
  29. 29. Collabera Case Study Study from European university Number of Class vs SIT defects 2% 1%1% 4%  Key parameters measured  Cyclomatic complexity  No. of methods  No. of Calls 92%  LOC/method  Our performance is above UCL on LOC/method 8% of classes is contributing to 100% of SIT defects 29
  30. 30. Collabera Sample Java Class and Code toxicity analysis Correlates to AT & SIT defects Detailed study of the data shows most of the SIT & AT defects are occurring amongst the top four Java classes shown in the sample data above which have highly toxic code with high method length 30
  31. 31. Collabera UC complexity vs. max code complexity 2.3.47.2 2.3.41.2 2.3.42.2 2.3.43.2 2.3.44.2 2.3.13.2 2.3.15.2 2.3.48.2 2.3.11.2 2.3.23.2 2.3.20.2 2.3.1.2 2.3.19.2 2.3.20.2 2.3.30.2 2.3.32.2 2.3.37.2 2.3.16.2 2.3.25.2 2.3.49.2 2.3.38.2 2.3.33.2 2.3.36.2 2.3.4.2 2.3.5.2 2.3.26.2 2.3.2.2 2.3.50.2 2.3.17.2 2.3.39.2 2.3.34.2 2.3.52.2 2.3.6.2 2.3.9.2 2.3.27.2 2.3.7.2 2.3.45.2 2.3.18.2 2.3.40.2 2.3.35.2 2.3.12.2 2.3.10.2 2.3.53.2 2.3.10 2.3.22.2 2.3.46.2 31
  32. 32. Collabera 32
  33. 33. Collabera Unit test measures Unit Test coverage Test LOC Vs SLOC Test Pass percentage 33
  34. 34. Collabera Customer Figured out - Coding Customer Require Architect Design & Unit System ments ure Coding Testing Testing %coverage of % UC with Alt flows BRtoASRs Cyclomatic % UC with Open #ofarchstyles complexity TestCoverageEngineering points Methods /Class Metrics % Ucs with more than2 changes % Use cases with /patterns Ratioof ASDto tradeoffs, risks & Calls PerMethod % Branch TestLOC/SLOC Test cases failed perbuild ? screens/Prototype sensitivities StatementsQuality Control Requirements Architecture System Metrics Code Review Unit Testing Review review testing Project EffortManagement Schedule 34
  35. 35. Collabera JIDOKA-Step By Step Structural application profile Test case Code adequacy structure Requirements structure 35
  36. 36. Collabera Variant -1 Application TC TV TI Others Before 1 Application 1 24 24 9 6 2 Application 2 36 54 27 9 3 Application 3 6 6 6 3 4 Application 4 9 12 0 6 After No Application TC TV TI Others 1 Application 1 30 45 15 18 2 Application 2 45 75 36 24 3 Application 3 9 9 6 12 4 Application 3 12 15 6 15 TC TV TI Others 1 1.25 1.25 2.3 36
  37. 37. Collabera Variant – 2 % Navigation test cases % Presentation test cases % Behavioral test cases % UI test cases % Accessibility test cases % Security test cases 37
  38. 38. Collabera Variant - 3 Scenario Level Test case Level • % of end to end • # of test cases per use case business scenarios • % of positive test cases • % of alternate business • % of negative test cases (exceptional cases, scenarios abnormalities) • % of untestable • % of interface test cases scenarios • % of UI test cases • % of non functional test cases • % of requirements covered through test cases 38
  39. 39. Collabera Customer JIDOKAA in software Customer Require Architect Design & Unit System ments ure Coding Testing Testing %coverage of %ofendtoend % UC with Alt flows BRtoASRs Cyclomatic scenarios % UC with Open #ofarchstyles complexity TestCoverageEngineering %ofuntestable points Methods /Class /patterns TestLOC/SLOC scenarios Metrics % Ucs with more than2 changes Ratioof ASDto Calls PerMethod Test cases failed %ofpositivetest % Use cases with tradeoffs, risks & % Branch perbuild cases screens/Prototype sensitivities Statements %ofnegativetest casesQuality Control Requirements Architecture System Metrics Code Review Unit Testing Review review testing Project EffortManagement Schedule 39
  40. 40. Collabera Shifting to the better - I 40
  41. 41. Collabera Improved Pre-SIT Detection III 70 % Pre_SIT Defects % 49 % Dec 2009 Last 1 year 100% of development and enhancement were above 2011 pre-SIT target Most development and enhancements had slipped defects ratio less than 2% 41
  42. 42. Collabera Shift in defect distributionRequirements & Code Review Unit Test System Test Post Release Design review Pre Post 42
  43. 43. Collabera What Did We See…. CSAT performance Overall Satisfaction Quality On time 2009 Mar-10 2010 Sep-10 2011 Mar-11 43
  44. 44. Collabera Qualitative Benefits These metrics and dashboards are easier to understand Improve ability to isolate and deal with the defective ones Improved risk management and transparency 44
  45. 45. Collabera Thank youMosesraj R - (mosesrajr@collabera.com)Smitha T – (smithat@collabera.com) 45

×