QA Trends 2010


Published on

Published in: Technology, Education
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • בוקר טוב וברוכים הבאים לכנס השנתי של STKI. שמי גלית פיין ואני אנליסטית בתחום של OFFICE OF THE CIO. השנה, בנוסף לנושאים הרגילים של OFFICE OF THE CIO, אני אתמקד במגמות המובייל, מכיוון שלשימוש העולה בטלפונים הסלולאריים החכמים יש השפעות חברתיות וכלכליות מרחיקות לכת. ואמנם החלטות המובייל מתקבלות ברמה הארגונית - אנו מעריכים, כי לארגוני IT יהיה תפקיד מכריע בשינוי מודלים עסקיים מסורתיים הן לגבי האינטרקציה עם הלקוחות והן לגבי צורת העבודה של אנשי השטח בארגון.
  • QA Trends 2010

    1. 1. QA Trends<br />Galit FeinEVP & Senior Analyst<br />Office of the CIO Strategies<br /><br />
    2. 2. Agenda <br />
    3. 3. QA & Testing Services Israeli Market<br />Software Testing<br />Outsourcing: <br />An Idea<br />Whose Time Has Come?<br />
    4. 4. QA & Testing Main Players<br />Category 1<br />Category 2<br />Category 3<br />
    5. 5. QA Staffing Level <br />The skills of a capable QA group are essential to improving application development & maintenance:<br />Early discovery of inconsistencies<br />Errors reduce <br />Rework prevention<br />Yet, the appropriate level of QA <br /> staffing is often difficult to determine<br />
    6. 6. Factors Influencing QA Staffing Level<br />When ITO requires higher level of QA staffing:<br />Orgs that produce their own SW other than orgs that implement commercial SW packages<br />Orgs relying on SW for mission-critical functions<br />Highly regulated industries<br />Orgs that produce SW as a part of their services to customers<br />Companies devoting their efforts to steady process improvement (Six Sigma/ CMMI…)<br />
    7. 7. QA & Testing Ratios<br /><ul><li>QA unit* ratio to total IT </li></ul>- Do some orgs have lower needs & are they more efficient in their use of QA staff ?<br />OR<br />- Are they understaffed in this position?<br /><ul><li>SW developers per QA FTE</li></ul>*Includes employees who are part of a dedicated QA or testing function. It does not include employees who perform testing as part of their other job responsibilities, such as application programmers who also perform their own unit testing <br />Source: ComputerEconomics<br />
    8. 8. QA Staff Ratio / total IT<br />Source: ComputerEconomics<br />
    9. 9. Find The Right Balance<br />Too often QA is viewed as an obstacle to getting work done<br />Desire to meet deadlines & enhance systems<br />Need to ensure quality, reduce waste &<br />enforce standards<br />
    10. 10. IT Trends Influencing QA Staffing Level<br />New regulations<br />Cloud computing<br />Office of the CIO<br />Agile<br />Outsourcing<br />Agile<br />
    11. 11. New Regulations Requirements<br />In recent years, the quality & integrity of information systems are being examined more closely because of regulations that address the security and privacy of information<br />QA function becomes even more important in light of these requirements<br />
    12. 12. Office of the CIO<br />
    13. 13. Office of the CIO Israeli Trends<br />After many years of talking OTC is actually happening!<br />Financial crisis & budget reduction in 2009 forced better ITG:<br />Increased focus on IT costs - efficiency increasing<br />New regulations requested better transparency<br />Most ITOs have expanded their OTC/ PMO department:<br />IT budget control & mng, PPM, rewrite methodologies & WF definition, tools evaluation, HR - resource allocation & mng, QA, GRC… <br />
    14. 14. The PMO goals are:<br />Keep all this in the right balance:<br />Scope of Work<br />Budget<br />Time<br />Quality<br />
    15. 15. SW Development Metrics<br />Bugs - How many bugs (including severity)<br />When the bug was open, when it was closed<br />Number of bugs correspondingly to closing date of the version<br />When was the bug found(dev, functional test, regression, prod = escaping bugs) <br />Test coverage (what part of SW was tested)<br />Percentage of automatic tests (from the complete project = automatic + manual)<br />Progress of project compared to plan<br />How many (and percentage of) passed builds<br />Development of new functionality vs. effort to correct bugs from prod & from tests<br />STKI recommends: change your metrics once in a while<br />
    16. 16. SW Measurement Insights<br />Bugs are the most easy metric to measure & track<br />Sometimes too much effort is spent on bugs (example: minor memory leak) while important functionality is delayed<br />How much effort should developer put in “non-dev” missions (like detailed progress report)? <br />Should maintenance be part of the general development team or should maintenance have a special “team”?<br />
    17. 17. Agile<br />
    18. 18. Traditional Software Development <br />The traditional development focus is to engineer out defects<br />Good principle<br />Hammer out defects early<br />Defects arise because requirements change<br />Too many communication gaps<br />Design<br />Code<br />Test<br />Deploy<br />Isolated Process<br />18<br />
    19. 19. Agile Project Management<br />12<br />9<br />6<br />3<br />12<br />3<br />6<br />9<br />Code<br />Analysis<br />Code<br />Test<br />Implement<br />Test<br />Analysis<br />Work Effort<br />Source: Cutter<br />Time in Months<br />
    20. 20. Agile SW Development Israeli Trends<br />Agile is catching up in ITOs<br />Clients see the benefits of Agile in SMPs<br />Large Agile projects (50 people) are <br /> more challengeable mainly when there is high interdependencies between the SW modules <br />Israeli ISV’s report that sometimes their clients demand Agile<br />Agile requires change in the hierarchical structure that is extremely difficult to large conservative organizations<br />
    21. 21. Outsourcing<br />Software TestingOutsourcing: <br />An Idea Whose Time Has Come?<br />
    22. 22. Outsourcing<br />While Professional Services market significantly dropped last year, the QA & testing PS remained stable<br />QA - rapidly growing sourcing segment<br />Acknowledging the advantage & cost saving (up to 50%) by local nearshore<br />
    23. 23. Israeli Nearshore<br />Israeli ITOs do not offshore QA, except global orgs <br />Israeli nearshore existing clients have broaden their scope<br />Added Value Professional Services :<br />Best Practices – ISTQB, ISO 27001 <br />Automation Testing Tools<br />ISTQB<br />COBIT<br />CMMI<br />ISO<br />Six Sigma<br />
    24. 24. Israeli Nearshore Main Players<br />Matrix Global (Talpiot)<br />Ness<br />Malam Team<br />Ness<br />Aman – Tehila<br />Manpower<br />Galil Software<br />Many more…<br />
    25. 25. Pricing Models<br />Traditionally QA was priced on a fixed-time/fixed-price basis (most tenders still are)<br />Today:<br /> There is a real difficulty to evaluate QA scope of work, therefore most contracts priced on time & material basis<br />Israeli ITOs prefer in-house responsibility & QA PS, both<br />On premises<br />Off premises – nearshore<br />
    26. 26. Developers vs. Testers<br />Advantage: <br />Already knows the system<br />- Driven by “delivery”<br />Disadvantage: <br />Must learn the system<br />- Seek the problems<br />- Driven by “hours”<br />But<br />But<br />
    27. 27. Thank you!<br />Galit Fein<br /> Blog:<br /> Twitter: GalitFein<br />