STKI application development research

1. ; IT Application Development Research Pini Cohen EVP pini@stki.info

2. Agenda Major Trends and Issues Development and SOA ESM BSM CMDB DBMS and DATA Platforms – Servers Clients Storage Source: http://astonguild.org.uk/files/NEW_MENU_FRONT_RGB%5B1%5D.jpg

3. STKI IT Development Survey The first IT development survey in Israel! Covering: Development vs. Maintenance budget Level of effort in development (requirements, design, code, testing, etc.) Level of effort in maintenance (bugs, new enhancements, infra. upgrades) Development internally, outsourced and package modification Regulation vs. planned vs. unplanned Development metrics QA organization, etc. Methodologies used in development process 3

4. STKI IT Development survey How should you use this data: Look at the fine print – not all graphs are the same – including or excluding specific data according to the industry If you do not have all data as stated look at the ratios 4

5. New Initiatives (“development”) vs. Running (“maintenance) Systems Israeli IT Average Source: STKI Survey The actual question was: Which part from your development budget is directed to “development vs. maintenance”

6. About Development vs. Maintenance Different companies has different takes. Example: “Development – 7 days or more with features that contribute to company profitability (not regulation)” “Everything is development except bugs correction or training support. Updating tables is development” Up to two months works is considered maintenance.

7. Development vs. Maintenance definition Source: STKI Survey

8. Spending from IT budget on developing new SW projects All Data Package customization not included 8 Source: STKI Survey

10. Testing including acceptance testing (effort by IT)

11. Development - means developers effort and not necessarily just development (might include unit testing and other testing)Source: STKI Survey

12. Per sector Source: STKI Survey

13. STKI IT Development Report 11 Public Government Spending more on the requirement stage Testing looks is much less mature. Therefore developers are dealing with testing Several organization are on the building stage of their testing unitsrocedures Health: more effort on design. Less effort on Testing Telecom: heavy investment in testing without specific budget to User Acceptance testing Finance (not banking): Heavy Management cost. Lots of investment in Design

14. Requirement Mgmt. Attention Source: STKI Survey

16. SW is an integral part of the org. services to customers

17. Regulation

18. Established methodologies (CMMI, ISO) (Insurance & Credit Cards) Source: STKI Survey

19. What “contributes” to Software maintenance: Not all “minor improvements” are the same: One company might put all improvement in “development budget” while the other will put all “new development that is less than two weeks” “Infra” is SW adjustment to infrastructure changes – Win7, Oracle 11G, etc. 14 Source: STKI Survey

20. Who and what is developed? 15 Publicealth All including Publicealth Source: STKI Survey

21. Development Budget Distribution Source: STKI Survey

22. Metrics used Source: STKI Survey Each respondent could add several metrics 17

23. Metrics used – what is missing? Deployment Hatmaa metrics are missing! 18

24. Selected Project Management metrics Resource, Time, Features. And keeping track of it. LOC – line of code Number of mission accomplished in a montheriod (normalized on mission size) Plan vs. actual in total effort spent per customer, project Net resources vs. overhead (courses, safety, illness-out of work) 19

25. Selected Quality (bugault related) metrics. All per severity level # of bugs in testing and per man year, per K LOC # of escaping bugs (limited time in production) and per man year, per K LOC # of escaping bugs per # of bugs found in testing First time quality – in testing and in production 20

26. Selected Quality (bugault related) metrics. All per severity level # of critical bugs per total bugs found in testing and in production # of requiring bugs (bugs that were not fixed at after first time) # of false positive bugs – bugs that were reported but actually did not exist 21

27. Selected testing breath metrics Percent of code tested Percent of code with automatic tests 22

28. Selected dev.roduction process metrics How many changes were introduced to a project while being developed (not relevant to Agile) Did the project followed all procedures How many times the project was put to production (if more than once- something went wrong…) # of LOC developed per specific feature (comparing two developing environmentupporting tools) 23

29. Other development metrics ISO metrics Maturity of reporting systems –how well people report to the activityug system (is reporting accurate, how often the reporting takes place, what is the delay between activity and the reporting). 24

30. Organization Position of QA Source: STKI Survey

31. Show me the QA money! When QA is part of development the testing budget is lower – 38% difference! (at average) 26 Source: STKI Survey

32. Profile of your testing personnel Rising interest in Israeli Nearshore due to their subsidization by the Gov. Source: STKI Survey

33. Which Methodology is used Counted even if used in few projects or experimenting (for example “using iterative only in Internet projects” or “experimenting agile in small projects” CMMI is more common in Banking ISO certifications used are ISO9001:2008 and 9002. 28

34. Methodologies in use Source: STKI Survey

35. 30 Thank you Pini Cohen