1. IMPROVING SOFTWARE QUALITY FORTHE
MODERNWEB
EUAN GARDEN
MICROSOFT
EUANG@MICROSOFT.COM
HTTP://WWW.TWITTER.COM/EUANGA
HTTP://BLOGS.MSDN.COM/EUANGA

2. DOWE STILL NEEDTO CARE ABOUT QUALITY?

3. on average professional coders
make 100 to 150 errors in every
1000 lines of code they write
defects found in production
cost 10x more to fix than
those found during
requirements gathering
last year, canceled projects cost firms $67
billion; overruns on the other projects racked
up another $21billion
software bugs cost the us
economy an estimated $59.5
billion every year

4. need something a little more concrete?

5. USSYORKTOWN, SMARTSHIP
crew member entered 0 in a data
entry field, caused a “divide by 0”
error
that shut down propulsion
ship was dead in the water for 2hrs
45mins

6. ARIANE 5 FLIGHT 501
re-used code from ariane 4, but
took a different flight path because
of different booster design
conversion from 64bit float to 16bit
signed int caused overflow
(exception handler was disabled for
perf reasons)
cost: > $370 million @ 1996 prices

7. F-22 RAPTOR
deploying overseas to japan the
first time crossed international
dateline
Raptor is likely the most advanced manned aircraft that will ever fly…
computers crashed losing all
navigation and communications
systems
clear weather allowed them to
follow tankers back to hawaii

8. need something a little more visual?

13. 1. what
2.when
3. how

14. AGILETESTING QUADRANTS
functional tests
examples
story test
prototypes
simulations
exploratory testing
scenarios
usability testing
uat (user acceptance testing)
alpha/beta
unit tests
components tests
performance and load testing
security testing
“ility” testing
TECHNOLOGY -FACING
CRITIQUEPRODUCT
SUPPORTINGTHETEAM
BUSINESS-FACING
*brian marick

15. AGILETESTING QUADRANTS
functional tests
examples
story test
prototypes
simulations
exploratory testing
scenarios
usability testing
uat (user acceptance testing)
alpha/beta
unit tests
components tests
performance and load testing
security testing
“ility” testing
TECHNOLOGY -FACING
CRITIQUEPRODUCT
SUPPORTINGTHETEAM
BUSINESS-FACING

16. 27%
26%
47%
How often do you write unit tests?
Almost Always
Sometimes
Don't
Source:Telerik Blog Survey May ‘08

17. 14%
60%
26%
Why are you not doing more UnitTesting?
Not worth writing
No time/Too Hard
Want to, but have not
Source: .Net/GIS Developer Blog Survey ‘08

18. “…for an increased development cost of 15-35%...
defect reduction of 40-90% can be achieved…”
Source: “Realizing quality improvement through test driven development”, MSR et al

19. AGILETESTING QUADRANTS
functional tests
examples
story test
prototypes
simulations
exploratory testing
scenarios
usability testing
uat (user acceptance testing)
alpha/beta
unit tests
components tests
performance and load testing
security testing
“ility” testing
TECHNOLOGY -FACING
CRITIQUEPRODUCT
SUPPORTINGTHETEAM
BUSINESS-FACING

20. 1. stop the bleeding
2.stay current
3. catch up
http://blog.mountaingoatsoftware.com/reduce-manual-test-techcnical-debt

21. “…the real low-hanging fruit is often not
automating some test execution but automating
other testing tasks, like populating databases or
automatic navigation to the page where you’ll
start manual testing. you’re not reducing the
number of manual tests, but you’re reducing the
total time it takes to run them...”
- mike cohn quoting brian marick

22. DEMO
exploratory testing
manual testing
fast forward for manual testing
Iteration N

23. AGILETESTING QUADRANTS
functional tests
examples
story test
prototypes
simulations
exploratory testing
scenarios
usability testing
uat (user acceptance testing)
alpha/beta
unit tests
components tests
performance and load testing
security testing
“ility” testing
TECHNOLOGY -FACING
CRITIQUEPRODUCT
SUPPORTINGTHETEAM
BUSINESS-FACING

24. TESTAUTOMATION PYRAMID
UI
Service
Unit/Component
Mike Cohn

25. DEMO
(web) ui test automation
Iteration N

26. AUTOMATION PLATFORM SUPPORT
Fully supported platform
Partial solution. Further
work required in future to
complete
Best efforts with known
issues. Users can
workaround these cases in
the code. No major ongoing
investment.
Currently no support but on
the roadmap for future
releases
Currently no support and
none planned for now.
Opportunity for partners to
add this using the
Extensibility support. Docs
and samples around
extensibility are here.
For latest info on this, refer
this post.
Platform RTM RTM+ Notes
IE7/8 – HTML/AJAX
Windows Forms 2.0+
.NET Fx Controls fully supported,
working on 3rd party support
WPF 3.5+
.NET Fx Controls fully
supported, working on 3rd party
support
SharePoint 2007
WindowsWin32 TBD – Known issues &
Workarounds
MFC TBD – Known issues &
Workarounds
FF3 – HTML/AJAX Currently in Beta
Dynamics (Ax) TBD – Release Plan
Silverlight TBD – Release Plan
Citrix/TerminalServices The client (MTLM orVS) need to be
on remote machine
Office Client Apps
IE 6 Opportunity for partners to add this
using the Extensibility support.
Docs and samples around
extensibility are here.
Chrome/Opera/Safari
Flash/Java
SAP

27. AGILETESTING QUADRANTS
functional tests
examples
story test
prototypes
simulations
exploratory testing
scenarios
usability testing
uat (user acceptance testing)
alpha/beta
unit tests
components tests
performance and load testing
security testing
“ility” testing
TECHNOLOGY -FACING
CRITIQUEPRODUCT
SUPPORTINGTHETEAM
BUSINESS-FACING

29. DEMO
performance testing
Iteration N

30. but what about the cloud?

31. auctioncloud.com mashup service
ebay api’s
ebay auction
service
ebay auction
data
zillow.com public api’s
zillow.com service
zillow custom data
mls public api’s
mls service
bing maps public
api’s
bing maps service
mls auction data bing maps image
store

32. pay attention to the details
care about quality

33. BECAUSE SOMEONE HASTO!

35. QUESTIONS