The document discusses testing of the healthcare.gov website which cost $840 million to build but had only 6 users register on the first day. It went over budget to $2 billion and took 2 months to recover technically. The document provides an overview of testing types like functionality, usability, compatibility, performance, security, localization, and 508 compliance testing. It discusses concepts like critical path analysis, risk-based testing, mind mapping, and testing web applications using a case study of the Triangle App.
2. $840mn invested in building the site healthcare.gov
6 users registered on the first day
The site took 2 months to recover technically
And the budget shot to ~$2 bn towards the end of campaign
Research has shown that over the past 10 years,
94% of large federal information technology projects were unsuccessful, more than
50% were delayed, over budget, or didn’t meet expectations and a total of 41.4%were judged to be complete failures.
3. YES, we are pessimistic
YES, we are picky
YES, we know what sucks and why
BUT, we don’t know what would happen if we don’t test
4. Web Based Applications
Triangle App – Case Study
Testing is not checking
Different Hats of a Tester
Critical Path Analysis
Risk Based Testing
Mind Mapping
Q&A
5.
6. Triangle App by Michael Bolton
Lets Think of Some Tests for this one?
7. Why was the site built?
What’s the objective behind this?
Who is it targeted to?
Is the site complete ? Is it ready to be tested?
Does the original requirements reflect on site now?
What is the critical path?
What is at Stake?
10. Clarify your mission
Analyse your product
Analyse risks
Define Strategy
Plan Logistics
Share the Plan
• Structure
• Function
• Data
• Interfaces
• Platforms
• Operation
• Time
• Smoke/Sanity
• Learn/Explore
• Retest/Regress
• Report
• Repeat
Context Driven Plan Things To Test Roadmap
13. Make a list of risks.
Product Risks
Project Risks
Risk catalogs/watch lists/matrices
Risk Prioritization
Perform testing that explores each risk.
As risks evaporate and new ones emerge, adjust your test effort to stay focused on
the current crop
18. Does your site need compatibility testing?
Is your site built on a responsive (mobile
friendly) framework?
If yes, does it work so?
How do we test it for compatibility
How to choose for which browsers to pick up
Is your site performance optimized for
Mobile and low bandwidths?
If yes, does it work so?
How do we test for AMP
19. We all know Jmeter, but have we understood
our applications performance needs yet?
Is the application built around high speed
response or it will be done later?
What is concurrency and how do I calculate it?
I want to know single page performance for a
web-page?
I want to understand my servers performance
I want to make sure my website is not
penalized by Google for its shabby
performance
20. What is the ultimate goal of security testing?
AAA
Authentication
Authorization
Availability
21.
22. Ever realized the importance of localisation?
Ever wondered how to test for i18n?
How to start
Where are the caveats?
What is the reward of testing for i18n?
Case Study
23. Know what is 508 compliance testing
Know the need of compliance
Know how it can be tested
Few examples
Case study
24. James Bach: www.satisfice.com
Michael Bolton: www.developsense.com
Ministry of Testing: http://www.ministryoftesting.com/resources/exploratory-
testing/
Presentation on Mindmaps and Exploratory Testing By
Ajay Balamurgadas
Meeta Prakash
Lots of Stats available on wikipedia and leading online publishers
25. 12 years of overall working experience in the core industry
Worked for Education, Finance & Travel sectors
Switched roles between a developer, QA engineer, Business
Analyst and many more
Now an entrepreneur running a web development firm and a test
consultancy
Easy to connect with and loves to travel
Call/Whatsapp - 9920996021
Email : younus@rethinkingweb.com