Testing in the Cloud Our experience of testing software that is “out there”
Introduction <ul><li>The Presenters </li></ul><ul><ul><li>Paul Selway –  [email_address] </li></ul></ul><ul><ul><li>Scott ...
What is “The Cloud”? <ul><li>Internet (“The Cloud”) accessible solution </li></ul><ul><li>Off-premise multi-tenant archite...
What things are the same about testing cloud solutions? <ul><li>Requirements coverage based testing </li></ul><ul><li>Risk...
What is different about testing cloud solutions? <ul><li>Shared multi-tenant test environments </li></ul><ul><li>Security ...
Project Philosophy <ul><li>Risk-based structured testing approach {std} </li></ul><ul><li>“Exploratory Testing” to discove...
Testing Phases Overlapping Test Phases Unit / Code Coverage Inspections & Reviews Exploratory & System UAT & Pilot End-To-...
What was harder than expected? <ul><li>Isolating the architectural components for a performance test </li></ul><ul><li>Und...
System Integration Architecture
What was easier than expected? <ul><li>Getting the IT leaders to embrace change </li></ul><ul><li>Overlapping Test phases ...
Key Success Factors <ul><li>Learn the “Out of the Box” cloud application features, security model, and configuration capab...
Questions?
Contact Info <ul><li>Scott Rostal –  [email_address] </li></ul><ul><ul><li>Performance Lead, Thrivent Financial for Luther...
Upcoming SlideShare
Loading in...5
×

Details...

230

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
230
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Details...

  1. 1. Testing in the Cloud Our experience of testing software that is “out there”
  2. 2. Introduction <ul><li>The Presenters </li></ul><ul><ul><li>Paul Selway – [email_address] </li></ul></ul><ul><ul><li>Scott Rostal – [email_address] </li></ul></ul><ul><li>What is “The Cloud”? </li></ul><ul><li>What is different / the same for cloud testers? </li></ul><ul><li>Testing Philosophy / Test phases </li></ul><ul><li>What was easier / harder than expected? </li></ul><ul><li>Key success factors </li></ul><ul><li>Questions? </li></ul>
  3. 3. What is “The Cloud”? <ul><li>Internet (“The Cloud”) accessible solution </li></ul><ul><li>Off-premise multi-tenant architecture </li></ul><ul><li>Accessed via a browser (PC or Wireless) </li></ul><ul><li>Delivered as Software as a Service (SaaS) </li></ul><ul><li>Common cloud companies are: </li></ul><ul><li>Google, Amazon, WorkDay, and Salesforce </li></ul>
  4. 4. What things are the same about testing cloud solutions? <ul><li>Requirements coverage based testing </li></ul><ul><li>Risk-based structured test approach </li></ul><ul><li>Test Plan / Test Phases </li></ul><ul><li>Test Cases / Test Data / Test Automation </li></ul><ul><li>Defect Management / Functional Test </li></ul><ul><li>Use of off-shore resources / Virtualization </li></ul><ul><li>Politics {Quality / Schedule / Resources} </li></ul>
  5. 5. What is different about testing cloud solutions? <ul><li>Shared multi-tenant test environments </li></ul><ul><li>Security (Test User IDs / SSO) </li></ul><ul><li>Integration of on/off premise systems </li></ul><ul><li>Performance / volume test </li></ul><ul><li>Defect isolation </li></ul><ul><li>Documentation of “Out Of the Box” reqs </li></ul><ul><li>Release Management </li></ul>
  6. 6. Project Philosophy <ul><li>Risk-based structured testing approach {std} </li></ul><ul><li>“Exploratory Testing” to discover the out of the box cloud solution features {non-std} </li></ul><ul><li>Data Migration – Moving legacy data off premise {Non-Std} </li></ul><ul><li>Performance / volume test only our new infrastructure – not the cloud app {Non-Std} </li></ul>
  7. 7. Testing Phases Overlapping Test Phases Unit / Code Coverage Inspections & Reviews Exploratory & System UAT & Pilot End-To-End Integration A mix of waterfall (with heavy phase overlapping), and iterative delivery Load & Performance Data Migration
  8. 8. What was harder than expected? <ul><li>Isolating the architectural components for a performance test </li></ul><ul><li>Understanding that a cloud solution vendor delivers new releases which you have to take! </li></ul><ul><li>Accepting that you have a “black box” in your environment </li></ul><ul><li>Determining who owns defects </li></ul><ul><li>Data Migration Mock Runs </li></ul>
  9. 9. System Integration Architecture
  10. 10. What was easier than expected? <ul><li>Getting the IT leaders to embrace change </li></ul><ul><li>Overlapping Test phases </li></ul><ul><li>End User Adoption </li></ul><ul><li>Use of off-shored test resources </li></ul><ul><ul><li>Functional </li></ul></ul><ul><ul><li>Performance </li></ul></ul><ul><ul><li>Data ETL </li></ul></ul>
  11. 11. Key Success Factors <ul><li>Learn the “Out of the Box” cloud application features, security model, and configuration capabilities </li></ul><ul><li>Understand the holistic system architecture </li></ul><ul><li>Understand the migrated test data </li></ul><ul><li>Establish tight communications with the vendor </li></ul>
  12. 12. Questions?
  13. 13. Contact Info <ul><li>Scott Rostal – [email_address] </li></ul><ul><ul><li>Performance Lead, Thrivent Financial for Lutherans </li></ul></ul><ul><li>Paul Selway – [email_address] </li></ul><ul><ul><li>President, Red Path Consulting Group </li></ul></ul>
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×