Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Testing in the CloudOur experience of testing software        that is “out there”
Introduction- The Presenters    - Paul Selway – paul_selway@redpathcg.com    - Scott Rostal – scott.rostal@thrivent.com-  ...
What is “The Cloud”?•   Internet (“The Cloud”) accessible solution•   Off-premise multi-tenant architecture•   Accessed vi...
What things are the same about       testing cloud solutions?   Requirements coverage based testing   Risk-based structu...
What is different about testing         cloud solutions?Shared multi-tenant test environmentsSecurity (Test User IDs / S...
Project Philosophy• Risk-based structured testing approach {std}• “Exploratory Testing” to discover the out of  the box cl...
Testing Phases                Inspections                       End-To-End                      Data                 & Rev...
What was harder than expected?• Isolating the architectural components for a  performance test• Understanding that a cloud...
System Integration Architecture
What was easier than expected?•   Getting the IT leaders to embrace change•   Overlapping Test phases•   End User Adoption...
Key Success Factors• Learn the “Out of the Box” cloud application  features, security model, and configuration  capabiliti...
Questions?
Contact Info• Scott Rostal – scott.rostal@thrivent.com  Performance Lead, Thrivent Financial for Lutherans• Paul Selway – ...
Upcoming SlideShare
Loading in …5
×

Testing in the cloud

391 views

Published on

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Testing in the cloud

  1. 1. Testing in the CloudOur experience of testing software that is “out there”
  2. 2. Introduction- The Presenters - Paul Selway – paul_selway@redpathcg.com - Scott Rostal – scott.rostal@thrivent.com- What is “The Cloud”?- What is different / the same for cloud testers?- Testing Philosophy / Test phases- What was easier / harder than expected?- Key success factors- Questions?
  3. 3. What is “The Cloud”?• Internet (“The Cloud”) accessible solution• Off-premise multi-tenant architecture• Accessed via a browser (PC or Wireless)• Delivered as Software as a Service (SaaS)Common cloud companies are: Google, Amazon, WorkDay, and Salesforce
  4. 4. What things are the same about testing cloud solutions? Requirements coverage based testing Risk-based structured test approach Test Plan / Test Phases Test Cases / Test Data / Test Automation Defect Management / Functional Test Use of off-shore resources / Virtualization Politics {Quality / Schedule / Resources}
  5. 5. What is different about testing cloud solutions?Shared multi-tenant test environmentsSecurity (Test User IDs / SSO)Integration of on/off premise systemsPerformance / volume testDefect isolationDocumentation of “Out Of the Box” reqsRelease Management
  6. 6. Project Philosophy• Risk-based structured testing approach {std}• “Exploratory Testing” to discover the out of the box cloud solution features {non-std}• Data Migration – Moving legacy data off premise {Non-Std}• Performance / volume test only our new infrastructure – not the cloud app {Non-Std}
  7. 7. Testing Phases Inspections End-To-End Data & Reviews Integration Migration Unit / Code Exploratory Load & UAT & Coverage & System Performance Pilot Overlapping Test PhasesA mix of waterfall (with heavy phase overlapping), and iterative delivery
  8. 8. What was harder than expected?• Isolating the architectural components for a performance test• Understanding that a cloud solution vendor delivers new releases which you have to take!• Accepting that you have a “black box” in your environment• Determining who owns defects• Data Migration Mock Runs
  9. 9. System Integration Architecture
  10. 10. What was easier than expected?• Getting the IT leaders to embrace change• Overlapping Test phases• End User Adoption• Use of off-shored test resources – Functional – Performance – Data ETL
  11. 11. Key Success Factors• Learn the “Out of the Box” cloud application features, security model, and configuration capabilities• Understand the holistic system architecture• Understand the migrated test data• Establish tight communications with the vendor
  12. 12. Questions?
  13. 13. Contact Info• Scott Rostal – scott.rostal@thrivent.com Performance Lead, Thrivent Financial for Lutherans• Paul Selway – Paul_Selway@redpathcg.com President, Red Path Consulting Group

×