SlideShare a Scribd company logo
Testing a SaaS Platform
About me - Joel Montvelisky

PractiTest – Co Founder & Prod. Architect

QA Instructor & Consultant

Mercury Interactive - QA Manager (retired )
             TD, QC, WR, QTP, etc


ITCB (IL) Advisory Board

QABlog.practitest.com

                        © 2010 -
Today’s Agenda

  SaaS - Software as a Service


  Things we Can Stop Testing


  Non-trivial Stuff to Think About & TEST


  Leveraging Live Feedback into the Testing Lifecycle


  Open Season for Questions…


                        © 2010 -
What is SaaS?



    © 2010 -
Software as a Service

  Hosted Platforms
       – Total Control
       – No Maintenance

  No Client Installations

  Customers buys each month – keep them happy 


               Users don’t care it is SaaS,
        it needs to be better than the alternative



                          © 2010 -
SaaS QA Management

  End-to-End QA Management (Reqs – Tests – Bugs)

  Enterprise Level SaaS Solution
       - Methodology
       - Customizations & Flexibility

  Global platform
       - Communication
       - Languages
       - Available 24x7 Worldwide

  Intuitive & Simple

  Agile Dev, RoR, on Amazon EC2
                          © 2010 -
What does SaaS mean
to the Testing Process?



        © 2010 -
Things we can STOP Testing

✘  Client or Server installations



✘  Multiplatform backend support



✘  Multiple version upgrades


                                       “Savings” of approx. 1/3
✘  Backwards compatibility          of the Traditional Enterprise
                                     Application Testing Cycle



                        © 2010 -
The regular testing scenarios

  Functionality
       - Manual scripts
       - Exploratory sessions            Agile Sprints & Updates
       - Checklists                           of 3 – 4 weeks
       - End-2-End Scenarios
       - Selenium                          Each sprint’s cycle is
       - Cucumber & RSpec                  based on its content


  Load & Stress

  Multi-platform & Multi-browser support

  I18N
       English, Swedish, German, Chinese Simplified, Hebrew

                           © 2010 -
Non-trivial stuff to think about & TEST

1. Remote accessibility & usage

  Staging Servers in USA - Amazon EC2
        Development & Testing teams in Israel (& WW collaborators)


  Globally distributed
  monitoring services

  (www.pingdom.com)




                           © 2010 -
Non-trivial stuff to think about & TEST

2. Security
 Application-related:                     Infrastructure-based:

     Cross-site scripting                    Secured communication

     SQL injections                          Backups & storage policies

     HTTP header injections                  Controlled Access to the
                                               site & servers
      etc…




                               © 2010 -
Non-trivial stuff to think about & TEST

3. Live updates & deployments (3 to 4 weeks)
     No concrete separation between Dev & IT
     Minimal service disruption
     Dressed rehearsals (including rollbacks!)
     Automated sanity & manual verification


     Patches & hot-fixes (extraordinary occasions )
     Prove of Concepts & Beta Releases

                       QA & Testing as a facilitator for Balance:
                       Stable & Professional, yet Flexible Environment

                               © 2010 -
Non-trivial stuff to think about & TEST

4. Disaster recovery procedures
Two Main scenarios:
  (a) System down to be brought up quickly

           Configure machines

           Install & deploy software

           Restore data
                                             Define a policy & schedule regular
                                             drills to ensure you can achieve it!
  (b) Rollback to last known stable data
     (with or without data restore)



                                 © 2010 -
Leveraging Real Data
into the Testing Process



         © 2010 -
Levering live feedback into
         the Testing Process

(1) Internally developed monitoring tools
 - Check usage patterns
                                                            No need to
 - Validate need & usability assumptions                continue guessing!!!

 - Analyze patterns and create realistic & prioritized testing scenarios




                               © 2010 -
Levering live feedback into
           the Testing Process

(2) Site Monitoring systems
 LiveAdmin (www.liveadmin.net)
     Real-time usage to schedule updates

     Allow users to contact the company
      with questions or issues



 Pingdom (www.pingdom.com)
     Up to date response times for real projects and data.

     Proactive alerts when things start slowing down




                                    © 2010 -
Levering live feedback into
           the Testing Process

(3) Proactive mail notifications on issues

                   (www.hoptoad.com)

     Real-time notifications on issues on the system.

     Information about the issue including system parameters that allow you to do an
      initial trouble-shoot of the issue




                                    © 2010 -
Levering live feedback into
           the Testing Process

(4) Ask users for Real Projects

     No better way to test than using real data


     Most users will trust you not to abuse their information in exchange for
      assurance of working software


     Since the data sits in your system it is easier to copy projects to your
      testing environment


  Need to be careful with who has access to the data; making sure your
      testing environment is as secured as your production environment



                                  © 2010 -
Wrapping up…




   © 2010 -
Wrapping up

  SaaS is only the delivery model, customers will not compromise
  on Functionality, Stability or Response Time

  Since the system is hosted you can save all tests related to backend
  installation and support

  You need to pay more attention to stuff like accessibility, security,
  deployments & DRPs

  The lines between the R&D and IT organizations in SaaS are blurry


  SaaS application allows better access to real data to be leveraged to
  improve the effectiveness of our testing operations.
                              © 2010 -
Open Season
for questions!



    © 2010 -
Special thanks to Anne-Marie Charrett 


      joel@practitest.com
  http://qablog.practitest.com

            © 2010 -

More Related Content

What's hot

Adopting Cloud Testing for Continuous Delivery, with the premier global provi...
Adopting Cloud Testing for Continuous Delivery, with the premier global provi...Adopting Cloud Testing for Continuous Delivery, with the premier global provi...
Adopting Cloud Testing for Continuous Delivery, with the premier global provi...
SOASTA
 
Cloud Testing by Suganya M
Cloud Testing by Suganya MCloud Testing by Suganya M
Cloud Testing by Suganya M
Forziatech
 
Cloud based testing
Cloud based testingCloud based testing
Cloud based testing
Muhammadu Isa
 
Cloud_Testing_The_future_of_softwareV1.04
Cloud_Testing_The_future_of_softwareV1.04Cloud_Testing_The_future_of_softwareV1.04
Cloud_Testing_The_future_of_softwareV1.04
Mrityunjaya Hikkalgutti
 
A Year of “Testing” the Cloud for Development and Test
A Year of “Testing” the Cloud for Development and TestA Year of “Testing” the Cloud for Development and Test
A Year of “Testing” the Cloud for Development and Test
TechWell
 
Cloud Testing Framework
Cloud Testing FrameworkCloud Testing Framework
Cloud Testing Framework
Crescencio Rodrigues Lima Neto
 
Testing the Migration of Monolithic Applications to Microservices on the Cloud
Testing the Migration of Monolithic Applications to Microservices on the CloudTesting the Migration of Monolithic Applications to Microservices on the Cloud
Testing the Migration of Monolithic Applications to Microservices on the Cloud
Nagarro
 
Applying a Comprehensive, Automated Assurance Framework to Validate Cloud Rea...
Applying a Comprehensive, Automated Assurance Framework to Validate Cloud Rea...Applying a Comprehensive, Automated Assurance Framework to Validate Cloud Rea...
Applying a Comprehensive, Automated Assurance Framework to Validate Cloud Rea...
Cognizant
 
Taking Testing to the Cloud
Taking Testing to the CloudTaking Testing to the Cloud
Taking Testing to the Cloud
Cognizant
 
Non-functional Issues in Cloud Based Systems by Kees Blokland and Martin Pol
Non-functional Issues in Cloud Based Systems by Kees Blokland and Martin PolNon-functional Issues in Cloud Based Systems by Kees Blokland and Martin Pol
Non-functional Issues in Cloud Based Systems by Kees Blokland and Martin Pol
Kees Blokland
 
Creating Complete Test Environments in the Cloud: Skytap & Parasoft Webinar
Creating Complete Test Environments in the Cloud: Skytap & Parasoft WebinarCreating Complete Test Environments in the Cloud: Skytap & Parasoft Webinar
Creating Complete Test Environments in the Cloud: Skytap & Parasoft Webinar
Skytap Cloud
 
Webinar: Automating the Creation and Use of Virtual Testing Environments
Webinar: Automating the Creation and Use of Virtual Testing Environments Webinar: Automating the Creation and Use of Virtual Testing Environments
Webinar: Automating the Creation and Use of Virtual Testing Environments
Skytap Cloud
 
Cloud Testing - A New Age Approach to Testing
Cloud Testing - A New Age Approach to TestingCloud Testing - A New Age Approach to Testing
Cloud Testing - A New Age Approach to Testing
Software Testing Solution
 
Cloud Testing: The Future of software Testing
Cloud Testing: The Future of software TestingCloud Testing: The Future of software Testing
Cloud Testing: The Future of software Testing
BugRaptors
 
Getting ready for Infrastructure Transformation with hyper-converged
Getting ready for Infrastructure Transformation with hyper-convergedGetting ready for Infrastructure Transformation with hyper-converged
Getting ready for Infrastructure Transformation with hyper-converged
Synapse360
 
Virtualization impact in software testing
Virtualization impact in software testingVirtualization impact in software testing
Virtualization impact in software testing
vodQA
 
Plan, Deploy & Manage Modern Applications Leveraging vCloud Automation Center...
Plan, Deploy & Manage Modern Applications Leveraging vCloud Automation Center...Plan, Deploy & Manage Modern Applications Leveraging vCloud Automation Center...
Plan, Deploy & Manage Modern Applications Leveraging vCloud Automation Center...
Puppet
 
From Relational Database Management to Big Data: Solutions for Data Migration...
From Relational Database Management to Big Data: Solutions for Data Migration...From Relational Database Management to Big Data: Solutions for Data Migration...
From Relational Database Management to Big Data: Solutions for Data Migration...
Cognizant
 
What is the PaaS?
What is the PaaS?What is the PaaS?
What is the PaaS?
CloudBees
 
Performance Testing Cloud-Based Systems
Performance Testing Cloud-Based SystemsPerformance Testing Cloud-Based Systems
Performance Testing Cloud-Based Systems
TechWell
 

What's hot (20)

Adopting Cloud Testing for Continuous Delivery, with the premier global provi...
Adopting Cloud Testing for Continuous Delivery, with the premier global provi...Adopting Cloud Testing for Continuous Delivery, with the premier global provi...
Adopting Cloud Testing for Continuous Delivery, with the premier global provi...
 
Cloud Testing by Suganya M
Cloud Testing by Suganya MCloud Testing by Suganya M
Cloud Testing by Suganya M
 
Cloud based testing
Cloud based testingCloud based testing
Cloud based testing
 
Cloud_Testing_The_future_of_softwareV1.04
Cloud_Testing_The_future_of_softwareV1.04Cloud_Testing_The_future_of_softwareV1.04
Cloud_Testing_The_future_of_softwareV1.04
 
A Year of “Testing” the Cloud for Development and Test
A Year of “Testing” the Cloud for Development and TestA Year of “Testing” the Cloud for Development and Test
A Year of “Testing” the Cloud for Development and Test
 
Cloud Testing Framework
Cloud Testing FrameworkCloud Testing Framework
Cloud Testing Framework
 
Testing the Migration of Monolithic Applications to Microservices on the Cloud
Testing the Migration of Monolithic Applications to Microservices on the CloudTesting the Migration of Monolithic Applications to Microservices on the Cloud
Testing the Migration of Monolithic Applications to Microservices on the Cloud
 
Applying a Comprehensive, Automated Assurance Framework to Validate Cloud Rea...
Applying a Comprehensive, Automated Assurance Framework to Validate Cloud Rea...Applying a Comprehensive, Automated Assurance Framework to Validate Cloud Rea...
Applying a Comprehensive, Automated Assurance Framework to Validate Cloud Rea...
 
Taking Testing to the Cloud
Taking Testing to the CloudTaking Testing to the Cloud
Taking Testing to the Cloud
 
Non-functional Issues in Cloud Based Systems by Kees Blokland and Martin Pol
Non-functional Issues in Cloud Based Systems by Kees Blokland and Martin PolNon-functional Issues in Cloud Based Systems by Kees Blokland and Martin Pol
Non-functional Issues in Cloud Based Systems by Kees Blokland and Martin Pol
 
Creating Complete Test Environments in the Cloud: Skytap & Parasoft Webinar
Creating Complete Test Environments in the Cloud: Skytap & Parasoft WebinarCreating Complete Test Environments in the Cloud: Skytap & Parasoft Webinar
Creating Complete Test Environments in the Cloud: Skytap & Parasoft Webinar
 
Webinar: Automating the Creation and Use of Virtual Testing Environments
Webinar: Automating the Creation and Use of Virtual Testing Environments Webinar: Automating the Creation and Use of Virtual Testing Environments
Webinar: Automating the Creation and Use of Virtual Testing Environments
 
Cloud Testing - A New Age Approach to Testing
Cloud Testing - A New Age Approach to TestingCloud Testing - A New Age Approach to Testing
Cloud Testing - A New Age Approach to Testing
 
Cloud Testing: The Future of software Testing
Cloud Testing: The Future of software TestingCloud Testing: The Future of software Testing
Cloud Testing: The Future of software Testing
 
Getting ready for Infrastructure Transformation with hyper-converged
Getting ready for Infrastructure Transformation with hyper-convergedGetting ready for Infrastructure Transformation with hyper-converged
Getting ready for Infrastructure Transformation with hyper-converged
 
Virtualization impact in software testing
Virtualization impact in software testingVirtualization impact in software testing
Virtualization impact in software testing
 
Plan, Deploy & Manage Modern Applications Leveraging vCloud Automation Center...
Plan, Deploy & Manage Modern Applications Leveraging vCloud Automation Center...Plan, Deploy & Manage Modern Applications Leveraging vCloud Automation Center...
Plan, Deploy & Manage Modern Applications Leveraging vCloud Automation Center...
 
From Relational Database Management to Big Data: Solutions for Data Migration...
From Relational Database Management to Big Data: Solutions for Data Migration...From Relational Database Management to Big Data: Solutions for Data Migration...
From Relational Database Management to Big Data: Solutions for Data Migration...
 
What is the PaaS?
What is the PaaS?What is the PaaS?
What is the PaaS?
 
Performance Testing Cloud-Based Systems
Performance Testing Cloud-Based SystemsPerformance Testing Cloud-Based Systems
Performance Testing Cloud-Based Systems
 

Viewers also liked

Testing SAAS, how to go about it?
Testing SAAS, how to go about it?Testing SAAS, how to go about it?
Testing SAAS, how to go about it?
Tomek Borek
 
Cloud testing
Cloud testingCloud testing
Cloud testing
Sachin Aralikatti
 
Cloud testing
Cloud testingCloud testing
Cloud testing
Md. Mahedi Mahfuj
 
Cloud testing
Cloud testingCloud testing
Cloud testing
Khizra Sammad
 
Coaching Testing
Coaching Testing Coaching Testing
Coaching Testing
Anne-Marie Charrett
 
Software as a Service - Concepts and Implementation
Software as a Service - Concepts and ImplementationSoftware as a Service - Concepts and Implementation
Software as a Service - Concepts and Implementation
ogglog
 
Performance testing in scope of migration to cloud by Serghei Radov
Performance testing in scope of migration to cloud by Serghei RadovPerformance testing in scope of migration to cloud by Serghei Radov
Performance testing in scope of migration to cloud by Serghei Radov
Valeriia Maliarenko
 
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
SOASTA
 
Beaker: Automated, Cloud-Based Acceptance Testing - PuppetConf 2014
Beaker: Automated, Cloud-Based Acceptance Testing - PuppetConf 2014Beaker: Automated, Cloud-Based Acceptance Testing - PuppetConf 2014
Beaker: Automated, Cloud-Based Acceptance Testing - PuppetConf 2014
Puppet
 
Testing capability ppt
Testing capability pptTesting capability ppt
Testing capability ppt
anilreddyqa
 
TRASYS Testing As A Service
TRASYS Testing As A ServiceTRASYS Testing As A Service
TRASYS Testing As A Service
Hans Cortoos
 
Spiral model explanation
Spiral model  explanationSpiral model  explanation
Spiral model explanation
Umar Farooq
 
Agile presentation
Agile presentationAgile presentation
Agile presentation
infolock
 
Manual testing interview question by INFOTECH
Manual testing interview question by INFOTECHManual testing interview question by INFOTECH
Manual testing interview question by INFOTECH
Pravinsinh
 
How to Develop Your SaaS Pricing Model
How to Develop Your SaaS Pricing ModelHow to Develop Your SaaS Pricing Model
How to Develop Your SaaS Pricing Model
Lincoln Murphy
 
The SaaS business model
The SaaS business modelThe SaaS business model
The SaaS business model
David Skok
 
Webservices Overview : XML RPC, SOAP and REST
Webservices Overview : XML RPC, SOAP and RESTWebservices Overview : XML RPC, SOAP and REST
Webservices Overview : XML RPC, SOAP and REST
Pradeep Kumar
 
Overview of Agile Methodology
Overview of Agile MethodologyOverview of Agile Methodology
Overview of Agile Methodology
Haresh Karkar
 
Upfront LP Survey of the Venture Capital & Startup Industry
Upfront LP Survey of the Venture Capital & Startup IndustryUpfront LP Survey of the Venture Capital & Startup Industry
Upfront LP Survey of the Venture Capital & Startup Industry
Mark Suster
 
Upfront Ventures VC Survey 2017
Upfront Ventures VC Survey 2017Upfront Ventures VC Survey 2017
Upfront Ventures VC Survey 2017
Mark Suster
 

Viewers also liked (20)

Testing SAAS, how to go about it?
Testing SAAS, how to go about it?Testing SAAS, how to go about it?
Testing SAAS, how to go about it?
 
Cloud testing
Cloud testingCloud testing
Cloud testing
 
Cloud testing
Cloud testingCloud testing
Cloud testing
 
Cloud testing
Cloud testingCloud testing
Cloud testing
 
Coaching Testing
Coaching Testing Coaching Testing
Coaching Testing
 
Software as a Service - Concepts and Implementation
Software as a Service - Concepts and ImplementationSoftware as a Service - Concepts and Implementation
Software as a Service - Concepts and Implementation
 
Performance testing in scope of migration to cloud by Serghei Radov
Performance testing in scope of migration to cloud by Serghei RadovPerformance testing in scope of migration to cloud by Serghei Radov
Performance testing in scope of migration to cloud by Serghei Radov
 
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
How To Use Jenkins for Continuous Load and Mobile Testing with SOASTA & Cloud...
 
Beaker: Automated, Cloud-Based Acceptance Testing - PuppetConf 2014
Beaker: Automated, Cloud-Based Acceptance Testing - PuppetConf 2014Beaker: Automated, Cloud-Based Acceptance Testing - PuppetConf 2014
Beaker: Automated, Cloud-Based Acceptance Testing - PuppetConf 2014
 
Testing capability ppt
Testing capability pptTesting capability ppt
Testing capability ppt
 
TRASYS Testing As A Service
TRASYS Testing As A ServiceTRASYS Testing As A Service
TRASYS Testing As A Service
 
Spiral model explanation
Spiral model  explanationSpiral model  explanation
Spiral model explanation
 
Agile presentation
Agile presentationAgile presentation
Agile presentation
 
Manual testing interview question by INFOTECH
Manual testing interview question by INFOTECHManual testing interview question by INFOTECH
Manual testing interview question by INFOTECH
 
How to Develop Your SaaS Pricing Model
How to Develop Your SaaS Pricing ModelHow to Develop Your SaaS Pricing Model
How to Develop Your SaaS Pricing Model
 
The SaaS business model
The SaaS business modelThe SaaS business model
The SaaS business model
 
Webservices Overview : XML RPC, SOAP and REST
Webservices Overview : XML RPC, SOAP and RESTWebservices Overview : XML RPC, SOAP and REST
Webservices Overview : XML RPC, SOAP and REST
 
Overview of Agile Methodology
Overview of Agile MethodologyOverview of Agile Methodology
Overview of Agile Methodology
 
Upfront LP Survey of the Venture Capital & Startup Industry
Upfront LP Survey of the Venture Capital & Startup IndustryUpfront LP Survey of the Venture Capital & Startup Industry
Upfront LP Survey of the Venture Capital & Startup Industry
 
Upfront Ventures VC Survey 2017
Upfront Ventures VC Survey 2017Upfront Ventures VC Survey 2017
Upfront Ventures VC Survey 2017
 

Similar to Testing a SaaS Platform

TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
SOASTA
 
Mobile Monitoring Best Practices
Mobile Monitoring Best PracticesMobile Monitoring Best Practices
Mobile Monitoring Best Practices
Lizzy Guido (she/her)
 
Using IBM Rational Change as an Enterprise-Wide Error Management Solution – ...
 Using IBM Rational Change as an Enterprise-Wide Error Management Solution – ... Using IBM Rational Change as an Enterprise-Wide Error Management Solution – ...
Using IBM Rational Change as an Enterprise-Wide Error Management Solution – ...
Contribyte
 
Improving Quality through Continuous Integration - A case study of CollabNet
Improving Quality through Continuous Integration - A case study of CollabNetImproving Quality through Continuous Integration - A case study of CollabNet
Improving Quality through Continuous Integration - A case study of CollabNet
Venkat Janardhanam, MS, MBA
 
Dev ops for mainframe innovate session 2402
Dev ops for mainframe innovate session 2402Dev ops for mainframe innovate session 2402
Dev ops for mainframe innovate session 2402
Rosalind Radcliffe
 
Ibm innovate ci for system z
Ibm innovate ci for system zIbm innovate ci for system z
Ibm innovate ci for system z
Rosalind Radcliffe
 
Anu_Sharma2016_DWH
Anu_Sharma2016_DWHAnu_Sharma2016_DWH
Anu_Sharma2016_DWH
Anu Sharma
 
A Blueprint for a Successful DevOps Metamorphosis
A Blueprint for a Successful DevOps MetamorphosisA Blueprint for a Successful DevOps Metamorphosis
A Blueprint for a Successful DevOps Metamorphosis
XebiaLabs
 
Improving DevOps through Cloud Automation and Management - Real-World Rocket ...
Improving DevOps through Cloud Automation and Management - Real-World Rocket ...Improving DevOps through Cloud Automation and Management - Real-World Rocket ...
Improving DevOps through Cloud Automation and Management - Real-World Rocket ...
Ostrato
 
2016 Federal User Group Conference - DevOps Product Strategy
2016 Federal User Group Conference - DevOps Product Strategy2016 Federal User Group Conference - DevOps Product Strategy
2016 Federal User Group Conference - DevOps Product Strategy
CollabNet
 
No Devops Without Continuous Testing
No Devops Without Continuous TestingNo Devops Without Continuous Testing
No Devops Without Continuous Testing
Parasoft
 
VCS_QAPerformanceSlides
VCS_QAPerformanceSlidesVCS_QAPerformanceSlides
VCS_QAPerformanceSlides
Michael Cowan
 
Visual Studio 2015 - Lançamento está próximo
Visual Studio 2015 - Lançamento está próximoVisual Studio 2015 - Lançamento está próximo
Visual Studio 2015 - Lançamento está próximo
Daniel Semedo
 
KARUNANIDHI E_ QA_SOFTWARE TESTING 5+ YEARS EXP IN AUTOMATION(Selenium) & MAN...
KARUNANIDHI E_ QA_SOFTWARE TESTING 5+ YEARS EXP IN AUTOMATION(Selenium) & MAN...KARUNANIDHI E_ QA_SOFTWARE TESTING 5+ YEARS EXP IN AUTOMATION(Selenium) & MAN...
KARUNANIDHI E_ QA_SOFTWARE TESTING 5+ YEARS EXP IN AUTOMATION(Selenium) & MAN...
KARUNANIDHI ETHIRAJ
 
Architecting for Continuous Delivery
Architecting for Continuous DeliveryArchitecting for Continuous Delivery
Architecting for Continuous Delivery
Mohammad Bilal Wahla
 
Continuous Testing
Continuous TestingContinuous Testing
Continuous Testing
SOASTA
 
Managing Continuous Delivery of Mobile Apps - for the Enterprise
Managing Continuous Delivery of Mobile Apps - for the EnterpriseManaging Continuous Delivery of Mobile Apps - for the Enterprise
Managing Continuous Delivery of Mobile Apps - for the Enterprise
Sauce Labs
 
DevOps : Integrate, Deliver and Deploy continuously with Visual Studio Team S...
DevOps : Integrate, Deliver and Deploy continuously with Visual Studio Team S...DevOps : Integrate, Deliver and Deploy continuously with Visual Studio Team S...
DevOps : Integrate, Deliver and Deploy continuously with Visual Studio Team S...
BAINIDA
 
XebiaLabs, CloudBees, Puppet Labs Webinar Slides - IT Automation for the Mode...
XebiaLabs, CloudBees, Puppet Labs Webinar Slides - IT Automation for the Mode...XebiaLabs, CloudBees, Puppet Labs Webinar Slides - IT Automation for the Mode...
XebiaLabs, CloudBees, Puppet Labs Webinar Slides - IT Automation for the Mode...
XebiaLabs
 
Leveraging Analytics for DevOps
Leveraging Analytics for DevOpsLeveraging Analytics for DevOps
Leveraging Analytics for DevOps
Michael Floyd
 

Similar to Testing a SaaS Platform (20)

TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
TechWell Accelerating Software Delivery with Continuous Integration feat. Dan...
 
Mobile Monitoring Best Practices
Mobile Monitoring Best PracticesMobile Monitoring Best Practices
Mobile Monitoring Best Practices
 
Using IBM Rational Change as an Enterprise-Wide Error Management Solution – ...
 Using IBM Rational Change as an Enterprise-Wide Error Management Solution – ... Using IBM Rational Change as an Enterprise-Wide Error Management Solution – ...
Using IBM Rational Change as an Enterprise-Wide Error Management Solution – ...
 
Improving Quality through Continuous Integration - A case study of CollabNet
Improving Quality through Continuous Integration - A case study of CollabNetImproving Quality through Continuous Integration - A case study of CollabNet
Improving Quality through Continuous Integration - A case study of CollabNet
 
Dev ops for mainframe innovate session 2402
Dev ops for mainframe innovate session 2402Dev ops for mainframe innovate session 2402
Dev ops for mainframe innovate session 2402
 
Ibm innovate ci for system z
Ibm innovate ci for system zIbm innovate ci for system z
Ibm innovate ci for system z
 
Anu_Sharma2016_DWH
Anu_Sharma2016_DWHAnu_Sharma2016_DWH
Anu_Sharma2016_DWH
 
A Blueprint for a Successful DevOps Metamorphosis
A Blueprint for a Successful DevOps MetamorphosisA Blueprint for a Successful DevOps Metamorphosis
A Blueprint for a Successful DevOps Metamorphosis
 
Improving DevOps through Cloud Automation and Management - Real-World Rocket ...
Improving DevOps through Cloud Automation and Management - Real-World Rocket ...Improving DevOps through Cloud Automation and Management - Real-World Rocket ...
Improving DevOps through Cloud Automation and Management - Real-World Rocket ...
 
2016 Federal User Group Conference - DevOps Product Strategy
2016 Federal User Group Conference - DevOps Product Strategy2016 Federal User Group Conference - DevOps Product Strategy
2016 Federal User Group Conference - DevOps Product Strategy
 
No Devops Without Continuous Testing
No Devops Without Continuous TestingNo Devops Without Continuous Testing
No Devops Without Continuous Testing
 
VCS_QAPerformanceSlides
VCS_QAPerformanceSlidesVCS_QAPerformanceSlides
VCS_QAPerformanceSlides
 
Visual Studio 2015 - Lançamento está próximo
Visual Studio 2015 - Lançamento está próximoVisual Studio 2015 - Lançamento está próximo
Visual Studio 2015 - Lançamento está próximo
 
KARUNANIDHI E_ QA_SOFTWARE TESTING 5+ YEARS EXP IN AUTOMATION(Selenium) & MAN...
KARUNANIDHI E_ QA_SOFTWARE TESTING 5+ YEARS EXP IN AUTOMATION(Selenium) & MAN...KARUNANIDHI E_ QA_SOFTWARE TESTING 5+ YEARS EXP IN AUTOMATION(Selenium) & MAN...
KARUNANIDHI E_ QA_SOFTWARE TESTING 5+ YEARS EXP IN AUTOMATION(Selenium) & MAN...
 
Architecting for Continuous Delivery
Architecting for Continuous DeliveryArchitecting for Continuous Delivery
Architecting for Continuous Delivery
 
Continuous Testing
Continuous TestingContinuous Testing
Continuous Testing
 
Managing Continuous Delivery of Mobile Apps - for the Enterprise
Managing Continuous Delivery of Mobile Apps - for the EnterpriseManaging Continuous Delivery of Mobile Apps - for the Enterprise
Managing Continuous Delivery of Mobile Apps - for the Enterprise
 
DevOps : Integrate, Deliver and Deploy continuously with Visual Studio Team S...
DevOps : Integrate, Deliver and Deploy continuously with Visual Studio Team S...DevOps : Integrate, Deliver and Deploy continuously with Visual Studio Team S...
DevOps : Integrate, Deliver and Deploy continuously with Visual Studio Team S...
 
XebiaLabs, CloudBees, Puppet Labs Webinar Slides - IT Automation for the Mode...
XebiaLabs, CloudBees, Puppet Labs Webinar Slides - IT Automation for the Mode...XebiaLabs, CloudBees, Puppet Labs Webinar Slides - IT Automation for the Mode...
XebiaLabs, CloudBees, Puppet Labs Webinar Slides - IT Automation for the Mode...
 
Leveraging Analytics for DevOps
Leveraging Analytics for DevOpsLeveraging Analytics for DevOps
Leveraging Analytics for DevOps
 

More from Anne-Marie Charrett

It takes a village to build a quality product
It takes a village to build a quality productIt takes a village to build a quality product
It takes a village to build a quality product
Anne-Marie Charrett
 
Test Management Revisited ATD2K16
Test Management Revisited ATD2K16Test Management Revisited ATD2K16
Test Management Revisited ATD2K16
Anne-Marie Charrett
 
Testing Microservices
Testing MicroservicesTesting Microservices
Testing Microservices
Anne-Marie Charrett
 
Robots, Testing and LAST
Robots, Testing and LASTRobots, Testing and LAST
Robots, Testing and LAST
Anne-Marie Charrett
 
Speak easy diversity
Speak easy diversity Speak easy diversity
Speak easy diversity
Anne-Marie Charrett
 
Develop your brand
Develop your brandDevelop your brand
Develop your brand
Anne-Marie Charrett
 
Disruptive Testing
Disruptive TestingDisruptive Testing
Disruptive Testing
Anne-Marie Charrett
 
Testing trapeze-2014-april
Testing trapeze-2014-aprilTesting trapeze-2014-april
Testing trapeze-2014-april
Anne-Marie Charrett
 
how to reduce the cost of software testing
how to reduce the cost of software testinghow to reduce the cost of software testing
how to reduce the cost of software testing
Anne-Marie Charrett
 
A story on failure
A story on failureA story on failure
A story on failure
Anne-Marie Charrett
 
Software testing
Software testingSoftware testing
Software testing
Anne-Marie Charrett
 
Creating a Context Driven Test Team
Creating a Context Driven Test TeamCreating a Context Driven Test Team
Creating a Context Driven Test Team
Anne-Marie Charrett
 
A taste of Exploratory Testing
A taste of Exploratory TestingA taste of Exploratory Testing
A taste of Exploratory Testing
Anne-Marie Charrett
 
Agile Testing
Agile Testing Agile Testing
Agile Testing
Anne-Marie Charrett
 
A Taste of Exploratory Testing
A Taste of Exploratory TestingA Taste of Exploratory Testing
A Taste of Exploratory Testing
Anne-Marie Charrett
 
Develop your inner tester
Develop your inner tester Develop your inner tester
Develop your inner tester
Anne-Marie Charrett
 
Exploratory testing workshop
Exploratory testing workshopExploratory testing workshop
Exploratory testing workshop
Anne-Marie Charrett
 
Discovering your inner tester
Discovering your inner testerDiscovering your inner tester
Discovering your inner tester
Anne-Marie Charrett
 
Startups And Software Testing
Startups And Software TestingStartups And Software Testing
Startups And Software Testing
Anne-Marie Charrett
 

More from Anne-Marie Charrett (19)

It takes a village to build a quality product
It takes a village to build a quality productIt takes a village to build a quality product
It takes a village to build a quality product
 
Test Management Revisited ATD2K16
Test Management Revisited ATD2K16Test Management Revisited ATD2K16
Test Management Revisited ATD2K16
 
Testing Microservices
Testing MicroservicesTesting Microservices
Testing Microservices
 
Robots, Testing and LAST
Robots, Testing and LASTRobots, Testing and LAST
Robots, Testing and LAST
 
Speak easy diversity
Speak easy diversity Speak easy diversity
Speak easy diversity
 
Develop your brand
Develop your brandDevelop your brand
Develop your brand
 
Disruptive Testing
Disruptive TestingDisruptive Testing
Disruptive Testing
 
Testing trapeze-2014-april
Testing trapeze-2014-aprilTesting trapeze-2014-april
Testing trapeze-2014-april
 
how to reduce the cost of software testing
how to reduce the cost of software testinghow to reduce the cost of software testing
how to reduce the cost of software testing
 
A story on failure
A story on failureA story on failure
A story on failure
 
Software testing
Software testingSoftware testing
Software testing
 
Creating a Context Driven Test Team
Creating a Context Driven Test TeamCreating a Context Driven Test Team
Creating a Context Driven Test Team
 
A taste of Exploratory Testing
A taste of Exploratory TestingA taste of Exploratory Testing
A taste of Exploratory Testing
 
Agile Testing
Agile Testing Agile Testing
Agile Testing
 
A Taste of Exploratory Testing
A Taste of Exploratory TestingA Taste of Exploratory Testing
A Taste of Exploratory Testing
 
Develop your inner tester
Develop your inner tester Develop your inner tester
Develop your inner tester
 
Exploratory testing workshop
Exploratory testing workshopExploratory testing workshop
Exploratory testing workshop
 
Discovering your inner tester
Discovering your inner testerDiscovering your inner tester
Discovering your inner tester
 
Startups And Software Testing
Startups And Software TestingStartups And Software Testing
Startups And Software Testing
 

Recently uploaded

How RPA Help in the Transportation and Logistics Industry.pptx
How RPA Help in the Transportation and Logistics Industry.pptxHow RPA Help in the Transportation and Logistics Industry.pptx
How RPA Help in the Transportation and Logistics Industry.pptx
SynapseIndia
 
Google I/O Extended Harare Merged Slides
Google I/O Extended Harare Merged SlidesGoogle I/O Extended Harare Merged Slides
Google I/O Extended Harare Merged Slides
Google Developer Group - Harare
 
The Rise of AI in Cybersecurity How Machine Learning Will Shape Threat Detect...
The Rise of AI in Cybersecurity How Machine Learning Will Shape Threat Detect...The Rise of AI in Cybersecurity How Machine Learning Will Shape Threat Detect...
The Rise of AI in Cybersecurity How Machine Learning Will Shape Threat Detect...
digitalxplive
 
Feature sql server terbaru performance.pptx
Feature sql server terbaru performance.pptxFeature sql server terbaru performance.pptx
Feature sql server terbaru performance.pptx
ssuser1915fe1
 
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptxDublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Kunal Gupta
 
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyyActive Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
RaminGhanbari2
 
Use Cases & Benefits of RPA in Manufacturing in 2024.pptx
Use Cases & Benefits of RPA in Manufacturing in 2024.pptxUse Cases & Benefits of RPA in Manufacturing in 2024.pptx
Use Cases & Benefits of RPA in Manufacturing in 2024.pptx
SynapseIndia
 
Recent Advancements in the NIST-JARVIS Infrastructure
Recent Advancements in the NIST-JARVIS InfrastructureRecent Advancements in the NIST-JARVIS Infrastructure
Recent Advancements in the NIST-JARVIS Infrastructure
KAMAL CHOUDHARY
 
Implementations of Fused Deposition Modeling in real world
Implementations of Fused Deposition Modeling  in real worldImplementations of Fused Deposition Modeling  in real world
Implementations of Fused Deposition Modeling in real world
Emerging Tech
 
The Role of IoT in Australian Mobile App Development - PDF Guide
The Role of IoT in Australian Mobile App Development - PDF GuideThe Role of IoT in Australian Mobile App Development - PDF Guide
The Role of IoT in Australian Mobile App Development - PDF Guide
Shiv Technolabs
 
Salesforce AI & Einstein Copilot Workshop
Salesforce AI & Einstein Copilot WorkshopSalesforce AI & Einstein Copilot Workshop
Salesforce AI & Einstein Copilot Workshop
CEPTES Software Inc
 
Girls call Kolkata 👀 XXXXXXXXXXX 👀 Rs.9.5 K Cash Payment With Room Delivery
Girls call Kolkata 👀 XXXXXXXXXXX 👀 Rs.9.5 K Cash Payment With Room Delivery Girls call Kolkata 👀 XXXXXXXXXXX 👀 Rs.9.5 K Cash Payment With Room Delivery
Girls call Kolkata 👀 XXXXXXXXXXX 👀 Rs.9.5 K Cash Payment With Room Delivery
sunilverma7884
 
Amul milk launches in US: Key details of its new products ...
Amul milk launches in US: Key details of its new products ...Amul milk launches in US: Key details of its new products ...
Amul milk launches in US: Key details of its new products ...
chetankumar9855
 
How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
Adam Dunkels
 
IPLOOK Remote-Sensing Satellite Solution
IPLOOK Remote-Sensing Satellite SolutionIPLOOK Remote-Sensing Satellite Solution
IPLOOK Remote-Sensing Satellite Solution
IPLOOK Networks
 
July Patch Tuesday
July Patch TuesdayJuly Patch Tuesday
July Patch Tuesday
Ivanti
 
CiscoIconsLibrary cours de réseau VLAN.ppt
CiscoIconsLibrary cours de réseau VLAN.pptCiscoIconsLibrary cours de réseau VLAN.ppt
CiscoIconsLibrary cours de réseau VLAN.ppt
moinahousna
 
How Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdfHow Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdf
HackersList
 
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptxRPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
SynapseIndia
 
Using LLM Agents with Llama 3, LangGraph and Milvus
Using LLM Agents with Llama 3, LangGraph and MilvusUsing LLM Agents with Llama 3, LangGraph and Milvus
Using LLM Agents with Llama 3, LangGraph and Milvus
Zilliz
 

Recently uploaded (20)

How RPA Help in the Transportation and Logistics Industry.pptx
How RPA Help in the Transportation and Logistics Industry.pptxHow RPA Help in the Transportation and Logistics Industry.pptx
How RPA Help in the Transportation and Logistics Industry.pptx
 
Google I/O Extended Harare Merged Slides
Google I/O Extended Harare Merged SlidesGoogle I/O Extended Harare Merged Slides
Google I/O Extended Harare Merged Slides
 
The Rise of AI in Cybersecurity How Machine Learning Will Shape Threat Detect...
The Rise of AI in Cybersecurity How Machine Learning Will Shape Threat Detect...The Rise of AI in Cybersecurity How Machine Learning Will Shape Threat Detect...
The Rise of AI in Cybersecurity How Machine Learning Will Shape Threat Detect...
 
Feature sql server terbaru performance.pptx
Feature sql server terbaru performance.pptxFeature sql server terbaru performance.pptx
Feature sql server terbaru performance.pptx
 
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptxDublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
 
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyyActive Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
 
Use Cases & Benefits of RPA in Manufacturing in 2024.pptx
Use Cases & Benefits of RPA in Manufacturing in 2024.pptxUse Cases & Benefits of RPA in Manufacturing in 2024.pptx
Use Cases & Benefits of RPA in Manufacturing in 2024.pptx
 
Recent Advancements in the NIST-JARVIS Infrastructure
Recent Advancements in the NIST-JARVIS InfrastructureRecent Advancements in the NIST-JARVIS Infrastructure
Recent Advancements in the NIST-JARVIS Infrastructure
 
Implementations of Fused Deposition Modeling in real world
Implementations of Fused Deposition Modeling  in real worldImplementations of Fused Deposition Modeling  in real world
Implementations of Fused Deposition Modeling in real world
 
The Role of IoT in Australian Mobile App Development - PDF Guide
The Role of IoT in Australian Mobile App Development - PDF GuideThe Role of IoT in Australian Mobile App Development - PDF Guide
The Role of IoT in Australian Mobile App Development - PDF Guide
 
Salesforce AI & Einstein Copilot Workshop
Salesforce AI & Einstein Copilot WorkshopSalesforce AI & Einstein Copilot Workshop
Salesforce AI & Einstein Copilot Workshop
 
Girls call Kolkata 👀 XXXXXXXXXXX 👀 Rs.9.5 K Cash Payment With Room Delivery
Girls call Kolkata 👀 XXXXXXXXXXX 👀 Rs.9.5 K Cash Payment With Room Delivery Girls call Kolkata 👀 XXXXXXXXXXX 👀 Rs.9.5 K Cash Payment With Room Delivery
Girls call Kolkata 👀 XXXXXXXXXXX 👀 Rs.9.5 K Cash Payment With Room Delivery
 
Amul milk launches in US: Key details of its new products ...
Amul milk launches in US: Key details of its new products ...Amul milk launches in US: Key details of its new products ...
Amul milk launches in US: Key details of its new products ...
 
How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
 
IPLOOK Remote-Sensing Satellite Solution
IPLOOK Remote-Sensing Satellite SolutionIPLOOK Remote-Sensing Satellite Solution
IPLOOK Remote-Sensing Satellite Solution
 
July Patch Tuesday
July Patch TuesdayJuly Patch Tuesday
July Patch Tuesday
 
CiscoIconsLibrary cours de réseau VLAN.ppt
CiscoIconsLibrary cours de réseau VLAN.pptCiscoIconsLibrary cours de réseau VLAN.ppt
CiscoIconsLibrary cours de réseau VLAN.ppt
 
How Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdfHow Social Media Hackers Help You to See Your Wife's Message.pdf
How Social Media Hackers Help You to See Your Wife's Message.pdf
 
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptxRPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
 
Using LLM Agents with Llama 3, LangGraph and Milvus
Using LLM Agents with Llama 3, LangGraph and MilvusUsing LLM Agents with Llama 3, LangGraph and Milvus
Using LLM Agents with Llama 3, LangGraph and Milvus
 

Testing a SaaS Platform

  • 2. About me - Joel Montvelisky PractiTest – Co Founder & Prod. Architect QA Instructor & Consultant Mercury Interactive - QA Manager (retired ) TD, QC, WR, QTP, etc ITCB (IL) Advisory Board QABlog.practitest.com © 2010 -
  • 3. Today’s Agenda   SaaS - Software as a Service   Things we Can Stop Testing   Non-trivial Stuff to Think About & TEST   Leveraging Live Feedback into the Testing Lifecycle   Open Season for Questions… © 2010 -
  • 4. What is SaaS? © 2010 -
  • 5. Software as a Service   Hosted Platforms – Total Control – No Maintenance   No Client Installations   Customers buys each month – keep them happy  Users don’t care it is SaaS, it needs to be better than the alternative © 2010 -
  • 6. SaaS QA Management   End-to-End QA Management (Reqs – Tests – Bugs)   Enterprise Level SaaS Solution - Methodology - Customizations & Flexibility   Global platform - Communication - Languages - Available 24x7 Worldwide   Intuitive & Simple   Agile Dev, RoR, on Amazon EC2 © 2010 -
  • 7. What does SaaS mean to the Testing Process? © 2010 -
  • 8. Things we can STOP Testing ✘  Client or Server installations ✘  Multiplatform backend support ✘  Multiple version upgrades “Savings” of approx. 1/3 ✘  Backwards compatibility of the Traditional Enterprise Application Testing Cycle © 2010 -
  • 9. The regular testing scenarios   Functionality - Manual scripts - Exploratory sessions Agile Sprints & Updates - Checklists of 3 – 4 weeks - End-2-End Scenarios - Selenium Each sprint’s cycle is - Cucumber & RSpec based on its content   Load & Stress   Multi-platform & Multi-browser support   I18N English, Swedish, German, Chinese Simplified, Hebrew © 2010 -
  • 10. Non-trivial stuff to think about & TEST 1. Remote accessibility & usage   Staging Servers in USA - Amazon EC2 Development & Testing teams in Israel (& WW collaborators)   Globally distributed monitoring services (www.pingdom.com) © 2010 -
  • 11. Non-trivial stuff to think about & TEST 2. Security Application-related: Infrastructure-based:   Cross-site scripting   Secured communication   SQL injections   Backups & storage policies   HTTP header injections   Controlled Access to the site & servers etc… © 2010 -
  • 12. Non-trivial stuff to think about & TEST 3. Live updates & deployments (3 to 4 weeks)   No concrete separation between Dev & IT   Minimal service disruption   Dressed rehearsals (including rollbacks!)   Automated sanity & manual verification   Patches & hot-fixes (extraordinary occasions )   Prove of Concepts & Beta Releases QA & Testing as a facilitator for Balance: Stable & Professional, yet Flexible Environment © 2010 -
  • 13. Non-trivial stuff to think about & TEST 4. Disaster recovery procedures Two Main scenarios: (a) System down to be brought up quickly   Configure machines   Install & deploy software   Restore data Define a policy & schedule regular drills to ensure you can achieve it! (b) Rollback to last known stable data (with or without data restore) © 2010 -
  • 14. Leveraging Real Data into the Testing Process © 2010 -
  • 15. Levering live feedback into the Testing Process (1) Internally developed monitoring tools - Check usage patterns No need to - Validate need & usability assumptions continue guessing!!! - Analyze patterns and create realistic & prioritized testing scenarios © 2010 -
  • 16. Levering live feedback into the Testing Process (2) Site Monitoring systems LiveAdmin (www.liveadmin.net)   Real-time usage to schedule updates   Allow users to contact the company with questions or issues Pingdom (www.pingdom.com)   Up to date response times for real projects and data.   Proactive alerts when things start slowing down © 2010 -
  • 17. Levering live feedback into the Testing Process (3) Proactive mail notifications on issues (www.hoptoad.com)   Real-time notifications on issues on the system.   Information about the issue including system parameters that allow you to do an initial trouble-shoot of the issue © 2010 -
  • 18. Levering live feedback into the Testing Process (4) Ask users for Real Projects   No better way to test than using real data   Most users will trust you not to abuse their information in exchange for assurance of working software   Since the data sits in your system it is easier to copy projects to your testing environment  Need to be careful with who has access to the data; making sure your testing environment is as secured as your production environment © 2010 -
  • 19. Wrapping up… © 2010 -
  • 20. Wrapping up   SaaS is only the delivery model, customers will not compromise on Functionality, Stability or Response Time   Since the system is hosted you can save all tests related to backend installation and support   You need to pay more attention to stuff like accessibility, security, deployments & DRPs   The lines between the R&D and IT organizations in SaaS are blurry   SaaS application allows better access to real data to be leveraged to improve the effectiveness of our testing operations. © 2010 -
  • 22. Special thanks to Anne-Marie Charrett  joel@practitest.com http://qablog.practitest.com © 2010 -