Deploying Tests To A Cloud


OnDemand Cloud Testing
Frank Cohen, +01 408-871-0122, fcohen@pushtotest.com
                    June 4, 2011
Open Source Test Automation




About PushToTest
‣Our Mission: We Test, For A More Reliable World
‣Make It Easier To Move From Manual To Automated Testing
‣Support Advanced Testing, including Agile, Load, Integration
‣Open Source Testing (OST) For Everyone



2
Open Source Test Automation




Why Run Tests In The Cloud
‣Larger Scale - Up To Millions of Virtual Users
‣Geographic Testing - Multiple Locations from California to Sidney
‣Remote Testing - Console in Deli and TestNodes in Seattle




3
Open Source Test Automation




TestMaker Architecture
                        Application Under Test                                  PTTMonitor
                            Web, RIA, BPM, SOA                                CPU, Net, Memory




                                            TestNode
         Bundles                  ScriptRunners               Data Production Libraries
      MySQL, HtmlUnit        Sahi, Selenium, SoapUI, Java        csv files, rdbms queries




                                   TestMaker Console
       Designer          Grid and Cloud          Repository           Results Analysis
     Record/Playback      Test Deployment        MySQL RDBMS        Business Intelligence Tool




4
Open Source Test Automation




OnDemand Cloud Architecture
                      Machine Instance
                              c1.medium


                          TestNode
    Credentials
      AMI ID             test.ds   HtmlUnit
      Count


                        PTTMonitor


       Cloud Client


    TestMaker                                 http://sahi.co.in/demo
     Console

          test.ds
5
Open Source Test Automation




OnDemand Cloud Architecture
                     Machine Instance                      Machine Instance
                             c1.medium                                 c1.medium


                         TestNode            Transaction, Step, Time


                        test.ds   HtmlUnit                              Repository


                                                                          MySQL
                       PTTMonitor                                         Oracle
                                                                       MS SQL Server




      Cloud Client


    TestMaker                                                           http://sahi.co.in/demo
     Console

6       Report
Open Source Test Automation




Try It Yourself
‣Download the Tutorial
 ‣http://twitter.com/fcohen
 ‣Please retweet
 ‣Please follow me
‣Request OnDemand Credentials From info@pushtotest.com
‣Add Credentials To config.ec2
‣Click Start
‣Let’s See It In Action...
7
Open Source Test Automation




Amazon Web Services (EC2)
‣High-CPU Medium Instance
    1.7 GB of memory
    5 EC2 Compute Units (2 virtual cores, 2.5 EC2 Compute Units each)
    350 GB of instance storage
    32-bit platform
    I/O Performance: Moderate
    API name: c1.medium




8
Open Source Test Automation




Test Authoring and Test Scale
TestMaker Approach                Advantages and Disadvantages                               Scale

                                  Large volume of virtual users per TestNode (1000+
                                  VUs)
                                  Script-level coding effort for Web apps with client-
Protocol Level Testing            side business logic                                        1000+ virtual users per TestNode
                                  Extra coding to test Web page resources (CSS,
                                  Javascript, Images)
                                  Test message-oriented services (BPM, MOM, ESB)


                                  Large volume of virtual users per TestNode (1000+
                                  VUs)
                                  Scriptless test authoring, create HAR files using point-
                                  and-click Firefox with Firebug
HTTP Archive (HAR)                Automatic testing of Web page resources (CSS,              1000+ virtual users per TestNode
                                  Javascript, Images)
                                  Does not support Ajax, Javascript functions within
                                  Web pages


                                  Scriptless test authoring using record/playback
HTMLUnit (SeleniumHtmlUnit,       Operates client-side business logic automatically
                                  Small volume of virtual users (50 VUs)                     20-200 virtual users per TestNode
SahiHtmlUnit)                     Possibly extra test coding for Javascript
                                  incompatibility


                                  Browser compatibility testing with the same test
Browser Functional (Selenese RC   script
                                  Visual test operation for test debugging                   2-4 virtual users per TestNode
TestNode or Sahi with Browser)    Very small volume of virtual users (2 VUs)
                                  Slow test operation
9
Open Source Test Automation




Where To Go From Here
‣Learn TestMaker
 ‣http://www.pushtotest.com
‣Watch A Screencast and Tutorial
 ‣http://www.pushtotest.com/screencastcentral
‣Attend An Open Source Test Workshop
 ‣http://workshop.pushtotest.com
‣Ask For A Proposal on Licenses, Training, Support, Consulting
 ‣Call +01 408 871 0122, sales@pushtotest.com
10

OnDemand Cloud Testing

  • 1.
    Deploying Tests ToA Cloud OnDemand Cloud Testing Frank Cohen, +01 408-871-0122, fcohen@pushtotest.com June 4, 2011
  • 2.
    Open Source TestAutomation About PushToTest ‣Our Mission: We Test, For A More Reliable World ‣Make It Easier To Move From Manual To Automated Testing ‣Support Advanced Testing, including Agile, Load, Integration ‣Open Source Testing (OST) For Everyone 2
  • 3.
    Open Source TestAutomation Why Run Tests In The Cloud ‣Larger Scale - Up To Millions of Virtual Users ‣Geographic Testing - Multiple Locations from California to Sidney ‣Remote Testing - Console in Deli and TestNodes in Seattle 3
  • 4.
    Open Source TestAutomation TestMaker Architecture Application Under Test PTTMonitor Web, RIA, BPM, SOA CPU, Net, Memory TestNode Bundles ScriptRunners Data Production Libraries MySQL, HtmlUnit Sahi, Selenium, SoapUI, Java csv files, rdbms queries TestMaker Console Designer Grid and Cloud Repository Results Analysis Record/Playback Test Deployment MySQL RDBMS Business Intelligence Tool 4
  • 5.
    Open Source TestAutomation OnDemand Cloud Architecture Machine Instance c1.medium TestNode Credentials AMI ID test.ds HtmlUnit Count PTTMonitor Cloud Client TestMaker http://sahi.co.in/demo Console test.ds 5
  • 6.
    Open Source TestAutomation OnDemand Cloud Architecture Machine Instance Machine Instance c1.medium c1.medium TestNode Transaction, Step, Time test.ds HtmlUnit Repository MySQL PTTMonitor Oracle MS SQL Server Cloud Client TestMaker http://sahi.co.in/demo Console 6 Report
  • 7.
    Open Source TestAutomation Try It Yourself ‣Download the Tutorial ‣http://twitter.com/fcohen ‣Please retweet ‣Please follow me ‣Request OnDemand Credentials From info@pushtotest.com ‣Add Credentials To config.ec2 ‣Click Start ‣Let’s See It In Action... 7
  • 8.
    Open Source TestAutomation Amazon Web Services (EC2) ‣High-CPU Medium Instance 1.7 GB of memory 5 EC2 Compute Units (2 virtual cores, 2.5 EC2 Compute Units each) 350 GB of instance storage 32-bit platform I/O Performance: Moderate API name: c1.medium 8
  • 9.
    Open Source TestAutomation Test Authoring and Test Scale TestMaker Approach Advantages and Disadvantages Scale Large volume of virtual users per TestNode (1000+ VUs) Script-level coding effort for Web apps with client- Protocol Level Testing side business logic 1000+ virtual users per TestNode Extra coding to test Web page resources (CSS, Javascript, Images) Test message-oriented services (BPM, MOM, ESB) Large volume of virtual users per TestNode (1000+ VUs) Scriptless test authoring, create HAR files using point- and-click Firefox with Firebug HTTP Archive (HAR) Automatic testing of Web page resources (CSS, 1000+ virtual users per TestNode Javascript, Images) Does not support Ajax, Javascript functions within Web pages Scriptless test authoring using record/playback HTMLUnit (SeleniumHtmlUnit, Operates client-side business logic automatically Small volume of virtual users (50 VUs) 20-200 virtual users per TestNode SahiHtmlUnit) Possibly extra test coding for Javascript incompatibility Browser compatibility testing with the same test Browser Functional (Selenese RC script Visual test operation for test debugging 2-4 virtual users per TestNode TestNode or Sahi with Browser) Very small volume of virtual users (2 VUs) Slow test operation 9
  • 10.
    Open Source TestAutomation Where To Go From Here ‣Learn TestMaker ‣http://www.pushtotest.com ‣Watch A Screencast and Tutorial ‣http://www.pushtotest.com/screencastcentral ‣Attend An Open Source Test Workshop ‣http://workshop.pushtotest.com ‣Ask For A Proposal on Licenses, Training, Support, Consulting ‣Call +01 408 871 0122, sales@pushtotest.com 10