Surface and Mitigate Performance Bottlenecks          Open Source Test Workshop                    For QA Testers, Develop...
Open Source Test Automation     Slides on Twitter     ‣ http://twitter.com/fcohen     ‣ Please retweet     ‣ Please follow...
Open Source Test Automation      About PushToTest      3Thursday, June 9, 2011
Open Source Test Automation      About PushToTest      3Thursday, June 9, 2011
Open Source Test Automation     About PushToTest     ‣ Our Mission: We Test, For A More Reliable World      3Thursday, Jun...
Open Source Test Automation     About PushToTest     ‣ Our Mission: We Test, For A More Reliable World     ‣ Make It Easie...
Open Source Test Automation     About PushToTest     ‣ Our Mission: We Test, For A More Reliable World     ‣ Make It Easie...
Open Source Test Automation     About PushToTest     ‣ Our Mission: We Test, For A More Reliable World     ‣ Make It Easie...
Open Source Test Automation      Manual Testing Process                         Manual                         Testing    ...
Open Source Test Automation      Manual Testing Process                                   1                               ...
Open Source Test Automation      Manual Testing Process                             Results                               ...
Open Source Test Automation      Side Effects      5Thursday, June 9, 2011
Open Source Test Automation     Side Effects     ‣ Exhaustion     ‣ Fatigue     ‣ Blurry Vision     ‣ Night Sweats     ‣ I...
Open Source Test Automation      Proprietary Testing Falling Behind     ‣ Adobe Releases Testing APIs for Flex/Flash in 20...
Open Source Test Automation      Open Source Testing Emerges          Lots Of Options      7Thursday, June 9, 2011
Open Source Test Automation      Open Source Testing EmergesWtness          Lots Of Options               Selenium        ...
Open Source Test Automation      Open Source Testing EmergesWtness          Lots Of Options               Selenium        ...
Open Source Test Automation      OST Architecture                         Application Under Test                          ...
Open Source Test Automation      OST Architecture                                       Application Under Test            ...
Open Source Test Automation      OST Architecture                                       Application Under Test            ...
Open Source Test Automation      OST Architecture                                            Application Under Test       ...
Open Source Test Automation      OST Architecture                                            Application Under Test       ...
Open Source Test Automation      TestMaker Architecture                         Application Under Test    PTTMonitor      ...
Open Source Test Automation      TestMaker Architecture                                            Application Under Test ...
Open Source Test Automation     Test Script          Selenium: Search Component          1        Load Home Page          ...
Open Source Test Automation     Test Script          Selenium: Search Component   Selenium Script Runner                  ...
Open Source Test Automation     Test Script          Selenium: Search Component    Selenium Script Runner                 ...
Open Source Test Automation      Browser Compatibility Tests                            Application Under Test            ...
Open Source Test Automation      ScriptRunners                          ScriptRunner          Type           Name (langtyp...
Open Source Test Automation      Your cloud or mine? Or both!                                            Application or Se...
Open Source Test Automation      Lots of Possibilities                                 TestMaker                          ...
Open Source Test Automation      Lots of Possibilities                                 TestMaker                          ...
Open Source Test Automation     TestMaker Demonstration     ‣ Fun And Easy Test Script Creation       ‣ Selenium and TestM...
Open Source Test Automation                         Root Cause Analysis                         ‣ PTTMonitor - Agent Based...
Open Source Test Automation     PTTMonitor     ‣ Correlate Test Operation To Resource Usage     ‣ Deploy as Web Applicatio...
Open Source Test Automation      Results Analysis Engine     18                         And 350 Additional ChartsThursday,...
Open Source Test Automation     Glassbox     ‣ Correlate Test Operation To Application Tier Issues       ‣ Memory Leaks   ...
Open Source Test Automation      Glassbox Troubleshooter     20Thursday, June 9, 2011
Open Source Test Automation     dynaTrace PurePaths     ‣ PurePath from TestMaker Virtual Users To Application & DB Tier  ...
Open Source Test Automation     Pinpoint The Problem     ‣ Down to the Line of Source Code     22Thursday, June 9, 2011
Open Source Test Automation     .NET Monitoring     ‣ Correlate PerfMon Statistics with Test Operation     ‣ PTTMonitor Ga...
Open Source Test Automation      Dual License     ‣    Functional Testing with TestMaker Object Designer       ‣   TestMak...
Open Source Test Automation     Where To Go From Here     ‣ Download TestMaker and Read The Tutorials     ‣ Please Complet...
Upcoming SlideShare
Loading in …5
×

Open Source Test Workshop for QA Testers, Developers, IT Managers

1,834 views
1,741 views

Published on

A live meet-up of QA testers, software developers, and IT managers needing to surface performance bottlenecks and functional issues in Web applications, Rich Internet Applications (RIA, using Flex, Flax, Ajax,) BPM, and SOA.

Published in: Technology
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,834
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
64
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Open Source Test Workshop for QA Testers, Developers, IT Managers

  1. 1. Surface and Mitigate Performance Bottlenecks Open Source Test Workshop For QA Testers, Developers, Operations Frank Cohen, +01 (408) 871-0122, fcohen@pushtotest.com June 9, 2011Thursday, June 9, 2011
  2. 2. Open Source Test Automation Slides on Twitter ‣ http://twitter.com/fcohen ‣ Please retweet ‣ Please follow me ‣ #ost 2Thursday, June 9, 2011
  3. 3. Open Source Test Automation About PushToTest 3Thursday, June 9, 2011
  4. 4. Open Source Test Automation About PushToTest 3Thursday, June 9, 2011
  5. 5. Open Source Test Automation About PushToTest ‣ Our Mission: We Test, For A More Reliable World 3Thursday, June 9, 2011
  6. 6. Open Source Test Automation About PushToTest ‣ Our Mission: We Test, For A More Reliable World ‣ Make It Easier To Move From Manual To Automated Testing 3Thursday, June 9, 2011
  7. 7. Open Source Test Automation About PushToTest ‣ Our Mission: We Test, For A More Reliable World ‣ Make It Easier To Move From Manual To Automated Testing ‣ Support Advanced Testing, including Agile, Load, Integration 3Thursday, June 9, 2011
  8. 8. Open Source Test Automation About PushToTest ‣ Our Mission: We Test, For A More Reliable World ‣ Make It Easier To Move From Manual To Automated Testing ‣ Support Advanced Testing, including Agile, Load, Integration ‣ Open Source Testing (OST) For Everyone 3Thursday, June 9, 2011
  9. 9. Open Source Test Automation Manual Testing Process Manual Testing 4Thursday, June 9, 2011
  10. 10. Open Source Test Automation Manual Testing Process 1 Explore Manual Testing 4Thursday, June 9, 2011
  11. 11. Open Source Test Automation Manual Testing Process Results 4 1 Recommend Changes Explore Manual Testing Tes 3 t 2 Plan 4 Run The Test Steps Create Test PlansThursday, June 9, 2011
  12. 12. Open Source Test Automation Side Effects 5Thursday, June 9, 2011
  13. 13. Open Source Test Automation Side Effects ‣ Exhaustion ‣ Fatigue ‣ Blurry Vision ‣ Night Sweats ‣ Insanity ‣ Hair Loss ‣ Acne ‣ Divorce 5Thursday, June 9, 2011
  14. 14. Open Source Test Automation Proprietary Testing Falling Behind ‣ Adobe Releases Testing APIs for Flex/Flash in 2009 ‣ JQuery, GWT, YUI, Extjs Each Make 5 Releases in 2010 ‣ Appcelerator Titanium Makes 3 Releases in 2010 ‣ Microsoft Draws 8,000 to Mix for StarLight in 2010 ‣ StarEast, Better Software, PyPy, JavaOne, Devoxx, OSBC, LinuxWorld Feature Keynote Talks On Ajax ‣ “HP Refundedcustomer in theFor The Ajax industry. Handler”, a PushToTest Our Payment automotive Protocol 6Thursday, June 9, 2011
  15. 15. Open Source Test Automation Open Source Testing Emerges Lots Of Options 7Thursday, June 9, 2011
  16. 16. Open Source Test Automation Open Source Testing EmergesWtness Lots Of Options Selenium HtmlUnit soapUI DBUnit Sahi Watir FlexMonkey FIT Windmill Hudson TestMaker jMeter 7Thursday, June 9, 2011
  17. 17. Open Source Test Automation Open Source Testing EmergesWtness Lots Of Options Selenium HtmlUnit soapUI DBUnit Sahi Watir FlexMonkey FIT Windmill Hudson TestMaker jMeter ‣ Signs of Maturity:Logger, Recovery Scenario Manager, Object Iteration Engine, Record/Playback, Data Generation/Importer, 7 RecognizerThursday, June 9, 2011
  18. 18. Open Source Test Automation OST Architecture Application Under Test Web, RIA, BPM, SOA 8Thursday, June 9, 2011
  19. 19. Open Source Test Automation OST Architecture Application Under Test Web, RIA, BPM, SOA Functional Test Test Authoring SoapUI (Pro) Sahi (Pro) JUnit Class Framework Load Test Eclipse Java IDE Fitness Languages: Java, Python Wiki Collaboration Production Monitor Continuous Test Repository Bug Tracker Monitoring Integration Management 8Thursday, June 9, 2011
  20. 20. Open Source Test Automation OST Architecture Application Under Test Web, RIA, BPM, SOA Functional Test Test Authoring SoapUI (Pro) Sahi (Pro) JUnit Class Framework Load Test Eclipse Java IDE Fitness Languages: Java, Python Wiki Collaboration Production Monitor Continuous Test Repository Bug Tracker Monitoring Integration Management 8Thursday, June 9, 2011
  21. 21. Open Source Test Automation OST Architecture Application Under Test Web, RIA, BPM, SOA Functional Test Test Authoring SoapUI (Pro) Sahi (Pro) JUnit Class Framework Load Test Eclipse Java IDE Fitness Test Operation Console Languages: Java, Python Wiki Collaboration Production Designer Grid and Cloud Repository Results Analysis Record/Playback Test Deployment MySQL RDBMS Business Intelligence Tool Monitor Continuous Test Repository Bug Tracker Monitoring Integration Management 8Thursday, June 9, 2011
  22. 22. Open Source Test Automation OST Architecture Application Under Test PTTMonitor Web, RIA, BPM, SOA CPU, Net, Memory Functional Test Injector Test Authoring Test Bundles ScriptRunners Data Production Libraries SoapUI (Pro) MySQL, HtmlUnit Sahi, Selenium, SoapUI, Java csv files, rdbms queries Sahi (Pro) JUnit Class Framework Load Test Eclipse Java IDE Fitness Test Operation Console Languages: Java, Python Wiki Collaboration Production Designer Grid and Cloud Repository Results Analysis Record/Playback Test Deployment MySQL RDBMS Business Intelligence Tool Monitor Continuous Test Repository Bug Tracker Monitoring Integration Management 8Thursday, June 9, 2011
  23. 23. Open Source Test Automation TestMaker Architecture Application Under Test PTTMonitor Web, RIA, BPM, SOA CPU, Net, Memory 9Thursday, June 9, 2011
  24. 24. Open Source Test Automation TestMaker Architecture Application Under Test PTTMonitor Web, RIA, BPM, SOA CPU, Net, Memory TestNode Bundles ScriptRunners Data Production Libraries MySQL, HtmlUnit Sahi, Selenium, SoapUI, Java csv files, rdbms queries TestMaker Console Designer Grid and Cloud Repository Results Analysis Record/Playback Test Deployment MySQL RDBMS Business Intelligence Tool 9Thursday, June 9, 2011
  25. 25. Open Source Test Automation Test Script Selenium: Search Component 1 Load Home Page 2 Enter Value 3 Validate Results 10Thursday, June 9, 2011
  26. 26. Open Source Test Automation Test Script Selenium: Search Component Selenium Script Runner Data Driven, Step Time, 1 Load Home Page HTMLUnit 2 Enter Value 3 Validate Results 10Thursday, June 9, 2011
  27. 27. Open Source Test Automation Test Script Selenium: Search Component Selenium Script Runner Data Driven, Step Time, 1 Load Home Page HTMLUnit 2 Enter Value TestMaker Transformer: Java Unit Test 3 Validate Results public class CheckEmail { public void setUp() {} ... public void runTest { selenium.setBaseUrl( "http://myurl" ); selenium.open("/login.srf”); selenium.type("search", "ctest"); selenium.click("//Item[6]"); selenium.assertTextExists("mytext"); } 10 }Thursday, June 9, 2011
  28. 28. Open Source Test Automation Browser Compatibility Tests Application Under Test TestNode Selenium RC SeleniumHtmlUnit Selenese Test TestMaker Console 11Thursday, June 9, 2011
  29. 29. Open Source Test Automation ScriptRunners ScriptRunner Type Name (langtype) Designer Script IE, Htmlunit designerscript Selenium HtmlUnit Browser selenium Selenium RC IE, Firefox, Chrome seleniumrc Sahi IE, HtmlUnit sahi HTTP Archive Page Optimization HAR Selenium RC IE, Firefox, Chrome seleniumrc SoapUI SOAP and REST soapui TestGen4Web Web 1.0 Tests testgen4web Mozmill Mozilla XUL Tests mozmill Unit Tests jUnit TestCase Java, Jython, JRuby, PHP, Perl, Groovy DotNet .NET Tests dotnet Visual Basic VB tests vb 12 Command Line Desktop and utils commandlineThursday, June 9, 2011
  30. 30. Open Source Test Automation Your cloud or mine? Or both! Application or Service HTTP REST AMF AJAX TestNode TestNode TestNode TestNode test test test test PTTMonitor PTTMonitor PTTMonitor PTTMonitor SOAP SOAP SOAP SOAP Test RunTime TestMaker Console 13Thursday, June 9, 2011
  31. 31. Open Source Test Automation Lots of Possibilities TestMaker Test Sent Seattle, Datacenter TestNode Generating Load Dallas, Texas Datacenter 14Thursday, June 9, 2011
  32. 32. Open Source Test Automation Lots of Possibilities TestMaker Test Sent Seattle, Datacenter TestNode Generating Load Dallas, Texas Datacenter You’re Such A Geek! 14Thursday, June 9, 2011
  33. 33. Open Source Test Automation TestMaker Demonstration ‣ Fun And Easy Test Script Creation ‣ Selenium and TestMaker ‣ Repurposing A Single Test ‣ Functional Test, Load and Performance Test, Production Monitor ‣ Results Analysis ‣ Chart Engine 15Thursday, June 9, 2011
  34. 34. Open Source Test Automation Root Cause Analysis ‣ PTTMonitor - Agent Based Monitor Gateway ‣ Glassbox - Performance Monitoring for Java Applications ‣ dynaTrace - Analysis In Application and DB Tiers 16Thursday, June 9, 2011
  35. 35. Open Source Test Automation PTTMonitor ‣ Correlate Test Operation To Resource Usage ‣ Deploy as Web Application (WAR) and Service ‣ Observes CPU, Network, Memory Utilization As Test Runs ‣ Gateway to Glassbox, dynaTrace, Windows PerfMon 17Thursday, June 9, 2011
  36. 36. Open Source Test Automation Results Analysis Engine 18 And 350 Additional ChartsThursday, June 9, 2011
  37. 37. Open Source Test Automation Glassbox ‣ Correlate Test Operation To Application Tier Issues ‣ Memory Leaks ‣ Thread Deadlocks ‣ Slow DB Connections ‣ No Instrumentation of Applications ‣ Live Performance Alert View ‣ Run In Production 19Thursday, June 9, 2011
  38. 38. Open Source Test Automation Glassbox Troubleshooter 20Thursday, June 9, 2011
  39. 39. Open Source Test Automation dynaTrace PurePaths ‣ PurePath from TestMaker Virtual Users To Application & DB Tier ‣ Answers: What Are The Transactions and Why Are They Slow? dynaTrace monitors applications for functional issues dynaTrace Database Agent and performance bottlenecks. dynaTrace Application Server Agent PurePath Token TestNode TestNode TestNode test test test PTTMonitor Test RunTime 21 TestMaker ConsoleThursday, June 9, 2011
  40. 40. Open Source Test Automation Pinpoint The Problem ‣ Down to the Line of Source Code 22Thursday, June 9, 2011
  41. 41. Open Source Test Automation .NET Monitoring ‣ Correlate PerfMon Statistics with Test Operation ‣ PTTMonitor Gateways Data from PerfMon or MS SQL Server .NET Application Tier PerfMon MS SQL Server SOAP HTTP REST TestNode TestNode TestNode PTTMonitor test test test Test RunTime TestMaker Console 23Thursday, June 9, 2011
  42. 42. Open Source Test Automation Dual License ‣ Functional Testing with TestMaker Object Designer ‣ TestMaker Enterprise expands on the success of ‣ TestMaker Community Repurposing Selenium, soapUI Sahi and unit tests into data-driven functional tests, load and performance ‣ Load Testing to Millions of Virtual Users ‣ tests, and business service monitors Cloud and Grid Testing ‣ Load Testing To 50 Virtual Users ‣ Data-driven tests using Data Production Libraries for ‣ Data-driven tests using CSV files. CSV files, RDBMS, Data Generating Objects ‣ PTTMonitor Correlates CPU, Network, Memory ‣ Root cause analysis and mitigation using Glassbox ‣ Utilization As Tests Operate. Mock services for agile service development ‣ 25 Charts and Reports ‣ Flex AMF Protocol Handler for Flex/Flash testing ‣ Community Support and access to all documentation ‣ 1000+ Charts and Reports ‣ Business service monitors, including email notification ‣ Support, QuickStart, Training, Consulting 24Thursday, June 9, 2011
  43. 43. Open Source Test Automation Where To Go From Here ‣ Download TestMaker and Read The Tutorials ‣ Please Complete The Evaluation Form ‣ And We Will Send You The Slides ‣ Watch the Screencasts ‣ http://www.pushtotest.com/screencastcentral ‣ Ask For A Proposal on Licenses, Training, Support, Consulting ‣ Call +01 408 871 0122, sales@pushtotest.com 25Thursday, June 9, 2011

×