Unit Tests Integration TestsAOE PMD(for Magento)broken links,HTTP headers,W3C validity,…Test features that rely on otherparts (e.g. framework, externalservices,…)External components(SSL, Redis, Varnish,…)Basically this is alsoPHPUnit, butaddressing other stuff
Integration Tests Acceptance TestsHere we go:Selenium!
Acceptance TestsInstall on“Staging”Behat(Cucumber)Same setup as production,but different machinesClient QA /approval
Install on“Staging”*http://www.slideshare.net/aoemedia/performance-measurement-and-tuningStressTestsJmeterSpin up EC2instances in thecloud to producetraffic*
Menta for PHPUnitAbstract test classPHPUnit_Framework_TestCaseMenta_PHPUnit_Testcase_Selenium2ProjectY_Abstract_TestCaseVery thin layer ontop of PHPUnitProjectY_TestCase_Registration ProjectY_TestCase_Checkoutthe “magic” happensin the components
HTML ReportScreenshots(on demandand on failure)test descriptionfrom phpdocadditionalmessageserror details
HTML Report“DurationHeatmap”shows longrunning tests
Menta for PHPUnitText Result PrinterPHPUnit 3.7.20 by Sebastian Bergmann.Configuration read from /var/www/Tests/Acceptance/conf/devfb.ff.vmhost.xml> SUITE:> SUITE:> SUITE: Acceptance_Tests_Account_Register> TEST: Acceptance_Tests_Account_Register::registerSUCCESS. (Duration: 8.18 sec)> TEST: Acceptance_Tests_Account_Register::loginSUCCESS. (Duration: 6.5 sec)> TEST: Acceptance_Tests_Account_Register::testRegistrationMailFAILURE: Searching for mail with subject Welcome, Test_705b077a962977e1a412696ea42249ae User_705b077a962977e1a412696ea42249ae timed out (Duration: 22< Duration: 36 sec< Duration: 36 sec> SUITE:> SUITE: Acceptance_Tests_Checkout_CheckoutMultiAddressTest> TEST: Acceptance_Tests_Checkout_CheckoutMultiAddressTest::putProductsInCartFAILURE: Element "//table[@id="shopping-cart-table"]//h3[contains(concat( , @class, ), attentionText )]" does not contain text "Bulb Vase" Fail< Duration: 9.87 sec> SUITE: Acceptance_Tests_Checkout_CheckoutTest> TEST: Acceptance_Tests_Checkout_CheckoutTest::categoryViewSUCCESS. (Duration: 1.79 sec)> TEST: Acceptance_Tests_Checkout_CheckoutTest::putPlatterInCartFAILURE: Failed asserting that two strings are equal. (Duration: 3.55 sec)SKIPPED: This test depends on "Acceptance_Tests_Checkout_CheckoutTest::putPlatterInCart" to pass. (Duration: 5.34 sec)