Automated testing with Drupal


Published on

Presented at Drupal Camp Chicago 2012

Michelle Krejci details how Promet has used Jenkins, PHPUnit, and Selenium to automate our current continuous integration process so you can begin to start automating your QA testing today. She then outlines how Promet has begun to also include Phing and Chef to run PHPUnit tests on custom modules as part of test driven development. Finally, she looks at the challenges to running user acceptance tests on a Drupal installation and moving the Drupal community away from SimpleTest towards PHPUnit testing.

In short, this is an overview of what works, what doesn't, and why this is important to the Drupal community.

1 Comment
  • You may be interested in SeLite. It's a framework for Selenium IDE that allows your test to access (read and write to) a test database (isolated from the database of the tested application).

    SeLite is ideal for Drupal, since all Drupal text content is in DB. Also, Drupal can work with SQLite DB, which is perfect for SeLite - so if (some of) your test deployments can use SQLite, your test data lifecycle would be very easy.

    See and
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Automated testing with Drupal

  1. 1. Automated testing testing at every stage
  2. 2. Exposition: characters • Michelle Krejci – a.k.a. craychee – a.k.a. dev_meshev • Promet Source –
  3. 3. Exposition: characters • Selenium* – a.k.a. Selenium IDE – a.k.a. Selenium RC – a.k.a. Selenium Webdriver *Actually, these are not at all the same. To wit: Selenium IDE = development enviroment to create scripts Selenium RC = Refers to Selenium 1 executable Selenium Webdriver = Selenium 2 executable
  4. 4. Exposition: characters • PHPUnit – a.k.a. the testing standard of the PHP community – a.k.a. the successor of SimpleTest
  5. 5. Exposition: characters • Jenkins – a.k.a. Hudson – a.k.a. A developer‟s most dependable butler
  6. 6. Exposition: characters • Chef – a.k.a. An opscode product – a.k.a. the answer to all your server-configuration-related prayers
  7. 7. Exposition: characters • xvfb – a.k.a. X virtual framer – a.k.a. what you need to run Selenium on a headless
  8. 8. Exposition: characters • Phing – a.k.a. Phing Is Not GNU make – a.k.a. Apache Ant for PHP – a.k.a. a build system for PHP – a.k.a. what you will need to run deeper regression, metric, and user acceptance testing
  9. 9. Exposition: the setting – During development Lots of clicking – After every update – If someone somehow has the time: on a regular basis as part of on-going support.
  10. 10. Development: rising action The Solution: Roll Call Testing – Use Selenium scripts to verify that elements such as ids, divs, and text are present on a regular basis (e.g., after updates, during development, on a regular basis)
  11. 11. Development: rising action Roll Call Tests – Each page gets its own test. – Each test must start and end at the home page. • Verify that all blocks and links are present using the VerifyElement command. • Do not use “assert” or this will halt all tests if element or text is not present.
  12. 12. Development: rising action Tools needed to write tests – Selenium IDE¹ – PHPUnit bindings² – Xpath plug-in³¹ Selenium IDE: – US/firefox/addon/selenium-ide/² PHP bindings: – US/firefox/addon/selenium-ide-php-formatters/?src=ss³ Xpath-checker add on: – checker/?src=search
  13. 13. Development: rising action Selenium IDE 1. Starting point. 2. Controls 3. Record actions (not needed for creating roll call tests, recommend using right click and select command) 4. Name of tests (should be named after page) 5. The display 6. View and edit selected command 7. Reference of commands
  14. 14. Development: rising action Tools needed to run tests locally – Selenium webdriver – PHP Unit – PHP Unit Selenium Exstentions• Installing Selenium Webdriver: – server-2-as-a-service-on-ubuntu/2010/09/23/• Installing PHP Unit & Extensions: – ation.html
  15. 15. Development: rising actionStart Selenium Webdriver: In a new tab, run command phpunit*: *In this example, I am using a bootstrap file. I have created a parent class that each page extends. In the parent class, I test the branding elements of each page.
  16. 16. Development: rising action Now, let‟s automate it:
  17. 17. Development: rising action Add a ruby build script:* #!/user/bin/env ruby current_dir = File.dirname(__FILE__) bootstrap_file = "MCMC.php” //if parent class build_dir = "build" Dir[File.join(current_dir), *].each do |file| puts file if file != bootstrap_file and File.file?(file) cmd = "phpunit --log-junit #{build_dir}/#{file}.selenium.xml /*--bootstrap #{bootstrap_file} #{file}*/" print cmd system(cmd) end end *No. It does not need to be ruby.
  18. 18. Development: rising action Create a git repo:* $git init newrepo *Yes. Use git.
  19. 19. Development: rising action Configure Jenkins Server: – Add xvfb There is a script in /root that has the commands to start the selenium service w/ Xvfb in a script named „‟ – Install the following plugins • analysis-core • Analysis-collector • Checkstyle • Dry • Phing • Plot • pmd
  20. 20. Development: rising actionConfigure Jenkins Job: – Specify source
  21. 21. Development: rising actionConfigure Jenkins Job: – Specify triggers:
  22. 22. Development: rising actionConfigure Jenkins Job: – Specify build command:
  23. 23. Development: rising actionSit back and admire how clever you are:
  24. 24. Development:At this point you might start thinking: Let‟s automate everything!
  25. 25. Development: falling action Continuous delivery* *image from:
  26. 26. Development: falling actionTest-driven dev: – Build tests – Then modules
  27. 27. Development: falling action User acceptance tests that leverage Drupal* abstract class DrupalTestCase extends PHPUnit_Framework_TestCase { } *
  28. 28. Development: falling action There are people working on this:
  29. 29. understanding Phpunit needs to be leveraged for DrupalDrupal culture
  30. 30. Development: the resolution Let‟s make it work. • protected function drupalCreateUser($permissions = array(access comments, access content, post comments, skip comment approval)) { • // Create a role with the given permission set. • if (!($rid = $this->drupalCreateRole($permissions))) { • return FALSE; • } • // Create a user assigned to that role. • $edit = array(); • $edit[name] = $this->randomName(); • $edit[mail] = $edit[name] .; • $edit[roles] = array($rid => $rid); • $edit[pass] = user_password(); • $edit[status] = 1; • $account = user_save(drupal_anonymous_user(), $edit); • $this->assertTrue(!empty($account->uid), t(User created with name %name and pass %pass, array(%name => $edit[name], %pass => $edit[pass])), t(User login)); • if (empty($account->uid)) { • return FALSE; • } • // Add the raw password so that we can log in as this user. • $account->pass_raw = $edit[pass]; • return $account; • }