Testing Mozilla Web Properties     Stephen Donner 6/24/2009
Meet the Team <ul><li>Stephen Donner -  [email_address] </li></ul><ul><li>Krupa Raj -  [email_address] </li></ul><ul><li>R...
Technologies we test <ul><ul><li>AJAX </li></ul></ul><ul><ul><li>Drupal </li></ul></ul><ul><ul><ul><li>Spread Firefox </li...
Tools We Use <ul><ul><li>Firebug </li></ul></ul><ul><ul><li>Web Developer toolbar </li></ul></ul><ul><ul><li>Live HTTP Hea...
Gotchas <ul><ul><li>Staging server vs. production </li></ul></ul><ul><ul><ul><li>Different environments </li></ul></ul></u...
Gotchas, part 2 <ul><ul><li>Partner integration </li></ul></ul><ul><ul><ul><li>GetSatisfaction </li></ul></ul></ul><ul><ul...
Pain Points <ul><ul><li>Tight schedules </li></ul></ul><ul><ul><ul><li>Quarterly goals from other parts of the org </li></...
Automated vs. Manual Testing <ul><ul><li>Balance need to rapidly execute/ship vs. long-term stability </li></ul></ul><ul><...
Grades / Levels of Testing <ul><ul><li>Acceptance check  </li></ul></ul><ul><ul><li>Full Functionality Test </li></ul></ul...
What we use Selenium for <ul><ul><li>Verify page titles </li></ul></ul><ul><ul><li>Verify content pieces (text, links, ima...
Example of manual testing <ul><li>Mozilla Service Week (http://mozillaservice.org) </li></ul>
Selenium demo <ul><ul><li>AMO Basic Functionality Test </li></ul></ul><ul><ul><li>AMO Search </li></ul></ul>
How can you help? <ul><ul><li>Vet content </li></ul></ul><ul><ul><li>Test browser compatibility </li></ul></ul><ul><ul><li...
Resources <ul><ul><li>Public mailing list:  [email_address] </li></ul></ul><ul><ul><li>Homepage:  https://wiki.mozilla.org...
Questions?  Comments?  Suggestions? <ul><li>  </li></ul>
Thanks for your interest!  
Upcoming SlideShare
Loading in …5
×

Testing Mozilla Web Properties

1,392 views

Published on

Testing Mozilla web properties - Wednesday June 24, 2009 at 6:30 PM

Published in: Technology, News & Politics
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,392
On SlideShare
0
From Embeds
0
Number of Embeds
17
Actions
Shares
0
Downloads
17
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Testing Mozilla Web Properties

  1. 1. Testing Mozilla Web Properties     Stephen Donner 6/24/2009
  2. 2. Meet the Team <ul><li>Stephen Donner - [email_address] </li></ul><ul><li>Krupa Raj - [email_address] </li></ul><ul><li>Raymond Etornam Agbeame - [email_address] </li></ul>
  3. 3. Technologies we test <ul><ul><li>AJAX </li></ul></ul><ul><ul><li>Drupal </li></ul></ul><ul><ul><ul><li>Spread Firefox </li></ul></ul></ul><ul><ul><ul><li>QMO </li></ul></ul></ul><ul><ul><li>Apache </li></ul></ul><ul><ul><ul><li>.htaccess - bug 478952 </li></ul></ul></ul><ul><ul><li>Open-source search engines </li></ul></ul><ul><ul><ul><li>Sphinx (SUMO) </li></ul></ul></ul><ul><ul><li>TikiWiki (SUMO is its biggest consumer) </li></ul></ul><ul><ul><li>Media types </li></ul></ul><ul><ul><ul><li>Ogg </li></ul></ul></ul><ul><ul><ul><li>Flash </li></ul></ul></ul><ul><ul><ul><ul><li>.swf vs. .flv </li></ul></ul></ul></ul>
  4. 4. Tools We Use <ul><ul><li>Firebug </li></ul></ul><ul><ul><li>Web Developer toolbar </li></ul></ul><ul><ul><li>Live HTTP Headers </li></ul></ul><ul><ul><li>SQL Injection </li></ul></ul><ul><ul><li>Selenium </li></ul></ul><ul><ul><ul><li>IDE </li></ul></ul></ul><ul><ul><ul><li>RC </li></ul></ul></ul><ul><ul><li>VMWare Fusion </li></ul></ul><ul><ul><li>Acunetix </li></ul></ul><ul><ul><li>W3C </li></ul></ul>
  5. 5. Gotchas <ul><ul><li>Staging server vs. production </li></ul></ul><ul><ul><ul><li>Different environments </li></ul></ul></ul><ul><ul><ul><ul><li>Configs (permissions, etc.) </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Application versions </li></ul></ul></ul></ul><ul><ul><ul><li>Caching </li></ul></ul></ul><ul><ul><ul><ul><li>Memcache </li></ul></ul></ul></ul><ul><ul><ul><ul><li>NetScaler / Zeus </li></ul></ul></ul></ul><ul><ul><ul><li>DB setups </li></ul></ul></ul><ul><ul><ul><ul><li>Slave vs. master </li></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>Replication lag </li></ul></ul></ul></ul></ul><ul><ul><ul><li>Legacy browsers / non-standard configs </li></ul></ul></ul><ul><ul><ul><ul><li>IE 6, anyone? </li></ul></ul></ul></ul><ul><ul><ul><ul><li>JavaScript disabled </li></ul></ul></ul></ul>
  6. 6. Gotchas, part 2 <ul><ul><li>Partner integration </li></ul></ul><ul><ul><ul><li>GetSatisfaction </li></ul></ul></ul><ul><ul><ul><li>reCaptcha </li></ul></ul></ul><ul><ul><ul><li>Mozilla Service Week </li></ul></ul></ul><ul><ul><li>Add-on promotions </li></ul></ul><ul><ul><ul><li>Fashion Your Firefox </li></ul></ul></ul>
  7. 7. Pain Points <ul><ul><li>Tight schedules </li></ul></ul><ul><ul><ul><li>Quarterly goals from other parts of the org </li></ul></ul></ul><ul><ul><li>Lack of clear specs </li></ul></ul><ul><ul><ul><li>Wireframes vs. mockups </li></ul></ul></ul><ul><ul><ul><ul><li>(vs. full user-interaction testing) </li></ul></ul></ul></ul><ul><ul><li>Project direction / ownership </li></ul></ul><ul><ul><li>Out-of-band testing requests </li></ul></ul><ul><ul><ul><li>Ops/IT - hardware failure, new-technology evals, regression-testing of new hardware </li></ul></ul></ul>
  8. 8. Automated vs. Manual Testing <ul><ul><li>Balance need to rapidly execute/ship vs. long-term stability </li></ul></ul><ul><ul><li>Ramp-up cost </li></ul></ul><ul><ul><li>Can't automate everything </li></ul></ul><ul><ul><li>  Quite a few projects are one-off (time investment) </li></ul></ul><ul><ul><ul><li>Impact Mozilla </li></ul></ul></ul><ul><ul><ul><li>Fashion Your Firefox </li></ul></ul></ul><ul><ul><ul><li>Operation Firefox </li></ul></ul></ul><ul><ul><li>Good automation candidates </li></ul></ul><ul><ul><ul><li>Search </li></ul></ul></ul><ul><ul><ul><li>APIs (services.addons.mozilla.org) </li></ul></ul></ul><ul><ul><ul><li>Static content </li></ul></ul></ul><ul><ul><ul><ul><li>Headers/footers/legal/privacy policies/EULAs </li></ul></ul></ul></ul><ul><ul><ul><ul><li>Login / logout / registration/ forgotten password </li></ul></ul></ul></ul><ul><ul><ul><ul><ul><li>Exception of Captcha systems </li></ul></ul></ul></ul></ul>
  9. 9. Grades / Levels of Testing <ul><ul><li>Acceptance check </li></ul></ul><ul><ul><li>Full Functionality Test </li></ul></ul><ul><ul><li>Regression testing </li></ul></ul><ul><ul><li>Basic Functionality Test </li></ul></ul><ul><li>  </li></ul><ul><li>(Exhaustive list: http://www.softwaretestinghelp.com/types-of-software-testing/ ) </li></ul><ul><li>  </li></ul>
  10. 10. What we use Selenium for <ul><ul><li>Verify page titles </li></ul></ul><ul><ul><li>Verify content pieces (text, links, images) </li></ul></ul><ul><ul><li>Pagination </li></ul></ul><ul><ul><li>Search terms persist in textfields </li></ul></ul><ul><ul><li>~ 15 commands </li></ul></ul>
  11. 11. Example of manual testing <ul><li>Mozilla Service Week (http://mozillaservice.org) </li></ul>
  12. 12. Selenium demo <ul><ul><li>AMO Basic Functionality Test </li></ul></ul><ul><ul><li>AMO Search </li></ul></ul>
  13. 13. How can you help? <ul><ul><li>Vet content </li></ul></ul><ul><ul><li>Test browser compatibility </li></ul></ul><ul><ul><li>Sanity check our testing </li></ul></ul><ul><ul><li>Write unit tests </li></ul></ul>
  14. 14. Resources <ul><ul><li>Public mailing list: [email_address] </li></ul></ul><ul><ul><li>Homepage: https://wiki.mozilla.org/QA/Execution/Web_Testing </li></ul></ul><ul><ul><li>IRC channel: irc.mozilla.org/webqa </li></ul></ul>
  15. 15. Questions?  Comments?  Suggestions? <ul><li>  </li></ul>
  16. 16. Thanks for your interest!  

×