MozMill Crowd - The birth of global automated testing

2,157 views

Published on

The MozMill crowd extension, which is currently under development by Mozilla QA, will offer an automated testing experience for people around the world.

Help us to make Firefox even better!

Published in: Technology, Business
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
2,157
On SlideShare
0
From Embeds
0
Number of Embeds
123
Actions
Shares
0
Downloads
15
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide


















  • MozMill Crowd - The birth of global automated testing

    1. 1. quality.mozilla.org qa automation MOZMILL CROWD The birth of global automated testing Anthony Hughes <ashughes@mozilla.com> Henrik Skupin <hskupin@mozilla.com>
    2. 2. MOZMILL CROWD
    3. 3. MOZMILL CROWD • What is MozMill?
    4. 4. MOZMILL CROWD • What is MozMill? • Automated test-runs
    5. 5. MOZMILL CROWD • What is MozMill? • Automated test-runs • Extended testing with MozMill
    6. 6. MOZMILL CROWD • What is MozMill? • Automated test-runs • Extended testing with MozMill • MozMill Crowd extension
    7. 7. MOZMILL CROWD • What is MozMill? • Automated test-runs • Extended testing with MozMill • MozMill Crowd extension • Demo
    8. 8. MOZMILL CROWD • What is MozMill? • Automated test-runs • Extended testing with MozMill • MozMill Crowd extension • Demo • Questions & Answers
    9. 9. WHAT IS MOZMILL • Automation • Framework & API • Reporting • IDE • Documentation • Community
    10. 10. AUTOMATED TEST-RUNS • BFT • Selection of automatable scripted manual tests from Litmus (including Smoketests and BFT) • Creation of new tests from too complex test scenarios • Breakup in restart-less and restart tests • Support for all localized builds • Executable on all platforms
    11. 11. AUTOMATED TEST-RUNS • Localization (L10n) • Multiple usage of the same access keys • Checking existing windows and dialogs for cut-off elements • Accessibility • Testsof proper XUL markup for exposing content to screen readers
    12. 12. AUTOMATED TEST-RUNS • Add-ons • Tests for add-ons provided by add-on authors • Add-ons hosted on AMO or on other servers • Breakup in restart-less and restart tests • (Software Update) • Release testing of feature and security releases • Will not be promoted in MozMill Crowd
    13. 13. EXTENDED TESTING WITH MOZMILL • In-house testing isn’t enough, we have to do more! • Outsourcing tasks to a large group of people • Increased coverage for daily test-runs • Support localization teams by executing test-runs for localized builds • Help add-on authors to get their add-ons tested • Performance tests on the testers system (planned)
    14. 14. MOZMILL CROWD EXTENSION • Tool to allow crowd sourcing of Mozmill tests • Which requirements have we set? • Support for all platforms and branches • Automatic setup of the whole MozMill environment • Execution of available test-runs with a single click • Sending of test results to a report server • Customizable for more focused testing
    15. 15. MOZMILL CROWD EXTENSION • Separate dialog with controls for test parameters • Area for immediate output of test results
    16. 16. MOZMILL CROWD EXTENSION • Preferences • Selection of the test repository • Sending reports • Security options for add-ons test-run
    17. 17. DEMO • What will be shown? • Add-on test-run for the Google Toolbar extension • BFT test-run in Firefox (fa) • Test results
    18. 18. QUESTIONS & ANSWERS Questions? We will collected ideas and proposals in the following Etherpad document: http://etherpad.mozilla.com:9000/h03KB01vcS
    19. 19. Thanks

    ×