Basics of Mozmill and how this functional testing tool can help us to improve the quality of localized Firefox builds.

1. Mozmill meets L10n
Henrik Skupin

2. Agenda
I. Why another testing framework?
II. Basics of Mozmill
III. Mozmill for l10n testing
IV. Information
V. Q&A
2

3. Agenda
I. Why another testing framework?
II. Basics of Mozmill
III. Mozmill for l10n testing
IV. Information
V. Q&A
3

4. Missing Pieces
• Several testing frameworks available:"
Mochitests, Reftests, Unit tests, …
BUT
• Complex user-centric functional testing too difficult
• Restart tests not possible (e.g. software update)
• Not easily usable by contributors to test "
their applications
4

5. What we focus on…
• Automation of manual Litmus tests
• Continuous test execution (buildbot)
• Optimizing the release and feature testing process
• Easy usable environment to get more daily testers
Increasing the Quality of the Application
5

6. Agenda
I. Why another testing framework?
II. Basics of Mozmill
III. Mozmill for l10n testing
IV. Information
V. Q&A
6

7. What is Mozmill
• Framework for automated UI testing
• Available for applications built on the Mozilla Platform
• Runnable as both an extension and from command line
• Integrated Development Environment
• Extendable by Python scripts
• Full unit test API (JavaScript Unit test module)
7

8. Architecture
Application Process (Firefox, Thunderbird, ...)
Extensions
JsBridge
Mozmill
IDE
JsBridge
Frame
Python (Mozmill)
Mozmill
8

9. Demo
• Mozmill IDE (Inspector / Recorder)
• Running a simple test
• Display of the test results
• Running existing tests via command line in a localized
build
9

10. Agenda
I. Why another testing framework?
II. Basics of Mozmill
III. Mozmill for l10n testing
IV. Information
V. Q&A
10

11. Current l10n testing status
• Compare-locales script to check current status"
(http://l10n.mozilla.org/dashboard/)
• No checks for undefined entities (XML parsing error)
which can result in a broken application
• Localizer test-run on Litmus most commonly used for
upcoming major releases
• No automated functional testing for localized"
Firefox builds on a regular basis
11

12. Goals / Ideas for l10n Mozmill Tests
12

13. Demo
• Software Update test for a localized build
13

14. Agenda
I. Why another testing framework?
II. Basics of Mozmill
III. Mozmill for l10n testing
IV. Information
V. Q&A
14

15. Downloads & Code
• Mozmill Extension on AMO:"
https://addons.mozilla.org/en-US/firefox/addon/9018
• PyPI packages for Mozmill:"
http://pypi.python.org/pypi/mozmill"
http://pypi.python.org/pypi/jsbridge"
http://pypi.python.org/pypi/mozrunner
• Code repositories:"
http://github.com/mikeal/mozmill"
http://github.com/mikeal/jsbridge"
http://github.com/mikeal/mozrunner
15

16. Documentation
• Main documentation on MDC:"
https://developer.mozilla.org/en/Mozmill
• Mozmill test writing tutorial on QMO:"
http://quality.mozilla.org/documents-home/code-docs/mozmill-test-
creation/
• Mozmill-Dev Google Group:"
http://groups.google.com/group/mozmill-dev
16

17. Questions
Developers
Mikeal Rogers (mikeal): mikeal.rogers@gmail.com
Clint Talbert (ctalbert): ctalbert@mozilla.com
Adam Christian (admc): adam.christian@gmail.com
Test creation
Henrik Skupin (whimboo): hskupin@mozilla.com
17

18. Agenda
I. Why another testing framework?
II. Basics of Mozmill
III. Mozmill for l10n testing
IV. Information
V. Q&A
18

19. Thank You
hskupin@mozilla.com
19