Mozmill meets L10n
Henrik Skupin

Agenda
I. Why another testing framework?
II. Basics of Mozmill
III. Mozmill for l10n testing
IV. Information
V. Q&A
2

Agenda
I. Why another testing framework?
II. Basics of Mozmill
III. Mozmill for l10n testing
IV. Information
V. Q&A
3

Missing Pieces
• Several testing frameworks available:"
Mochitests, Reftests, Unit tests, …
BUT
• Complex user-centric functional testing too difficult
• Restart tests not possible (e.g. software update)
• Not easily usable by contributors to test "
their applications
4

What we focus on…
• Automation of manual Litmus tests
• Continuous test execution (buildbot)
• Optimizing the release and feature testing process
• Easy usable environment to get more daily testers
Increasing the Quality of the Application
5

Agenda
I. Why another testing framework?
II. Basics of Mozmill
III. Mozmill for l10n testing
IV. Information
V. Q&A
6

What is Mozmill
• Framework for automated UI testing
• Available for applications built on the Mozilla Platform
• Runnable as both an extension and from command line
• Integrated Development Environment
• Extendable by Python scripts
• Full unit test API (JavaScript Unit test module)
7

Architecture
Application Process (Firefox, Thunderbird, ...)
Extensions
JsBridge
Mozmill
IDE
JsBridge
Frame
Python (Mozmill)
Mozmill
8

Demo
• Mozmill IDE (Inspector / Recorder)
• Running a simple test
• Display of the test results
• Running existing tests via command line in a localized
build
9

Agenda
I. Why another testing framework?
II. Basics of Mozmill
III. Mozmill for l10n testing
IV. Information
V. Q&A
10

Current l10n testing status
• Compare-locales script to check current status"
(http://l10n.mozilla.org/dashboard/)
• No checks for undefined entities (XML parsing error)
which can result in a broken application
• Localizer test-run on Litmus most commonly used for
upcoming major releases
• No automated functional testing for localized"
Firefox builds on a regular basis
11

Goals / Ideas for l10n Mozmill Tests
12

Demo
• Software Update test for a localized build
13

Agenda
I. Why another testing framework?
II. Basics of Mozmill
III. Mozmill for l10n testing
IV. Information
V. Q&A
14

Downloads & Code
• Mozmill Extension on AMO:"
https://addons.mozilla.org/en-US/firefox/addon/9018
• PyPI packages for Mozmill:"
http://pypi.python.org/pypi/mozmill"
http://pypi.python.org/pypi/jsbridge"
http://pypi.python.org/pypi/mozrunner
• Code repositories:"
http://github.com/mikeal/mozmill"
http://github.com/mikeal/jsbridge"
http://github.com/mikeal/mozrunner
15

Documentation
• Main documentation on MDC:"
https://developer.mozilla.org/en/Mozmill
• Mozmill test writing tutorial on QMO:"
http://quality.mozilla.org/documents-home/code-docs/mozmill-test-
creation/
• Mozmill-Dev Google Group:"
http://groups.google.com/group/mozmill-dev
16

Questions
Developers
Mikeal Rogers (mikeal): mikeal.rogers@gmail.com
Clint Talbert (ctalbert): ctalbert@mozilla.com
Adam Christian (admc): adam.christian@gmail.com
Test creation
Henrik Skupin (whimboo): hskupin@mozilla.com
17

Agenda
I. Why another testing framework?
II. Basics of Mozmill
III. Mozmill for l10n testing
IV. Information
V. Q&A
18

Thank You
hskupin@mozilla.com
19