Mozmill meets L10n

Henrik Skupin

2 2

Agenda

I.  Why another testing framework?

II.  Basics of Mozmill

III.  Mozmill for l10n testing

IV.  Information

V.  Q&A

3 3

Agenda

I.  Why another testing framework?

II.  Basics of Mozmill

III.  Mozmill for l10n testing

IV.  Information

V.  Q&A

4 4

Missing Pieces

•  Several testing frameworks available:"Mochitests, Reftests, Unit tests, …

BUT

•  Complex user-centric functional testing too difficult

•  Restart tests not possible (e.g. software update)

•  Not easily usable by contributors to test "their applications

5 5

What we focus on…

•  Automation of manual Litmus tests

•  Continuous test execution (buildbot)

•  Optimizing the release and feature testing process

•  Easy usable environment to get more daily testers

Increasing the Quality of the Application

6 6

Agenda

I.  Why another testing framework?

II.  Basics of Mozmill

III.  Mozmill for l10n testing

IV.  Information

V.  Q&A

7 7

What is Mozmill

•  Framework for automated UI testing

•  Available for applications built on the Mozilla Platform

•  Runnable as both an extension and from command line

•  Integrated Development Environment

•  Extendable by Python scripts

•  Full unit test API (JavaScript Unit test module)

8 8

Architecture

Python (Mozmill)

JsBridge

Application Process (Firefox, Thunderbird, ...) E

xten

sion

s

JsBridge Mozmill

Mozmill

IDE

Frame

9 9

Demo

•  Mozmill IDE (Inspector / Recorder)

•  Running a simple test

•  Display of the test results

•  Running existing tests via command line in a localized build

10 10

Agenda

I.  Why another testing framework?

II.  Basics of Mozmill

III.  Mozmill for l10n testing

IV.  Information

V.  Q&A

11 11

Current l10n testing status

•  Compare-locales script to check current status"(http://l10n.mozilla.org/dashboard/)

•  No checks for undefined entities (XML parsing error) which can result in a broken application

•  Localizer test-run on Litmus most commonly used for upcoming major releases

•  No automated functional testing for localized"Firefox builds on a regular basis

12 12

Goals / Ideas for l10n Mozmill Tests

13 13

Demo

•  Software Update test for a localized build

14 14

Agenda

I.  Why another testing framework?

II.  Basics of Mozmill

III.  Mozmill for l10n testing

IV.  Information

V.  Q&A

15 15

Downloads & Code

•  Mozmill Extension on AMO:"https://addons.mozilla.org/en-US/firefox/addon/9018

•  PyPI packages for Mozmill:"http://pypi.python.org/pypi/mozmill "http://pypi.python.org/pypi/jsbridge"http://pypi.python.org/pypi/mozrunner

•  Code repositories:"http://github.com/mikeal/mozmill "http://github.com/mikeal/jsbridge "http://github.com/mikeal/mozrunner

16 16

Documentation

•  Main documentation on MDC:"https://developer.mozilla.org/en/Mozmill

•  Mozmill test writing tutorial on QMO:"http://quality.mozilla.org/documents-home/code-docs/mozmill-test-creation/

•  Mozmill-Dev Google Group:"http://groups.google.com/group/mozmill-dev

17 17

Questions

Developers

Mikeal Rogers (mikeal): mikeal.rogers@gmail.com

Clint Talbert (ctalbert): ctalbert@mozilla.com

Adam Christian (admc): adam.christian@gmail.com

Test creation

Henrik Skupin (whimboo): hskupin@mozilla.com

18 18

Agenda

I.  Why another testing framework?

II.  Basics of Mozmill

III.  Mozmill for l10n testing

IV.  Information

V.  Q&A

19 19

hskupin@mozilla.com

Thank You